LeaderRebalancerTest.AddTserver: /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:454: Failure
Failed
Bad status: Timed out: Client connection negotiation failed: client connection to 127.4.155.194:38517: received 0 of 4 requested bytes
I20260620 13:57:59.889333 11094 raft_consensus.cc:3055] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:59.889532 11154 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:59.889271 11295 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:59.889873 11094 raft_consensus.cc:740] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:59.890690 11295 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.890941 11094 consensus_queue.cc:260] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.891791 11295 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:57:59.892118 11094 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:59.892247 11001 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.877983  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:59.839386 10918 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:59.878199  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:59.894450  6024 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:59.879952  5883 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:59.880379  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:59.886370  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:59.880864 11254 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:59.888125 11287 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.894940  6029 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:59.889755  4719 tablet_server.cc:179] TabletServer@127.4.155.193:0 shutting down...
I20260620 13:57:59.909338  6586 raft_consensus.cc:1217] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-8.8]   Dedup: 6.7->[8.8-8.8]
I20260620 13:57:59.910200  6586 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260620 13:57:59.911922  6027 raft_consensus.cc:2393] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:59.912122  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:59.921100  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 180836us
I20260620 13:57:59.922676  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:59.926781  5883 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260620 13:57:59.928519  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:59.931830 11189 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:59.833766  5954 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260620 13:57:59.932371 11189 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:59.932857 11189 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:59.933053  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2561) took 1118 ms. Trace:
I20260620 13:57:59.918643 11254 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.890691 11164 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:59.913997 11210 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 12. Current term is 13.
I20260620 13:57:59.942305 10831 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:59.942972 10831 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.944088  6031 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:59.913856 10918 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:59.881330 11273 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:59.953294  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2349) took 2202 ms. Trace:
I20260620 13:57:59.954496 11293 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:59.953790 11273 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.956087 11332 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:59.889202 11338 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.933583  5954 rpcz_store.cc:276] 0620 13:57:58.814350 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.757983 (+943633us) service_pool.cc:224] Handling call
0620 13:57:59.758388 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.932690 (+174302us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.932980 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:59.970083  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:59.937249  5952 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260620 13:57:59.938531 11001 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:59.940878 11356 negotiation.cc:336] Failed RPC negotiation. Trace:
0620 13:57:58.889679 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:39830 (local address 127.4.155.194:38517)
0620 13:57:59.680747 (+791068us) server_negotiation.cc:207] Beginning negotiation
0620 13:57:59.680794 (+    47us) server_negotiation.cc:400] Waiting for connection header
0620 13:57:59.680883 (+    89us) server_negotiation.cc:408] Connection header received
0620 13:57:59.681099 (+   216us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0620 13:57:59.681141 (+    42us) server_negotiation.cc:462] Received NEGOTIATE request from client
0620 13:57:59.734929 (+ 53788us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0620 13:57:59.824301 (+ 89372us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39830: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":756292,"thread_start_us":282208,"threads_started":1}
I20260620 13:57:59.926520 11313 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:59.971719  5952 pending_rounds.cc:85] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 12
I20260620 13:57:59.989048  5952 pending_rounds.cc:107] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260620 13:57:59.989502  5952 raft_consensus.cc:2889] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:59.975876  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1230) took 1069 ms. Trace:
I20260620 13:57:59.890940 11183 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.990156  5954 rpcz_store.cc:276] 0620 13:57:58.899724 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.967048 (+1067324us) service_pool.cc:224] Handling call
0620 13:57:59.967570 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.967821 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.967861 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:59.967929 (+    68us) raft_consensus.cc:1645] Marking committed up to 11
0620 13:57:59.967975 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.968055 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:59.968227 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:59.927198  5955 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260620 13:57:59.953752  5951 rpcz_store.cc:276] 0620 13:57:57.750692 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.750823 (+   131us) service_pool.cc:224] Handling call
0620 13:57:57.751196 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:57.899334 (+148138us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:57:59.203899 (+1304565us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b180044f380. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdf3a385c 00007f0fdc6edc8b 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc707c55 00007f0fe31f6247 00007f0fdf806d87 00007f0fdf81649f
0620 13:57:59.385179 (+181280us) log.cc:844] Serialized 14 byte log entry
0620 13:57:59.835412 (+450233us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:59.835878 (+   466us) log.cc:844] Serialized 26 byte log entry
0620 13:57:59.836015 (+   137us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:59.836045 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.836113 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:59.952761 (+116648us) raft_consensus.cc:1685] finished
0620 13:57:59.952908 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:59.953106 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1915,"prepare.queue_time_us":334427,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":217254,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":16157,"spinlock_wait_cycles":4234624,"thread_start_us":582500,"threads_started":3,"wal-append.queue_time_us":493876}
I20260620 13:57:59.995959  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2550) took 1193 ms. Trace:
I20260620 13:57:59.996616  5955 rpcz_store.cc:276] 0620 13:57:58.802241 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.737464 (+935223us) service_pool.cc:224] Handling call
0620 13:57:59.786828 (+ 49364us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.995672 (+208844us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.995905 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:59.998298  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2350) took 2247 ms. Trace:
I20260620 13:57:59.968344 11338 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:00.086617  6551 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:00.089128  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.090852  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:00.092973  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.098620  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.106099  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.106995  6580 raft_consensus.cc:2393] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:58:00.068504 10831 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:00.100724 11293 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:58:00.108585 11288 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:00.109218 11254 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:00.112717 11287 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:00.278609  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:00.283679  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:00.284606  6585 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:00.296140  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.300339  6585 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:58:00.138857 11293 raft_consensus.cc:697] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:58:00.219094 11328 consensus_meta.cc:287] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.711s	user 0.015s	sys 0.000s
W20260620 13:58:00.322026 11368 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260620 13:58:00.323426 11366 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260620 13:58:00.327373 11293 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:00.338812  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.343495  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.343572  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.345888  6585 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:00.348728  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 1226) took 1449 ms. Trace:
I20260620 13:58:00.349781 11189 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:00.349261  5950 rpcz_store.cc:276] 0620 13:57:58.898336 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.919241 (+ 20905us) service_pool.cc:224] Handling call
0620 13:58:00.347799 (+1428558us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54002620d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:00.347923 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":869453184}
W20260620 13:58:00.345292 11330 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 1.893s	user 0.016s	sys 0.018s
I20260620 13:58:00.367632  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.337370 11273 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:00.379701  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.381352  6582 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260620 13:58:00.386505 11189 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:00.392843  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:00.429489  6582 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260620 13:58:00.429605  5877 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.003s	sys 0.007s
W20260620 13:58:00.431906  5877 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.004s	sys 0.008s
W20260620 13:58:00.422741  5959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.004s	sys 0.006s
I20260620 13:58:00.438512  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1228) took 1539 ms. Trace:
I20260620 13:58:00.439673  5877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 2018) took 3012 ms. Trace:
I20260620 13:58:00.440132  5877 rpcz_store.cc:276] 0620 13:57:57.431450 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.431708 (+   258us) service_pool.cc:224] Handling call
0620 13:57:57.432507 (+   799us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:57.452997 (+ 20490us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:57.453029 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:59.496708 (+2043679us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b2c00103cc8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fde0f5c71 00007f0fde1055d2 00007f0fdf837de1 00007f0fdf7fc81a 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22
0620 13:57:59.505541 (+  8833us) log.cc:844] Serialized 52 byte log entry
0620 13:57:59.873543 (+368002us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:58:00.432196 (+558653us) log.cc:844] Serialized 14 byte log entry
0620 13:58:00.432432 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:00.432495 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:00.432523 (+    28us) raft_consensus.cc:1685] finished
0620 13:58:00.439473 (+  6950us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:00.439618 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":238261,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":10287,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":23632,"spinlock_wait_cycles":16783232,"thread_start_us":878640,"threads_started":2,"wal-append.queue_time_us":563669}
I20260620 13:58:00.439002  5959 rpcz_store.cc:276] 0620 13:57:58.898718 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.873910 (+975192us) service_pool.cc:224] Handling call
0620 13:57:59.874317 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:59.874736 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.874778 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:59.875335 (+   557us) log.cc:844] Serialized 26 byte log entry
0620 13:58:00.437201 (+561866us) raft_consensus.cc:1645] Marking committed up to 11
0620 13:58:00.437238 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:00.437307 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:00.438131 (+   824us) raft_consensus.cc:1685] finished
0620 13:58:00.438152 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:00.438460 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":15334,"thread_start_us":516615,"threads_started":1,"wal-append.queue_time_us":398575}
I20260620 13:58:00.601351 11293 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:00.715529 11380 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:00.716084 11293 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:00.716244 11380 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:00.719858 11332 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:00.720487 11332 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:00.720882 10778 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:00.721612 10778 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:00.724112 10778 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:00.870673  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:00.743777 11332 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:01.111819  6025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.000s	sys 0.008s
W20260620 13:58:01.112556  6025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.000s	sys 0.008s
W20260620 13:58:01.215255  6551 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.000s	sys 0.008s
W20260620 13:58:01.215142  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 124988us
W20260620 13:58:01.226631  6551 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.001s	sys 0.009s
W20260620 13:58:01.227383  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 790185us
W20260620 13:58:01.228540  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.062129 11380 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:01.292044  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.241233 11293 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:01.308487 10918 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:01.322235  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2652) took 1439 ms. Trace:
I20260620 13:58:01.322804  6025 rpcz_store.cc:276] 0620 13:57:59.882704 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:00.425862 (+543158us) service_pool.cc:224] Handling call
0620 13:58:00.426307 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:00.426600 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 8
0620 13:58:00.426960 (+   360us) log.cc:844] Serialized 14 byte log entry
0620 13:58:01.321861 (+894901us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:01.321921 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:58:01.321974 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.322046 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.322170 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1715,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":207000,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":883713,"threads_started":2,"wal-append.queue_time_us":867374}
W20260620 13:58:01.468413  5876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.623s	user 0.007s	sys 0.023s
W20260620 13:58:01.469038  5876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.624s	user 0.007s	sys 0.023s
I20260620 13:58:01.475328  5875 raft_consensus.cc:1217] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Deduplicated request from leader. Original: 13.7->[14.8-14.8]   Dedup: 14.8->[]
I20260620 13:58:01.476383  5875 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260620 13:58:01.478940  5875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2899) took 2476 ms. Trace:
I20260620 13:58:01.479387  5875 rpcz_store.cc:276] 0620 13:57:59.002542 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.857104 (+854562us) service_pool.cc:224] Handling call
0620 13:57:59.857590 (+   486us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:01.476805 (+1619215us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.478616 (+  1811us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400001c54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:01.478863 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3720112896}
W20260620 13:58:01.482086  5958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.703s	user 0.023s	sys 0.031s
W20260620 13:58:01.482604  5958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.704s	user 0.023s	sys 0.031s
I20260620 13:58:01.483319  5876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 2025) took 2575 ms. Trace:
I20260620 13:58:01.483319  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2359) took 2585 ms. Trace:
I20260620 13:58:01.484138  5958 rpcz_store.cc:276] 0620 13:57:58.897588 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.777739 (+880151us) service_pool.cc:224] Handling call
0620 13:57:59.778066 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:59.778399 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.778425 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:59.778841 (+   416us) log.cc:844] Serialized 26 byte log entry
0620 13:58:01.482956 (+1704115us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:58:01.482994 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.483063 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:01.483122 (+    59us) raft_consensus.cc:1685] finished
0620 13:58:01.483135 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.483261 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6774,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":8002,"thread_start_us":1703816,"threads_started":1,"wal-append.queue_time_us":533009,"wal-append.run_cpu_time_us":1525,"wal-append.run_wall_time_us":1013902}
I20260620 13:58:01.485859  5876 rpcz_store.cc:276] 0620 13:57:58.907921 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.758406 (+850485us) service_pool.cc:224] Handling call
0620 13:57:59.800709 (+ 42303us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:59.801170 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.801211 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:59.813446 (+ 12235us) log.cc:844] Serialized 52 byte log entry
0620 13:58:01.469483 (+1656037us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:58:01.470475 (+   992us) log.cc:844] Serialized 14 byte log entry
0620 13:58:01.482997 (+ 12522us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.483063 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:01.483122 (+    59us) raft_consensus.cc:1685] finished
0620 13:58:01.483134 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.483261 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1104,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":108,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4274,"thread_start_us":1636975,"threads_started":3,"wal-append.queue_time_us":513290,"wal-append.run_cpu_time_us":2250,"wal-append.run_wall_time_us":1022107}
I20260620 13:58:01.498160  6583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 1214) took 3357 ms. Trace:
I20260620 13:58:01.498677  6583 rpcz_store.cc:276] 0620 13:57:58.140965 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.188214 (+ 47249us) service_pool.cc:224] Handling call
0620 13:57:58.188922 (+   708us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:58.321849 (+132927us) raft_consensus.cc:1534] Early marking committed up to index 9
0620 13:57:58.337210 (+ 15361us) log.cc:844] Serialized 14 byte log entry
0620 13:57:58.714198 (+376988us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:58.714259 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:58.714307 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.497823 (+2783516us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54003b74d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:01.497884 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.498059 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":191394,"prepare.queue_time_us":31125,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":22136,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":200060,"spinlock_wait_cycles":304983808,"thread_start_us":360117,"threads_started":1,"wal-append.queue_time_us":514612,"wal-append.run_cpu_time_us":14675,"wal-append.run_wall_time_us":1589811}
W20260620 13:58:01.510147  5924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.585s	user 0.015s	sys 0.027s
W20260620 13:58:01.511974  5924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.586s	user 0.016s	sys 0.028s
W20260620 13:58:01.512321  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 1.58688e+06us
I20260620 13:58:01.514329  5924 leader_election.cc:400] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 15.
I20260620 13:58:01.514612  5924 leader_election.cc:403] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260620 13:58:01.521062  5848 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.875s	user 0.021s	sys 0.019s
W20260620 13:58:01.522840  5848 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.876s	user 0.022s	sys 0.020s
W20260620 13:58:01.523342  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 1.87772e+06us
W20260620 13:58:01.523861  5848 connection.cc:256] RPC call timeout handler was delayed by -1.9555046130000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
W20260620 13:58:01.524514  5848 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.897s (SENT)
W20260620 13:58:01.525710  5848 leader_election.cc:336] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.982s (SENT)
I20260620 13:58:01.526286  5848 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:01.536572 11307 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:01.539177  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.540310 10977 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:01.545102 11405 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 15.
I20260620 13:58:01.546550  5880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2887) took 2705 ms. Trace:
I20260620 13:58:01.547394  5880 rpcz_store.cc:276] 0620 13:57:58.841224 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.841349 (+   125us) service_pool.cc:224] Handling call
0620 13:57:58.869261 (+ 27912us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.152930 (+283669us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.546270 (+2393340us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b540030f2d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:01.546482 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251506048}
I20260620 13:58:01.548053 11405 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:58:01.548779  5848 connection.cc:256] RPC call timeout handler was delayed by -1.7978626889999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260620 13:58:01.550393  5848 connection.cc:256] RPC call timeout handler was delayed by -1.3684010959999569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260620 13:58:01.550804  5848 connection.cc:256] RPC call timeout handler was delayed by -1.309412769000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
W20260620 13:58:01.551189  5848 connection.cc:256] RPC call timeout handler was delayed by -1.2680127689999381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
W20260620 13:58:01.551527  5848 connection.cc:256] RPC call timeout handler was delayed by -1.183930417000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26320000000000005s for a response
W20260620 13:58:01.551971  5848 connection.cc:256] RPC call timeout handler was delayed by -1.1066364119999434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.336s for a response
W20260620 13:58:01.552345  5848 connection.cc:256] RPC call timeout handler was delayed by -1.0765454109999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
I20260620 13:58:01.553798 10977 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260620 13:58:01.556362  6024 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.609s	user 0.016s	sys 0.030s
W20260620 13:58:01.558000  6024 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.610s	user 0.017s	sys 0.030s
I20260620 13:58:01.562737 11405 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.564680  5848 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:01.570361  5848 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:01.566864 11405 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:01.572418 11405 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:01.573523 11405 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.572754 10977 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:01.577105 11405 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:01.579195 11405 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:01.580245 11405 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:01.583653  5924 connection.cc:256] RPC call timeout handler was delayed by -1.3224151470000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260620 13:58:01.584120  5924 connection.cc:256] RPC call timeout handler was delayed by -1.3224151470000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260620 13:58:01.584648  5924 connection.cc:256] RPC call timeout handler was delayed by -1.1505151469999646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260620 13:58:01.585011  5924 connection.cc:256] RPC call timeout handler was delayed by -1.1505151469999646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260620 13:58:01.585366  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0425151470000174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260620 13:58:01.585690  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0425151470000174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260620 13:58:01.586061  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0254151469999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260620 13:58:01.585777  5848 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:01.586476  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0254151469999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260620 13:58:01.586966  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0146151469999722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260620 13:58:01.587333  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0146151469999722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
I20260620 13:58:01.587718  5848 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:01.589565  6024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2650) took 1710 ms. Trace:
I20260620 13:58:01.589934  6024 rpcz_store.cc:276] 0620 13:57:59.879296 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.926097 (+ 46801us) service_pool.cc:224] Handling call
0620 13:57:59.939351 (+ 13254us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.939598 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 10
0620 13:58:01.558409 (+1618811us) log.cc:844] Serialized 14 byte log entry
0620 13:58:01.589223 (+ 30814us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:01.589281 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:58:01.589323 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.589395 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.589507 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":416694,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":113,"thread_start_us":1640962,"threads_started":2}
I20260620 13:58:01.583767 11406 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:01.592381 11405 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:01.593600  5924 leader_election.cc:400] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:58:01.593930  5924 leader_election.cc:403] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:58:01.594933 11405 consensus_queue.cc:1059] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:01.595763 11405 consensus_queue.cc:1243] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer b0ce39342d8c4a64904b30b98de02b9f log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260620 13:58:01.596724 11405 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:58:01.598415 11405 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:01.600147 11406 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.602511 11406 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:01.588943 10977 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:01.603084 11406 raft_consensus.cc:3055] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:58:01.615326 11406 raft_consensus.cc:740] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:01.616999 11406 consensus_queue.cc:260] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.608047 10977 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:58:01.618371  5953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2552) took 2806 ms (client timeout 1647 ms). Trace:
I20260620 13:58:01.618472 10977 consensus_queue.cc:1059] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260620 13:58:01.612807  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:01.619822  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.620568 11397 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:01.621105 11397 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.623471 11397 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:01.624198  5997 connection.cc:256] RPC call timeout handler was delayed by -2.1791553169999816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
W20260620 13:58:01.625720  5879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.850s	user 0.015s	sys 0.032s
W20260620 13:58:01.626209  5879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.850s	user 0.017s	sys 0.033s
I20260620 13:58:01.624670 11397 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:01.626737 11397 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.626921  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 2026) took 2718 ms. Trace:
I20260620 13:58:01.628050  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:01.628909  6583 raft_consensus.cc:2393] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 14: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:01.627959  5879 rpcz_store.cc:276] 0620 13:57:58.908093 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.774221 (+866128us) service_pool.cc:224] Handling call
0620 13:57:59.774548 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:59.774938 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.774959 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:59.775438 (+   479us) log.cc:844] Serialized 26 byte log entry
0620 13:58:01.626580 (+1851142us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:58:01.626621 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.626685 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:01.626724 (+    39us) raft_consensus.cc:1685] finished
0620 13:58:01.626736 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.626868 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2320,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":82,"thread_start_us":1850771,"threads_started":1,"wal-append.queue_time_us":323881,"wal-append.run_cpu_time_us":1744,"wal-append.run_wall_time_us":1094267}
I20260620 13:58:01.630651  6026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1176) took 4075 ms. Trace:
I20260620 13:58:01.631062  6026 rpcz_store.cc:276] 0620 13:57:57.554889 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.561066 (+  6177us) service_pool.cc:224] Handling call
0620 13:57:57.561399 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:57.729470 (+168071us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:57.729501 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:57.729937 (+   436us) log.cc:844] Serialized 26 byte log entry
0620 13:57:57.937150 (+207213us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:57.937202 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.870236 (+1933034us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:58:01.630141 (+1759905us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54001e50d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:01.630335 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:01.630399 (+    64us) raft_consensus.cc:1685] finished
0620 13:58:01.630412 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.630565 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35738,"raft.queue_time_us":110971,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":35861,"spinlock_wait_cycles":405333248,"thread_start_us":105264,"threads_started":1,"wal-append.queue_time_us":167315,"wal-append.run_cpu_time_us":11477,"wal-append.run_wall_time_us":2906997}
W20260620 13:58:01.632717  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:01.633113  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.633952  6030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2891) took 2814 ms. Trace:
I20260620 13:58:01.634415  6030 rpcz_store.cc:276] 0620 13:57:58.819531 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.819665 (+   134us) service_pool.cc:224] Handling call
0620 13:57:58.819997 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.152753 (+332756us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.633704 (+2480951us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54000b72d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:01.633897 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757531520}
I20260620 13:58:01.638741 11221 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:01.618882  5953 rpcz_store.cc:269] 0620 13:57:58.811810 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.869168 (+ 57358us) service_pool.cc:224] Handling call
0620 13:58:01.618072 (+2748904us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54002512d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:01.618279 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609133440}
I20260620 13:58:01.635370 11107 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:01.640869 11406 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:01.641249 11107 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260620 13:58:01.648231  5884 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.717s	user 0.015s	sys 0.005s
W20260620 13:58:01.648774  5884 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.718s	user 0.015s	sys 0.005s
I20260620 13:58:01.649372 11404 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:01.649562  5884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 2035) took 2562 ms. Trace:
I20260620 13:58:01.649915  5884 rpcz_store.cc:276] 0620 13:57:59.086902 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.868891 (+781989us) service_pool.cc:224] Handling call
0620 13:57:59.900796 (+ 31905us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:59.930030 (+ 29234us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.930075 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:59.930694 (+   619us) log.cc:844] Serialized 26 byte log entry
0620 13:58:01.649160 (+1718466us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:58:01.649202 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.649281 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:01.649319 (+    38us) raft_consensus.cc:1685] finished
0620 13:58:01.649331 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.649507 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28679,"raft.queue_time_us":34055,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":1718011,"threads_started":1,"wal-append.queue_time_us":434215,"wal-append.run_cpu_time_us":2349,"wal-append.run_wall_time_us":1031877}
W20260620 13:58:01.652748  5849 connection.cc:256] RPC call timeout handler was delayed by -1.3380730920000588s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
I20260620 13:58:01.653200 11408 raft_consensus.cc:3055] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:58:01.653620 11408 raft_consensus.cc:740] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:58:01.653208  5849 connection.cc:256] RPC call timeout handler was delayed by -1.2885730919999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260620 13:58:01.660228  5849 connection.cc:256] RPC call timeout handler was delayed by -1.2885730919999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260620 13:58:01.660874  5849 connection.cc:256] RPC call timeout handler was delayed by -1.0941730920000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
I20260620 13:58:01.660521 11408 consensus_queue.cc:260] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:01.661242  5849 connection.cc:256] RPC call timeout handler was delayed by -1.0698730919999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
W20260620 13:58:01.665766  6031 consensus_meta.cc:287] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 1.721s	user 0.031s	sys 0.012s
I20260620 13:57:59.999593  5952 rpcz_store.cc:276] 0620 13:57:57.751034 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.753431 (+  2397us) service_pool.cc:224] Handling call
0620 13:57:57.753782 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.797487 (+2043705us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b4c0010dd40. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fddac6120 00007f0fddad7129 00007f0fdda9cd44 00007f0fddac462d 00007f0fddac4293 00007f0fdf7f756b 00007f0fdf7f8095 00007f0fdf7f3310 00007f0fdf7f4bbe 00007f0fdf7fef29 00007f0fdf7ff7f6
0620 13:57:59.998025 (+200538us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.998232 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90018560}
I20260620 13:58:01.672318  6031 raft_consensus.cc:2410] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260620 13:58:01.661752  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 71578.3us
W20260620 13:58:01.665719  5849 connection.cc:256] RPC call timeout handler was delayed by -1.0698730919999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
W20260620 13:58:01.673646 11317 log.cc:927] Time spent T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 3.218s	user 0.022s	sys 0.017s
I20260620 13:58:01.637557 11397 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:01.682524  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:01.684666  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 90151.4us
W20260620 13:58:01.688486  5881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.845s	user 0.007s	sys 0.021s
W20260620 13:58:01.703719  5881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.860s	user 0.008s	sys 0.022s
I20260620 13:58:01.703831 11414 consensus_queue.cc:1059] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:58:01.705202  5881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2897) took 2703 ms. Trace:
I20260620 13:58:01.705644  5881 rpcz_store.cc:276] 0620 13:57:59.001967 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.799360 (+797393us) service_pool.cc:224] Handling call
0620 13:57:59.799760 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:59.812991 (+ 13231us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.813024 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:59.813446 (+   422us) log.cc:844] Serialized 26 byte log entry
0620 13:58:01.704658 (+1891212us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:58:01.704717 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.704800 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:01.704843 (+    43us) raft_consensus.cc:1685] finished
0620 13:58:01.704855 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.705143 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1861203,"threads_started":1,"wal-append.queue_time_us":512295,"wal-append.run_cpu_time_us":2442,"wal-append.run_wall_time_us":1079446}
W20260620 13:58:01.683028  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.711138 11413 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:01.711660  5924 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:01.711733 11413 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.713730  6032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2893) took 2872 ms. Trace:
I20260620 13:58:01.714252 11413 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:01.714126  6032 rpcz_store.cc:276] 0620 13:57:58.840867 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.841122 (+   255us) service_pool.cc:224] Handling call
0620 13:57:58.868784 (+ 27662us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.544275 (+675491us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.713492 (+2169217us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b54001c8754. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:01.713668 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1491144960}
I20260620 13:58:01.714969 11413 consensus_queue.cc:1059] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260620 13:58:01.716972 11416 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260620 13:58:01.718338  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.718178 11413 consensus_queue.cc:1059] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260620 13:58:01.715831 11414 consensus_queue.cc:1243] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260620 13:58:01.689286 11412 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:58:01.684789 11409 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:01.724795 11409 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.725402 11414 raft_consensus.cc:3055] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:01.725883 11414 raft_consensus.cc:740] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:01.726662 11414 consensus_queue.cc:260] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.727052 11409 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:01.728201 11414 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:01.728427 11409 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:58:01.728987 11409 raft_consensus.cc:697] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:01.718786 11416 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260620 13:58:01.730600 11417 raft_consensus.cc:3055] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:58:01.731025 11410 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:01.730650 11409 consensus_queue.cc:237] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.732245 11410 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.731045 11417 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:58:01.736691  5998 connection.cc:256] RPC call timeout handler was delayed by -1.7176850490000106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
W20260620 13:58:01.737529  5998 connection.cc:256] RPC call timeout handler was delayed by -1.2393195900000364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260620 13:58:01.737943  5998 connection.cc:256] RPC call timeout handler was delayed by -1.1601195900000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260620 13:58:01.738286  5998 connection.cc:256] RPC call timeout handler was delayed by -1.1601195900000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
I20260620 13:58:01.738438 11397 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:01.739578 11397 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.742848 11397 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:01.740162  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:01.747568 11182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.966s	user 0.009s	sys 0.010s
W20260620 13:58:01.748060 11182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.966s	user 0.009s	sys 0.010s
W20260620 13:58:01.708228  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:01.738633  5998 connection.cc:256] RPC call timeout handler was delayed by -1.1538195900000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
W20260620 13:58:01.753482  5998 connection.cc:256] RPC call timeout handler was delayed by -1.1538195900000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
W20260620 13:58:01.754015  5998 connection.cc:256] RPC call timeout handler was delayed by -1.11331959000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260620 13:58:01.754434  5998 connection.cc:256] RPC call timeout handler was delayed by -1.0809195900000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260620 13:58:01.756271  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 130008us
I20260620 13:58:01.755568  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:01.667387 11408 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:01.766021 11419 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:01.766597 11419 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.768918 11419 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:01.736342 11417 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.770345 11417 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:01.764801  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:58:01.775043  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:01.775669  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.670451 11406 raft_consensus.cc:3055] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:58:01.775974  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:01.786829 11418 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:58:01.777225 11406 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:01.776916 11106 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:01.780458 11414 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:01.791839 11418 raft_consensus.cc:697] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:58:01.818066  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 114874us
I20260620 13:58:01.798795 11106 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:01.810420 11409 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:01.822774 11106 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:01.822919 11409 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.825547 11409 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:01.829061  6581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 1199) took 2133 ms. Trace:
I20260620 13:58:01.829965  6581 rpcz_store.cc:276] 0620 13:57:59.695442 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.695555 (+   113us) service_pool.cc:224] Handling call
0620 13:58:01.828719 (+2133164us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54004eb954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:01.828861 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330808576}
W20260620 13:58:01.819749  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 55054.8us
I20260620 13:58:01.798136 11410 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:01.837751  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.812919 11414 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:01.846055  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:58:01.842783  5848 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.647s (SENT)
I20260620 13:58:01.850457  5848 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:01.857746  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 117925us
I20260620 13:58:01.834650 11106 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.800472 11406 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.866082  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.866855  5952 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:58:01.869119  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.869848  5952 raft_consensus.cc:2393] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:01.872473  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.873190  5953 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:58:01.873510  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.874537  5958 raft_consensus.cc:2410] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260620 13:58:01.876348  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.869148  5998 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:01.845808 11412 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260620 13:58:01.880398  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.883126  5958 raft_consensus.cc:2376] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12. Re-sending same reply.
I20260620 13:58:01.884672 11409 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:01.885289 11409 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.886013 11415 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.022s
I20260620 13:58:01.886700 11415 consensus_queue.cc:1243] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260620 13:58:01.887379 11106 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:01.888037 11415 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260620 13:58:01.888929  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.889648  5958 raft_consensus.cc:2376] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9. Re-sending same reply.
I20260620 13:58:01.891489  6586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 1197) took 2196 ms. Trace:
I20260620 13:58:01.891932  6586 rpcz_store.cc:276] 0620 13:57:59.694753 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.701721 (+  6968us) service_pool.cc:224] Handling call
0620 13:57:59.702029 (+   308us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:59.910603 (+208574us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.891197 (+1980594us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54005f4bd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:01.891425 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476263168}
I20260620 13:58:01.892311 11424 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:01.892872 11424 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:01.894069  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.899780  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.901731  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.905347  5950 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 17: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:58:01.893302 11424 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:01.906256  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.902338  5955 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260620 13:58:01.908810  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.910167  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.903648  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.903690  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.916222  5951 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:01.900462  5959 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:01.916193  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.917807  5952 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:01.919541  5950 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:58:01.920817  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.921662  5955 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:58:01.924072  5955 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260620 13:58:01.903985  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 138405us
I20260620 13:58:01.935007  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.937108 11409 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:01.900218 11414 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.900458 11423 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:01.942907  5959 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:58:01.943475  6033 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260620 13:58:01.926600 11418 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.926668 11106 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:01.926021 11278 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:58:01.953560  5955 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:01.961122  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.988276  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:01.989226  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 120168us
I20260620 13:58:01.989743  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.990473  5950 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:58:01.963137  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2892) took 3143 ms. Trace:
I20260620 13:58:01.963254  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.991947  5959 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:58:01.991706  6033 rpcz_store.cc:276] 0620 13:57:58.820007 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.820357 (+   350us) service_pool.cc:224] Handling call
0620 13:57:58.820713 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:01.943179 (+3122466us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b54004b0da0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7741a0 00007f0fdf7fe5a0 00007f0fdf7ff611 00007f0fdf7fc16f 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c
0620 13:58:01.962859 (+ 19680us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.963068 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135764864}
I20260620 13:58:01.993077  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.993718  5959 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:58:01.993587  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.994344  5955 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:58:01.994448 11367 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:01.994524  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.995445  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.969421  5958 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
I20260620 13:58:01.998301  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.999043  5955 raft_consensus.cc:2376] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14. Re-sending same reply.
I20260620 13:58:01.945786 11426 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:02.000094  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.998322  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.001010  5958 raft_consensus.cc:2393] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 12: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:58:02.001039  5955 raft_consensus.cc:2410] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260620 13:58:02.001976  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.002725  5958 raft_consensus.cc:2393] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:01.976800  5951 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:58:01.995805  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.999845 11426 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.004180  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.005376  5951 raft_consensus.cc:2410] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 13 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260620 13:58:02.006220 11426 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:01.996220  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.006863  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:02.007007  5950 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:58:02.008177  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.008935  5950 raft_consensus.cc:2410] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 18 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260620 13:58:02.009765  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.010502  5950 raft_consensus.cc:2410] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260620 13:58:02.001982  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.994992 11367 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.013375  5955 raft_consensus.cc:1275] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260620 13:58:02.015796  5848 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.767s (SENT)
I20260620 13:58:02.020889  5958 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:02.028983 11255 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:02.030014  5848 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.831s (SENT)
I20260620 13:58:02.031795 11412 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:02.034745 11412 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.035573 11276 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:02.037216 11412 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:02.037786 11412 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:02.038259 11412 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.031925 11415 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:02.032130 10831 consensus_queue.cc:1059] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:58:02.039527 11415 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.040074 10831 raft_consensus.cc:3055] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:02.040624 10831 raft_consensus.cc:740] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:02.042461 11415 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:02.033034 11408 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:02.044201 11408 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.032938 11221 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:58:02.046902 11408 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:02.048774  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.034155 11430 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:02.041849 10831 consensus_queue.cc:260] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.056587 11412 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:02.052780 11430 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.054741 10831 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:02.062742 11430 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:02.064284  5848 leader_election.cc:336] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.852s (SENT)
W20260620 13:58:02.065165  5848 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.867s (SENT)
W20260620 13:58:02.085824  6031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43502 (request call id 2646) took 2198 ms (client timeout 2068 ms). Trace:
W20260620 13:58:02.086877  6031 rpcz_store.cc:269] 0620 13:57:59.877103 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.877257 (+   154us) service_pool.cc:224] Handling call
0620 13:58:02.074711 (+2197454us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b54001c9b54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:02.075032 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71707008}
W20260620 13:58:02.094708  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.066787  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:02.112509  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.113536  6586 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: []
I20260620 13:58:02.119812  6582 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260620 13:58:02.115350  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:02.120785  6581 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 13: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:02.116716  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:02.122264  6582 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260620 13:58:02.122524  5952 raft_consensus.cc:2410] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260620 13:58:02.117918  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:02.125173 11406 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:02.125883  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:02.127259  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:01.984330 11106 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:58:02.149801  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.130650  6582 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
W20260620 13:58:02.162220  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 95642us
I20260620 13:58:02.154050  5951 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
W20260620 13:58:02.164621  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.164220  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.167681  5951 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:58:02.169642  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:02.171545  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:02.166563  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 237645us
I20260620 13:58:02.175560 11440 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:58:02.176384  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:02.177157  6581 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:58:02.178512  6583 raft_consensus.cc:2410] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260620 13:58:02.125900  5952 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260620 13:58:02.188011  5952 pending_rounds.cc:85] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 9
I20260620 13:58:02.188414  5952 pending_rounds.cc:107] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260620 13:58:02.188768  5952 raft_consensus.cc:2889] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:02.190085  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.191591  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.175896  5997 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:02.196167  5997 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:02.197887  5997 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:02.184595  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.983537 11423 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.211915  5952 raft_consensus.cc:2410] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260620 13:58:02.214262  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:02.226646  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.162220 11106 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:02.167093 11210 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:02.249859 11424 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.253801 11367 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:02.256451  5954 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:58:02.173202 11409 consensus_queue.cc:1059] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260620 13:58:02.257594 11409 raft_consensus.cc:3055] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:58:02.257978 11409 raft_consensus.cc:740] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:02.258841 11409 consensus_queue.cc:260] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.203429 11311 consensus_queue.cc:1059] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260620 13:58:02.261691 11311 consensus_queue.cc:1243] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer 2e82c0c231624695ac5a813230bf5038 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260620 13:58:02.262210 11311 raft_consensus.cc:3055] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:02.262540 11311 raft_consensus.cc:740] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:02.267879 11311 consensus_queue.cc:260] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.269133 11311 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:02.271571  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:02.276589  5956 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.434s	user 0.018s	sys 0.009s
I20260620 13:58:02.277352 11423 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:02.278009  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.278544 11304 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:58:02.279242 11304 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:02.279657 11304 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:02.282039 11397 consensus_queue.cc:1059] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260620 13:58:02.283555  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.283578 11397 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:02.284751 11397 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:02.285239 11397 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:02.286195 11289 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260620 13:58:02.260742 11409 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:02.297842 11397 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.305207 11435 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:58:02.306726 11419 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Stepping down as leader of term 19
I20260620 13:58:02.315343 11419 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:02.316314 11419 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.317644 11419 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:58:02.321005 11435 raft_consensus.cc:697] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:02.322353 11435 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.309446 11106 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.311079  5952 raft_consensus.cc:1217] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 8.9->[9.10-12.12]   Dedup: 9.10->[10.11-12.12]
I20260620 13:58:02.312068 11294 raft_consensus.cc:3055] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Stepping down as leader of term 9
W20260620 13:58:02.310978  5882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.530s	user 0.015s	sys 0.041s
I20260620 13:58:02.308537 11289 raft_consensus.cc:3055] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Stepping down as leader of term 13
W20260620 13:58:02.327541  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:02.353070  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:02.327484  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 195116us
I20260620 13:58:02.331192  5952 pending_rounds.cc:85] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 10
I20260620 13:58:02.355261  5952 pending_rounds.cc:107] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260620 13:58:02.355674  5952 raft_consensus.cc:2889] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:02.156575  5958 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:58:02.363304  5848 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:02.365443  5848 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:02.373355  6551 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:02.384147  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:02.385198  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:02.380947  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca260 after lost signal to thread 4722
I20260620 13:58:02.382551  6551 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:02.352662 11289 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:02.370401 11142 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:02.369445 11294 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:02.391340 11257 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260620 13:58:02.397409  5956 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.555s	user 0.019s	sys 0.010s
I20260620 13:58:02.374931 11404 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260620 13:58:02.401228  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 203402us
W20260620 13:58:02.408839  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.394170 11397 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:02.398056 11300 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:02.401072 11257 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:58:02.466743  5882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.686s	user 0.016s	sys 0.041s
W20260620 13:58:02.468492  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:02.469533  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.473978 11106 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:02.416594 11300 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:02.440884 11305 consensus_queue.cc:1059] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.095s
I20260620 13:58:02.439792 11404 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:02.441636 11257 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:02.484609  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.493582  6029 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:58:02.486124  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.494779  6027 raft_consensus.cc:2368] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 15. Current term is 16.
I20260620 13:58:02.487679  6031 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 16. Current term is 17. Ops: []
I20260620 13:58:02.488816  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:02.489588  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:02.490880  6026 raft_consensus.cc:1240] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:02.492103  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:02.497467  6025 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:02.500519  6032 raft_consensus.cc:1240] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: []
W20260620 13:58:02.450558 11410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.034s	sys 0.069s
I20260620 13:58:02.505317  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:02.508522  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.509408  6024 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:58:02.479048 11300 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:02.523730  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.525192  6029 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:58:02.531996  6025 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
W20260620 13:58:02.513289 11410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.035s	sys 0.070s
I20260620 13:58:02.499553 11424 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:02.503147 11278 raft_consensus.cc:697] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:02.517555 11293 raft_consensus.cc:3055] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Stepping down as leader of term 16
I20260620 13:58:02.441433 11289 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:02.547178  5998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.002s	sys 0.006s
I20260620 13:58:02.562913  5848 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:58:02.564828  5957 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260620 13:58:02.602182  5957 pending_rounds.cc:85] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 8
I20260620 13:58:02.602540  5957 pending_rounds.cc:107] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260620 13:58:02.570513  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:02.593531  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.499807 11404 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.468008 11294 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:02.603593  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:02.604077  5998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.002s	sys 0.007s
I20260620 13:58:02.602844  5957 raft_consensus.cc:2889] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:58:02.604458  5847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.010s	sys 0.036s
W20260620 13:58:02.604501  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 580591us
W20260620 13:58:02.605053  5847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.010s	sys 0.036s
I20260620 13:58:02.592958 11305 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:02.607036  6583 raft_consensus.cc:2410] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260620 13:58:02.614766 11305 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.617926 11404 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:02.619530  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003821a0 after lost signal to thread 5815
W20260620 13:58:02.621362  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.592665 11439 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:02.598778 11293 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:02.640846  6024 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260620 13:58:02.605871 11445 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:02.649457 11445 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.651193 11307 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:02.651819 11445 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:02.651738 11307 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.647205 11410 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260620 13:58:02.648118 11406 consensus_meta.cc:287] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.000s
I20260620 13:58:02.639037 11278 consensus_queue.cc:237] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.653231  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.646067 11449 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:02.664561  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.765337  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:02.666323  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.766423  6031 raft_consensus.cc:2393] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 14: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:58:02.766537  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.729820  6028 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 12. Current term is 13. Ops: []
I20260620 13:58:02.740314  5997 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:58:02.741099  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 358600us
W20260620 13:58:02.748849  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003366a0 after lost signal to thread 5908
I20260620 13:58:02.768481  5959 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
W20260620 13:58:02.768940  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003af440 after lost signal to thread 5983
W20260620 13:58:02.769251  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08002ebb20 after lost signal to thread 5984
W20260620 13:58:02.727391 11255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.014s	sys 0.006s
I20260620 13:58:02.630806 11443 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:58:02.760246  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.761966  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.765668  6027 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 13: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:02.767560  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:02.770269  6054 debug-util.cc:398] Leaking SignalData structure 0x7b0800419540 after lost signal to thread 6057
W20260620 13:58:02.792018  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6d00 after lost signal to thread 6611
W20260620 13:58:02.792570  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003e45a0 after lost signal to thread 6612
I20260620 13:58:02.740370  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:02.781453  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.771973  6551 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:02.795858  5954 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 15: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:58:02.812803  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.826529  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.827719  6027 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 15: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:02.829836  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:02.839191  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.839742  6026 raft_consensus.cc:2410] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260620 13:58:02.790136 11255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.015s	sys 0.006s
I20260620 13:58:02.840965  6551 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:02.846933  6028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2890) took 4028 ms. Trace:
W20260620 13:58:02.791566 11414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.007s	sys 0.021s
I20260620 13:58:02.858127  6028 rpcz_store.cc:276] 0620 13:57:58.819043 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.819259 (+   216us) service_pool.cc:224] Handling call
0620 13:57:58.819625 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:02.767452 (+3947827us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.846599 (+ 79147us) spinlock_profiling.cc:243] Waited 3.91 s on lock 0x7b540037cdd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:02.846858 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8992165248}
I20260620 13:58:02.870601  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.871683  6028 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 16: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:58:02.874814  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.848127  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.790414 11425 raft_consensus.cc:2764] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260620 13:58:02.882027  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.869385  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.883319  6031 raft_consensus.cc:2410] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260620 13:58:02.867341  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2360) took 3969 ms. Trace:
I20260620 13:58:02.868079  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:02.884999  5953 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.017s	sys 0.019s
W20260620 13:58:02.885313  5953 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.017s	sys 0.019s
I20260620 13:58:02.883419  6026 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:58:02.843624 11380 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
W20260620 13:58:02.894582  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:02.869999 11414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.007s	sys 0.021s
I20260620 13:58:02.906059  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.644529 11439 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.883850  5956 rpcz_store.cc:276] 0620 13:57:58.897904 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.841550 (+943646us) service_pool.cc:224] Handling call
0620 13:57:59.841974 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.842231 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 10
0620 13:58:02.401868 (+2559637us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.866576 (+464708us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:02.866660 (+    84us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:58:02.866723 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.866922 (+   199us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:02.867141 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4823,"prepare.queue_time_us":9912,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":19693,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3332,"thread_start_us":3018617,"threads_started":2}
I20260620 13:58:02.912923  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:02.900380  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.879786 11413 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:02.909123  5953 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:02.921823  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.922644  5953 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:58:02.923810  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.924582  5953 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:58:02.926020  5953 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260620 13:58:02.929733 11289 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:02.932489 11378 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:02.933115 11378 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:02.933568 11378 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:02.914357  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:02.888088  5958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.010s
W20260620 13:58:02.951493  5958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.011s	sys 0.010s
W20260620 13:58:02.916580  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.917663  5956 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:02.955008  5957 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:58:02.818415 11449 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.969532  5956 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:02.973714  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.975363  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:02.986440  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 407565us
W20260620 13:58:02.898025  5951 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.020s
W20260620 13:58:02.993746  5951 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.000s	sys 0.021s
I20260620 13:58:02.866474 11293 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.823729 11443 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.998061  5956 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260620 13:58:03.000383  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.965201 11413 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.012091 11449 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:03.013134 11257 consensus_meta.cc:287] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.000s
W20260620 13:58:03.018018 11304 consensus_meta.cc:287] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.738s	user 0.003s	sys 0.008s
I20260620 13:58:03.026364  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.027935  6026 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
W20260620 13:58:03.011667 11436 log.cc:927] Time spent T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260620 13:58:03.048081 11447 log.cc:927] Time spent T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.387s	user 0.000s	sys 0.001s
W20260620 13:58:03.050410 11451 log.cc:927] Time spent T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260620 13:58:03.057637  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.307395  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 653640us
I20260620 13:58:03.402966  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2581) took 1388 ms. Trace:
W20260620 13:58:03.300285  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 737212us
W20260620 13:58:03.333729  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.074327  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 213516us
W20260620 13:58:03.455535  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.456971 11142 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:03.457093  6551 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:03.457960 11142 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:03.458514 11142 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:03.307297  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 2030) took 4398 ms. Trace:
W20260620 13:58:03.341470  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.107331 10831 consensus_meta.cc:287] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.044s	user 0.014s	sys 0.001s
I20260620 13:58:03.013604 11257 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.188313 11293 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:03.499449  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.500571  6027 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:58:03.502377  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:03.161973 11294 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:58:03.177208 11300 consensus_meta.cc:287] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.640s	user 0.012s	sys 0.000s
I20260620 13:58:03.019613 11304 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.551929 11304 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.018522 11305 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:03.172854 11307 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.150605 11378 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.555318  6032 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: []
I20260620 13:58:03.555953 11378 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:03.557124  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.558037  6026 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:58:03.124814 11380 raft_consensus.cc:697] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:03.157582 11413 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:03.146333 11419 consensus_meta.cc:287] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.827s	user 0.014s	sys 0.000s
I20260620 13:58:03.560667 11332 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:58:03.561880 11380 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.123565 11439 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:03.092841 11442 log.cc:927] Time spent T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260620 13:58:03.145469 11443 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:03.403831  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2580) took 1456 ms. Trace:
I20260620 13:58:03.565773 11487 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.564271  5955 rpcz_store.cc:276] 0620 13:58:01.962719 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.019905 (+ 57186us) service_pool.cc:224] Handling call
0620 13:58:02.020283 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:02.133262 (+112979us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:58:02.133294 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:02.133774 (+   480us) log.cc:844] Serialized 26 byte log entry
0620 13:58:02.549307 (+415533us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:58:02.600065 (+ 50758us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.600321 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.600566 (+   245us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:02.650193 (+ 49627us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b4800002dd8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe47261a1 00007f0fe471d237 00007f0fe471d0ca 00007f0fe481496f 00007f0fe4814637 00007f0fe4828c5c 00007f0fe4828c08 00007f0fe4828b88 00007f0fe4828b43 00007f0fe4827dec 00007f0fe3754f76
0620 13:58:03.184289 (+534096us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b180009a900. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc70abf3 00007f0fdc70cfc1 00007f0fdc70cf79 00007f0fdc70cf09 00007f0fdc70ced1 00007f0fdc70c1cd 0000000000389354 0000000000389199 00007f0fdc6ee03a
0620 13:58:03.403188 (+218899us) raft_consensus.cc:1685] finished
0620 13:58:03.403243 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.403617 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51717,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":63,"raft.queue_time_us":562,"raft.run_cpu_time_us":4549,"raft.run_wall_time_us":629467,"spinlock_wait_cycles":15139584,"thread_start_us":353390,"threads_started":1,"wal-append.queue_time_us":390892}
W20260620 13:58:03.108819 11448 log.cc:927] Time spent T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260620 13:58:03.108450 11452 log.cc:927] Time spent T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260620 13:58:03.166126 11455 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260620 13:58:03.185979 11456 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260620 13:58:03.134605 11457 log.cc:927] Time spent T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260620 13:58:03.030812 11464 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
W20260620 13:58:03.333877  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.335623  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 348052us
W20260620 13:58:03.583701  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.584256  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.584745  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.408638  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.587594  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.588476  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.402967  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2583) took 1338 ms. Trace:
I20260620 13:58:03.593870  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2585) took 1529 ms. Trace:
I20260620 13:58:03.592187  5952 rpcz_store.cc:276] 0620 13:58:02.064287 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.310162 (+245875us) service_pool.cc:224] Handling call
0620 13:58:02.310569 (+   407us) raft_consensus.cc:1471] Updating replica for 3 ops
0620 13:58:02.379780 (+ 69211us) raft_consensus.cc:1534] Early marking committed up to index 10
0620 13:58:02.400042 (+ 20262us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.856467 (+456425us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:58:02.857131 (+   664us) log.cc:844] Serialized 52 byte log entry
0620 13:58:02.857274 (+   143us) raft_consensus.cc:1645] Marking committed up to 12
0620 13:58:02.857534 (+   260us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.982740 (+125206us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b1800215a40. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc68540a 00007f0fe5dca5d9 00007f0fdc70d240 00007f0fdc707ce4 00007f0fdc707c55 00007f0fe31f6247 00007f0fdf806d87 00007f0fdf81649f 00007f0fdf816418
0620 13:58:02.983036 (+   296us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.983558 (+   522us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.990095 (+  6537us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:03.181279 (+191184us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b1800215a40. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc70abf3 00007f0fdc70cfc1 00007f0fdc70cf79 00007f0fdc70cf09 00007f0fdc70ced1 00007f0fdc70c1cd 0000000000389354 0000000000389199 00007f0fdc6ee03a
0620 13:58:03.402152 (+220873us) raft_consensus.cc:1685] finished
0620 13:58:03.402207 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.402643 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":535341,"prepare.queue_time_us":154470,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":133,"raft.queue_time_us":52590,"raft.run_cpu_time_us":505,"raft.run_wall_time_us":25879,"spinlock_wait_cycles":69167104,"thread_start_us":437497,"threads_started":1,"wal-append.queue_time_us":640803}
W20260620 13:58:03.467403  6029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.005s	sys 0.001s
W20260620 13:58:03.595573  6029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.006s	sys 0.001s
I20260620 13:58:03.594300  5958 rpcz_store.cc:276] 0620 13:58:02.064764 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.357977 (+293213us) service_pool.cc:224] Handling call
0620 13:58:02.358389 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:02.380134 (+ 21745us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:58:02.380163 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:02.382790 (+  2627us) log.cc:844] Serialized 26 byte log entry
0620 13:58:02.952083 (+569293us) raft_consensus.cc:1645] Marking committed up to 14
0620 13:58:02.990688 (+ 38605us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.990966 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.991050 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:03.183721 (+192671us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b4800002dd8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe47261a1 00007f0fe471d237 00007f0fe471d0ca 00007f0fe481496f 00007f0fe4814637 00007f0fe4828c5c 00007f0fe4828c08 00007f0fe4828b88 00007f0fe4828b43 00007f0fe4827dec 00007f0fe3754f76
0620 13:58:03.185209 (+  1488us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:58:03.593403 (+408194us) raft_consensus.cc:1685] finished
0620 13:58:03.593455 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.593674 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84938,"prepare.queue_time_us":483543,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":91,"raft.queue_time_us":30958,"raft.run_cpu_time_us":4765,"raft.run_wall_time_us":190945,"spinlock_wait_cycles":10331648,"thread_start_us":568863,"threads_started":1,"wal-append.queue_time_us":641730}
I20260620 13:58:03.596575  6029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1190) took 1052 ms. Trace:
I20260620 13:58:03.597692  5958 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260620 13:58:03.598091  5958 pending_rounds.cc:85] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 11
I20260620 13:58:03.596985  6029 rpcz_store.cc:276] 0620 13:58:02.543846 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.544131 (+   285us) service_pool.cc:224] Handling call
0620 13:58:02.546105 (+  1974us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:02.919440 (+373335us) raft_consensus.cc:1534] Early marking committed up to index 10
0620 13:58:02.919519 (+    79us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:02.927296 (+  7777us) log.cc:844] Serialized 26 byte log entry
0620 13:58:03.596107 (+668811us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:58:03.596184 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.596253 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:03.596338 (+    85us) raft_consensus.cc:1685] finished
0620 13:58:03.596356 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.596499 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4102,"raft.queue_time_us":98308,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":1035830,"threads_started":2,"wal-append.queue_time_us":222421}
I20260620 13:58:03.598322  5958 pending_rounds.cc:107] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260620 13:58:03.598696  5958 raft_consensus.cc:2889] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:03.469251 11221 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260620 13:58:03.446058  5998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.016s	sys 0.064s
I20260620 13:58:03.599074  5958 pending_rounds.cc:107] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260620 13:58:03.599308 11221 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:58:03.599431  5998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.017s	sys 0.065s
I20260620 13:58:03.599785 11221 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:58:03.599984  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 993983us
I20260620 13:58:03.476850  6030 raft_consensus.cc:2410] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260620 13:58:03.602931  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:03.603737  6582 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260620 13:58:03.599458  5958 raft_consensus.cc:2889] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:03.477160 11311 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.605784 11311 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:03.606456  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:03.477494  6024 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:03.478107  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.608428  6031 raft_consensus.cc:2368] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 15. Current term is 16.
W20260620 13:58:03.484086  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.491657 11408 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.495383  6580 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:58:03.508734  6027 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:03.509799  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:03.515318  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:03.518235 11257 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:03.530349  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:03.529891 11300 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.495398 11210 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.463503  5882 rpcz_store.cc:276] 0620 13:57:58.908815 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.779421 (+870606us) service_pool.cc:224] Handling call
0620 13:57:59.779719 (+   298us) raft_consensus.cc:1471] Updating replica for 3 ops
0620 13:57:59.780066 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.780095 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0620 13:57:59.780727 (+   632us) log.cc:844] Serialized 78 byte log entry
0620 13:58:02.467440 (+2686713us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:58:02.479501 (+ 12061us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.546591 (+ 67090us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.903506 (+356915us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b18001ece80. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc68540a 00007f0fe5dca5d9 00007f0fdc70d240 00007f0fdc707ce4 00007f0fdc707c55 00007f0fdf7f4440 00007f0fdf806af6 00007f0fdf817667 00007f0fdf8175e8
0620 13:58:02.903752 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.903856 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:03.306127 (+402271us) raft_consensus.cc:1685] finished
0620 13:58:03.306282 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.306871 (+   589us) inbound_call.cc:177] Queueing success response
0620 13:58:03.439221 (+132350us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b18001ece80. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc70ad22 00007f0fdc70cfc1 00007f0fdc70cf79 00007f0fdc70cf09 00007f0fdc70ced1 00007f0fdc70c1cd 0000000000389354 0000000000389199 00007f0fdc6ee03a
Metrics: {"mutex_wait_us":672687,"prepare.queue_time_us":13709,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":3470,"raft.queue_time_us":369762,"raft.run_cpu_time_us":482,"raft.run_wall_time_us":20771,"spinlock_wait_cycles":102268032,"thread_start_us":2752602,"threads_started":2,"wal-append.queue_time_us":472374,"wal-append.run_cpu_time_us":3123,"wal-append.run_wall_time_us":1195137}
I20260620 13:58:03.546759 10831 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:58:03.547885 11404 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.633841 11404 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.636854 11404 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.637893 11404 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:03.548383  6552 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:03.548959  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.639536  6552 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:03.566490 11487 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.558992  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:03.640345  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 92217.5us
I20260620 13:58:03.576066 11414 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:03.641094  6552 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:03.641611 11414 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:03.642063  6552 leader_election.cc:336] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:03.576625  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 1200) took 3880 ms. Trace:
I20260620 13:58:03.454056  5950 rpcz_store.cc:276] 0620 13:58:02.013986 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.159084 (+145098us) service_pool.cc:224] Handling call
0620 13:58:02.205160 (+ 46076us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:02.205583 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:58:02.205625 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:02.216214 (+ 10589us) log.cc:844] Serialized 26 byte log entry
0620 13:58:02.612279 (+396065us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:58:02.985971 (+373692us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.986195 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.986272 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:03.174908 (+188636us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b4800002dd8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe47261a1 00007f0fe471d237 00007f0fe471d0ca 00007f0fe481496f 00007f0fe4814637 00007f0fe4828c5c 00007f0fe4828c08 00007f0fe4828b88 00007f0fe4828b43 00007f0fe4827dec 00007f0fe3754f76
0620 13:58:03.402025 (+227117us) raft_consensus.cc:1685] finished
0620 13:58:03.402232 (+   207us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.402638 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40746,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":40807,"raft.run_cpu_time_us":4031,"raft.run_wall_time_us":185726,"spinlock_wait_cycles":5928192,"thread_start_us":705615,"threads_started":2,"wal-append.queue_time_us":665755}
I20260620 13:58:03.580955 11444 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:03.612255 11311 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:03.599018  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:03.621786  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.629521 11300 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:03.576050  5848 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:03.630560 11210 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.631469  6033 raft_consensus.cc:2410] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260620 13:58:03.654450  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.643344  6587 rpcz_store.cc:276] 0620 13:57:59.695735 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.695933 (+   198us) service_pool.cc:224] Handling call
0620 13:57:59.696250 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:59.696472 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.696496 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:02.251220 (+2554724us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b2c000fb6b8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fde0f5c71 00007f0fde1055d2 00007f0fdf837de1 00007f0fdf7fc81a 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22
0620 13:58:02.251654 (+   434us) log.cc:844] Serialized 26 byte log entry
0620 13:58:02.535868 (+284214us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:58:02.536835 (+   967us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.536914 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:03.575836 (+1038922us) raft_consensus.cc:1685] finished
0620 13:58:03.575889 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.576321 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71491328,"thread_start_us":283780,"threads_started":1,"wal-append.queue_time_us":630899}
I20260620 13:58:03.658299  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:03.658650  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.660353  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:03.660511  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 157474us
I20260620 13:58:03.662169  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.663843 11293 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:03.664053  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:03.665359  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.665074 11408 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:03.665699 11142 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.666561  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:03.642876  6552 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:03.671772  6552 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:03.605805  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:03.667987  6024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1193) took 1023 ms. Trace:
I20260620 13:58:03.663861  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.670428 11210 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.638638 11404 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:03.668407  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 92574.4us
I20260620 13:58:03.686818 11404 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.687652 11404 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:03.690788  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.691659  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:03.692170  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.694625  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2388) took 1038 ms. Trace:
I20260620 13:58:03.695518 11416 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:03.701136  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:03.701514  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 100562us
I20260620 13:58:03.702540  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:03.703534  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:03.703735  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:03.672574 11444 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:03.693660 11221 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:03.706040  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 63224.8us
I20260620 13:58:03.706539  6585 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: []
I20260620 13:58:03.704881 11487 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.695075  5950 rpcz_store.cc:276] 0620 13:58:02.656075 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:03.656817 (+1000742us) service_pool.cc:224] Handling call
0620 13:58:03.693296 (+ 36479us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:03.693884 (+   588us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:58:03.693931 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:03.694000 (+    69us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:58:03.694078 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.694145 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.694538 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:58:03.662938  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:03.674232  6024 rpcz_store.cc:276] 0620 13:58:02.644526 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.645063 (+   537us) service_pool.cc:224] Handling call
0620 13:58:02.758318 (+113255us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:03.607448 (+849130us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.667726 (+ 60278us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54001c8754. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:03.667927 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541451008}
W20260620 13:58:03.720345  6552 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:03.723053  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.733732  6552 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:03.719077 11300 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:03.732379  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:03.731216  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 1181) took 1238 ms. Trace:
I20260620 13:58:03.736660  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:03.736939  6033 rpcz_store.cc:276] 0620 13:58:02.488382 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.488537 (+   155us) service_pool.cc:224] Handling call
0620 13:58:03.720314 (+1231777us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001c9654. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:03.726828 (+  6514us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2462906752}
I20260620 13:58:03.735838  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.743085  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.739488  6030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 1183) took 1250 ms. Trace:
I20260620 13:58:03.744792  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2376) took 1331 ms. Trace:
I20260620 13:58:03.745434  6030 rpcz_store.cc:276] 0620 13:58:02.489193 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.489325 (+   132us) service_pool.cc:224] Handling call
0620 13:58:03.728278 (+1238953us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54001e69d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:03.739431 (+ 11153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2143761152}
I20260620 13:58:03.747053  6028 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:58:03.756105  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.757665  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:03.762449  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.739017 11487 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:58:03.733528 11404 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260620 13:58:03.777778 11406 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:03.778601 11406 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.780350 11404 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.781250 11406 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.781015 11404 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.745824 11408 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:03.749158 11142 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.774612 11221 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:03.774946  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 112136us
I20260620 13:58:03.775533  5997 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:03.783828  5997 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:03.784358  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:03.784929  5997 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:03.786422  5997 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:03.775879  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2382) took 1336 ms. Trace:
I20260620 13:58:03.787528 11437 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:03.787698 11210 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.788020 11142 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:03.788446 11439 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:03.777240  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:03.788973  6032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1188) took 1285 ms. Trace:
I20260620 13:58:03.776734 11311 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:03.788573 11142 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:03.847741  5849 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:03.862219 11444 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:03.975042  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.838335  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2582) took 1674 ms. Trace:
W20260620 13:58:03.838860  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 96923.8us
I20260620 13:58:03.838866 11487 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.891978  6027 raft_consensus.cc:2410] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260620 13:58:03.875397  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.792660  6032 rpcz_store.cc:276] 0620 13:58:02.503527 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.505898 (+  2371us) service_pool.cc:224] Handling call
0620 13:58:02.506254 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:03.555919 (+1049665us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.764529 (+208610us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540005a0d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:03.788915 (+ 24386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2411568512}
I20260620 13:58:03.767932 11293 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:58:03.791280  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2383) took 1379 ms. Trace:
I20260620 13:58:03.881289 11419 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:03.835793 11410 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260620 13:58:03.767083  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:03.835906  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.000761  5950 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:04.007570  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.827483  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.847401 11408 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:58:03.839066 11435 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:58:03.839124 11404 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.862810  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.892446  6026 raft_consensus.cc:2410] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260620 13:58:03.942090  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:03.837950 11492 log.cc:927] Time spent T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260620 13:58:03.850044  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:04.038259  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.038729  6024 raft_consensus.cc:2376] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13. Re-sending same reply.
I20260620 13:58:04.039904  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.040274  6025 raft_consensus.cc:2410] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260620 13:58:04.040644  6024 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:03.904445  6551 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:04.041795  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 137508us
W20260620 13:58:04.042660 11500 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260620 13:58:04.043223 11278 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:03.787259  5956 rpcz_store.cc:276] 0620 13:58:02.409047 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:03.404490 (+995443us) service_pool.cc:224] Handling call
0620 13:58:03.405453 (+   963us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:03.406116 (+   663us) raft_consensus.cc:1534] Early marking committed up to index 9
0620 13:58:03.446766 (+ 40650us) log.cc:844] Serialized 14 byte log entry
0620 13:58:03.744656 (+297890us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:03.744716 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:58:03.744776 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.744851 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.744989 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":214731,"prepare.queue_time_us":77734,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":216747,"thread_start_us":72970,"threads_started":2,"wal-append.queue_time_us":143819}
I20260620 13:58:04.045855  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:04.046658  5956 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:58:03.900274 11414 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.047757 11221 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:04.048225 11221 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:04.048614 11221 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:04.052119 11300 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260620 13:58:03.868048  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 161151us
W20260620 13:58:04.055615  6552 leader_election.cc:336] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:04.057448  6552 leader_election.cc:336] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:04.057916  6552 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:03.749693  5959 rpcz_store.cc:276] 0620 13:58:02.407488 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.936096 (+528608us) service_pool.cc:224] Handling call
0620 13:58:03.408135 (+472039us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:58:03.408637 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:03.437031 (+ 28394us) raft_consensus.cc:1534] Early marking committed up to index 9
0620 13:58:03.471338 (+ 34307us) log.cc:844] Serialized 14 byte log entry
0620 13:58:03.735841 (+264503us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:03.735909 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:58:03.735960 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.736034 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.738871 (+  2837us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":257438,"prepare.queue_time_us":62510,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":238903,"spinlock_wait_cycles":43855744,"thread_start_us":18636,"threads_started":1,"wal-append.queue_time_us":95951}
I20260620 13:58:03.788446 11210 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.059432  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.060456  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:03.788035 11437 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:04.061203 11437 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:04.036013 11435 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:04.061772  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:04.061908 11435 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:04.062393  5959 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:58:03.834517 11422 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260620 13:58:04.063318  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.883494 11416 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:04.064016 11257 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:58:03.860865  6580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46858 (request call id 1294) took 1736 ms (client timeout 2094 ms). Trace:
W20260620 13:58:04.064674  6580 rpcz_store.cc:269] 0620 13:58:02.124434 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.125650 (+  1216us) service_pool.cc:224] Handling call
0620 13:58:03.832583 (+1706933us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540043b2d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:03.860779 (+ 28196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3147330944}
I20260620 13:58:03.789062 11304 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.828298  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.067915 11304 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.068645  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.060675  6027 raft_consensus.cc:2410] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
W20260620 13:58:03.996018  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.070189  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.988420 11142 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:04.029106  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.030170 11488 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:04.009209 11487 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.000862  5955 rpcz_store.cc:276] 0620 13:58:02.409562 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:03.566834 (+1157272us) service_pool.cc:224] Handling call
0620 13:58:03.576326 (+  9492us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:03.576851 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 7
0620 13:58:03.577382 (+   531us) log.cc:844] Serialized 14 byte log entry
0620 13:58:03.788658 (+211276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:03.788712 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:58:03.788760 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.788825 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.788950 (+   125us) inbound_call.cc:177] Queueing success response
0620 13:58:03.898250 (+109300us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b4800002dd8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe47261a1 00007f0fe471d237 00007f0fe471d0ca 00007f0fe481496f 00007f0fe4814637 00007f0fe4828c5c 00007f0fe4828c08 00007f0fe4828b88 00007f0fe4828b43 00007f0fe4827dec 00007f0fe3754f76
Metrics: {"mutex_wait_us":176816,"prepare.queue_time_us":2013,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":217076,"raft.run_cpu_time_us":1295,"raft.run_wall_time_us":68263,"spinlock_wait_cycles":67209088,"thread_start_us":33788,"threads_started":1,"wal-append.queue_time_us":163394}
I20260620 13:58:04.034564  6029 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:04.007882 11311 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.037824  6033 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 17: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:04.087755  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:04.041651  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.792388 11439 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:03.953154  6031 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:58:04.077236  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:04.079980  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 232379us
I20260620 13:58:04.078068  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:04.092406  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.089612  6025 raft_consensus.cc:2410] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260620 13:58:04.093134  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.086315  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2387) took 1455 ms. Trace:
I20260620 13:58:04.097810  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:04.094202  5958 rpcz_store.cc:276] 0620 13:58:02.630963 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:03.606055 (+975092us) service_pool.cc:224] Handling call
0620 13:58:03.606503 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:03.607295 (+   792us) raft_consensus.cc:1534] Early marking committed up to index 11
0620 13:58:03.608000 (+   705us) log.cc:844] Serialized 14 byte log entry
0620 13:58:04.085876 (+477876us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:04.085949 (+    73us) raft_consensus.cc:1645] Marking committed up to 11
0620 13:58:04.086017 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.086104 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:04.086246 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44242,"prepare.queue_time_us":336,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":53,"raft.queue_time_us":49078,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":61,"thread_start_us":426672,"threads_started":2,"wal-append.queue_time_us":442549}
W20260620 13:58:04.093298  5778 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47386 (request call id 236) took 12434 ms (client timeout 15000 ms). Trace:
I20260620 13:58:04.097923  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.994475  5951 rpcz_store.cc:276] 0620 13:58:02.063844 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.199571 (+135727us) service_pool.cc:224] Handling call
0620 13:58:02.199889 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:02.360677 (+160788us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:58:02.360722 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:02.372021 (+ 11299us) log.cc:844] Serialized 26 byte log entry
0620 13:58:02.938097 (+566076us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b4800002dd8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe47261a1 00007f0fe471d237 00007f0fe471d0ca 00007f0fe481496f 00007f0fe4814637 00007f0fe4828c5c 00007f0fe4828c08 00007f0fe4828b88 00007f0fe4828b43 00007f0fe4827dec 00007f0fe3754f76
0620 13:58:03.178809 (+240712us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b2400032fa8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc591614 00007f0fdc58f71b 00007f0fdc74a619 00007f0fdc74a2a5 00007f0fdc749800 00007f0fdf3c3828 00007f0fdf3c3f88 00007f0fdf39b738 00007f0fdf396b0a 00007f0fdf395f56
0620 13:58:03.402722 (+223913us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:58:03.446828 (+ 44106us) log.cc:844] Serialized 14 byte log entry
0620 13:58:03.713709 (+266881us) spinlock_profiling.cc:243] Waited 931 us on lock 0x7b1800126e20. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc68540a 00007f0fe5dca5d9 00007f0fdc70d240 00007f0fdc707ce4 00007f0fdc707c55 00007f0fdf7f4440 00007f0fdf806af6 00007f0fdf817667 00007f0fdf8175e8
0620 13:58:03.720891 (+  7182us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.728332 (+  7441us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:03.728396 (+    64us) raft_consensus.cc:1685] finished
0620 13:58:03.728414 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.737876 (+  9462us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":191522,"prepare.queue_time_us":62165,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":438404,"raft.run_cpu_time_us":2589,"raft.run_wall_time_us":639620,"spinlock_wait_cycles":19821312,"thread_start_us":1042908,"threads_started":2,"wal-append.queue_time_us":629675}
W20260620 13:58:04.094362  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 365700us
W20260620 13:58:04.115617  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.096611  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:04.030517 11419 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.122697  6580 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 12. Current term is 13. Ops: []
I20260620 13:58:04.127761  5956 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:58:04.096678  6579 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:58:04.085534 11422 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:04.131568  5849 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.097572 11439 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:04.130606  6587 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
I20260620 13:58:04.137431  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:04.137745  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:04.138003  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.085024 11278 raft_consensus.cc:697] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:58:04.134663  6552 leader_election.cc:336] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:04.143816  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.118526 11304 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.142952  5959 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
W20260620 13:58:04.145593  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.145063  6585 raft_consensus.cc:2410] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260620 13:58:04.149086  6024 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260620 13:58:04.150853  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:04.151153  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:04.151875  5951 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:04.155946  6029 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 19. Current term is 20. Ops: []
I20260620 13:58:04.158164 11406 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:04.158915 11406 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.159716  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:04.160573  5956 raft_consensus.cc:2393] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:04.137503 11210 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.161458  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:04.161859 11406 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.161993  5956 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:04.163187  5955 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:04.164177  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:04.164707  5955 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:04.168792 11311 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.169921  6028 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260620 13:58:04.170378  6028 pending_rounds.cc:85] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 8
I20260620 13:58:04.170703  6028 pending_rounds.cc:107] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260620 13:58:04.170939  6028 raft_consensus.cc:2889] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:04.162038  6033 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:04.138468 11471 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:04.182619  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 51169.2us
W20260620 13:58:04.184767  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.179899 11404 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:04.189658  5958 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: []
I20260620 13:58:04.190362  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2390) took 1453 ms. Trace:
I20260620 13:58:04.190656  5958 rpcz_store.cc:276] 0620 13:58:02.736727 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:04.163948 (+1427221us) service_pool.cc:224] Handling call
0620 13:58:04.182386 (+ 18438us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:58:04.189424 (+  7038us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:04.190094 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.190287 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18154752}
I20260620 13:58:04.191900  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:04.192591  5958 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:58:04.198956  6026 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260620 13:58:04.201659  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2384) took 1791 ms. Trace:
W20260620 13:58:04.202376 11497 log.cc:927] Time spent T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260620 13:58:04.202144  5952 rpcz_store.cc:276] 0620 13:58:02.409812 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:03.594743 (+1184931us) service_pool.cc:224] Handling call
0620 13:58:03.612292 (+ 17549us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:03.613133 (+   841us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:58:03.613173 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:03.614977 (+  1804us) log.cc:844] Serialized 564 byte log entry
0620 13:58:03.721202 (+106225us) raft_consensus.cc:1645] Marking committed up to 13
0620 13:58:03.721261 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.721349 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:04.201424 (+480075us) raft_consensus.cc:1685] finished
0620 13:58:04.201443 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:04.201584 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":32481,"threads_started":1,"wal-append.queue_time_us":330011}
I20260620 13:58:04.204433  5952 raft_consensus.cc:1275] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260620 13:58:04.127653 11414 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260620 13:58:04.194940  5958 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260620 13:58:04.214372  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.169497 11419 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.220281  5952 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 14. Current term is 15. Ops: []
W20260620 13:58:04.214545  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 67195.6us
I20260620 13:58:04.222434  5955 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
W20260620 13:58:04.235062  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.233703  6551 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:04.150767 11488 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260620 13:58:04.246699  5956 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:58:04.247427 11300 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:04.247212 11278 consensus_queue.cc:237] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.248013 11300 raft_consensus.cc:697] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:04.248782 11257 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:04.248993 11300 consensus_queue.cc:237] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.148136 11422 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.257233 11422 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.259796  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.260053  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.260488 11487 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.258198  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:04.261904  6033 raft_consensus.cc:2410] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260620 13:58:04.261111  5777 catalog_manager.cc:5696] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 10 to 11, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 11 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:04.262742  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.263490  6033 raft_consensus.cc:2368] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:58:04.261261  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:04.264904  6024 raft_consensus.cc:2376] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13. Re-sending same reply.
I20260620 13:58:04.270480  5997 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:04.279438 11293 consensus_queue.cc:1059] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260620 13:58:04.280522  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.278972  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:04.281929  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 59528.1us
I20260620 13:58:04.280782  6551 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:04.261330  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.280532 11293 raft_consensus.cc:3055] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:04.287775 11293 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:58:04.292079  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 174541us
I20260620 13:58:04.295316 11293 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.296729 11293 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:04.297068 11304 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:04.297524 11304 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:04.297900 11304 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:04.303027 11221 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.305357 11221 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.306499  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:04.312497 11501 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260620 13:58:04.320257  5777 catalog_manager.cc:5696] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 8 to 9, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 9 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:04.326277  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:04.335139  6028 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 17: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:04.327499  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2377) took 1919 ms. Trace:
I20260620 13:58:04.291471  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.342784  5951 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:58:04.364289  5950 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:58:04.366480  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.367316  5955 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: []
I20260620 13:58:04.290935 11257 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:58:04.368815  6551 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:04.386482  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:58:04.404305  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 56740.6us
I20260620 13:58:04.336063  5953 rpcz_store.cc:276] 0620 13:58:02.407766 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.958713 (+550947us) service_pool.cc:224] Handling call
0620 13:58:02.958989 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:02.959210 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:58:03.453813 (+494603us) log.cc:844] Serialized 14 byte log entry
0620 13:58:04.273825 (+820012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:04.277958 (+  4133us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:58:04.287123 (+  9165us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.327119 (+ 39996us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:04.327305 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185303,"prepare.queue_time_us":504185,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":1648,"raft.queue_time_us":207544,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":148,"thread_start_us":522406,"threads_started":3,"wal-append.queue_time_us":233627}
W20260620 13:58:04.414723  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 123352us
I20260620 13:58:04.292814 11471 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:04.429966  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 56606.2us
I20260620 13:58:04.434921  5951 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:58:04.435632  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.406069 11499 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:04.408777 11404 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:04.409636 11380 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:58:04.412038 11257 raft_consensus.cc:697] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:58:04.437321  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 340184us
I20260620 13:58:04.441229  5997 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:04.441494  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2378) took 2027 ms. Trace:
I20260620 13:58:04.449743  5957 rpcz_store.cc:276] 0620 13:58:02.408025 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.965496 (+557471us) service_pool.cc:224] Handling call
0620 13:58:02.966178 (+   682us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:02.966694 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 9
0620 13:58:03.504189 (+537495us) log.cc:844] Serialized 14 byte log entry
0620 13:58:04.375421 (+871232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:04.385303 (+  9882us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:58:04.408278 (+ 22975us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.430030 (+ 21752us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:04.435318 (+  5288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":536719,"prepare.queue_time_us":521883,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":97984,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":630534,"threads_started":3,"wal-append.queue_time_us":235640}
W20260620 13:58:04.098711  5778 rpcz_store.cc:269] 0620 13:57:51.620359 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:51.620787 (+   428us) service_pool.cc:224] Handling call
0620 13:58:04.054699 (+12433912us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:57:58.145282 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:57:58.292840 (+147558us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:57:58.297762 (+  4922us) write_op.cc:435] Acquired schema lock
0620 13:57:58.320261 (+ 22499us) tablet.cc:662] Decoding operations
0620 13:57:58.369759 (+ 49498us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:57:58.369848 (+    89us) write_op.cc:641] Partition lock acquired for write op
0620 13:57:58.369873 (+    25us) tablet.cc:685] Acquiring locks for 18 operations
0620 13:57:58.870219 (+500346us) tablet.cc:701] Row locks acquired
0620 13:57:58.870243 (+    24us) write_op.cc:260] PREPARE: finished
0620 13:57:58.884094 (+ 13851us) write_op.cc:270] Start()
0620 13:57:58.892458 (+  8364us) write_op.cc:276] Timestamp: P: 1781963878876575 usec, L: 0
0620 13:57:58.897107 (+  4649us) op_driver.cc:348] REPLICATION: starting
0620 13:57:59.051466 (+154359us) log.cc:844] Serialized 7077 byte log entry
0620 13:58:00.350128 (+1298662us) op_driver.cc:464] REPLICATION: finished
0620 13:58:00.371879 (+ 21751us) write_op.cc:301] APPLY: starting
0620 13:58:00.371964 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:01.304369 (+932405us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:01.304471 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:01.318826 (+ 14355us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:01.319171 (+   345us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0620 13:58:01.319218 (+    47us) write_op.cc:312] APPLY: finished
0620 13:58:01.320799 (+  1581us) log.cc:844] Serialized 164 byte log entry
0620 13:58:01.333715 (+ 12916us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:01.333887 (+   172us) write_op.cc:454] Released schema lock
0620 13:58:01.333945 (+    58us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:01.358469 (+ 24524us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:01.358502 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":94753,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":21466,"apply.run_cpu_time_us":32253,"apply.run_wall_time_us":962409,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79439,"num_ops":18,"prepare.queue_time_us":242485,"prepare.run_cpu_time_us":81483,"prepare.run_wall_time_us":1298590,"raft.queue_time_us":443295,"raft.run_cpu_time_us":5095,"raft.run_wall_time_us":38539,"replication_time_us":1443089,"thread_start_us":781234,"threads_started":5,"wal-append.queue_time_us":498454,"wal-append.run_cpu_time_us":35465,"wal-append.run_wall_time_us":2575071}]]}
W20260620 13:58:04.468619  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.471557  6031 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260620 13:58:04.471971  6031 pending_rounds.cc:85] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 11
I20260620 13:58:04.472199  6031 pending_rounds.cc:107] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260620 13:58:04.472442  6031 raft_consensus.cc:2889] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:58:04.474586  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.475610  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.479936  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.481396  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:04.478341  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 44880.5us
I20260620 13:58:04.439183 11408 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:04.474200 11422 consensus_queue.cc:1059] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260620 13:58:04.491719  5953 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260620 13:58:04.485817 11221 consensus_queue.cc:1059] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260620 13:58:04.481228 11416 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:04.495009 11450 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:58:04.495589 11450 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:04.495826 11221 raft_consensus.cc:3055] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:58:04.495438 11416 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:58:04.496022 11450 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:04.496243 11221 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:04.497305 11221 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.498237 11416 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.498661 11221 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:04.483182  5777 catalog_manager.cc:5696] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 8 to 10, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 10 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:04.477258 11380 raft_consensus.cc:697] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:04.477532 11404 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:04.486742  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 203433us
I20260620 13:58:04.480625 11435 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:04.513098  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 149041us
I20260620 13:58:04.513084 11487 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:04.489822 11507 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:04.525506  6032 raft_consensus.cc:2393] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:58:04.525895  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 77975.7us
I20260620 13:58:04.514956 11416 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260620 13:58:04.503366 11304 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.523207 11293 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260620 13:58:04.534345  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.529028 11142 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.540683  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2381) took 2066 ms. Trace:
I20260620 13:58:04.513521 11408 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.546319 11414 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:04.542894 11419 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:04.523090 11487 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.554854 11499 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:04.555547 11505 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:04.543545  5954 rpcz_store.cc:276] 0620 13:58:02.408786 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.976894 (+568108us) service_pool.cc:224] Handling call
0620 13:58:02.992978 (+ 16084us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:02.993443 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 12
0620 13:58:03.448235 (+454792us) log.cc:844] Serialized 14 byte log entry
0620 13:58:03.772722 (+324487us) log.cc:844] Serialized 14 byte log entry
0620 13:58:03.876820 (+104098us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b4800002dd8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe47261a1 00007f0fe471d237 00007f0fe471d0ca 00007f0fe481496f 00007f0fe4814637 00007f0fe4828c5c 00007f0fe4828c08 00007f0fe4828b88 00007f0fe4828b43 00007f0fe4827dec 00007f0fe3754f76
0620 13:58:04.369468 (+492648us) log.cc:844] Serialized 14 byte log entry
0620 13:58:04.403628 (+ 34160us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:04.440930 (+ 37302us) log.cc:844] Serialized 26 byte log entry
0620 13:58:04.441079 (+   149us) raft_consensus.cc:1645] Marking committed up to 12
0620 13:58:04.441113 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.441326 (+   213us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:04.468334 (+ 27008us) raft_consensus.cc:1685] finished
0620 13:58:04.468363 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:04.475325 (+  6962us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":687221,"prepare.queue_time_us":545932,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":3186,"raft.queue_time_us":257938,"raft.run_cpu_time_us":4907,"raft.run_wall_time_us":150602,"spinlock_wait_cycles":201735552,"thread_start_us":614358,"threads_started":4,"wal-append.queue_time_us":207757}
I20260620 13:58:04.556701 11142 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.556257 11380 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.546550 11488 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:04.568733 11414 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.526332 11507 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:04.585915  6552 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:04.524291 11257 consensus_queue.cc:237] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.601851  6552 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:04.602236  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.609474  5951 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
W20260620 13:58:04.615265  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.622262  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.630903  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.634523  6551 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:04.635741  5998 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:58:04.584980 11419 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.619220 10831 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260620 13:58:04.655853  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.662436  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.662949  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 88463.3us
I20260620 13:58:04.640869 11471 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:04.664757  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 223609us
I20260620 13:58:04.639734 11506 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:04.659399 11437 consensus_meta.cc:287] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.598s	user 0.003s	sys 0.010s
I20260620 13:58:04.628225 11505 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.661352 11278 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election won for term 15
W20260620 13:58:04.683866  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 154307us
W20260620 13:58:04.682739  6552 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 72 similar messages]
W20260620 13:58:04.699182  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.687593 11514 log.cc:927] Time spent T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260620 13:58:04.665942 11439 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.682646 10831 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:04.708580 10831 raft_consensus.cc:697] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:04.709538 11471 consensus_queue.cc:1048] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260620 13:58:04.710795  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.707978  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 117620us
I20260620 13:58:04.712193 11487 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.710702 11507 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.706830 11450 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.713730  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2594) took 1043 ms. Trace:
W20260620 13:58:04.731880 11516 log.cc:927] Time spent T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260620 13:58:04.732635 11450 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.702817 11404 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.736603 11410 raft_consensus.cc:3055] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:58:04.737323 11410 raft_consensus.cc:740] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:04.723713 11419 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:04.739214  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51741.6us
I20260620 13:58:04.739637 11422 consensus_queue.cc:1059] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260620 13:58:04.740978  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.741981 11304 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:04.744202 11408 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.744673  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.748660 11450 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:04.680054 11437 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.751379  5998 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.751777  6030 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 16: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:04.752691 11439 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:04.753539 11439 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260620 13:58:04.700487 11278 raft_consensus.cc:697] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:58:04.755299  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.755182 11278 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.702135 11435 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:04.723596  5848 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.770s (SENT)
I20260620 13:58:04.764547  5848 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.725684  5959 rpcz_store.cc:276] 0620 13:58:03.670106 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:04.177560 (+507454us) service_pool.cc:224] Handling call
0620 13:58:04.185416 (+  7856us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:04.185986 (+   570us) raft_consensus.cc:1534] Early marking committed up to index 7
0620 13:58:04.186390 (+   404us) log.cc:844] Serialized 14 byte log entry
0620 13:58:04.525010 (+338620us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:04.537281 (+ 12271us) log.cc:844] Serialized 26 byte log entry
0620 13:58:04.537428 (+   147us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:58:04.537632 (+   204us) log.cc:844] Serialized 14 byte log entry
0620 13:58:04.540981 (+  3349us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.541058 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:04.713477 (+172419us) raft_consensus.cc:1685] finished
0620 13:58:04.713506 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:04.713666 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25787,"prepare.queue_time_us":20092,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2496,"raft.queue_time_us":33324,"raft.run_cpu_time_us":613,"raft.run_wall_time_us":39293,"spinlock_wait_cycles":3043200,"thread_start_us":325408,"threads_started":1,"wal-append.queue_time_us":461950}
I20260620 13:58:04.770076  6027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1209) took 1318 ms. Trace:
I20260620 13:58:04.770612  6027 rpcz_store.cc:276] 0620 13:58:03.459290 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:04.100186 (+640896us) service_pool.cc:224] Handling call
0620 13:58:04.162203 (+ 62017us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:04.162500 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 10
0620 13:58:04.503219 (+340719us) log.cc:844] Serialized 14 byte log entry
0620 13:58:04.768295 (+265076us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:04.768355 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:58:04.769788 (+  1433us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.769875 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:04.770007 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":582208,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":1899,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":580858,"threads_started":2}
W20260620 13:58:04.774148  5924 leader_election.cc:336] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:04.775655  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:04.775841  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 78291.1us
I20260620 13:58:04.776690 11524 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:58:04.777424  5848 leader_election.cc:336] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.129s (SENT)
I20260620 13:58:04.777837 11524 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:04.777882  5848 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:04.778429 11524 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:04.778111 11523 consensus_queue.cc:1059] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260620 13:58:04.778803 11524 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Advancing to term 18
W20260620 13:58:04.780829  6552 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:04.783721 11437 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:04.786288 11414 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.777601  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:04.774972  5924 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:04.679329 11506 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.794155 11404 raft_consensus.cc:3055] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:58:04.790721 11487 consensus_queue.cc:1059] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260620 13:58:04.795887 11408 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:04.800869 11523 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:04.709568 10831 consensus_queue.cc:237] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.802966 11404 raft_consensus.cc:740] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:58:04.803779  5848 leader_election.cc:336] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.206s (SENT)
I20260620 13:58:04.806362  5848 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.818039  6030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2914) took 1148 ms. Trace:
I20260620 13:58:04.814607 11524 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.818892  6030 rpcz_store.cc:276] 0620 13:58:03.669329 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:03.757640 (+ 88311us) service_pool.cc:224] Handling call
0620 13:58:04.817747 (+1060107us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54000e56d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:04.817954 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708439936}
I20260620 13:58:04.820609 11524 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.827462  6029 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 15. Current term is 16. Ops: []
I20260620 13:58:04.804473 11505 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.831240  6025 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 16. Ops: []
I20260620 13:58:04.832365  6024 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 13. Current term is 14. Ops: []
I20260620 13:58:04.833330  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2908) took 1298 ms. Trace:
I20260620 13:58:04.833745  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.833985  6025 rpcz_store.cc:276] 0620 13:58:03.534829 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:04.130492 (+595663us) service_pool.cc:224] Handling call
0620 13:58:04.830937 (+700445us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:04.832129 (+  1192us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.833072 (+   943us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54000e56d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:04.833246 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568657280}
W20260620 13:58:04.834713  6552 connection.cc:256] RPC call timeout handler was delayed by -1.1188874409999698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260620 13:58:04.835384  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:04.837735 11521 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260620 13:58:04.840596  5998 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:04.841257 11437 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260620 13:58:04.805297 11523 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:04.843606  6032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2911) took 1218 ms. Trace:
I20260620 13:58:04.868522  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.868759  6032 rpcz_store.cc:276] 0620 13:58:03.651560 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:04.010839 (+359279us) service_pool.cc:224] Handling call
0620 13:58:04.843390 (+832551us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54000e74d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:04.843525 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1118138112}
W20260620 13:58:04.844604  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 69671.9us
W20260620 13:58:04.849586  6552 connection.cc:256] RPC call timeout handler was delayed by -1.0972874410000486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
W20260620 13:58:04.869921  5924 leader_election.cc:336] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:04.870021  6552 connection.cc:256] RPC call timeout handler was delayed by -1.0837874410000268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
I20260620 13:58:04.845774 11404 consensus_queue.cc:260] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.845726  6026 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: []
I20260620 13:58:04.844162 11506 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.870393  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:04.870405  6552 connection.cc:256] RPC call timeout handler was delayed by -1.0756874410000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260620 13:58:04.882486  6552 connection.cc:256] RPC call timeout handler was delayed by -1.0675874410000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260620 13:58:04.874433  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:04.874672  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:04.885771  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.886865  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:04.887681  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 256886us
W20260620 13:58:04.894937  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.871083 11523 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
W20260620 13:58:04.914783  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.871575 11416 raft_consensus.cc:3055] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:58:04.917868  5959 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:58:04.874584 11439 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:04.883823 11142 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:04.919148  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:04.927528  6580 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:58:04.935261  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:04.938225  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 135920us
I20260620 13:58:04.937922  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:04.935866  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.951248 11520 raft_consensus.cc:2764] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260620 13:58:04.951594  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:04.952602  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:04.953445  6587 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:58:04.955209  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:04.963532  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.949592  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.965839 11538 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:04.966418 11538 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:04.966807 11538 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:04.967525  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:04.972669  5849 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:04.976691  6583 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:04.978672  6585 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260620 13:58:04.926177 11300 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:04.983533 11507 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:04.984495  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:04.984632  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 114715us
W20260620 13:58:04.997660  5924 leader_election.cc:336] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:04.926359 11439 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:04.917642 11416 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:04.937024 11506 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:04.985872 11404 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:04.935423 11410 consensus_queue.cc:260] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:04.990661 11518 log.cc:927] Time spent T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.276s	user 0.004s	sys 0.000s
I20260620 13:58:04.991425 11142 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:58:05.002147  5924 leader_election.cc:336] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:05.054926  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 55455.8us
I20260620 13:58:05.001750  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.013163  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:05.013823  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:05.040982  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 97677.6us
I20260620 13:58:04.997653 11507 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:05.007975 11439 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:05.082486  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:05.083129  6585 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 16
I20260620 13:58:05.063866 11414 consensus_queue.cc:1059] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260620 13:58:05.055902  5924 leader_election.cc:336] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:05.088455  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:05.014842  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 311646us
W20260620 13:58:05.093767  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.070485  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:05.071182 11419 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:05.098027 11419 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.073565  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:05.073849 11525 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:05.105034 11525 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.035808 11487 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:05.012993 11300 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.075533 11416 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.078296 11538 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.108340  6582 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260620 13:58:05.080324 11257 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:05.080976 11499 consensus_queue.cc:1059] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:58:05.109051 11300 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:05.109591 11499 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:05.110081 11499 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.112390  6552 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.114521 11221 consensus_queue.cc:1059] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:05.115955 11142 raft_consensus.cc:3055] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:58:05.116387 11142 raft_consensus.cc:740] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:05.117169 11142 consensus_queue.cc:260] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:05.115942 11419 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:05.097131 11380 consensus_queue.cc:1059] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:58:05.112488 11499 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:05.081809  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1261) took 1224 ms. Trace:
I20260620 13:58:05.157461  5958 rpcz_store.cc:276] 0620 13:58:03.857381 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:04.233591 (+376210us) service_pool.cc:224] Handling call
0620 13:58:04.233981 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:04.272914 (+ 38933us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:58:04.273149 (+   235us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:04.330346 (+ 57197us) log.cc:844] Serialized 26 byte log entry
0620 13:58:04.520600 (+190254us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:58:04.520659 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.520747 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:04.871687 (+350940us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:58:05.081505 (+209818us) raft_consensus.cc:1685] finished
0620 13:58:05.081526 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:05.081740 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3100,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":130,"spinlock_wait_cycles":22460288,"thread_start_us":189763,"threads_started":1,"wal-append.queue_time_us":334183}
I20260620 13:58:05.036090 11488 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.107s
I20260620 13:58:05.096005  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:05.137948  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.164155  6587 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:58:05.167080  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:05.163025  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 98101.4us
I20260620 13:58:05.168223  5997 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:05.091682 11507 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:05.172614  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:05.173525 11538 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:05.176069  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.051156 11524 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.123s
I20260620 13:58:05.134368 11142 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:05.145744 11410 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:05.180799  5849 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:05.179773  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 65887.4us
I20260620 13:58:05.185853  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:05.186424  6032 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:05.183354  6582 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:58:05.169265 11416 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:05.186889  6585 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:58:05.210285  6583 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260620 13:58:05.211246  6552 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.212591  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.212837  6552 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:58:05.215222  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 45318.4us
I20260620 13:58:05.188457  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:05.159530 11300 consensus_queue.cc:1059] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260620 13:58:05.223790  6027 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:05.182621 11278 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:58:05.167044 11523 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.254175  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.206853 11380 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260620 13:58:05.252435  5848 leader_election.cc:336] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.671s (SENT)
I20260620 13:58:05.169730 11450 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.057s
I20260620 13:58:05.184696 11525 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:05.269879 11531 log.cc:927] Time spent T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260620 13:58:05.274685  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:05.264101  5848 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.284837  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:05.286324  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.286952  6582 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:58:05.288864 11546 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:05.289340 11546 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:05.290095 11546 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
W20260620 13:58:05.296140  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 83456us
I20260620 13:58:05.297812  5952 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: []
I20260620 13:58:05.298131  6027 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
I20260620 13:58:05.255285 11257 raft_consensus.cc:3055] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:05.303442  5955 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:05.327304 11506 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:05.328338 11506 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:05.304376  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 64442.4us
I20260620 13:58:05.302835  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:05.311075  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:05.260151 11278 raft_consensus.cc:697] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:05.327734 11257 raft_consensus.cc:740] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:05.333671 11525 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:58:05.334523 11525 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:05.309165  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:05.332475  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.334610 11257 consensus_queue.cc:260] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.345573  6032 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 18.
I20260620 13:58:05.347405  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:05.341216  5955 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:58:05.335424 11525 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:58:05.349819  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.352818  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:05.354121  5955 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:05.356398  6585 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: []
I20260620 13:58:05.343058 11543 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:05.367890  5955 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:05.344187 11450 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:05.345139 11300 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:05.374188  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.379560  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:58:05.381474  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 72425.6us
I20260620 13:58:05.354347 11541 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:05.388912  6578 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260620 13:58:05.389106  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.389673  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.390621  6587 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:05.392480  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.405254  6583 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:05.392782  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:05.393723 11380 raft_consensus.cc:3055] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:58:05.394449 11534 raft_consensus.cc:3055] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:58:05.371861 11548 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:58:05.399235  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:58:05.432603  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 78031.8us
I20260620 13:58:05.371049 11543 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:05.402367 11487 raft_consensus.cc:3055] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Stepping down as leader of term 15
I20260620 13:58:05.374269 11419 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:05.445951  6552 leader_election.cc:400] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 15. Current term is 16.
I20260620 13:58:05.446251  5952 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:05.411525 11526 log.cc:927] Time spent T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260620 13:58:05.402913 11300 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.424216 11523 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:05.450794 11300 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:05.398373  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.333760 11278 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.446316  6552 leader_election.cc:403] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:58:05.431475 11534 raft_consensus.cc:740] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:05.452231 11419 consensus_queue.cc:1059] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:05.452865  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.380939 11450 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.418448  6582 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:58:05.468771  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:05.457312  5952 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
W20260620 13:58:05.459034  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:05.465261  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.433523 11257 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:05.408483 11380 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:05.443655 11487 raft_consensus.cc:740] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:05.474406  5955 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 17.
I20260620 13:58:05.443934 11543 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:05.479976  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:05.483568  6582 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:05.466504 10831 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:58:05.494076  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 48301.4us
W20260620 13:58:05.503618  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.504742  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:05.510174  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 113012us
I20260620 13:58:05.508340 11419 raft_consensus.cc:3055] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:05.485154 11506 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:05.554200  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.509861 11541 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:58:05.561153  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 108337us
I20260620 13:58:05.559552  5997 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:58:05.560057  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 78148.8us
I20260620 13:58:05.562865  5924 leader_election.cc:400] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:58:05.563596  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:05.551703 11419 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:58:05.578609  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.503623 10831 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.539022 11507 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:05.583806  6582 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 18.
I20260620 13:58:05.545964 11534 consensus_queue.cc:260] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.601713  5955 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260620 13:58:05.602860  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.605737 11419 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.607205 11419 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:05.607896 11450 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:05.611413  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:05.621395  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 58709.7us
I20260620 13:58:05.568557 11487 consensus_queue.cc:260] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:05.629520 11562 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260620 13:58:05.629720 11557 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:58:05.629971 11487 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:05.629570 11553 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 15. Current term is 16.
I20260620 13:58:05.632898 11556 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:58:05.633558 11556 raft_consensus.cc:697] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:58:05.634740  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 96640.9us
I20260620 13:58:05.635834 11534 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:05.637383  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.566680 11439 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.568723 11541 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:05.643262 11541 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:05.583467 11380 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.646354 11546 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.647848  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:05.649864 11525 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.650274  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:05.651237  6579 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: []
I20260620 13:58:05.651183 11499 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:58:05.652453 11499 consensus_queue.cc:1059] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:58:05.653654 11499 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:58:05.654897 11416 raft_consensus.cc:3055] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:58:05.655284 11416 raft_consensus.cc:740] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:05.656219 11416 consensus_queue.cc:260] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:05.657554 11416 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:05.659669 11499 raft_consensus.cc:697] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:05.664690  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:05.683233  6032 raft_consensus.cc:1240] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 15. Current term is 16. Ops: []
W20260620 13:58:05.682842  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 60552us
I20260620 13:58:05.690786  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.693089  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.600672 11221 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:05.689149 11142 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Leader election won for term 18
I20260620 13:58:05.701961 11557 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260620 13:58:05.712363  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.634491 11556 consensus_queue.cc:237] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:05.738560  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 45547.9us
W20260620 13:58:05.740276  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 180662us
I20260620 13:58:05.707479 11439 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:05.741055  5997 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:05.708871 11553 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:05.709919 11507 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:05.737363 10831 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:05.820320  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 79352.8us
I20260620 13:58:05.708334 11293 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
I20260620 13:58:05.825397  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:05.818023  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:05.826674  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:05.826670  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.828977  6032 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:05.829180  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:05.740644 11142 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 18 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:05.739091 11221 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:05.828377  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:05.840417  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.872511 11557 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:58:05.869458  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:05.871093  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:05.872337  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 45629.6us
W20260620 13:58:05.875756 11561 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260620 13:58:05.874804 11564 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:58:05.892024  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:05.913372  6032 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:05.830212  6584 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 16: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:05.864953 11439 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:05.865893  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:05.910948  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.918967 11142 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.915575 11541 consensus_queue.cc:1059] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260620 13:58:05.915904  6026 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 16: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:05.741477 11499 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:05.925444  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 123466us
I20260620 13:58:05.907862 11221 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:05.930708  6032 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:05.930634  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:05.876353 11523 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
W20260620 13:58:05.933257  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.833818 11553 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.916950 11525 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:05.940225  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:05.952222  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 86517.9us
W20260620 13:58:05.955762 11571 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260620 13:58:05.931586 11507 consensus_queue.cc:1059] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260620 13:58:05.959359 11543 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.962989 11543 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:05.963979 11543 raft_consensus.cc:3055] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Stepping down as leader of term 15
I20260620 13:58:05.965446 11543 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:05.966784 11543 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.969254 11543 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:05.971683 11565 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:58:05.973977  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.974715  6584 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:58:05.975469  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:05.948942 11546 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:05.979224 11557 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260620 13:58:05.985738  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 348422us
I20260620 13:58:05.980782 11553 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:05.986621  6552 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.980988 11543 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:05.987421 11543 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.990137 11380 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:58:05.991452  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 60902.5us
I20260620 13:58:06.015875  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:05.993000 11574 log.cc:927] Time spent T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.163s	user 0.003s	sys 0.000s
I20260620 13:58:05.958962  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:06.000633  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:58:06.001264  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 91341.4us
I20260620 13:58:06.001567  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.001679 11439 raft_consensus.cc:697] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:58:06.001930 11257 consensus_meta.cc:287] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.002s
W20260620 13:58:06.003517  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 79471.2us
W20260620 13:58:06.003892  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.005749 11487 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:58:06.021432  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:06.023470  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.034345  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:06.020366 11548 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:58:06.027616  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 68751.9us
I20260620 13:58:06.027946  5952 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:06.028395 11435 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:58:06.028419  5997 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:06.035193  6582 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:58:06.044122  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.046533  6582 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
W20260620 13:58:06.048843  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.048054 11435 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:06.019670 11564 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:06.053757  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:06.054622 11439 consensus_queue.cc:237] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:06.055279 11278 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:58:06.055545 11585 consensus_queue.cc:1059] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:58:06.048676 11487 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.083985 11487 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.086203  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:06.051008  5849 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:06.087982  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 101439us
I20260620 13:58:06.089264  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:06.072155  5952 raft_consensus.cc:2410] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260620 13:58:06.075253  5956 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: []
I20260620 13:58:06.079659  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:06.091027  5957 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:06.081314 11585 raft_consensus.cc:3055] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:58:06.099195  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.037387 11553 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.102435  5849 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:06.099844  5959 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:58:06.115932  5955 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 15. Current term is 16. Ops: []
I20260620 13:58:06.067447 11435 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:58:06.094904 11571 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260620 13:58:06.114113  5998 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:58:06.070906 11419 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:06.129839  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 43745.3us
I20260620 13:58:06.093881 11278 raft_consensus.cc:697] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:06.129086 11542 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:58:06.098646 11487 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:58:06.096861 11585 raft_consensus.cc:740] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:06.115643 11557 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:06.105997 11404 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260620 13:58:06.133420  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:06.187426  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:06.195580  6579 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
W20260620 13:58:06.161983  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.196703  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:06.217007  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 83666.3us
I20260620 13:58:06.192595 11557 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:06.219816 11557 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:06.223505 11437 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:06.223994 11437 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:06.224874 11437 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:06.225291 11563 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:58:06.225785 11563 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:06.226214 11563 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:06.224884  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:06.128525 11553 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.241915  5957 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:58:06.129381 11471 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
W20260620 13:58:06.261718  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 133710us
I20260620 13:58:06.262668  5997 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:58:06.278470  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 164447us
I20260620 13:58:06.264176 11419 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:06.322252  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 59664.7us
W20260620 13:58:06.291095 11534 consensus_meta.cc:287] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.002s
I20260620 13:58:06.280866 11507 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:06.329257  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.323587 11257 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.331910  6552 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:58:06.337667  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 112910us
I20260620 13:58:06.300393 11543 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:06.347028  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 66940.7us
W20260620 13:58:06.348719  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:06.355489  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:06.344761  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 128456us
W20260620 13:58:06.377152  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.332474 11257 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.378661  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:06.383666  6027 raft_consensus.cc:2410] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260620 13:58:06.379024  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:06.332878 11542 raft_consensus.cc:697] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 16 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:06.377075  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:06.404585  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 77569.7us
I20260620 13:58:06.337327 11507 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.408564  6579 raft_consensus.cc:2410] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260620 13:58:06.380304 11554 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:58:06.298375 11585 consensus_queue.cc:260] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.416224  5849 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:06.417989  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:06.419601  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.328650 11278 consensus_queue.cc:237] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:06.422104  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:06.443706 11410 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:58:06.444590 11410 raft_consensus.cc:697] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:06.445858 11410 consensus_queue.cc:237] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:06.450750  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:06.480278  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 64060.5us
W20260620 13:58:06.485688  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 99241.8us
I20260620 13:58:06.499617  6027 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260620 13:58:06.416066 11471 consensus_queue.cc:1059] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260620 13:58:06.422469 11554 raft_consensus.cc:697] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:06.413736 11437 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:06.512979  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 93533.8us
W20260620 13:58:06.508716 11221 consensus_meta.cc:287] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.002s
W20260620 13:58:06.519495  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.500329 11543 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:06.499768 11142 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:06.515125 11603 log.cc:927] Time spent T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260620 13:58:06.513756 11546 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260620 13:58:06.553043  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.557909  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:06.562438  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:06.564610 11257 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:06.565402 11437 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.532550 11471 consensus_queue.cc:1243] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260620 13:58:06.571727  6031 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 13. Current term is 14. Ops: []
I20260620 13:58:06.534986 11529 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260620 13:58:06.576879  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.577085  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:06.575053  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 201213us
I20260620 13:58:06.579916  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:06.553472 11543 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:06.508520 11557 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.584880  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:06.546765 11439 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.588452  6025 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
W20260620 13:58:06.589468  5924 connection.cc:256] RPC call timeout handler was delayed by -1.4108477449999555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260620 13:58:06.592136  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0121477449999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
I20260620 13:58:06.594069  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:06.595996  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.596280  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.598167  5953 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:06.594022  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:06.601859  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.581707 11543 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:06.551400 11614 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:06.521903 11563 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.576864 11529 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:06.537771 11221 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.607656  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.635291  5956 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:06.609784  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:58:06.592923 11556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.009s	sys 0.024s
I20260620 13:58:06.635769  5959 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:06.553900 11142 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.649119  5953 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260620 13:58:06.534523 11542 consensus_queue.cc:237] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:06.572718 11559 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.263s
I20260620 13:58:06.662325 11563 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:06.636124 11529 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:06.636992 11619 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.668658 11619 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.610641 11601 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.671931 11601 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.675598  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:06.644642 11556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.009s	sys 0.024s
I20260620 13:58:06.590881 11257 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
W20260620 13:58:06.672969 11594 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.410s	user 0.003s	sys 0.001s
I20260620 13:58:06.605718 11546 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260620 13:58:06.684307  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:06.654263  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 44763.7us
I20260620 13:58:06.686892  5998 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:06.688989  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:06.603698 11439 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.693301  5953 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
W20260620 13:58:06.691921 11610 log.cc:927] Time spent T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260620 13:58:06.647166 11471 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260620 13:58:06.735693  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.694257 11507 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.737907  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.612902 11614 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.718163 11548 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260620 13:58:06.742039  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 45682.5us
W20260620 13:58:06.727516 11590 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260620 13:58:06.719267 11612 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:58:06.748488  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:06.723137 11564 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:06.742817 11629 consensus_queue.cc:1059] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:58:06.727341 11611 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:06.735827 11471 consensus_queue.cc:1243] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer b0ce39342d8c4a64904b30b98de02b9f log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260620 13:58:06.754861  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.723256 11304 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260620 13:58:06.760483  5952 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:06.653229 11554 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.774953  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.751605 11612 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:06.826910  5951 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: []
I20260620 13:58:06.760738 11602 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:06.832851  6582 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 15. Current term is 16. Ops: []
I20260620 13:58:06.833963  5954 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 14: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:06.765872 11601 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.766793 11471 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:58:06.841845  6579 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260620 13:58:06.838402 11488 raft_consensus.cc:3055] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:06.842585  5952 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:06.845099  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:06.846558  6580 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:06.828811 11612 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:06.844907 11488 raft_consensus.cc:740] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:06.766513 11221 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:06.866704  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.838701 11625 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.840665 11557 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.874280  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.876242  5954 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:58:06.857594 11599 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:06.854792 11559 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:06.897812  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.875605 11619 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.898202  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.887056 11599 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:06.908782  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.857412 11615 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.216s
W20260620 13:58:06.898097 11606 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.251s	user 0.002s	sys 0.000s
I20260620 13:58:06.885761 11142 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.897491 11621 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:06.907825 11609 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.215s	user 0.000s	sys 0.002s
I20260620 13:58:06.931911  5954 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260620 13:58:06.932260  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.901053 11614 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.901952 11599 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:06.941150  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:06.942685  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:06.944129  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.920543 11563 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.953329  5954 raft_consensus.cc:1275] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260620 13:58:06.926555 11557 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.878675 11625 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.928490 11439 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:06.949950 11617 log.cc:927] Time spent T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260620 13:58:06.929661 11624 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.890244 11488 consensus_queue.cc:260] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:06.971066  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:06.975219  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.989979 11619 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:06.990687 11619 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:06.992137  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 253027us
W20260620 13:58:06.993233  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:06.993316 11619 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:06.993813  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:06.975337 11142 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:06.976922  5848 leader_election.cc:336] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.533s (SENT)
I20260620 13:58:06.994549 11142 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.994645  5848 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:06.995082  5951 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
I20260620 13:58:06.986258  6580 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:06.909389 11559 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.003013  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:06.994689  6552 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:06.997597 11624 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.930845 11621 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.999468 11619 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:07.037776  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:07.041735  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:07.042863  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 48212us
W20260620 13:58:07.044817  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.965452 11563 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.009477  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.978212 11557 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:07.036588 11435 consensus_meta.cc:287] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.873s	user 0.008s	sys 0.005s
W20260620 13:58:07.027484 11620 log.cc:927] Time spent T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.239s	user 0.000s	sys 0.002s
I20260620 13:58:07.004774 11488 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:07.027251  5958 raft_consensus.cc:2955] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 10 to 14, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:07.066663  5955 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260620 13:58:07.023380 11221 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:07.032614 11625 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.070174  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:07.068148  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:07.038398 11142 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.047755 11615 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.074738  5951 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260620 13:58:07.036510 11559 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:07.077179  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:07.079583  5950 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:07.006340 11633 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260620 13:58:07.040215 11543 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.085466  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.086122  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:58:07.078496  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:07.091678  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.065521 11435 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.096290 11563 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:07.096808 11435 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.100273  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:07.098583  6552 leader_election.cc:336] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.090229 11142 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.080554 11221 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.104482  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.105047  5950 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:58:07.110448 11221 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:07.110606 11543 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.111790 11557 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.111896 11624 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.117570 11621 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.120438  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.121963  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.123039  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:07.123589  5955 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:07.083364 11615 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:07.123849  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2427) took 1028 ms. Trace:
I20260620 13:58:07.124306  5956 rpcz_store.cc:276] 0620 13:58:06.095574 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:06.122284 (+ 26710us) service_pool.cc:224] Handling call
0620 13:58:06.122671 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:06.635782 (+513111us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:07.123607 (+487825us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54003cfd54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:07.123786 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125967104}
W20260620 13:58:07.099529 11380 consensus_meta.cc:287] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.067s	user 0.015s	sys 0.000s
I20260620 13:58:07.125249  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:07.128058  5956 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:07.129220  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.107825 11142 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:07.131979 11615 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:07.133090 11602 raft_consensus.cc:2955] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 10 to 14, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:07.140002 11553 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:07.137892 11612 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.141566  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.142202  5953 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 17.
I20260620 13:58:07.144097 11529 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.145107 11585 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:07.146678 11553 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:07.147404  6026 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 14: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:07.147336 11553 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.143083  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:07.149050  5953 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:07.143086 11612 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:07.153673  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 58924.5us
W20260620 13:58:07.154691  6552 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.155189  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:07.156029  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:07.156925  5950 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:07.170562  5956 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:07.146297 11529 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.131939 11142 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:07.179633  4719 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:07.160624 11565 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:07.140038 11599 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.187016  5848 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.190455 11414 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:07.196192  6551 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.200649  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.200945  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.201095  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.201495  5958 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
W20260620 13:58:07.202886  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 48226.8us
I20260620 13:58:07.200208  5997 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:07.201552  5954 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
W20260620 13:58:07.204159  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:07.204645  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.206583  5953 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 18.
I20260620 13:58:07.208201  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:07.204748  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:07.209427  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:07.209316  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:07.211196  6552 leader_election.cc:336] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.211741  5848 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.212854  5848 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.212989  5955 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:07.218619  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:07.210435  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.219251  5955 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 12. Current term is 13. Ops: []
I20260620 13:58:07.220099  5956 raft_consensus.cc:1240] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 15. Current term is 16. Ops: []
I20260620 13:58:07.223503  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.197383 11414 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.203238 11554 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:07.250259 11554 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:07.250725 11554 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:07.253935 11221 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election won for term 18
I20260620 13:58:07.254500 11221 raft_consensus.cc:697] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 18 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:58:07.255261  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 44087.3us
W20260620 13:58:07.256018  6552 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:07.249181  5950 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:07.218449 11437 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:07.259492  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.231276 11488 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:07.265681  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.199690 11435 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260620 13:58:07.264648  5997 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:07.266548  5958 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:07.266387  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.274130  6579 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 20.
I20260620 13:58:07.246701 11142 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:58:07.267163  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 53119.3us
W20260620 13:58:07.277007  5848 leader_election.cc:336] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.961s (SENT)
I20260620 13:58:07.277437  5848 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.278560  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.281272  5954 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:58:07.282528  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.283381  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.231505 11529 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260620 13:58:07.256677 11414 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.272361 11437 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:07.266199 11488 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:07.284323 11588 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:07.231093 11633 consensus_queue.cc:1059] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260620 13:58:07.303522 11599 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.297598  6580 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:58:07.285430  6582 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:58:07.300103  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:07.305874  5848 leader_election.cc:336] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.038s (SENT)
I20260620 13:58:07.296445 11612 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:07.309566 11612 raft_consensus.cc:697] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:07.310556 11612 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.312506 11414 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.306450  5848 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.302661 11488 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:07.314486  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.316634 11604 raft_consensus.cc:3055] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Stepping down as leader of term 15
I20260620 13:58:07.317039 11604 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:07.317078  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:07.317250 11414 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:07.317942  6579 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 15: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:07.317066  5848 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.317966 11604 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.319458  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.319649 11414 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:07.320067 11604 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:07.320412  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.319413  5848 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.321010  6582 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 18.
I20260620 13:58:07.321413 11414 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:07.320065  6580 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
W20260620 13:58:07.325266  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:07.326166  5848 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:07.326972  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 100523us
W20260620 13:58:07.328022  5924 leader_election.cc:336] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 2.987s (SENT)
I20260620 13:58:07.300635 11437 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:07.328621  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.330511  5848 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.332638 11142 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:07.347391  5848 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.347692  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.278955 11221 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.351682 11554 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.356981  6584 raft_consensus.cc:2393] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 18: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:07.352396 11553 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:07.353957  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:07.358543  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:07.359458  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.360056  6582 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 16.
I20260620 13:58:07.360910 11554 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:07.342476 11588 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:07.343966 11564 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260620 13:58:07.378495  5924 leader_election.cc:336] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.378825  5848 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.379153  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:07.409401  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:07.410305  5924 leader_election.cc:336] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.410749  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.411623 11624 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:07.411942  5924 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.412386  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.413113 11624 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260620 13:58:07.413472  5924 leader_election.cc:336] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.413934  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.414628 11557 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:07.372360 11615 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:58:07.403440 11585 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:07.401319 11588 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:07.427909  5924 leader_election.cc:336] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.429872  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.401239 11622 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260620 13:58:07.427806  6552 leader_election.cc:336] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.407387 11414 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260620 13:58:07.438437  6552 leader_election.cc:336] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.443562 11557 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:58:07.446094  5924 leader_election.cc:336] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.446584  5924 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.452368 11613 raft_consensus.cc:3055] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:07.453070 11613 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:07.452929 11488 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.435111 11588 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.487040 11557 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:58:07.488240 11488 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.487388 11588 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.488907 11488 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.489378 11488 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:07.492411 11437 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.493059  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.496124 11627 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:07.496270  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.496670 11627 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.497525  6031 raft_consensus.cc:2410] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260620 13:58:07.498354  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:07.499115 11529 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:07.499293  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:07.499646 11529 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.502089 11529 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.454353 11613 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:07.504561  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:07.509431  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:07.494484 11437 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.515084  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.523084  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:07.526796  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 80721.7us
W20260620 13:58:07.527942  5924 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.531764  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.532899  6025 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 18: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:07.511456 11525 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.535028  6027 raft_consensus.cc:3055] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:58:07.535550  6027 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:07.536441  6027 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.537814  6027 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:07.542166  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:07.543037  6033 raft_consensus.cc:2393] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:07.543956  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:07.544835  6024 raft_consensus.cc:2410] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260620 13:58:07.545756  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.546387  6029 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:58:07.553900  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.504355 11627 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.558393  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:07.571616  6030 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:07.564322  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.572402  6582 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:07.573751  6582 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260620 13:58:07.565151  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.568600  6027 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260620 13:58:07.550501 11221 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.574980  6027 pending_rounds.cc:85] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 10
I20260620 13:58:07.575302  6027 pending_rounds.cc:107] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260620 13:58:07.576148  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.576144  6025 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:07.575534  6027 raft_consensus.cc:2889] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:58:07.578063  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:07.578147  5924 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.578634  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.583370  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.584187  6585 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:07.585606  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.586320  6585 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:07.588406  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.589136  6583 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:58:07.589443  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.589963  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:07.588478  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.555649 11488 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:07.591413  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:07.592092  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 97882.8us
I20260620 13:58:07.592317  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:07.599839  6033 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 18: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:07.592528  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.592988  6029 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260620 13:58:07.593331  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.601509  6032 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:07.601815  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:07.602968  5924 leader_election.cc:336] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.603669  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.552543 11525 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.600342  6024 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:58:07.608194  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:07.606848  6028 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:07.591825 11624 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:07.606197 11419 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:07.613121  6579 raft_consensus.cc:3055] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Stepping down as leader of term 16
I20260620 13:58:07.611246  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.614058  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2599) took 1016 ms. Trace:
W20260620 13:58:07.592816 11569 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260620 13:58:07.616284  6028 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260620 13:58:07.614439  5952 rpcz_store.cc:276] 0620 13:58:06.597380 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:06.609539 (+ 12159us) service_pool.cc:224] Handling call
0620 13:58:07.613896 (+1004357us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400262fd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:07.614004 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285377920}
I20260620 13:58:07.613662  6579 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:07.591694 11607 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:58:07.617411  5924 leader_election.cc:336] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.613323  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.618646  6025 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:07.619568  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.610534 11488 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:07.624244  6025 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
W20260620 13:58:07.624336  5998 leader_election.cc:336] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:07.625468  5998 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.626341  5998 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:07.627172 11520 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:07.625487  6025 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260620 13:58:07.630748  5998 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.631769  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:07.632397  5998 leader_election.cc:336] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.632540 11419 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:07.632886  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.633666 11520 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260620 13:58:07.635018  5998 leader_election.cc:336] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:07.637274  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:07.638695  5998 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:07.634323  5924 leader_election.cc:336] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.619565 11608 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.640712 11608 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.642627  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.615137  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.646384  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.592226 11221 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.647069  6025 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:58:07.642699  6579 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.648186  5849 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:07.644745  5998 leader_election.cc:336] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.653060  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.654441  6024 pending_rounds.cc:85] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 11
I20260620 13:58:07.654831  6024 pending_rounds.cc:107] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260620 13:58:07.655299  6024 raft_consensus.cc:2889] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:07.655447  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.657138  6579 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:07.652776  5998 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:07.653970 11488 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.006s
I20260620 13:58:07.659812  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.658619  5849 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.667874  6578 raft_consensus.cc:2410] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260620 13:58:07.668251 11605 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260620 13:58:07.671978  5924 leader_election.cc:336] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.672839  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.653023 11419 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:07.652788 11541 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:07.668586 11414 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:58:07.661978 11588 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:07.683836  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.684674  6025 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:07.685389  6584 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 17. Current term is 18. Ops: []
I20260620 13:58:07.678777 11520 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:07.686105 11557 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:07.687065 11221 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:07.687090  5998 leader_election.cc:336] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.689029  5849 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.646479 11607 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.668776 11605 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:07.686625 11557 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:07.693441  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:07.697184  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:07.701530  5849 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.709481  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:07.712442  6585 raft_consensus.cc:2368] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
I20260620 13:58:07.688062 11588 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:07.713654  6582 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260620 13:58:07.683403 11414 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:58:07.716949  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 45009.2us
I20260620 13:58:07.695779 11605 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:07.723359  5998 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:58:07.697575 11487 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.431s	user 0.012s	sys 0.047s
I20260620 13:58:07.721019  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.695057 11608 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.695719 11615 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:07.722512  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:07.723138  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:07.718012  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:07.724764  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:07.769176  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51274.7us
I20260620 13:58:07.769547  6583 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:58:07.697918 11419 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:07.699363 11523 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:07.779690 11523 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:58:07.779951 11659 log.cc:927] Time spent T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260620 13:58:07.713416 11541 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:07.727823  6581 raft_consensus.cc:2955] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 10 to 14, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:07.744903  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:07.697749 11404 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260620 13:58:07.719785 11588 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:07.719206 11414 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:07.766101  6030 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
W20260620 13:58:07.770494  5924 leader_election.cc:336] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.780294 11523 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:07.778581  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:07.808101  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.808727  6583 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 18.
I20260620 13:58:07.700171 11142 consensus_queue.cc:1059] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
W20260620 13:58:07.811373 11661 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260620 13:58:07.811633 11142 raft_consensus.cc:3055] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:07.812090 11142 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:07.812950 11607 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.813148 11142 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.814568 11142 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:07.726771  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:07.739454 11525 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:07.815896 11658 log.cc:927] Time spent T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260620 13:58:07.729733 11585 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:07.800504  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:07.753801 11487 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.514s	user 0.012s	sys 0.047s
I20260620 13:58:07.800949  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.776217  6585 raft_consensus.cc:2393] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 10: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:07.738047 11471 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:07.818146  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.824642  6579 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260620 13:58:07.825603  6579 pending_rounds.cc:85] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 10
I20260620 13:58:07.825551  5998 leader_election.cc:400] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
I20260620 13:58:07.825970  6579 pending_rounds.cc:107] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260620 13:58:07.826030  5998 leader_election.cc:403] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260620 13:58:07.826323  6579 raft_consensus.cc:2889] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:58:07.827744  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 57272.5us
W20260620 13:58:07.828750  5924 leader_election.cc:336] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.818655 11585 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:07.835186 11585 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:07.836045 11557 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:07.835230 11419 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:07.840869  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 400943us
W20260620 13:58:07.842579  6552 leader_election.cc:336] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.840392 11588 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.846108 11588 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.791121 11662 consensus_queue.cc:1059] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.079s
I20260620 13:58:07.847452 11662 raft_consensus.cc:3055] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Stepping down as leader of term 17
I20260620 13:58:07.847800 11662 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:07.848701 11662 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.849932 11662 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:07.850402  6033 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260620 13:58:07.854362  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.727823 11604 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260620 13:58:07.822144 11487 raft_consensus.cc:697] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:07.860692 11487 consensus_queue.cc:237] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.799312 11541 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:58:07.869408  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 46074.9us
I20260620 13:58:07.893096  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.895605  5956 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260620 13:58:07.870993  6552 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.871273  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:58:07.897157  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:07.884009  5953 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 13. Current term is 14. Ops: []
W20260620 13:58:07.890177  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:07.897891  6552 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.899317  6552 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:07.896333  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.897125  6586 raft_consensus.cc:3055] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Stepping down as leader of term 13
W20260620 13:58:07.907996  6552 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.904975  6586 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:07.908869  5951 raft_consensus.cc:1240] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: []
W20260620 13:58:07.908048  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 77683.6us
I20260620 13:58:07.910377  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.912395  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.914397  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:07.908725  6552 leader_election.cc:336] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.919031  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.898226 11541 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:07.918644 11611 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260620 13:58:07.921334  5954 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260620 13:58:07.923448  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:07.924227  5951 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 18: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:07.869294 11471 raft_consensus.cc:697] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:07.925383 11471 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.927163 11622 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:07.927613 11622 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:07.927992 11622 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:07.918426 11419 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:07.929199 11419 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:07.934620 11419 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:07.918581 11557 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260620 13:58:07.899567 11257 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260620 13:58:07.940577  6586 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.899434 11553 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.941679  6586 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:07.942170 11553 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.942839 11557 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:07.943290 11557 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:07.943681 11557 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:07.944599 11553 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:07.899144 11602 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
W20260620 13:58:07.947940  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 51760.1us
I20260620 13:58:07.954792  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.956315  5924 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.958385  5924 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.920178 11628 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260620 13:58:07.920372 11551 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:07.953696 11588 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.953883 11499 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:08.020254  5957 raft_consensus.cc:1275] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260620 13:58:07.953883 11304 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:07.969483 11520 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260620 13:58:08.033136 11499 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.033624 11520 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:08.034168 11520 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Advancing to term 19
W20260620 13:58:08.035493 11667 log.cc:927] Time spent T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260620 13:58:08.035706 11499 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:08.036198 11665 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260620 13:58:08.039108  5997 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.039692 11528 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:58:08.041296 11528 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260620 13:58:07.960062 11523 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.053010 11613 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:08.052834 11414 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.959482 11564 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:08.055661 11564 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:08.029516  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 68942.1us
I20260620 13:58:08.032742 11304 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:08.060063  5951 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260620 13:58:08.007838 11628 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:58:08.065454  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 107144us
W20260620 13:58:08.071301  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:08.071838 11628 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Advancing to term 21
I20260620 13:58:08.059762 11304 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:07.998706 11585 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.959270 11611 consensus_queue.cc:1059] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260620 13:58:07.977764 11541 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:08.063341 11624 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:08.074980  5848 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.085722  5848 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.076303 11414 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.031607 11588 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.080973  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.086953  5848 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.074234 11529 consensus_queue.cc:1048] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260620 13:58:08.095028  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.076603 11605 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.087965 11142 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:08.089917 11499 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:58:08.101733  5848 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.105325  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.105906  6031 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:08.106245 11541 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:08.108541 11585 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:08.110100  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:08.110564  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 194062us
W20260620 13:58:08.111186  6552 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.111557  6552 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:08.113363 11564 raft_consensus.cc:3055] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:58:08.113827 11564 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:08.116668 11588 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.102451 11142 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:08.117703 11142 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:08.120863  6552 leader_election.cc:336] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:08.122743  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:08.125191  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.125835  6033 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
W20260620 13:58:08.126509  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:08.128144  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:08.128568  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.129170  5950 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:58:08.130365  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.133930  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.135526 11541 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:58:08.135597  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:08.138471  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.139240  5952 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:08.140256  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.141599  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:08.142298  5952 raft_consensus.cc:2376] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16. Re-sending same reply.
I20260620 13:58:08.145867  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.095487 11414 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:08.151580  5924 leader_election.cc:336] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.152848  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.155629 11419 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.157227  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.103920 11499 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:08.159406 11499 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:08.159744  6033 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 13. Current term is 14. Ops: []
W20260620 13:58:08.163209  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:08.164821  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:08.170068  6033 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260620 13:58:08.146523  5848 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.152165  5924 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.171768  5848 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:08.172035  5924 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.172662  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.174342 11419 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.175192 11419 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:08.180157  4719 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:08.183569  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:08.103607 11523 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.196156  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.196640  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:08.110117 11622 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.197656  5950 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260620 13:58:08.198071  5998 leader_election.cc:336] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.151336 11380 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:58:08.203390  6586 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260620 13:58:08.203743  6586 pending_rounds.cc:85] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 10
I20260620 13:58:08.203981  6586 pending_rounds.cc:107] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260620 13:58:08.204171  6031 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:08.209944  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.200263  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.204210  6586 raft_consensus.cc:2889] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:08.216372  6580 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260620 13:58:08.186486 11404 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:58:08.221208  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:08.114827 11564 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.194586 11414 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:58:08.224970  5998 leader_election.cc:336] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.225461 11523 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:58:08.225939 11488 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:08.235898  5998 leader_election.cc:336] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.228469  5959 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: []
I20260620 13:58:08.229266  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:08.236963  5998 leader_election.cc:336] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.237285  6033 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:08.199214 11221 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:08.249341 11488 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:08.250344 11142 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:08.252804 11488 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:08.229948  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.198925 11525 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:08.238341  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.260470  6031 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:08.260661  6027 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:08.263933 11525 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.266067 11525 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:08.239303  5998 leader_election.cc:336] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.242044 11628 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.242465 11557 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.218307 11541 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260620 13:58:08.243191 11564 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:08.243321  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.290635  6028 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:58:08.243474 11523 raft_consensus.cc:697] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 16 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:08.226742 11627 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:08.227044 11507 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260620 13:58:08.246333 11622 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.270975  6027 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
I20260620 13:58:08.285866  5954 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 21 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 20. Current term is 21. Ops: []
W20260620 13:58:08.270303  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:08.312368  5998 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.289940  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:08.314441  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 116674us
I20260620 13:58:08.315239  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.293358  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.316745  6033 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
W20260620 13:58:08.290935  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 118937us
I20260620 13:58:08.293944 11523 consensus_queue.cc:237] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.295508 11520 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.296734  6031 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:08.307791 11142 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:08.317188  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:08.318996  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 119878us
W20260620 13:58:08.317828  5924 leader_election.cc:336] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.312829  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.318480  6026 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 15.
I20260620 13:58:08.320015  6552 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.324008 11605 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.331302 11553 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:58:08.332063 11557 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.285647 11611 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:58:08.348824  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.355687  6032 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 18. Current term is 19. Ops: []
W20260620 13:58:08.357383  5924 leader_election.cc:336] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.332582 11488 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:58:08.357831  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.332227 11499 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:08.361513  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:08.348047 11628 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 21 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:08.364836  5924 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:08.358321  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 44891.7us
W20260620 13:58:08.366544  5998 leader_election.cc:336] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.367421  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:08.366642  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 46715.3us
I20260620 13:58:08.365480  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:08.369850  5924 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.370428  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:08.371948  5924 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.372545  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.356863 11627 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260620 13:58:08.375491  5924 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.362593 11488 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:08.376513  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.359282 11557 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:08.377046  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:08.364369 11624 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:08.365278 11525 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260620 13:58:08.384212  6552 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:08.384713  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:08.376207 11675 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260620 13:58:08.388785 11668 log.cc:927] Time spent T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.592s	user 0.005s	sys 0.000s
I20260620 13:58:08.378149 11257 consensus_queue.cc:1059] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260620 13:58:08.379668 11488 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:08.378398 11553 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.024s
I20260620 13:58:08.381057 11628 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:08.375679 11686 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:08.361675 11687 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260620 13:58:08.399120 11437 consensus_queue.cc:1059] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260620 13:58:08.417280 11437 raft_consensus.cc:3055] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:58:08.417649 11437 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:08.399422 11633 consensus_queue.cc:1059] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260620 13:58:08.421151 11633 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 LEADER]: Stepping down as leader of term 20
I20260620 13:58:08.421725 11633 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:08.413144 11304 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.426524 11304 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.414394 11605 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:08.427600 11605 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.429643 11605 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.380745 11602 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260620 13:58:08.445780 11672 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.285s	user 0.002s	sys 0.000s
W20260620 13:58:08.385363  5998 leader_election.cc:336] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.457966  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.462845 11525 raft_consensus.cc:3055] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:58:08.463376 11525 raft_consensus.cc:740] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:08.463872  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.464190 11525 consensus_queue.cc:260] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.465503 11525 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:08.465734 11541 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:58:08.466225 11541 raft_consensus.cc:697] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:08.466619  5959 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:58:08.433339 11563 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:08.467077 11541 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.473688 11602 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:08.467278 11404 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:58:08.475311 11404 raft_consensus.cc:697] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:08.476126 11404 consensus_queue.cc:237] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:08.468045 11563 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:08.480130 11563 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:08.454954 11221 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260620 13:58:08.468811 11520 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.469996 11499 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.489527 11605 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260620 13:58:08.422703 11633 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.491391 11633 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Advancing to term 21
I20260620 13:58:08.496865  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.497540  6026 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:08.418509 11437 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.507956 11437 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:08.516762  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.458129  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:08.546698  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:08.555636  6026 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:58:08.563319  5951 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260620 13:58:08.563792  5951 pending_rounds.cc:85] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 9
I20260620 13:58:08.564183  5951 pending_rounds.cc:107] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260620 13:58:08.564589  5951 raft_consensus.cc:2889] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:58:08.573150  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:08.581509  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 196154us
W20260620 13:58:08.582617  5998 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.583245  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.592707  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.573370 11528 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:08.601209  5998 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:08.604580  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 225800us
W20260620 13:58:08.637787  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 253666us
I20260620 13:58:08.640283  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:08.641606  6552 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.643093  6552 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.646056  5848 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:08.646946  5998 leader_election.cc:336] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.599730 11523 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:08.649801  5848 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.650842  5848 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.652210  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.652884  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.651937  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.653802  6026 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:08.653908  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.654551  6027 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:08.656962  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:08.657474  5951 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:08.658257  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.654007  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:08.659459  5959 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:08.662482  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:08.664677  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:08.665367  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:08.655781  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:08.604769 11529 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:58:08.606976 11604 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:08.667789  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:08.648545 11551 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:08.669785 11696 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:58:08.648175 11687 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:08.674592 11142 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:08.616087 11556 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260620 13:58:08.675186 11487 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:08.676239 11507 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:58:08.701850 11507 consensus_queue.cc:1243] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260620 13:58:08.677451  5958 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260620 13:58:08.666608 11605 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:08.710644 11686 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:08.684021  6026 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:58:08.685359  5959 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
W20260620 13:58:08.712190 11704 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260620 13:58:08.686146  6027 raft_consensus.cc:2410] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260620 13:58:08.669140  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.643946 11221 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260620 13:58:08.694386 11687 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:08.695317 11696 raft_consensus.cc:697] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:08.692224 11604 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.692363 11551 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:08.644106 11257 consensus_queue.cc:1059] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260620 13:58:08.648056 11688 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260620 13:58:08.716095  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 352355us
I20260620 13:58:08.688685 11523 raft_consensus.cc:697] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:08.724534  6551 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:08.728502  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:08.745198  5777 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56594 (request call id 334) took 24868 ms (client timeout 15000 ms). Trace:
I20260620 13:58:08.720336 11551 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:08.720808 11622 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:08.719298 11687 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:08.744441 11703 log.cc:927] Time spent T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260620 13:58:08.757082 11604 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.760555  6031 raft_consensus.cc:2410] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260620 13:58:08.759366  5779 catalog_manager.cc:5696] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 13 to 16, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 16 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:08.761514 11563 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.744417 11523 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.746037 11221 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:08.768124 11696 consensus_queue.cc:237] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.770448  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:08.770519 11701 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260620 13:58:08.777412 11525 raft_consensus.cc:3055] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Stepping down as leader of term 10
W20260620 13:58:08.782151  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:08.732134  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.789361  6032 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 18. Current term is 19. Ops: []
I20260620 13:58:08.815994 11507 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:58:08.826818  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 160936us
I20260620 13:58:08.826653 11507 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:08.827509  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:08.828065  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:08.828537  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:08.828667 11541 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:08.828789 11507 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:08.829077  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:08.826661  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 94637.7us
I20260620 13:58:08.820319  5779 catalog_manager.cc:5696] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 6 to 11, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 11 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:08.831049 11525 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:08.815582 11221 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:08.831766 11221 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:08.832019 11525 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.832551 11687 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:08.833431 11525 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:08.836040  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:08.837487  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:08.838201  5998 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.839052 11605 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:08.839584 11605 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:08.811345 11488 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.835245 11604 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:08.844821 11604 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.841850 11605 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:08.846110  6027 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260620 13:58:08.846216 11605 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260620 13:58:08.847317  5779 catalog_manager.cc:5696] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:08.848362  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.849103  5779 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 14 to 19, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 19 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:08.852847  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.853986  6031 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:08.855899 11221 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.805614  5951 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
W20260620 13:58:08.900363  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:08.899550  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 230610us
I20260620 13:58:08.803618 11404 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:08.901413 11404 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:08.902750  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:08.806722 11257 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:08.856456 11563 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:08.810428 11564 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:58:08.856213 11551 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.846894 11604 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:08.863407  5998 leader_election.cc:336] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.864683  6033 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 21.
W20260620 13:58:08.922328  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 58993.8us
I20260620 13:58:08.922583  6583 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 13. Current term is 14. Ops: []
I20260620 13:58:08.865965  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.923460  5958 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
W20260620 13:58:08.795674  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 126641us
I20260620 13:58:08.868461  6031 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
W20260620 13:58:08.786002  5777 rpcz_store.cc:269] 0620 13:57:43.861878 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:43.862373 (+   495us) service_pool.cc:224] Handling call
0620 13:58:08.730391 (+24868018us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:58:05.088900 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:58:05.089778 (+   878us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:58:05.089848 (+    70us) write_op.cc:435] Acquired schema lock
0620 13:58:05.089884 (+    36us) tablet.cc:662] Decoding operations
0620 13:58:05.090653 (+   769us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:58:05.090782 (+   129us) write_op.cc:641] Partition lock acquired for write op
0620 13:58:05.090821 (+    39us) tablet.cc:685] Acquiring locks for 3 operations
0620 13:58:05.208749 (+117928us) tablet.cc:701] Row locks acquired
0620 13:58:05.219785 (+ 11036us) write_op.cc:260] PREPARE: finished
0620 13:58:05.246964 (+ 27179us) write_op.cc:270] Start()
0620 13:58:05.301066 (+ 54102us) write_op.cc:276] Timestamp: P: 1781963885227860 usec, L: 0
0620 13:58:05.336018 (+ 34952us) op_driver.cc:348] REPLICATION: starting
0620 13:58:05.463704 (+127686us) log.cc:844] Serialized 1308 byte log entry
0620 13:58:06.070565 (+606861us) op_driver.cc:464] REPLICATION: finished
0620 13:58:06.754691 (+684126us) write_op.cc:301] APPLY: starting
0620 13:58:06.766900 (+ 12209us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:07.030214 (+263314us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:07.030367 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:07.143166 (+112799us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:07.143449 (+   283us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0620 13:58:07.143515 (+    66us) write_op.cc:312] APPLY: finished
0620 13:58:07.143828 (+   313us) log.cc:844] Serialized 41 byte log entry
0620 13:58:07.248411 (+104583us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:07.258342 (+  9931us) write_op.cc:454] Released schema lock
0620 13:58:07.274426 (+ 16084us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:07.287922 (+ 13496us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:07.287956 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87150,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":618181,"apply.run_cpu_time_us":33632,"apply.run_wall_time_us":541377,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16679,"num_ops":3,"prepare.queue_time_us":297474,"prepare.run_cpu_time_us":11755,"prepare.run_wall_time_us":512789,"raft.queue_time_us":180876,"raft.run_cpu_time_us":44801,"raft.run_wall_time_us":589911,"replication_time_us":696806,"thread_start_us":785695,"threads_started":5,"wal-append.queue_time_us":364025,"wal-append.run_cpu_time_us":35619,"wal-append.run_wall_time_us":2270110}]]}
I20260620 13:58:08.925021  5848 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.926113  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.887900  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:08.889317  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:08.890157  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:08.928627  6585 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:08.846220 11488 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.928872  6579 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:58:08.895381  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:08.903807  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:08.930646  6580 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 17
I20260620 13:58:08.930794  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.901121  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:08.931824  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:58:08.917145  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:08.932780  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.886716  6582 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260620 13:58:08.927534  5951 raft_consensus.cc:1217] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 9.6->[12.7-16.9]   Dedup: 12.7->[14.8-16.9]
I20260620 13:58:08.928679  6586 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:08.923041  5998 leader_election.cc:336] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.872406 11605 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260620 13:58:08.850987  5779 catalog_manager.cc:5696] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
W20260620 13:58:08.934643  5998 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.933648  5951 pending_rounds.cc:85] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 7
W20260620 13:58:08.938540  5924 leader_election.cc:336] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.935873  5998 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:08.939888  5951 pending_rounds.cc:107] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260620 13:58:08.947227  5951 raft_consensus.cc:2889] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:08.945904  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:08.915911 11499 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:08.952929  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:08.947247  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.949234  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:08.949306  5848 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.953698  6583 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 14: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:08.916780 11414 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:08.951295  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 50264.6us
I20260620 13:58:08.960783  6586 raft_consensus.cc:2410] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260620 13:58:08.961845  5998 leader_election.cc:336] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:08.963443  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:08.964545  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.968216  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:08.968822  6586 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:08.970888  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.974123  5779 catalog_manager.cc:5696] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 9 to 12, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 12 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:08.953063 11708 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260620 13:58:08.946102 11686 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:08.997987  6585 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:08.935712 11564 raft_consensus.cc:697] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:08.978605  5779 catalog_manager.cc:5696] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:08.919329 11257 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:09.001261  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 44931us
I20260620 13:58:08.959931 11487 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:09.004879  6578 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260620 13:58:08.971992 11507 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:58:08.972470 11529 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260620 13:58:08.966744 11675 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:09.007072  6586 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:58:09.020236  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.976645 11707 raft_consensus.cc:2764] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260620 13:58:09.038242  6032 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 16: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:58:09.029458  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 54154.1us
W20260620 13:58:09.046154  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 120139us
I20260620 13:58:09.048002  5849 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.004241 11622 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 21 FOLLOWER]: Leader election won for term 21
I20260620 13:58:08.979329 11608 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:58:09.028322  5779 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 14 to 16, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 16 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:58:09.029460  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:09.048056  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.049336  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.965318 11499 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:09.065157  5779 catalog_manager.cc:5696] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 12 to 13, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 13 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:09.028327 11686 raft_consensus.cc:697] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:09.006951 11696 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.053s
I20260620 13:58:08.973744 11414 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.007314 11633 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260620 13:58:09.067626 11717 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260620 13:58:09.065296 11541 raft_consensus.cc:3055] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 18 LEADER]: Stepping down as leader of term 18
W20260620 13:58:09.089953  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:09.064136 11622 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 21 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:09.069216 11608 raft_consensus.cc:697] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:09.084188  5779 catalog_manager.cc:5696] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 10 to 13, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 13 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
W20260620 13:58:09.108207 11715 log.cc:927] Time spent T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
I20260620 13:58:09.115790 11564 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.125852 11221 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:09.126929 11686 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.130452 11551 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.131927 11257 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.086232 11633 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:09.132644 11633 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
W20260620 13:58:09.139053 11711 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260620 13:58:09.141273 11712 log.cc:927] Time spent T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260620 13:58:09.091434 11404 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.092291 11541 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:09.144462 11541 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.145766 11541 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:09.148433 11608 consensus_queue.cc:237] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.152074 11488 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:09.151722 11622 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.152599 11488 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:09.161314  5779 catalog_manager.cc:5696] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
W20260620 13:58:09.181183  4719 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:09.190153 11633 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.194976  5779 catalog_manager.cc:5696] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 11 to 14, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 14 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:09.154907 11488 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.192781 11612 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:09.207495  5779 catalog_manager.cc:5696] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 9 to 10, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 10 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
W20260620 13:58:09.201653  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 156285us
I20260620 13:58:09.202666 11414 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.051038  6580 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
W20260620 13:58:09.213491  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 264247us
I20260620 13:58:09.214126  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.216292  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:09.210139 11612 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.222491 11499 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.225207  5779 catalog_manager.cc:5696] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:09.228963 11414 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:58:09.229895  5848 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:09.236712 11488 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260620 13:58:09.237555  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 189614us
I20260620 13:58:09.236812 11633 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:09.020987  6552 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.261812  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:09.262771  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 298473us
W20260620 13:58:09.263707  5998 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:09.261462  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 240500us
I20260620 13:58:09.275338 11612 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.264156  5998 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.245292  5953 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:58:09.255309  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 284520us
I20260620 13:58:09.281445  5848 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:09.282315  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:09.263880  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 50777us
I20260620 13:58:09.288148  5848 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:09.293354  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.295239  5779 catalog_manager.cc:5696] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 8 to 13, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 13 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:09.297549 11507 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:09.298303 11507 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:09.264009 11722 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:58:09.300372 11722 raft_consensus.cc:697] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:09.300628 11622 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:09.301519 11722 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.298617  5779 catalog_manager.cc:5696] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 11 to 13, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 13 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:58:09.303155 11523 consensus_queue.cc:1059] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260620 13:58:09.305446 11523 raft_consensus.cc:3055] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:58:09.305864 11523 raft_consensus.cc:740] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:09.304680  5779 catalog_manager.cc:5696] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 10 to 13, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 13 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:09.263768 11404 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.308560 11304 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260620 13:58:09.309198 11721 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:09.308434 11404 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.312398 11404 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.298870 11507 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.322952 11507 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.328310  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:09.325031  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 61351.2us
I20260620 13:58:09.330125  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.331764  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.334558 11488 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:58:09.332755  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:09.326355  5779 catalog_manager.cc:5696] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 7 to 10, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 10 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:09.339311  5957 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260620 13:58:09.340415  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:09.306692 11523 consensus_queue.cc:260] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.335134 11488 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:09.339818  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:09.343063 11488 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.345328  5779 catalog_manager.cc:5696] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:09.347121 11523 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:09.347291  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:09.347389  5998 leader_election.cc:336] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:09.348605  5998 leader_election.cc:336] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.349452 11414 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260620 13:58:09.349767  5998 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.350183  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.350864 11304 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260620 13:58:09.352165  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 68895.5us
I20260620 13:58:09.352849  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.353433  5957 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 18.
I20260620 13:58:09.354269  6580 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260620 13:58:09.354689  6580 pending_rounds.cc:85] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 9
I20260620 13:58:09.354935  6580 pending_rounds.cc:107] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260620 13:58:09.355244  6580 raft_consensus.cc:2889] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:58:09.351217  5998 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.360718  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.325784 11507 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.353433  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:09.361820  5998 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:09.365130  5998 leader_election.cc:336] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.365518  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.358021  5848 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:58:09.367146  5849 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.378657  5953 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:58:09.387496  5779 catalog_manager.cc:5696] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 10 to 11, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 11 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:58:09.390010  5957 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 13. Current term is 14. Ops: [11.9-13.10]
W20260620 13:58:09.370023  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:09.363348 11564 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:58:09.401419  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.388388 11541 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:09.398775  6033 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260620 13:58:09.394730 11662 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:58:09.404312  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:09.405622  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.369403 11633 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:58:09.389217 11612 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:09.389864 11507 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260620 13:58:09.410145  5954 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:09.390537 11608 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260620 13:58:09.410356  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 144642us
I20260620 13:58:09.412184  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:09.412593  6552 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:09.413499  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:09.414536  6032 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260620 13:58:09.375741 11551 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.423677  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.422289  6551 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:09.410475 11507 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:58:09.424079  6552 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.399760 11487 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260620 13:58:09.430048  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:09.431033  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:09.435009  6578 raft_consensus.cc:2410] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260620 13:58:09.428426 11507 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:09.432523  6586 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260620 13:58:09.433425  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:09.436995  6580 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 16: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:09.442206  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:09.442845  6585 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:09.444211  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:09.444777  6585 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 18.
I20260620 13:58:09.449082  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.422821 11551 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.475765  6583 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:58:09.475198  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.510133  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:09.516374  6033 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:09.516494  6581 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:58:09.483068  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.451936  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:09.518364  6582 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:58:09.435952 11686 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:09.480561  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:09.529336  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 48875.8us
I20260620 13:58:09.482575  6029 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:58:09.472708 11520 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
W20260620 13:58:09.448045  6552 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.534003  5849 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:09.490075 11727 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260620 13:58:09.539529  6552 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:09.545115  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 97590.3us
I20260620 13:58:09.490193 11602 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.451690 11414 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.560349 11414 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:09.481760 11528 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260620 13:58:09.564301 11551 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.564752  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.438788 11608 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.553062  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:09.542757  5954 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 18.
I20260620 13:58:09.539050 11604 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:09.546887 11662 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:09.545475 11686 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.556344  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:09.480746 11631 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260620 13:58:09.567423  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:09.581192  6585 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:09.459329  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:09.452322  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:09.569286 11488 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:09.569392  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:09.570158 11414 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.597936  5998 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.568554  5849 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:09.439474 11525 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:09.575578  6581 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:09.547860 11257 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260620 13:58:09.593403  6585 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 17.
I20260620 13:58:09.600729  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.603049  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.606477  6033 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:58:09.612020  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:09.616281  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.616849  6032 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 14: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:58:09.595939 11142 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.604674 11622 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:09.632879  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.573566 11602 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.620831 11525 raft_consensus.cc:697] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:09.608633 11471 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:09.621671  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 53186.8us
I20260620 13:58:09.646622  5849 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:09.656095  6581 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:58:09.660734  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.661695  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:09.662961  5849 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:09.674060  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:09.579352 11608 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.630198 11523 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:09.689812  5998 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 113 similar messages]
I20260620 13:58:09.697305  6024 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260620 13:58:09.716981  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:09.727783 11738 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260620 13:58:09.723562 11711 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260620 13:58:09.729753 11686 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.667255 11414 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:09.731703 11414 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:09.732175 11414 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:09.732607 11414 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:09.699378 11633 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election won for term 18
I20260620 13:58:09.735702 11633 raft_consensus.cc:697] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 18 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:09.736836 11633 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.665002 11404 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:09.686527 11487 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:09.686429 11721 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.633687 11142 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.697299 11687 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:09.666958 11605 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260620 13:58:09.692236 11499 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260620 13:58:09.661497 11622 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.756419 11487 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:58:09.768612  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 165635us
W20260620 13:58:09.773273  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 56430.7us
I20260620 13:58:09.773365 11487 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:09.761759 11721 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.766314 11687 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.807647  6025 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260620 13:58:09.809384  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.815227  5849 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:09.816444  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.817262  6030 raft_consensus.cc:2393] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:09.818234  6025 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260620 13:58:09.823714 11499 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:09.824951 11608 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.828011  6552 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:09.830335 11563 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:09.834277  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:58:09.836941 11563 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:09.771142 11525 consensus_queue.cc:237] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.837350 11563 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:09.837911 11563 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:09.837352 11602 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.842693 11687 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.843505 11686 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260620 13:58:09.844353 11721 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:09.845239 11737 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260620 13:58:09.845649 11142 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.847252 11563 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.847862 11622 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.849411 11563 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.853892 11605 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:09.854620 11605 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:09.791831 11662 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260620 13:58:09.857228 11605 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.896987  6582 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 15. Current term is 16. Ops: []
I20260620 13:58:09.864166 11488 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:09.899044  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:09.902520  6582 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:58:09.900596  6581 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Advancing to term 21
I20260620 13:58:09.907601 11487 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.910127 11487 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.910768  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.911199  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:09.911530  6030 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:58:09.911787  6028 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:09.912431 11507 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.908032 11723 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:58:09.918216  6552 leader_election.cc:336] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.914695 11507 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:09.939159  6552 leader_election.cc:336] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.939718  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:09.940971  6552 leader_election.cc:336] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.939580  6028 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 16.
I20260620 13:58:09.946128  6581 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260620 13:58:09.942122  6552 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.954603  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:09.958212  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 318360us
W20260620 13:58:09.955752  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 135350us
I20260620 13:58:09.961833  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.962633  5956 raft_consensus.cc:2393] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 13: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:58:09.964133  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:09.915619 11488 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:09.974324 11488 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.953085 11752 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:58:09.920173 11487 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.975310 11414 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.975968 11487 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.977483 11414 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.977908 11487 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.953717 11723 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:09.981228 11723 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:10.017108  5998 leader_election.cc:336] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.017818  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.018775  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:10.022138  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 80034.1us
W20260620 13:58:10.023494  6552 leader_election.cc:336] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.024063  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.022907 11257 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.022818 11612 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260620 13:58:10.031876 11687 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260620 13:58:10.029825 11752 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:10.043530  6033 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260620 13:58:10.044461 11723 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:10.045040 11723 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:10.050148  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.050593  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.051692  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.052685  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.054579  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.055684  5955 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:10.059021  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:10.061865  5998 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.062472  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.027822 11257 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.064178  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.065683  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:10.067454  5955 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:10.068461  5953 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260620 13:58:10.069537  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.073388  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:10.076305 11564 raft_consensus.cc:2764] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260620 13:58:10.081151 11754 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:58:10.081422  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.076478 11752 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:10.084499 11752 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:10.084908 11752 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:10.085484 11687 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:10.086373 11556 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260620 13:58:10.086493 11754 raft_consensus.cc:697] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:10.094269  6578 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260620 13:58:10.095806  6552 leader_election.cc:336] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.097602  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.060060 11723 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:10.099596  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:10.101226  6552 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.101823  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:10.108062  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:10.111092  6578 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260620 13:58:10.112880  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.058979 11622 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260620 13:58:10.115061  5955 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 19.
I20260620 13:58:10.119544  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.121659  6578 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:10.125195  5848 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:58:10.129599 11487 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:10.130029 11487 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:10.130363 11487 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:10.131431 11751 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:10.131970 11751 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:10.133034 11414 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:10.133996 11751 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:10.140390  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.143219 11754 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.120962 11748 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260620 13:58:10.122205 11564 consensus_queue.cc:1059] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260620 13:58:10.149494 11564 raft_consensus.cc:3055] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Stepping down as leader of term 15
I20260620 13:58:10.149976 11564 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:10.150672 11257 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:10.150873 11564 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.116416 11760 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260620 13:58:10.116132 11722 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:10.118350 11723 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:58:10.154632 11722 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:58:10.155349 11723 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:10.155849 11723 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:10.158908  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.159789  6028 raft_consensus.cc:2393] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:10.160602  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:10.161478  6024 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260620 13:58:10.162191  5998 leader_election.cc:336] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.164755  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:10.166553  6578 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 16
I20260620 13:58:10.170919  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:10.171573  6025 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260620 13:58:10.175693  6585 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:10.157426 11722 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:10.174706  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.177289  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:10.186002  6032 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:10.186810  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.171485  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:10.181701  4719 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:10.165509 11721 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.189446  6586 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260620 13:58:10.190613  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:10.192379  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.194733 11722 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260620 13:58:10.203516  6551 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.204353 11707 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:10.194733 11721 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.193873 11564 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:10.207798 11721 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:10.210738  6578 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:10.212658 11721 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.215879 11721 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.217473 11752 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.217949 11721 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:10.218251  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 91473.1us
I20260620 13:58:10.218510 11721 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.218951 11721 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.221289 11721 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:10.222247  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:10.225064  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 52119.1us
I20260620 13:58:10.225905  6585 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 19.
I20260620 13:58:10.239882  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.240576  5959 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:58:10.243285  6032 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:10.246809  5849 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.246923  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.249502  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.249815  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.251644  5848 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:58:10.255309  5849 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.263262  5849 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.270781 11499 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Leader election won for term 19
I20260620 13:58:10.280145  5951 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260620 13:58:10.270977 11541 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:10.280756  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.282346  5849 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.282680 11608 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:10.283288 11722 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:10.283540 11608 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:10.245944 11622 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260620 13:58:10.288825 11499 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 19 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:10.291414 11541 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.251472 11721 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260620 13:58:10.268294 11753 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:10.278788  5924 leader_election.cc:336] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.316632  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.306492  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.319615  5848 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.319890  6032 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 16: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:10.274426 11751 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
W20260620 13:58:10.332724  5924 leader_election.cc:336] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.340891 11633 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:10.341701 11633 consensus_queue.cc:1243] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260620 13:58:10.343998 11722 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:10.344578 11722 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.346686 11722 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:10.347744  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:10.352972  6552 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.356472  5951 pending_rounds.cc:85] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 10
I20260620 13:58:10.356948  5951 pending_rounds.cc:107] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260620 13:58:10.357358  5951 raft_consensus.cc:2889] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:10.360497  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.367177 11499 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.372990 11564 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:10.329677 11753 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260620 13:58:10.319825 11723 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.310447 11541 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.377918 11723 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:10.378700 11541 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:10.327040 11745 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:10.374796 11487 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.399333  6029 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
W20260620 13:58:10.422844  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 140557us
I20260620 13:58:10.428923  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.443285  6579 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:10.447896  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:10.448704  5959 raft_consensus.cc:2393] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 13: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:58:10.450858  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.411454 11754 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:10.452224  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:10.422492 11541 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:10.481299  6551 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:10.482513  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.481333  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.474872  6579 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260620 13:58:10.484220 11709 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:10.484624 11709 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:10.485013 11709 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:10.475880 11754 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.490336 11754 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:10.493399 11774 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260620 13:58:10.493135 11709 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.502856  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.503767  6581 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 16: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:10.453166 11605 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260620 13:58:10.464968 11757 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:58:10.508761  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 176071us
I20260620 13:58:10.509588  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:10.514518  5924 leader_election.cc:336] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.515225  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.435920 11721 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260620 13:58:10.477015 11487 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:10.504938 11608 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:58:10.513615 11435 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:58:10.527576  5924 leader_election.cc:336] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.479072 11541 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:10.539398  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.520361 11745 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:10.556202  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.557080  6030 raft_consensus.cc:2393] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 19: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:10.527647 11709 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:10.569430  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 54079.7us
I20260620 13:58:10.544799 11487 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.545694 11608 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 16 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:10.592754  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:10.593511  6030 raft_consensus.cc:2393] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:10.573782 11686 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:10.574795 11752 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:10.639065  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.640456  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:10.641014  5959 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:10.592480 11487 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.661849  5959 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
W20260620 13:58:10.675257  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 104845us
I20260620 13:58:10.678346  5848 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
W20260620 13:58:10.682319  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 122129us
I20260620 13:58:10.683138  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:10.683409  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:58:10.684262  5959 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 14: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:58:10.688714  5955 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260620 13:58:10.686172 11757 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:10.688946 11721 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:10.694116 11707 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:58:10.709112 11487 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:10.677537 11608 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:10.723752 11785 log.cc:927] Time spent T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260620 13:58:10.728191 11541 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:10.711946 11721 raft_consensus.cc:697] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:10.730432 11721 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.713318 11707 raft_consensus.cc:697] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:10.756870 11707 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.782897  5849 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.815129  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.816622  5849 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.828194  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.823711 11722 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:10.833923  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.830819  6033 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 19.
I20260620 13:58:10.825636 11563 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.827091 11605 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:10.823953 11662 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:10.842905  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.843315  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:10.846592  6579 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 14: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:10.855880  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.859723  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.860380  6580 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 18.
I20260620 13:58:10.840821 11753 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.874881 11404 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:10.875396 11791 log.cc:927] Time spent T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.165s	user 0.003s	sys 0.002s
I20260620 13:58:10.896629  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.848030 11563 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.888489 11142 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:10.889111 11404 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:10.871032 11753 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.926421  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:10.940269 11404 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:10.958554  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.959606 11523 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.960261 11523 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:10.961582 11779 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:10.962302 11779 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:10.974699  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.977993  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:10.980818  6552 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.981455  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.962848 11523 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:10.987694  6552 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.992410  6586 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
W20260620 13:58:10.993476  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:10.918315 11142 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:10.998571  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.995028 11798 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:10.994261 11523 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.996798 11779 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:11.001466 11748 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:58:11.017241  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.017052 11142 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:11.024680 11605 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:11.038532  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.047485 11563 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:11.048513 11753 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:11.027869 11748 raft_consensus.cc:697] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:11.049814 11748 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.008355 11523 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.065424 11523 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:11.066516  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.067282  5952 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:58:11.081470 11523 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:11.044195  6552 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:11.103404  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 59240.5us
I20260620 13:58:11.107749  5848 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:58:11.111266 11414 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:11.111721 11414 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:11.112077 11414 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:11.116497 11488 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:11.117218 11488 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.117570  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.118824  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.119266 11783 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:58:11.111302  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 431507us
I20260620 13:58:11.121810  5955 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260620 13:58:11.116521  6033 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260620 13:58:11.120211  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.119849 11783 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.127851  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.129618  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.137311  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.144035 11798 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260620 13:58:11.159229 11710 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260620 13:58:11.160569 11633 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:11.160677 11757 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260620 13:58:11.172701  6551 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:11.177949  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.180372 11142 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:11.181674  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:11.183768 11783 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:11.185105  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 50803.6us
I20260620 13:58:11.185829  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:11.187402 11257 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:11.188602 11257 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:11.189194 11257 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:11.191200  4719 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:11.192588 11257 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:11.097226 11738 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.029s	sys 0.056s
I20260620 13:58:11.196599  5849 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:11.202767  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 19 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.082986 11523 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.213272  5849 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:11.200169 11738 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.029s	sys 0.057s
I20260620 13:58:11.218245  5849 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:11.200619 11541 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260620 13:58:11.227710  5959 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260620 13:58:11.229126  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:11.232705  5959 pending_rounds.cc:85] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 11
I20260620 13:58:11.233186  5959 pending_rounds.cc:107] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260620 13:58:11.233507  5959 raft_consensus.cc:2889] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:11.230228  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:11.234838 11404 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:11.235268 11802 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:58:11.238921 11709 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260620 13:58:11.240216  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 19 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.208947 11753 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:58:11.250237 11815 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.130s	user 0.003s	sys 0.000s
I20260620 13:58:11.249245  5959 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260620 13:58:11.232662  5849 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:11.244735 11523 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:11.258800 11721 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:11.225313 11605 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:11.231693 11541 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:11.254802  5849 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:11.265820 11541 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Advancing to term 20
W20260620 13:58:11.305124  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 172557us
I20260620 13:58:11.291406  5849 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.232970 11488 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:11.309661  6551 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:11.311220  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:11.283860 11605 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:11.290271 11757 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:11.312999 11779 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:11.334728  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:11.336390  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:11.332000 11757 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:11.338579  5776 catalog_manager.cc:5696] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 13 to 17, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 17 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:11.340818 11757 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:11.340407  5776 catalog_manager.cc:5696] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.343403  6584 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260620 13:58:11.322705 11753 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:11.341997  5776 catalog_manager.cc:5696] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 16 to 17, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 17 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:11.351339  5779 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56610 (request call id 353) took 17523 ms (client timeout 15000 ms). Trace:
I20260620 13:58:11.347980  5776 catalog_manager.cc:5696] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 11 to 13, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 13 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.356412  5959 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260620 13:58:11.356902  5776 catalog_manager.cc:5696] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.358865  5776 catalog_manager.cc:5696] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 10, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 10 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.362273  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.314110 11563 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260620 13:58:11.369516  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.364898 11788 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260620 13:58:11.352007  5779 rpcz_store.cc:269] 0620 13:57:53.828084 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:53.828519 (+   435us) service_pool.cc:224] Handling call
0620 13:57:54.134068 (+305549us) spinlock_profiling.cc:243] Waited 89.3 ms on lock 0x7b540002b7d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf766470 00007f0fdf80531a 00007f0fe55baaac 00007f0fe56b90ae 00007f0fe3b7e4a4 00007f0fe3b7e432 00007f0fe3b7e361 00007f0fe3b7e2dc 00007f0fe3b7d592 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:54.362890 (+228822us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b5400002490. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3e40 00007f0fe55af456 00007f0fe56b996e 00007f0fe3b7e4a4 00007f0fe3b7e432 00007f0fe3b7e361 00007f0fe3b7e2dc 00007f0fe3b7d592 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:11.351241 (+16988351us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:58:09.839159 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:58:09.839735 (+   576us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:58:09.839773 (+    38us) write_op.cc:435] Acquired schema lock
0620 13:58:09.839796 (+    23us) tablet.cc:662] Decoding operations
0620 13:58:09.841384 (+  1588us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:58:09.841441 (+    57us) write_op.cc:641] Partition lock acquired for write op
0620 13:58:09.841472 (+    31us) tablet.cc:685] Acquiring locks for 20 operations
0620 13:58:09.972473 (+131001us) tablet.cc:701] Row locks acquired
0620 13:58:09.972495 (+    22us) write_op.cc:260] PREPARE: finished
0620 13:58:09.972641 (+   146us) write_op.cc:270] Start()
0620 13:58:09.972763 (+   122us) write_op.cc:276] Timestamp: P: 1781963889972594 usec, L: 0
0620 13:58:09.972785 (+    22us) op_driver.cc:348] REPLICATION: starting
0620 13:58:09.973501 (+   716us) log.cc:844] Serialized 7922 byte log entry
0620 13:58:10.531029 (+557528us) op_driver.cc:464] REPLICATION: finished
0620 13:58:10.744511 (+213482us) write_op.cc:301] APPLY: starting
0620 13:58:10.744621 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:10.955086 (+210465us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:10.975915 (+ 20829us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:11.074341 (+ 98426us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:11.074725 (+   384us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0620 13:58:11.074793 (+    68us) write_op.cc:312] APPLY: finished
0620 13:58:11.075376 (+   583us) log.cc:844] Serialized 180 byte log entry
0620 13:58:11.076383 (+  1007us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:11.076642 (+   259us) write_op.cc:454] Released schema lock
0620 13:58:11.076718 (+    76us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:11.077422 (+   704us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:11.077464 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9782,"reported_tablets":46,"spinlock_wait_cycles":248017536,"child_traces":[["op",{"apply.queue_time_us":204944,"apply.run_cpu_time_us":30992,"apply.run_wall_time_us":332861,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87807,"num_ops":20,"prepare.queue_time_us":328381,"prepare.run_cpu_time_us":24128,"prepare.run_wall_time_us":310608,"raft.queue_time_us":261162,"raft.run_cpu_time_us":13099,"raft.run_wall_time_us":186297,"replication_time_us":547592,"thread_start_us":609018,"threads_started":4,"wal-append.queue_time_us":196961}]]}
I20260620 13:58:11.361027  5776 catalog_manager.cc:5696] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:58:11.390373  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 66980us
I20260620 13:58:11.330755 11709 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260620 13:58:11.394122  5776 catalog_manager.cc:5696] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 14, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.396494  5776 catalog_manager.cc:5696] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 14, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:58:11.412389  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 49942.7us
I20260620 13:58:11.414594 11499 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260620 13:58:11.426199  5849 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.427986 11507 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:11.363032 11753 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.430781  5849 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.398963  5776 catalog_manager.cc:5696] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.435619 11507 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:11.438268 11507 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260620 13:58:11.439922  5849 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.442564  6032 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260620 13:58:11.450857  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.451728  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.433346  5776 catalog_manager.cc:5696] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 15 to 18, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 18 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:11.454396  5776 catalog_manager.cc:5696] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:58:11.464397  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:11.487149  5924 leader_election.cc:336] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:11.496109  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.452142 11783 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:11.452315 11662 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:11.511314 11783 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.444118 11414 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.513602 11783 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:11.514213 11824 log.cc:927] Time spent T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260620 13:58:11.514524 11414 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:11.487727  5776 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 19 to 20, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 20 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:11.501698 11257 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260620 13:58:11.502380 11753 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:11.503461  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:11.503834 11748 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:58:11.505203  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 61871.7us
I20260620 13:58:11.519345  5776 catalog_manager.cc:5696] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 15 to 18, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 18 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.524394 11753 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:11.523874  5776 catalog_manager.cc:5696] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 11 to 12, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 12 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:11.543248  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:11.537412  5776 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 14, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 14 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:11.549039  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:11.545926  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:11.557871  5776 catalog_manager.cc:5696] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.561419  5776 catalog_manager.cc:5696] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:11.563925  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:11.564429  6581 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260620 13:58:11.568809  5776 catalog_manager.cc:5696] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.571636  5776 catalog_manager.cc:5696] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 13 to 15, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 15 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:11.578022  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 92892.1us
I20260620 13:58:11.573351  5776 catalog_manager.cc:5696] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 10 to 14, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:11.593550  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.597416  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:11.597472  5776 catalog_manager.cc:5696] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.600878  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:11.601841  5776 catalog_manager.cc:5696] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 7 to 9, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 9 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:11.617473  5776 catalog_manager.cc:5696] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.619437  5776 catalog_manager.cc:5696] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:11.622141  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 48573.1us
I20260620 13:58:11.642783  5849 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.644047 11605 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:58:11.663478  5849 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.667711 11605 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
W20260620 13:58:11.679224  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 61473.1us
I20260620 13:58:11.680498  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.676913 11753 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:11.807435  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 121748us
I20260620 13:58:11.690482 11745 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:11.846750 11812 log.cc:927] Time spent T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.153s	user 0.011s	sys 0.003s
I20260620 13:58:11.848706 11707 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:11.849056 11826 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
I20260620 13:58:11.849292 11707 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:11.861115 11541 consensus_meta.cc:287] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.551s	user 0.002s	sys 0.006s
I20260620 13:58:11.861616 11541 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:11.885342  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:11.886966  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:11.901816  6552 leader_election.cc:336] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:11.908454 11707 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:11.951547 11541 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 20 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:11.931200 11605 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:11.953076 11605 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:11.971655  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:11.989478 11612 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:11.992985 11612 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:11.996407 11841 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260620 13:58:12.007139 11848 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:12.007743 11848 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:12.009651  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:12.010238  6033 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:58:12.022439  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.023329  6025 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 16.
I20260620 13:58:12.035745  6033 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 20.
I20260620 13:58:12.028956 11612 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:12.084520 11819 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:12.085371 11819 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:12.094116 11435 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:12.095053 11435 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.097992 11435 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:12.191701  4719 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:12.215674 11757 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:12.259449 11848 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.254572 11757 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:12.262135 11757 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.264060 11819 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:12.302507 11839 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.446s	user 0.009s	sys 0.012s
I20260620 13:58:12.331475  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.338171  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.343057 11802 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:12.343731 11802 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.350992 11854 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:12.363231 11854 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.367659 11854 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.368309 11605 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.369025 11802 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.369266  6033 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260620 13:58:12.374004  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.376403  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.378422  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.378685  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:12.379779  6579 raft_consensus.cc:2410] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260620 13:58:12.381045  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:12.396916 11834 log.cc:927] Time spent T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.541s	user 0.005s	sys 0.009s
I20260620 13:58:12.398515  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.403643  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:12.408154  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 435444us
W20260620 13:58:12.408500 11835 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.479s	user 0.019s	sys 0.000s
I20260620 13:58:12.420688  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.421361  6027 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:58:12.422240  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.427516 11748 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
W20260620 13:58:12.439411 11832 log.cc:927] Time spent T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.588s	user 0.000s	sys 0.015s
I20260620 13:58:12.445056  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:12.445845  6578 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:58:12.453513  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:12.453617  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 90262.2us
I20260620 13:58:12.454780  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.459088  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.459475  5997 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:12.460911  6580 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260620 13:58:12.470222  6578 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 20.
I20260620 13:58:12.430859 11793 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:12.476395  5997 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:12.457567 11760 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:12.479861 11760 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.482045 11760 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.483664 11793 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.485893 11793 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.491197 11844 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:12.492674  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:12.499560 11608 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 20 FOLLOWER]: Leader election won for term 20
I20260620 13:58:12.500087 11608 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 20 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:12.500952 11608 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.511149 11631 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:12.541392  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:12.560422 11803 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:12.560993 11803 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:12.561533 11803 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
W20260620 13:58:12.561040  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 129679us
I20260620 13:58:12.572261  5849 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.575726 11541 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:12.577453  5849 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.583720 11753 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:12.584367 11753 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.587908 11608 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:12.588001  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:12.588917 11709 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:12.589320 11709 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:12.589681 11709 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:12.590786  5849 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.589848 11753 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:12.573716  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:12.600224 11608 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:12.604763  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.629086  6552 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:12.631502  5924 leader_election.cc:336] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:12.632025  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.632830 11842 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:12.631191 11803 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.648336 11793 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:12.648860  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.649668 11709 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.650036  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.651124 11803 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.661331  6582 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 15. Current term is 16. Ops: []
I20260620 13:58:12.661620  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:12.666852  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51294.8us
W20260620 13:58:12.673609  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:12.674934 11709 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.681586  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:12.682459  6024 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:12.688405  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:12.691759 11753 consensus_queue.cc:1059] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:12.692952 11608 raft_consensus.cc:3055] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Stepping down as leader of term 15
I20260620 13:58:12.693315 11608 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:12.694057 11608 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.695569 11605 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:12.696084 11605 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:12.697996 11605 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.701700  5849 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:12.702729 11605 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:12.709946  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.710390 11608 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:12.726050 11819 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:12.727495  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.737861  6024 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 17.
I20260620 13:58:12.751247  5849 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.748616  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:12.752868 11605 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:12.764030  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:12.756762 11851 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election won for term 17
W20260620 13:58:12.769371  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:12.770519  6552 leader_election.cc:336] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:12.772202  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:12.772826  6552 leader_election.cc:336] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:12.773129  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.777668 11851 raft_consensus.cc:697] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 17 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:58:12.786291  6552 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:12.786849  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.787665 11710 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:12.764308 11753 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:12.791450  6552 leader_election.cc:336] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:12.789901 11798 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:58:12.779237 11851 consensus_queue.cc:237] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.794276 11753 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.803318 11753 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:12.806355  6552 leader_election.cc:336] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:12.807202  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 62919us
I20260620 13:58:12.825776  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.806545  5776 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47386 (request call id 237) took 3361 ms. Trace:
I20260620 13:58:12.832472  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.833714  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:12.834066  5777 catalog_manager.cc:5696] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.838654  5777 catalog_manager.cc:5696] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 12 to 14, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 14 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:12.841444  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:12.843755  5777 catalog_manager.cc:5696] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 13 to 14, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 14 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.846251  5777 catalog_manager.cc:5696] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.848011  5777 catalog_manager.cc:5696] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 12 to 15, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 15 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.849977  5777 catalog_manager.cc:5696] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 13 to 14, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 14 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.838897 11803 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260620 13:58:12.851931  5777 catalog_manager.cc:5696] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.830760  5776 rpcz_store.cc:276] 0620 13:58:09.432969 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:09.472923 (+ 39954us) service_pool.cc:224] Handling call
0620 13:58:12.794325 (+3321402us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:58:11.959610 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:58:11.960193 (+   583us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:58:11.960233 (+    40us) write_op.cc:435] Acquired schema lock
0620 13:58:11.960264 (+    31us) tablet.cc:662] Decoding operations
0620 13:58:11.962136 (+  1872us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:58:11.962209 (+    73us) write_op.cc:641] Partition lock acquired for write op
0620 13:58:11.962244 (+    35us) tablet.cc:685] Acquiring locks for 25 operations
0620 13:58:12.021554 (+ 59310us) tablet.cc:701] Row locks acquired
0620 13:58:12.021582 (+    28us) write_op.cc:260] PREPARE: finished
0620 13:58:12.021770 (+   188us) write_op.cc:270] Start()
0620 13:58:12.021924 (+   154us) write_op.cc:276] Timestamp: P: 1781963892021711 usec, L: 0
0620 13:58:12.021954 (+    30us) op_driver.cc:348] REPLICATION: starting
0620 13:58:12.077567 (+ 55613us) log.cc:844] Serialized 9788 byte log entry
0620 13:58:12.303032 (+225465us) op_driver.cc:464] REPLICATION: finished
0620 13:58:12.352050 (+ 49018us) write_op.cc:301] APPLY: starting
0620 13:58:12.352129 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:12.400096 (+ 47967us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b540002b7d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7f8208 00007f0fe3234401 00007f0fe3233bd8 00007f0fe3238871 00007f0fe3238829 00007f0fe32387b9 00007f0fe3238781 00007f0fe32379ad 0000000000389354 0000000000389199
0620 13:58:12.512984 (+112888us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:12.513015 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:12.684176 (+171161us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:12.684510 (+   334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0620 13:58:12.684555 (+    45us) write_op.cc:312] APPLY: finished
0620 13:58:12.725031 (+ 40476us) log.cc:844] Serialized 220 byte log entry
0620 13:58:12.725225 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:12.725457 (+   232us) write_op.cc:454] Released schema lock
0620 13:58:12.725524 (+    67us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:12.736332 (+ 10808us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:12.736368 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23874,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":48642,"apply.run_cpu_time_us":32713,"apply.run_wall_time_us":373980,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108727,"mutex_wait_us":26582,"num_ops":25,"prepare.queue_time_us":85491,"prepare.run_cpu_time_us":18113,"prepare.run_wall_time_us":460795,"raft.queue_time_us":6044,"raft.run_cpu_time_us":46730,"raft.run_wall_time_us":49025,"replication_time_us":280902,"spinlock_wait_cycles":11955584,"thread_start_us":250978,"threads_started":4,"wal-append.queue_time_us":184402}]]}
I20260620 13:58:12.853371  5777 catalog_manager.cc:5696] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:12.856952  5777 catalog_manager.cc:5696] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.861680  5777 catalog_manager.cc:5696] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:12.859411 11608 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:58:12.869092  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:12.864681  5777 catalog_manager.cc:5696] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 14 to 15, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 15 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
W20260620 13:58:12.875308  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:12.876443  5777 catalog_manager.cc:5696] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 14 to 15, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 15 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.878504  5777 catalog_manager.cc:5696] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 7 to 12, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 12 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.883307  5777 catalog_manager.cc:5696] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 8 to 12, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 12 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.907048  5777 catalog_manager.cc:5696] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
W20260620 13:58:12.912108  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:12.910094  5777 catalog_manager.cc:5696] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.973031 11499 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:12.973574 11499 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:12.977037  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.975960 11499 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:13.011130  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:13.024366  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:13.029075 11847 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.041239 11847 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.043489 11847 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.037720 11608 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.077335 11608 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.086089  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.079670 11608 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.118119 11753 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:13.120246  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 73253.4us
I20260620 13:58:13.130008  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:13.136135  6027 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260620 13:58:13.141831 11499 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:13.142422 11499 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:13.119743 11753 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:13.144734 11753 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:13.145573  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:13.146337  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.146845 11499 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:13.150717  5849 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:13.151665 11499 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:13.152774  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.154073  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:13.157364 11499 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260620 13:58:13.169149  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:13.172026  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:13.178018  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:13.179690  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:13.176847  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:13.190716  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:13.192315  4719 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:13.193257 11499 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.194900 11499 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.196746 11874 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.197249 11874 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.197674  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.198385 11753 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:13.197677 11499 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.199818 11874 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.200829  5849 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:13.207645 11753 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:13.210166  6024 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260620 13:58:13.215054  5849 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:13.216197  5849 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:13.216357 11608 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:13.217193  6584 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260620 13:58:13.218914 11499 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:13.228565  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:13.229431  6024 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 17: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:13.229063 11877 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:58:13.230522  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:13.285041  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:13.292474 11874 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260620 13:58:13.296895  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:13.303642  5849 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:13.306315 11874 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:13.311684  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:13.312429  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:13.315973 11499 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.334000 11874 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:13.351256 11608 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.351369 11874 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:13.351810 11608 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.353520 11874 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:13.353705 11608 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.355921  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.351001 11499 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.356161  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.357985 11499 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.361725  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.336489  5777 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56624 (request call id 347) took 4014 ms. Trace:
W20260620 13:58:13.379235  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 66841.7us
I20260620 13:58:13.364744  5777 rpcz_store.cc:276] 0620 13:58:09.321923 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:09.322077 (+   154us) service_pool.cc:224] Handling call
0620 13:58:09.330840 (+  8763us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b5400002490. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d38b2 00007f0fe5651659 00007f0fe55e98b6 00007f0fe55ba968 00007f0fe56b90ae 00007f0fe3b7e4a4 00007f0fe3b7e432 00007f0fe3b7e361 00007f0fe3b7e2dc
0620 13:58:13.336421 (+4005581us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:58:13.087023 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:58:13.087797 (+   774us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:58:13.087845 (+    48us) write_op.cc:435] Acquired schema lock
0620 13:58:13.087871 (+    26us) tablet.cc:662] Decoding operations
0620 13:58:13.089776 (+  1905us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:58:13.089881 (+   105us) write_op.cc:641] Partition lock acquired for write op
0620 13:58:13.089924 (+    43us) tablet.cc:685] Acquiring locks for 16 operations
0620 13:58:13.099603 (+  9679us) tablet.cc:701] Row locks acquired
0620 13:58:13.099636 (+    33us) write_op.cc:260] PREPARE: finished
0620 13:58:13.099838 (+   202us) write_op.cc:270] Start()
0620 13:58:13.100023 (+   185us) write_op.cc:276] Timestamp: P: 1781963893099770 usec, L: 0
0620 13:58:13.100057 (+    34us) op_driver.cc:348] REPLICATION: starting
0620 13:58:13.101078 (+  1021us) log.cc:844] Serialized 6347 byte log entry
0620 13:58:13.199537 (+ 98459us) op_driver.cc:464] REPLICATION: finished
0620 13:58:13.200513 (+   976us) write_op.cc:301] APPLY: starting
0620 13:58:13.200603 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:13.209757 (+  9154us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:13.209857 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:13.236493 (+ 26636us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:13.236769 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0620 13:58:13.236823 (+    54us) write_op.cc:312] APPLY: finished
0620 13:58:13.237230 (+   407us) log.cc:844] Serialized 148 byte log entry
0620 13:58:13.237404 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:13.237582 (+   178us) write_op.cc:454] Released schema lock
0620 13:58:13.237644 (+    62us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:13.238023 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:13.238056 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2672,"reported_tablets":46,"spinlock_wait_cycles":3180288,"child_traces":[["op",{"apply.queue_time_us":736,"apply.run_cpu_time_us":19324,"apply.run_wall_time_us":37467,"cfile_cache_hit":64,"cfile_cache_hit_bytes":66944,"num_ops":16,"prepare.queue_time_us":114345,"prepare.run_cpu_time_us":6377,"prepare.run_wall_time_us":53142,"replication_time_us":99323,"thread_start_us":98455,"threads_started":1}]]}
I20260620 13:58:13.392100  5780 catalog_manager.cc:5696] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 11 to 16, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 16 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
W20260620 13:58:13.394151  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:13.402091 11499 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.411936 11499 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:13.414381 11499 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:13.402190  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:13.442723 11753 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:13.454077 11753 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:58:13.465678  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.488124  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:13.488386  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:13.488796  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:13.489428  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:13.511672  5780 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 20 to 21, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 21 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:13.565737  5849 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:13.582626  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51551.9us
W20260620 13:58:13.652639  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 85236.8us
I20260620 13:58:13.656371  5849 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:13.522672 11541 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.567412 11874 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:13.701061  5780 catalog_manager.cc:5696] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 14 to 17, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 17 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:58:13.703465 11608 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:13.745468  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 89490.8us
I20260620 13:58:13.758077 11541 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.772553 11541 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.774293  5780 catalog_manager.cc:5696] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 10 to 14, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 14 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:13.723742 11874 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:58:13.787921 11874 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:13.791214 11887 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:13.822830  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 95349.1us
I20260620 13:58:13.899040  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:13.908196  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 63079.8us
I20260620 13:58:13.951820 11889 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:13.952636 11889 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.958598 11889 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.961621  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:13.963393  6584 raft_consensus.cc:2393] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 16: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:13.979676 11893 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.980548 11893 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:13.985247 11893 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:13.997757  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:14.001375  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:14.012753  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:14.016099  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:14.110436 11887 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:14.111258 11887 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:14.113870 11887 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:14.115057  5849 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:14.119701  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:14.122601 11874 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:14.129545  5849 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:14.148119 11874 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:14.166709  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:14.175745 11874 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:14.176569 11874 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:14.178997 11874 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:14.179569  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:14.194839  4719 thread.cc:527] Waited for 8000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:14.201982  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:14.226887  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:14.247659  5780 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56610 (request call id 354) took 3747 ms. Trace:
I20260620 13:58:14.248143  5780 rpcz_store.cc:276] 0620 13:58:10.500522 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:10.500790 (+   268us) service_pool.cc:224] Handling call
0620 13:58:10.766604 (+265814us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540002b7d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf766470 00007f0fdf80531a 00007f0fe55baaac 00007f0fe56b90ae 00007f0fe3b7e4a4 00007f0fe3b7e432 00007f0fe3b7e361 00007f0fe3b7e2dc 00007f0fe3b7d592 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:14.247531 (+3480927us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:58:13.924034 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:58:13.944533 (+ 20499us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:58:13.944588 (+    55us) write_op.cc:435] Acquired schema lock
0620 13:58:13.944624 (+    36us) tablet.cc:662] Decoding operations
0620 13:58:13.945424 (+   800us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:58:13.945537 (+   113us) write_op.cc:641] Partition lock acquired for write op
0620 13:58:13.945572 (+    35us) tablet.cc:685] Acquiring locks for 4 operations
0620 13:58:13.946171 (+   599us) tablet.cc:701] Row locks acquired
0620 13:58:13.946214 (+    43us) write_op.cc:260] PREPARE: finished
0620 13:58:13.946444 (+   230us) write_op.cc:270] Start()
0620 13:58:13.946660 (+   216us) write_op.cc:276] Timestamp: P: 1781963893946355 usec, L: 0
0620 13:58:13.946711 (+    51us) op_driver.cc:348] REPLICATION: starting
0620 13:58:13.947874 (+  1163us) log.cc:844] Serialized 1696 byte log entry
0620 13:58:13.986353 (+ 38479us) op_driver.cc:464] REPLICATION: finished
0620 13:58:14.095485 (+109132us) write_op.cc:301] APPLY: starting
0620 13:58:14.095604 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:14.132769 (+ 37165us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:14.132915 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:14.136368 (+  3453us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:14.136721 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0620 13:58:14.136799 (+    78us) write_op.cc:312] APPLY: finished
0620 13:58:14.137222 (+   423us) log.cc:844] Serialized 49 byte log entry
0620 13:58:14.184389 (+ 47167us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:14.184504 (+   115us) write_op.cc:454] Released schema lock
0620 13:58:14.184569 (+    65us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:14.185124 (+   555us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:14.185167 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":69625,"reported_tablets":46,"spinlock_wait_cycles":380349184,"child_traces":[["op",{"apply.queue_time_us":108791,"apply.run_cpu_time_us":9485,"apply.run_wall_time_us":89563,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20863,"num_ops":4,"prepare.queue_time_us":96075,"prepare.run_cpu_time_us":4647,"prepare.run_wall_time_us":75447,"replication_time_us":39459,"thread_start_us":223285,"threads_started":2}]]}
I20260620 13:58:14.255556  5776 catalog_manager.cc:5696] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 15 to 17, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 17 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.258464  5776 catalog_manager.cc:5696] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 16, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 16 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:14.269558  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:14.270779 11893 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:14.275072  5849 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:14.282150 11874 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260620 13:58:14.284274  5776 catalog_manager.cc:5696] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.292423  5849 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:14.293427 11874 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:14.297089  5776 catalog_manager.cc:5696] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 14 to 16, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 16 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.299031  5776 catalog_manager.cc:5696] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 18, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 18 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.300987  5776 catalog_manager.cc:5696] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 11, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 11 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.306115  5849 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:14.308795  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:14.312685 11893 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:14.315549  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:14.316429  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:14.317157  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:14.317922  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:14.318436  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:14.323897  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:14.324298  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:14.324574  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:14.325357  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:14.339433  5776 catalog_manager.cc:5696] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:14.342854  5849 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:14.351766 11894 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:58:14.360095  5998 leader_election.cc:336] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:14.362632  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:14.368016 11896 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:14.373538  5776 catalog_manager.cc:5696] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:14.379905  5776 catalog_manager.cc:5696] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 13, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 13 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:14.382102  5776 catalog_manager.cc:5696] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 6 to 11, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 11 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:14.392514  5776 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 16 to 19, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 19 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.398736 11896 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:14.400188  5776 catalog_manager.cc:5696] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:14.423429  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:14.425334  5776 catalog_manager.cc:5696] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 11, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 11 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.428670  5776 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.473019 11894 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:14.473657 11894 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:14.476192 11894 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:14.479630  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:14.491432  6024 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:14.492835  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:14.479971  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:14.494074  6584 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:14.493777 11894 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:14.497445 11894 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:14.498449 11894 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:14.533317 11874 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:14.534050 11874 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:14.536463 11874 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:14.540807  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:14.548012  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:14.563489  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:14.564517  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:14.566634 11874 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:14.611550  5776 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47386 (request call id 238) took 1663 ms. Trace:
I20260620 13:58:14.619650  5776 rpcz_store.cc:276] 0620 13:58:12.943220 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:12.943375 (+   155us) service_pool.cc:224] Handling call
0620 13:58:14.606681 (+1663306us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:58:14.438839 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:58:14.439434 (+   595us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:58:14.439489 (+    55us) write_op.cc:435] Acquired schema lock
0620 13:58:14.439511 (+    22us) tablet.cc:662] Decoding operations
0620 13:58:14.440698 (+  1187us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:58:14.440762 (+    64us) write_op.cc:641] Partition lock acquired for write op
0620 13:58:14.440793 (+    31us) tablet.cc:685] Acquiring locks for 14 operations
0620 13:58:14.442024 (+  1231us) tablet.cc:701] Row locks acquired
0620 13:58:14.442040 (+    16us) write_op.cc:260] PREPARE: finished
0620 13:58:14.442249 (+   209us) write_op.cc:270] Start()
0620 13:58:14.442376 (+   127us) write_op.cc:276] Timestamp: P: 1781963894442145 usec, L: 0
0620 13:58:14.442393 (+    17us) op_driver.cc:348] REPLICATION: starting
0620 13:58:14.443128 (+   735us) log.cc:844] Serialized 5575 byte log entry
0620 13:58:14.445714 (+  2586us) op_driver.cc:464] REPLICATION: finished
0620 13:58:14.446040 (+   326us) write_op.cc:301] APPLY: starting
0620 13:58:14.446125 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:14.453738 (+  7613us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:14.453840 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:14.490924 (+ 37084us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:14.496443 (+  5519us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0620 13:58:14.496500 (+    57us) write_op.cc:312] APPLY: finished
0620 13:58:14.496873 (+   373us) log.cc:844] Serialized 129 byte log entry
0620 13:58:14.497695 (+   822us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:14.497855 (+   160us) write_op.cc:454] Released schema lock
0620 13:58:14.497903 (+    48us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:14.547681 (+ 49778us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b540002b628. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe5bb9c21 00007f0fe5bb888c 00007f0fe324a27d 00007f0fe3236209 00007f0fe32359d3 00007f0fe3239be1 00007f0fe3239b99 00007f0fe3239b29 00007f0fe3239af1 00007f0fe3238d1d 0000000000389354
0620 13:58:14.558238 (+ 10557us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:14.558272 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3577,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":115,"apply.run_cpu_time_us":21004,"apply.run_wall_time_us":111592,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58576,"num_ops":14,"prepare.queue_time_us":2933,"prepare.run_cpu_time_us":4602,"prepare.run_wall_time_us":4602,"replication_time_us":3176,"spinlock_wait_cycles":88947072}]]}
W20260620 13:58:14.642874  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 43796.6us
I20260620 13:58:14.624046 11894 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:14.704810 11894 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:14.708004  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:14.708788  6033 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:14.726511  6033 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
I20260620 13:58:14.737548  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:58:14.729621  5998 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 234 similar messages]
I20260620 13:58:14.745712 11894 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:58:14.748549 11894 raft_consensus.cc:697] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:14.749619 11894 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:14.763686  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:14.764422  6584 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:14.826326  6584 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
W20260620 13:58:14.839562  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 92953.1us
W20260620 13:58:14.886387  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 192949us
W20260620 13:58:14.893070  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 236744us
I20260620 13:58:14.870857  5777 catalog_manager.cc:5696] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 11 to 15, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 15 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.957499  5777 catalog_manager.cc:5696] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.999145  5778 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56594 (request call id 335) took 9917 ms. Trace:
I20260620 13:58:14.999642  5778 rpcz_store.cc:276] 0620 13:58:05.068850 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:05.069061 (+   211us) service_pool.cc:224] Handling call
0620 13:58:14.986083 (+9917022us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":585,"reported_tablets":45}
W20260620 13:58:15.007601  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:15.010530  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 57313.9us
I20260620 13:58:15.042788  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:58:15.048388  4719 tablet_replica.cc:333] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.050274  4719 raft_consensus.cc:2243] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 16 LEADER]: Raft consensus shutting down.
W20260620 13:58:15.069169  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:15.071296 11894 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:15.076449 11894 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:15.079675 11894 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:15.086494  4719 raft_consensus.cc:2272] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.092320  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:15.091969  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:15.096366  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:15.112280  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:15.112493  4719 tablet_replica.cc:333] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.114882  4719 raft_consensus.cc:2243] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.116011  4719 pending_rounds.cc:70] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
W20260620 13:58:15.134897  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:15.145830  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:15.149264  5849 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:15.152350 11901 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:15.116572  4719 pending_rounds.cc:77] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 15 index: 9 } timestamp: 7298924030170198016 op_type: NO_OP noop_request { }
I20260620 13:58:15.155923  4719 raft_consensus.cc:2889] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.164496  4719 raft_consensus.cc:2272] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:15.182418  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:15.188349  4719 tablet_replica.cc:333] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.190980  4719 raft_consensus.cc:2243] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.192546  4719 raft_consensus.cc:2272] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.195885  4719 tablet_replica.cc:333] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.197499  4719 raft_consensus.cc:2243] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.198315  4719 raft_consensus.cc:2272] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.201758  4719 tablet_replica.cc:333] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.203151  4719 raft_consensus.cc:2243] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 16 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.204313  4719 raft_consensus.cc:2272] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.207975  4719 tablet_replica.cc:333] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.209319  4719 raft_consensus.cc:2243] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.210162  4719 raft_consensus.cc:2272] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.213442  4719 tablet_replica.cc:333] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.214704  4719 raft_consensus.cc:2243] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.215621  4719 raft_consensus.cc:2272] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.218691  4719 tablet_replica.cc:333] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.219794  4719 raft_consensus.cc:2243] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.221060  4719 pending_rounds.cc:70] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.221364  4719 pending_rounds.cc:77] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 13 index: 10 } timestamp: 7298924084686622720 op_type: NO_OP noop_request { }
I20260620 13:58:15.221937  4719 raft_consensus.cc:2889] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.222368  4719 raft_consensus.cc:2272] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.226383  4719 tablet_replica.cc:333] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.227433  4719 raft_consensus.cc:2243] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.228586  4719 raft_consensus.cc:2272] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.233552  4719 tablet_replica.cc:333] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.234750  4719 raft_consensus.cc:2243] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:15.234989  5767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51352.9us
I20260620 13:58:15.235426  4719 pending_rounds.cc:70] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.235728  4719 pending_rounds.cc:77] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 9 index: 7 } timestamp: 7298924051582746624 op_type: NO_OP noop_request { }
I20260620 13:58:15.236131  4719 raft_consensus.cc:2889] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.236467  4719 raft_consensus.cc:2272] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.239634  4719 tablet_replica.cc:333] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.240625  4719 raft_consensus.cc:2243] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 19 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.243183  4719 raft_consensus.cc:2272] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:15.243989  5767 catalog_manager.cc:4754] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): ChangeConfig:REMOVE_PEER RPC failed for tablet 71fbe22bd18849f1b94912bb0bdf5bbe: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:15.246264  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:15.248435  4719 tablet_replica.cc:333] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
W20260620 13:58:15.249274  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:15.254056  4719 raft_consensus.cc:2243] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.254889  4719 raft_consensus.cc:2272] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.258797  4719 tablet_replica.cc:333] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.260046  4719 raft_consensus.cc:2243] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.260788  6584 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260620 13:58:15.261230  4719 pending_rounds.cc:70] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.261556  4719 pending_rounds.cc:77] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 12 index: 10 } timestamp: 7298924015162245120 op_type: NO_OP noop_request { }
I20260620 13:58:15.261987  4719 raft_consensus.cc:2889] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.262531  4719 raft_consensus.cc:2272] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.265671 11901 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:15.275215  4719 tablet_replica.cc:333] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.276249  4719 raft_consensus.cc:2243] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.276969  4719 pending_rounds.cc:70] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.277217  4719 pending_rounds.cc:77] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 17 index: 11 } timestamp: 7298924113035751424 op_type: NO_OP noop_request { }
I20260620 13:58:15.277535  4719 raft_consensus.cc:2889] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.277843  4719 raft_consensus.cc:2272] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.281559  4719 tablet_replica.cc:333] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.282490  4719 raft_consensus.cc:2243] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.283452  4719 raft_consensus.cc:2272] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.286849  4719 tablet_replica.cc:333] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.299800  4719 raft_consensus.cc:2243] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.300498  4719 pending_rounds.cc:70] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.300740  4719 pending_rounds.cc:77] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 12 index: 6 } timestamp: 7298924032944414720 op_type: NO_OP noop_request { }
I20260620 13:58:15.301118  4719 raft_consensus.cc:2889] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.301533  4719 raft_consensus.cc:2272] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.302904  5780 catalog_manager.cc:5696] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:15.304739  4719 tablet_replica.cc:333] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.311540  4719 raft_consensus.cc:2243] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.313042  4719 raft_consensus.cc:2272] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.328258  4719 tablet_replica.cc:333] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.329121  4719 raft_consensus.cc:2243] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.329681  4719 pending_rounds.cc:70] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.329945  4719 pending_rounds.cc:77] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 15 index: 9 } timestamp: 7298924035047546880 op_type: NO_OP noop_request { }
I20260620 13:58:15.330339  4719 raft_consensus.cc:2889] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.330917  4719 raft_consensus.cc:2272] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.333787  4719 tablet_replica.cc:333] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.335081  4719 raft_consensus.cc:2243] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.339171  4719 raft_consensus.cc:2272] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.342228  4719 tablet_replica.cc:333] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.343123  4719 raft_consensus.cc:2243] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.343834  4719 raft_consensus.cc:2272] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.347450  4719 tablet_replica.cc:333] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.348371  4719 raft_consensus.cc:2243] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 16 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.349675  4719 raft_consensus.cc:2272] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.364989  4719 tablet_replica.cc:333] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.366178  4719 raft_consensus.cc:2243] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.366873  4719 raft_consensus.cc:2272] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.370447  4719 tablet_replica.cc:333] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.371515  4719 raft_consensus.cc:2243] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.372411  4719 raft_consensus.cc:2272] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.375502  5777 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56624 (request call id 348) took 1872 ms. Trace:
I20260620 13:58:15.387851  4719 tablet_replica.cc:333] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.375979  5777 rpcz_store.cc:276] 0620 13:58:13.503550 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:13.504143 (+   593us) service_pool.cc:224] Handling call
0620 13:58:15.375431 (+1871288us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:58:15.051421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:58:15.051987 (+   566us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:58:15.052021 (+    34us) write_op.cc:435] Acquired schema lock
0620 13:58:15.052043 (+    22us) tablet.cc:662] Decoding operations
0620 13:58:15.061192 (+  9149us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:58:15.061305 (+   113us) write_op.cc:641] Partition lock acquired for write op
0620 13:58:15.061334 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0620 13:58:15.061885 (+   551us) tablet.cc:701] Row locks acquired
0620 13:58:15.061905 (+    20us) write_op.cc:260] PREPARE: finished
0620 13:58:15.062043 (+   138us) write_op.cc:270] Start()
0620 13:58:15.062211 (+   168us) write_op.cc:276] Timestamp: P: 1781963895061998 usec, L: 0
0620 13:58:15.062234 (+    23us) op_driver.cc:348] REPLICATION: starting
0620 13:58:15.062857 (+   623us) log.cc:844] Serialized 919 byte log entry
0620 13:58:15.189559 (+126702us) op_driver.cc:464] REPLICATION: finished
0620 13:58:15.249776 (+ 60217us) write_op.cc:301] APPLY: starting
0620 13:58:15.249865 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:15.258152 (+  8287us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:15.258264 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:15.263435 (+  5171us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:15.263631 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0620 13:58:15.263676 (+    45us) write_op.cc:312] APPLY: finished
0620 13:58:15.263863 (+   187us) log.cc:844] Serialized 33 byte log entry
0620 13:58:15.264028 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:15.264115 (+    87us) write_op.cc:454] Released schema lock
0620 13:58:15.264152 (+    37us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:15.296030 (+ 31878us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:15.296061 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":182019,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":52292,"apply.run_cpu_time_us":4865,"apply.run_wall_time_us":46168,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12495,"num_ops":2,"prepare.queue_time_us":39983,"prepare.run_cpu_time_us":3112,"prepare.run_wall_time_us":11773,"replication_time_us":127160,"spinlock_wait_cycles":2432,"thread_start_us":89750,"threads_started":2}]]}
I20260620 13:58:15.403283  4719 raft_consensus.cc:2243] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.404699  4719 raft_consensus.cc:2272] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.415164  4719 tablet_replica.cc:333] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.416054  4719 raft_consensus.cc:2243] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 20 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.417414  4719 raft_consensus.cc:2272] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.420516  4719 tablet_replica.cc:333] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.431713  4719 raft_consensus.cc:2243] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.432394  4719 raft_consensus.cc:2272] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.435437  4719 tablet_replica.cc:333] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.436268  4719 raft_consensus.cc:2243] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.445835  4719 raft_consensus.cc:2272] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.448818  4719 tablet_replica.cc:333] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.449749  4719 raft_consensus.cc:2243] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.450390  4719 raft_consensus.cc:2272] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.453465  4719 tablet_replica.cc:333] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.454381  4719 raft_consensus.cc:2243] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.455485  4719 raft_consensus.cc:2272] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.458710  4719 tablet_replica.cc:333] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.459568  4719 raft_consensus.cc:2243] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.460206  4719 raft_consensus.cc:2272] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.463225  4719 tablet_replica.cc:333] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.464046  4719 raft_consensus.cc:2243] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.464954  4719 raft_consensus.cc:2272] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.473001  4719 tablet_replica.cc:333] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.488751  4719 raft_consensus.cc:2243] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.498107  4719 raft_consensus.cc:2272] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.496331 11901 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:15.498757 11901 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:15.501057  4719 tablet_replica.cc:333] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.501125 11901 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:15.502154  4719 raft_consensus.cc:2243] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.506249  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:15.511979  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:15.503050  4719 raft_consensus.cc:2272] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.519624  4719 tablet_replica.cc:333] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.520565  4719 raft_consensus.cc:2243] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.521147  4719 raft_consensus.cc:2272] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.522792  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:15.523880  5849 raft_consensus.cc:2686] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 13:58:15.524999  4719 tablet_replica.cc:333] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.526266  4719 raft_consensus.cc:2243] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.526876  4719 raft_consensus.cc:2272] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.542809  4719 tablet_replica.cc:333] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.543751  4719 raft_consensus.cc:2243] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.544345  4719 pending_rounds.cc:70] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.544569  4719 pending_rounds.cc:77] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 14 index: 10 } timestamp: 7298924031453487104 op_type: NO_OP noop_request { }
I20260620 13:58:15.544919  4719 raft_consensus.cc:2889] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.545248  4719 raft_consensus.cc:2272] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.558807  4719 tablet_replica.cc:333] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.559747  4719 raft_consensus.cc:2243] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.560384  4719 pending_rounds.cc:70] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Trying to abort 2 pending ops.
I20260620 13:58:15.560622  4719 pending_rounds.cc:77] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 15 index: 11 } timestamp: 7298924031446654976 op_type: NO_OP noop_request { }
I20260620 13:58:15.561025  4719 raft_consensus.cc:2889] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.573997  4719 pending_rounds.cc:77] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 13 index: 10 } timestamp: 7298923981674422272 op_type: NO_OP noop_request { }
I20260620 13:58:15.574373  4719 raft_consensus.cc:2889] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.574757  4719 raft_consensus.cc:2272] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.597966  4719 tablet_replica.cc:333] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.598630 11901 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:15.598875  4719 raft_consensus.cc:2243] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.599622  4719 pending_rounds.cc:70] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.599295 11901 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:15.599925  4719 pending_rounds.cc:77] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 14 index: 9 } timestamp: 7298924031119417344 op_type: NO_OP noop_request { }
I20260620 13:58:15.600322  4719 raft_consensus.cc:2889] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.600781  4719 raft_consensus.cc:2272] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.603032  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:15.606786 11901 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:15.608090  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:15.615481  5849 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:15.619699 11901 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:15.628872  4719 tablet_replica.cc:333] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.629792  4719 raft_consensus.cc:2243] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.630935  4719 raft_consensus.cc:2272] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.639312  4719 tablet_replica.cc:333] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.640115  4719 raft_consensus.cc:2243] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.641355  4719 raft_consensus.cc:2272] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.685981  4719 tablet_replica.cc:333] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.686872  4719 raft_consensus.cc:2243] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.687630  4719 raft_consensus.cc:2272] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.697127  4719 tablet_replica.cc:333] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.704746  4719 raft_consensus.cc:2243] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.705648  4719 raft_consensus.cc:2272] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.708710  4719 tablet_replica.cc:333] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.709568  4719 raft_consensus.cc:2243] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.711630  4719 pending_rounds.cc:70] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.713335  4719 pending_rounds.cc:77] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 12 index: 7 } timestamp: 7298924032892555264 op_type: NO_OP noop_request { }
I20260620 13:58:15.715219  4719 raft_consensus.cc:2889] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.715649  4719 raft_consensus.cc:2272] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.718752  4719 tablet_replica.cc:333] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.722652  4719 raft_consensus.cc:2243] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.727929  4719 pending_rounds.cc:70] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.728266  4719 pending_rounds.cc:77] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 13 index: 10 } timestamp: 7298924030041391104 op_type: NO_OP noop_request { }
I20260620 13:58:15.728714  4719 raft_consensus.cc:2889] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.729128  4719 raft_consensus.cc:2272] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.732295  4719 tablet_replica.cc:333] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.734529  4719 raft_consensus.cc:2243] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.736472  4719 raft_consensus.cc:2272] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:15.744445  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:15.821699  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:15.848755  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:15.868202  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:15.965823  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:15.972590  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:16.061662 11842 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.062758 11842 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.065404 11842 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.067437  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:16.087145  5924 leader_election.cc:336] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:16.087612  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:16.088845 11842 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260620 13:58:16.143533  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:16.144234  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:16.144729  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:16.145184  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:16.234144 11910 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.234788 11910 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.237262 11910 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.239539  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:16.240211  5955 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:58:16.241981  5997 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:16.243995 11908 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:16.244423 11908 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.244768 11908 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
W20260620 13:58:16.251348  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:16.252015  5998 leader_election.cc:336] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.253722 11908 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.264602  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:16.265233  5955 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:16.264428 11908 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:16.271584  5998 leader_election.cc:336] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.272423  5955 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
I20260620 13:58:16.273675  5997 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.275059 11908 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:58:16.276432 11908 raft_consensus.cc:697] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:16.277393 11908 consensus_queue.cc:237] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:16.299754  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:16.311934  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:16.314823  5777 catalog_manager.cc:5696] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 16 to 17, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 17 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:16.448354 11877 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.449049 11877 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.451300 11877 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.455183  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:16.457157  6552 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.458438  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:16.459579 11877 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:58:16.462538 11914 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.463167 11914 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.465564 11914 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.466441 11914 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.467068 11914 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.469421 11914 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:16.475461  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:16.480527  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.484437  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:16.506291  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:16.528874  5924 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.534451  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:16.536485 11914 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260620 13:58:16.538393  5924 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.542855 11912 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.543746 11912 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:16.552744  6552 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.554057 11912 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.555382  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:16.556089  5955 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 19.
W20260620 13:58:16.542995  5767 catalog_manager.cc:4754] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): ChangeConfig:REMOVE_PEER RPC failed for tablet 71fbe22bd18849f1b94912bb0bdf5bbe: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.558207  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:16.558277  6551 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.559549 11912 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260620 13:58:16.559924 11912 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.560290 11912 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:58:16.560389 11914 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:16.568862 11912 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:16.579514  6552 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.582844 11912 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.583133  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:16.583793  5953 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:58:16.593940 11908 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.594563 11908 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.595096 11912 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.595659 11912 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.597635 11912 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.598125  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:16.600518  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.603523 11910 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.604173 11910 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.606339 11910 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:16.610164  5998 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.610219  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.610745  5998 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.615268 11885 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:16.616710  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.616779 11912 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.618325 11912 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.620617 11912 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:16.620704  6552 leader_election.cc:336] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.621237  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:16.625406  5998 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.626564  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:16.627529 11885 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:16.597096  5953 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 20.
I20260620 13:58:16.630533 11908 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.632663  6551 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.633832 11877 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:58:16.633958 11912 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Leader election won for term 20
I20260620 13:58:16.634800 11912 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 20 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:16.636248 11912 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:16.641644  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:16.647250 11842 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.647840 11842 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.646896 11914 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.651731 11914 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.653820 11914 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.656320 11889 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.659212  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.650921 11842 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.656883 11889 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.668627 11908 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.668785 11889 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.669282 11908 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.672271  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.672878  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.673400 11877 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.673803  6584 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:58:16.674157  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.674015 11877 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.679001  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:16.679929  5955 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 17.
W20260620 13:58:16.681176  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:16.682142 11908 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.683424 11912 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.684371 11912 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.679358 11877 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.672982  6033 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 17.
I20260620 13:58:16.690778  5777 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 19 to 20, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 20 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:16.693491  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:16.696940  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.697927  6584 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 17.
I20260620 13:58:16.696911  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.699297  6033 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 17.
I20260620 13:58:16.701687  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:16.704157  5998 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.709681  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:16.710120  5924 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.710439  6584 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:58:16.707285 11912 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.710709 11909 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.711972 11889 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:16.707633  6552 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:16.712430 11889 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.713025 11889 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:16.713099 11912 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:16.715523 11912 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.716212 11912 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:16.711414 11909 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.720618 11909 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.722440  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:16.718271  5998 leader_election.cc:336] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.723701  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:16.714977  6552 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.724634  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:16.710777  5924 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.725858  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:16.727587 11937 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:16.731536 11885 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:16.731964 11909 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260620 13:58:16.733878  5953 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260620 13:58:16.732043 11885 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.735255 11885 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:16.740306 11910 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:58:16.748101  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.750037 11937 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:16.750494 11937 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.750116 11889 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.750893 11937 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:16.752375 11889 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.756505  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:16.757248  6584 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:16.760275 11885 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:16.763897  6552 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:16.765548  6552 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:16.766595  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:16.772462  5998 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.772505  6552 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.767531 11908 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.774544  6584 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
I20260620 13:58:16.773813 11908 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.776329 11877 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:16.777752 11908 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.762900 11885 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:16.781965  5998 leader_election.cc:336] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:16.782536  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:16.768193 11937 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.770545  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:16.771552 11909 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.788389  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.788700 11909 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.788434  6578 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:16.793548 11937 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.790848 11909 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.803560 11912 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.806492 11912 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.810842  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:16.811522  6024 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:16.815593 11909 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.816159 11909 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.818231 11909 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:16.818585  5998 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.819371 11910 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:58:16.819499  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:16.819907 11910 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:16.820255  5951 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 18: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:58:16.820765 11910 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.821784  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.822343  6584 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 20.
I20260620 13:58:16.824363  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.831302 11940 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.831954 11940 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.834571 11940 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.839706 11885 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260620 13:58:16.840425 11885 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.841005 11885 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Advancing to term 21
W20260620 13:58:16.841272  5924 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.802814  6578 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
I20260620 13:58:16.843255 11909 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.843815 11909 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:16.844388  6552 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.845000  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.846079 11909 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.847482  6024 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 18.
I20260620 13:58:16.848614 11877 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:16.861040 11937 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.861792 11937 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.864337 11937 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:16.874511  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 55956.5us
W20260620 13:58:16.875730  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 51440.8us
I20260620 13:58:16.880120 11908 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.880563 11885 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.880785 11908 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.883184 11908 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.884296 11942 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.885718 11942 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.886385  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.887334  6024 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 17.
W20260620 13:58:16.896400  5924 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.894327  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:16.897842  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.901639  6033 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 18: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:58:16.902920 11945 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:58:16.888031 11942 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.907359  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:16.907747  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:16.909161  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.910780  6578 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
I20260620 13:58:16.910936  6033 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:58:16.900590  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.915383  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:16.917910  6578 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 18: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:16.916944  6024 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 17.
I20260620 13:58:16.909888 11945 raft_consensus.cc:697] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:16.912876  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:16.924844  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:16.912793 11885 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 21 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.925664  5951 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:58:16.927242 11942 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.927831 11942 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.929039 11941 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:16.929471 11941 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.929826 11941 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:16.929946 11942 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.930361  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:16.930963  6584 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Advancing to term 21
I20260620 13:58:16.932124  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.933117  6578 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:58:16.944025  5997 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:16.953369  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:16.954061  5998 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.954201  5951 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
I20260620 13:58:16.954174 11885 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:16.955199 11885 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.956020 11885 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:16.959637  6584 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 21.
I20260620 13:58:16.959856  5777 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 16 to 17, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 17 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:16.928583 11945 consensus_queue.cc:237] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.953521  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:16.954994  5998 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.967928  6552 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:16.968783 11909 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:16.969293 11909 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.969801 11909 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:16.970180 11940 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260620 13:58:16.969283 11885 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.977509 11885 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.924080 11889 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:58:16.978366  5998 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.978296 11889 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.981105 11889 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.981906  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:16.982220  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.983343 11909 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.959808  5997 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:16.984617 11889 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Leader election won for term 21
I20260620 13:58:16.984774 11885 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:16.985342 11885 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.986119  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:16.986701  5955 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:16.987785 11889 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:16.988948 11889 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.996172  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:16.996307  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.997692  6584 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:17.002311 11940 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:58:16.985752 11885 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:17.002818 11940 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:17.004864 11940 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:16.998574  5955 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:58:17.016954 11909 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:17.012002  5998 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.021749  5997 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:17.022651 11945 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:58:17.024056 11885 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:17.046018 11885 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:17.028970 11945 raft_consensus.cc:697] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:17.032210  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:17.033375  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:17.047006  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:16.988082 11941 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.047879  5955 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:17.047886 11945 consensus_queue.cc:237] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:17.054539  5998 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.041630  5777 catalog_manager.cc:5696] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 16 to 17, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 17 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:17.026235 11909 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:17.055316 11940 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.055652 11909 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:17.056083  5777 catalog_manager.cc:5696] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 20 to 21, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 21 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:17.069595 11909 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:17.070045 11941 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:17.047644  6033 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
W20260620 13:58:17.055348  5998 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.059132  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:17.073729  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:17.074957 11889 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:17.076244 11937 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260620 13:58:17.081094  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:17.080847 11909 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.061162  5955 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 18.
I20260620 13:58:17.064353  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:17.082204  6024 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
W20260620 13:58:17.086609  5998 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:17.087265  5998 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.088342  5997 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:17.089386 11908 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election won for term 18
I20260620 13:58:17.090040 11908 raft_consensus.cc:697] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:17.090656 11889 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:17.091192 11889 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:17.091140 11908 consensus_queue.cc:237] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:17.097098  6024 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 18.
I20260620 13:58:17.101693 11914 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:17.102198 11914 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:17.102589 11914 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:17.104108  4719 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 5905)
I20260620 13:58:17.107533  6578 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 18: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:17.109508 11937 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:17.110065 11937 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.112164 11937 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:17.116701  5924 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:17.119266  6552 leader_election.cc:336] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.120007  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:17.121160  6552 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:17.122437  6552 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:17.123799  6552 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:17.124784  6552 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.104225 11940 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:17.126112 11948 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260620 13:58:17.142782 11889 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.152918  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:17.159579 11912 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:17.160127 11912 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:17.160567 11912 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:17.138375 11909 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:17.168818  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:17.170339  5955 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260620 13:58:17.171134  5777 catalog_manager.cc:5696] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 15 to 16, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 16 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:17.172565 11877 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election won for term 18
I20260620 13:58:17.173084 11877 raft_consensus.cc:697] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 18 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:17.172807  5777 catalog_manager.cc:5696] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 17 to 18, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 18 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:17.173987 11877 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.174945 11940 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260620 13:58:17.179172  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:17.179916  6552 leader_election.cc:336] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.181609 11914 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.189004  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:17.189810  6024 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:17.192394  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:17.185953  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:17.196960  6033 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 18: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:17.196882  6578 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:58:17.201632  6024 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:58:17.177000 11912 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.222970 11912 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:17.222865  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:17.229925 11889 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:17.242419 11914 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:17.244442  5998 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.269992  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:17.277376  6033 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 15: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:58:17.279832  6552 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:17.286870  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:17.292230  6552 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.292758  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:17.287958  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 98405.1us
I20260620 13:58:17.298259  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:17.282965  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 66168.4us
I20260620 13:58:17.269418 11909 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:58:17.299609 11909 raft_consensus.cc:697] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:58:17.300221  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:17.300596 11909 consensus_queue.cc:237] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.301970 11877 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260620 13:58:17.303371 11937 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:17.306770 11937 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:17.307199 11937 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:17.310340  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:17.310634  6552 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.310978  6578 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:17.311043  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:17.312212 11950 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260620 13:58:17.314129  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:17.319566  6578 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 15.
W20260620 13:58:17.321045  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:17.324440  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:17.324913  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:17.325304  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:17.333407  5777 catalog_manager.cc:5696] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 17 to 18, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 18 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:17.337118  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:17.338131  5924 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.338734 11914 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:58:17.339304 11914 raft_consensus.cc:697] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:17.340189 11914 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.358547  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:17.359584  6578 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 15: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:17.362857  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:17.366103 11885 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:58:17.379388  6582 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260620 13:58:17.385311 11937 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:17.418673  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:17.425146  5924 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.425726  5777 catalog_manager.cc:5696] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 14 to 15, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 15 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:17.426018 11937 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:17.440292  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:17.440897  6584 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:17.450241  5955 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260620 13:58:17.459237  5780 catalog_manager.cc:5696] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 11 to 12, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 12 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:17.463264 11941 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:17.471870 11941 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260620 13:58:17.500941  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:17.512965  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:17.514484  6582 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260620 13:58:17.524320 11941 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:58:17.536767  6584 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:58:17.577080  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:17.578497 11937 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:58:17.579044 11937 raft_consensus.cc:697] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:17.580039 11937 consensus_queue.cc:237] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:17.590390  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:17.623629  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:17.647135  6584 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260620 13:58:17.652212  5777 catalog_manager.cc:5696] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 12 to 13, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 13 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:58:17.656755  5767 catalog_manager.cc:4754] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): ChangeConfig:REMOVE_PEER RPC failed for tablet 71fbe22bd18849f1b94912bb0bdf5bbe: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.670885  5957 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260620 13:58:17.672621 11941 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260620 13:58:17.690376  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:17.691700 11942 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260620 13:58:17.696175  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:17.721334  6027 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260620 13:58:17.722675 11965 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260620 13:58:17.757519  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:17.759405  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:17.765650 11973 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260620 13:58:17.804512  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:17.805243  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:17.893457  6027 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260620 13:58:17.897357 11912 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260620 13:58:17.909310  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:17.943328  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:17.949642  6584 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260620 13:58:17.952682 11957 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260620 13:58:18.104677  4719 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:18.187258  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:18.199573  6578 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260620 13:58:18.205581 11957 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260620 13:58:18.346880  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.387667  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 60033.4us
W20260620 13:58:18.429149  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.440490  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.458397  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.471418  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.562808  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.588778  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:18.620458 11937 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:18.621100 11937 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:18.629357 11937 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:18.635043  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:18.635843  6027 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 18.
I20260620 13:58:18.643688  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:18.644404  5924 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:18.644418  6578 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 18.
I20260620 13:58:18.647403  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:18.647799  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:18.649667 11937 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260620 13:58:18.650612 11937 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:18.651041 11937 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:18.683753 11937 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:18.700693  5924 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:18.703136  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:18.703693  6027 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:18.713181  6027 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 19.
W20260620 13:58:18.714038  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:18.715390  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:18.721122  6578 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:18.722141 11937 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:18.728883  6578 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 19.
I20260620 13:58:18.730692  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:18.732204 11937 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Leader election won for term 19
I20260620 13:58:18.733085 11937 raft_consensus.cc:697] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:18.734297 11937 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:18.766271  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:18.801882  5778 catalog_manager.cc:5696] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 17 to 19, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 19 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:58:18.826242  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.834371  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.877797  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.919091  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:18.945359 11912 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:18.946045 11912 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:18.948691 11912 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:18.951365  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:18.952257  6024 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:58:18.955264  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:18.956491 11909 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:18.956938 11909 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:18.957283 11909 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
W20260620 13:58:18.967334  6552 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:18.970417 11909 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:18.980145 11909 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:19.002887  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:19.003566  6024 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
W20260620 13:58:19.009260  6552 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:19.017958  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:19.021765  6024 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 16.
I20260620 13:58:19.027750  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:19.032683 11909 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election won for term 16
W20260620 13:58:19.046494  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 58025.3us
W20260620 13:58:19.061422  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:19.072983  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:19.085218 11909 raft_consensus.cc:697] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:19.102635  5953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56494
I20260620 13:58:19.103574  5953 raft_consensus.cc:606] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Received request to transfer leadership
I20260620 13:58:19.099244 11909 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:19.105270  4719 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 5905)
I20260620 13:58:19.108353  5957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56494
I20260620 13:58:19.109017  5957 raft_consensus.cc:606] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Received request to transfer leadership
I20260620 13:58:19.141916  5957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56494
I20260620 13:58:19.142556  5957 raft_consensus.cc:606] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Received request to transfer leadership
I20260620 13:58:19.150887  6584 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260620 13:58:19.156862 11937 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260620 13:58:19.193326 11957 raft_consensus.cc:993] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: : Instructing follower b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:58:19.193797 11957 raft_consensus.cc:1081] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Signalling peer b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:58:19.194033  5778 catalog_manager.cc:5696] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 14 to 16, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 16 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:19.204962  6584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:46864
I20260620 13:58:19.205646  6584 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:58:19.205976  6584 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:58:19.217437  6584 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:19.257880  6024 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260620 13:58:19.260102 11937 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260620 13:58:19.261794  6584 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:19.266583  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:19.276741  5953 raft_consensus.cc:3055] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Stepping down as leader of term 19
W20260620 13:58:19.277791  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:19.279325  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:19.283030  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:19.283702  6033 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:58:19.277101  5953 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:19.285095  5953 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:19.286291  5953 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Advancing to term 20
W20260620 13:58:19.298538  6552 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:19.300770  6033 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 20.
I20260620 13:58:19.301065  5953 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 20.
W20260620 13:58:19.306103  5829 auto_rebalancer.cc:855] Removing replace marker failed: Replica 192c750f597c43858e1ad09e8d805685 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:19.306525  5829 auto_rebalancer.cc:863] Could not move replica: Remote error: Service unavailable: leadership transfer for 71fbe22bd18849f1b94912bb0bdf5bbe already in progress
W20260620 13:58:19.306831  5829 auto_rebalancer.cc:301] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 71fbe22bd18849f1b94912bb0bdf5bbe already in progress
I20260620 13:58:19.312456 11945 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:19.313041 11945 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:19.314656  6552 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:19.317411 11988 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Leader election won for term 20
I20260620 13:58:19.317973 11988 raft_consensus.cc:697] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 20 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:19.318943 11988 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:19.323010 11945 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:19.325592  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:19.326241  6584 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 18.
I20260620 13:58:19.336102  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:19.339270 11945 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260620 13:58:19.339695 11945 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:19.341612  5778 catalog_manager.cc:5696] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 19 to 20, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 20 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:58:19.347579  5998 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:19.340143 11945 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:19.396739 11945 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:19.400408 11945 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:19.401758  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:19.402377  6584 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Advancing to term 19
W20260620 13:58:19.406271  5998 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:19.423669  6584 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 19.
I20260620 13:58:19.426328  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:19.427016 11994 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Leader election won for term 19
I20260620 13:58:19.427834 11994 raft_consensus.cc:697] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:19.428762 11994 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:19.458420  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:19.474675  5778 catalog_manager.cc:5696] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 17 to 19, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 19 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:19.519424  6024 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260620 13:58:19.521606 11909 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260620 13:58:19.534365  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:19.544275  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:19.549060  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:19.623906  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:19.672780  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:19.712538  6024 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260620 13:58:19.714857 11912 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260620 13:58:19.784860  5924 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111) [suppressed 423 similar messages]
I20260620 13:58:19.810145  5957 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260620 13:58:19.811535  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260620 13:58:19.812501 11988 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260620 13:58:19.825752  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 64216.1us
W20260620 13:58:19.867674  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:19.868732  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:19.869467  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:19.880129  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:19.907506  5767 catalog_manager.cc:5226] ChangeConfig:REMOVE_PEER RPC for tablet 71fbe22bd18849f1b94912bb0bdf5bbe with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260620 13:58:19.911222  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 49898.1us
W20260620 13:58:19.926048  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:19.954628  6584 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260620 13:58:19.970422  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:19.970996  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260620 13:58:19.989900 12005 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260620 13:58:20.068739  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:20.099857  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:20.106587  4719 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:20.173903  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:20.276417  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:20.291280  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:20.335647  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:20.343794  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:20.352159  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:20.353955  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:20.387339  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:20.628597  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:20.643982  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:20.666546  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:20.845752  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:20.962123  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.109617  4719 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:21.181331  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.187976  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.190474  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.193243  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.193782  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.208027  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.321287  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.335989  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.470304  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.480934  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:21.502365  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.573356  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.704797  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.753752  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.832056  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:21.907552  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.912948  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.955436  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.051245  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.109737  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:22.110210  4719 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:22.132949  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 99610us
W20260620 13:58:22.152882  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:22.242769  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.317227  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:22.336095  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:22.437754  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.448881  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.468832  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:22.489051  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.578408  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.605912  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.607693  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.687413  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:22.721342  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:22.826428  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:22.882519  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:22.973296  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.988996  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.049105  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:23.111881  4719 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:23.116313  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:23.159421  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:23.209328  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.313004  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:23.411029  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.438529  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.508450  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.523320  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.534442  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.651716  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.654755  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.753443  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:24.020084  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:24.020888  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:24.021427  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260620 13:58:24.044579  6582 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:24.094357  6027 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260620 13:58:24.098333 12020 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260620 13:58:24.088992  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:24.109124  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:24.112612  4719 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:24.117758  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260620 13:58:24.144315 12019 raft_consensus.cc:2955] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 8 to 14, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:24.159495  6027 raft_consensus.cc:2955] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 8 to 14, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:24.183892  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:24.224378  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260620 13:58:24.274618  5778 catalog_manager.cc:5696] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 8 to 14, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New cstate: current_term: 20 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:24.359474  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 71fbe22bd18849f1b94912bb0bdf5bbe with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
W20260620 13:58:24.398826  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:24.400657  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260620 13:58:24.403579  5949 tablet_service.cc:1558] Processing DeleteTablet for tablet 71fbe22bd18849f1b94912bb0bdf5bbe with delete_type TABLET_DATA_TOMBSTONED (TS 192c750f597c43858e1ad09e8d805685 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:56494
W20260620 13:58:24.441682  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260620 13:58:24.524760 12030 tablet_replica.cc:333] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:24.553256 12030 raft_consensus.cc:2243] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:24.559669 12030 raft_consensus.cc:2272] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:24.586604 12030 ts_tablet_manager.cc:1916] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260620 13:58:24.582432  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:24.605171  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:24.611893  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:24.617553  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:24.618260  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:24.627410  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:24.691799  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:24.726459  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:24.740443 12030 ts_tablet_manager.cc:1929] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.13
I20260620 13:58:24.741285 12030 log.cc:1199] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/wals/71fbe22bd18849f1b94912bb0bdf5bbe
I20260620 13:58:24.743932  5766 catalog_manager.cc:5027] TS 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): tablet 71fbe22bd18849f1b94912bb0bdf5bbe (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
W20260620 13:58:24.751722  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:24.777184  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:24.777765  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:24.849149  5998 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111) [suppressed 449 similar messages]
W20260620 13:58:24.875967  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:24.916411  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:24.989089  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:25.031225  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:25.113206  4719 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:25.214633  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:25.261606  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:25.262503  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:25.275012  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:25.282362  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:25.346730  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:25.524688  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:25.568738  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:25.707789  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:25.765190  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:25.960832  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.019255  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:26.041878  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.113466  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:26.113708  4719 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:26.114037  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.132413  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.175251  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 58194.1us
W20260620 13:58:26.212134  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.223325  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.226866  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.397590  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.587450  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.623179  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.687306  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.695964  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:26.723227  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.787618  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.816176  5812 debug-util.cc:398] Leaking SignalData structure 0x7b0800308000 after lost signal to thread 4722
W20260620 13:58:26.817345  5812 debug-util.cc:398] Leaking SignalData structure 0x7b08001948c0 after lost signal to thread 5815
W20260620 13:58:26.818661  5812 debug-util.cc:398] Leaking SignalData structure 0x7b0800035380 after lost signal to thread 5983
W20260620 13:58:26.819810  5812 debug-util.cc:398] Leaking SignalData structure 0x7b0800034d40 after lost signal to thread 6057
W20260620 13:58:26.821324  5812 debug-util.cc:398] Leaking SignalData structure 0x7b08001725a0 after lost signal to thread 6611
W20260620 13:58:26.828399  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.972661  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:27.031857  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:27.085577  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:27.114776  4719 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:27.118801  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:27.143612  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:27.173522  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:27.217525  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:27.223919  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.253543  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.301852  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.303920  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:27.320514  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.370146  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.385782  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:27.403410  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:27.410187  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.746675  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:27.759907  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:27.762957  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:27.781060  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.805656  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.849509  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.005556  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.009836  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.115312  4719 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:28.298512  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:28.334697  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:28.356916  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.388926  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.459909  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.466511  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.532045  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:28.546291  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.573807  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.676573  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:28.775310  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.815584  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.908795  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.919811  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:29.070269  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.079260  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:29.090238  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.115800  4719 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:29.313788  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.371599  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.422955  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.433701  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.491431  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:29.549681  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.587122  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:29.601053  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.618994  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:29.654975  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:29.690016  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.712522  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:29.752080  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.801847  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:29.830238  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:29.878881  6552 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111) [suppressed 441 similar messages]
W20260620 13:58:29.891314  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:29.896106  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:29.937305  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:29.974190  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:30.029333  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.116365  4719 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:30.162879  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.284505  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:30.349702  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:30.385330  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.396354  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.502813  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:30.562105  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.657449  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.785882  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.889709  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:30.906824  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.926275  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:30.924314  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.002255  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:31.049196  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.070832  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.080200  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.109310  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:31.116981  4719 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:31.180369  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.237552  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.346577  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 77149.5us
W20260620 13:58:31.362918  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.426620  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.446596  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.528671  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:31.566143  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.588680  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:31.632441  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.665544  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.875547  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.908579  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:31.940757  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 51959us
W20260620 13:58:32.021153  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:32.060791  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:32.073865  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.079787  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:32.108177  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:32.111884  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:32.117468  4719 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:32.169091  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:32.242837  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:32.262337  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.271541  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.315759  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:32.322211  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.322949  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.443183  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.444128  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:32.607620  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.888542  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:32.930119  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.933775  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:32.936564  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:33.025722  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.048575  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.079697  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.117959  4719 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:33.139086  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.215399  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.239842  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:33.292147  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.331665  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:33.460968  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.484815  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:33.491546  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.522518  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.550936  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.559798  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.643694  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.720047  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:33.784821  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 49512.6us
W20260620 13:58:33.795066  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.888890  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 73056.9us
W20260620 13:58:33.920437  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.055263  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:34.078720  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:34.115020  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.118669  4719 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:34.155812  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.225785  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.329171  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.365911  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:34.509532  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.512696  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:34.572535  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.574370  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:34.630394  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:34.644611  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:34.695688  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:34.727514  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:34.728479  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:34.747448  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.779811  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.797338  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:34.836436  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:34.880479  6552 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111) [suppressed 453 similar messages]
W20260620 13:58:34.907912  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:34.966534  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.012040  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.045720  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:35.119185  4719 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:35.362258  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:35.437079  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.512944  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.514063  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.514581  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:35.530820  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:35.536854  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.647372  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.815261  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.850651  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.881553  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260620 13:58:36.016101  4719 tablet_server.cc:196] TabletServer@127.4.155.193:0 shutdown complete.
W20260620 13:58:36.063259  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:36.076894  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:36.077612  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.098176  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.119257  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.127628  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:36.163156  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:36.164168  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.347841  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.467077  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.527444  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:36.541664  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260620 13:58:36.543498  4719 tablet_server.cc:179] TabletServer@127.4.155.194:0 shutting down...
W20260620 13:58:36.634241  6551 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.694636  6551 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.695647  5997 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.701267  5997 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.706255  5997 consensus_peers.cc:597] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.725521  5997 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.730432  6551 consensus_peers.cc:597] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.731938  6551 consensus_peers.cc:597] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.737546  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.754171  5997 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.755383  5997 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.779731  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:36.785549  6551 consensus_peers.cc:597] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:36.787326  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:58:36.788915  4719 tablet_replica.cc:333] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:36.790019  4719 raft_consensus.cc:2243] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.791081  4719 raft_consensus.cc:2272] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:36.799206  4719 tablet_replica.cc:333] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:36.795801  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260620 13:58:36.813166  4719 raft_consensus.cc:2243] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.814278  4719 raft_consensus.cc:2272] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:36.820478  4719 tablet_replica.cc:333] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:36.821568  4719 raft_consensus.cc:2243] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.822628  4719 raft_consensus.cc:2272] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:36.826269  6551 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:36.827685  4719 tablet_replica.cc:333] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:36.855533  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.851647  6551 consensus_peers.cc:597] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:36.856182  4719 raft_consensus.cc:2243] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.876569  4719 raft_consensus.cc:2272] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:36.845997  5997 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:36.888399  4719 tablet_replica.cc:333] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:36.889978  4719 raft_consensus.cc:2243] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.890997  4719 raft_consensus.cc:2272] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:36.907693  4719 tablet_replica.cc:333] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:36.908706  4719 raft_consensus.cc:2243] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.909605  4719 raft_consensus.cc:2272] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:36.917435  4719 tablet_replica.cc:333] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:36.918736  4719 raft_consensus.cc:2243] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.923717  4719 raft_consensus.cc:2272] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:36.926759  4719 tablet_replica.cc:333] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:36.940938  4719 raft_consensus.cc:2243] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.946224  4719 raft_consensus.cc:2272] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:36.951516  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.959741  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260620 13:58:36.954758  4719 tablet_replica.cc:333] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:36.972818  5997 consensus_peers.cc:597] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.974920  5997 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.995481  5997 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.005008  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260620 13:58:36.973217  4719 raft_consensus.cc:2243] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.006009  4719 raft_consensus.cc:2272] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:37.013954  6551 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.014744  6551 consensus_peers.cc:597] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:37.024017  4719 tablet_replica.cc:333] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.033041  4719 raft_consensus.cc:2243] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.034601  4719 raft_consensus.cc:2272] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.043218  4719 tablet_replica.cc:333] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:37.045184  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:37.047464  5997 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.052366  6551 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.054594  5997 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.055281  5997 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.055934  5997 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.056572  5997 consensus_peers.cc:597] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.057199  5997 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.060657  5997 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.062055  5997 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:37.061367  4719 raft_consensus.cc:2243] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Raft consensus shutting down.
I20260620 13:58:37.065369  4719 raft_consensus.cc:2272] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:37.065758  5997 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.077626  6551 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.084542  6551 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.085146  6551 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.085748  6551 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.083690  5997 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.087291  5997 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.088627  5997 consensus_peers.cc:597] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:37.072738  4719 tablet_replica.cc:333] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.090590  4719 raft_consensus.cc:2243] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:37.090950  5997 consensus_peers.cc:597] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.125912  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:37.132454  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260620 13:58:37.156153  4719 raft_consensus.cc:2272] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:37.187160  5997 consensus_peers.cc:597] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:37.188086  4719 tablet_replica.cc:333] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:37.206032  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:37.222337  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:37.219532  4719 raft_consensus.cc:2243] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.225231  4719 raft_consensus.cc:2272] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.233930  4719 tablet_replica.cc:333] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.234881  4719 raft_consensus.cc:2243] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 21 LEADER]: Raft consensus shutting down.
I20260620 13:58:37.262748  4719 raft_consensus.cc:2272] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:37.285740  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260620 13:58:37.287055  4719 tablet_replica.cc:333] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.297911  4719 raft_consensus.cc:2243] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.327251  4719 raft_consensus.cc:2272] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.335162  4719 tablet_replica.cc:333] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:37.323272  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:37.344985  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:37.359236  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:37.367929  4719 raft_consensus.cc:2243] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:37.374928  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260620 13:58:37.398983  4719 raft_consensus.cc:2272] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.409937  4719 tablet_replica.cc:333] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.433300  4719 raft_consensus.cc:2243] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:37.437115  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:37.445190  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:37.446957  4719 raft_consensus.cc:2272] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:37.449177  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:37.457267  4719 tablet_replica.cc:333] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.463441  4719 raft_consensus.cc:2243] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:37.466297  4719 raft_consensus.cc:2272] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.486791  4719 tablet_replica.cc:333] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.489259  4719 raft_consensus.cc:2243] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:37.539899  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:37.492180  4719 raft_consensus.cc:2272] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.575763 12074 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:37.576385 12074 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:37.579293 12074 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:37.585176  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:37.585498  4719 tablet_replica.cc:333] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.588064  4719 raft_consensus.cc:2243] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.589370  4719 raft_consensus.cc:2272] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.598372  4719 tablet_replica.cc:333] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.603516  4719 raft_consensus.cc:2243] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:37.604429  5924 leader_election.cc:336] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:37.611629  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:37.612659 12074 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:37.607615  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260620 13:58:37.620370  4719 raft_consensus.cc:2272] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.629137  4719 tablet_replica.cc:333] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.630795  4719 raft_consensus.cc:2243] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.631728  4719 raft_consensus.cc:2272] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.637739 12074 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.638445  4719 tablet_replica.cc:333] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.638345 12074 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.641494 12074 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:37.639353  4719 raft_consensus.cc:2243] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Raft consensus shutting down.
I20260620 13:58:37.645227  4719 raft_consensus.cc:2272] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.646831  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.654227 12074 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.654824 12074 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:37.656945 12074 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:37.656527  4719 tablet_replica.cc:333] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.658942  4719 raft_consensus.cc:2243] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.662739  4719 raft_consensus.cc:2272] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.665814  4719 tablet_replica.cc:333] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.670915  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.672394  4719 raft_consensus.cc:2243] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.673273  4719 raft_consensus.cc:2272] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:37.678666  5924 leader_election.cc:336] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:37.679311  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:37.680087 12074 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:37.681206  4719 tablet_replica.cc:333] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.688205  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:37.705973  4719 raft_consensus.cc:2243] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.706971  4719 raft_consensus.cc:2272] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.707535  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:37.708334  5924 raft_consensus.cc:2686] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 13:58:37.711591 12074 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.712198 12074 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.714293 12074 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:37.716391  4719 tablet_replica.cc:333] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.719281  4719 raft_consensus.cc:2243] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:37.725098  4719 raft_consensus.cc:2272] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.727747  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.730908  4719 tablet_replica.cc:333] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.735437 12074 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:58:37.736017  5924 leader_election.cc:336] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:37.736491  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:37.736166 12074 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.737655  4719 raft_consensus.cc:2243] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.738265 12074 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:37.738626  4719 raft_consensus.cc:2272] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.749343 12074 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:37.751533  4719 tablet_replica.cc:333] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.754575  4719 raft_consensus.cc:2243] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.758548  4719 raft_consensus.cc:2272] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.799825  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:37.803356  5922 raft_consensus.cc:687] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: failed to submit failure detected task: Service unavailable: Thread pool token was shut down
I20260620 13:58:37.803522 12074 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.804239 12074 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.807375 12074 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:37.809619 12074 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.810473 12074 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.814862  4719 tablet_replica.cc:333] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.826203  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.827363  4719 raft_consensus.cc:2243] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Raft consensus shutting down.
I20260620 13:58:37.828681  4719 raft_consensus.cc:2272] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.833292  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.819495 12074 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:37.841435 12074 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.844676 12087 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:37.845275 12087 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:37.842017 12074 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.849611 12074 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:37.858243 12087 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:37.858975  4719 tablet_replica.cc:333] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.859894  4719 raft_consensus.cc:2243] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:37.860491  5924 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:37.860651  4719 raft_consensus.cc:2272] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.869232 12087 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.873229 12087 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.875429 12087 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:37.875788  4719 tablet_replica.cc:333] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.876670  4719 raft_consensus.cc:2243] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.877739  4719 raft_consensus.cc:2272] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.881129  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:37.881922 12087 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260620 13:58:37.887997 12087 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:37.888559 12087 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:37.890645 12087 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:37.894090  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.897883  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.909078  4719 tablet_replica.cc:333] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.910065  4719 raft_consensus.cc:2243] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.910810  4719 raft_consensus.cc:2272] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.912534  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:37.916013  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.919373 12087 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.920083 12087 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.920611  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:37.922127 12087 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:37.927140  5924 leader_election.cc:336] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:37.927667  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:37.934983 12087 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:37.935278  5924 leader_election.cc:336] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:37.935714  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:37.936457 12087 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:37.947062  4719 tablet_replica.cc:333] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:37.949975  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:37.950554  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:37.957845  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:37.958771 12087 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:58:37.948439  4719 raft_consensus.cc:2243] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.028555  4719 raft_consensus.cc:2272] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.034960  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:38.037722 12087 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:38.038450 12087 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:38.040757 12087 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:38.053610  5924 leader_election.cc:336] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:38.054171  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:38.054845  5924 raft_consensus.cc:2686] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 13:58:38.059357  4719 tablet_replica.cc:333] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.060266  4719 raft_consensus.cc:2243] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:38.065877  5924 leader_election.cc:336] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:38.066460  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:38.067260 12087 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:38.067500  5924 leader_election.cc:336] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:38.067932  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:38.068907 12087 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:38.072016  4719 raft_consensus.cc:2272] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:38.092357  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260620 13:58:38.127243  4719 tablet_replica.cc:333] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:38.129873  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 60690.8us
W20260620 13:58:38.141701  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:38.147505  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260620 13:58:38.162094  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:38.152263  4719 raft_consensus.cc:2243] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.164661  4719 raft_consensus.cc:2272] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.165426 12087 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:38.176483 12087 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:38.178550 12087 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:38.166334  5924 leader_election.cc:336] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:38.169699 12080 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.184434  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:38.185238  5924 raft_consensus.cc:2686] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 13:58:38.184609 12080 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.188398 12080 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:38.197160  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:38.213181  4719 tablet_replica.cc:333] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.221401  4719 raft_consensus.cc:2243] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.225184  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:38.237681  4719 raft_consensus.cc:2272] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.249598  4719 tablet_replica.cc:333] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:38.229460  5924 leader_election.cc:336] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:38.270566  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:38.271483 12087 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:58:38.264881  6551 leader_election.cc:336] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:38.273836  6551 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:38.276089  5924 leader_election.cc:336] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:38.276898  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:38.287170 12087 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:38.278530  4719 raft_consensus.cc:2243] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Raft consensus shutting down.
I20260620 13:58:38.280939 12084 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:38.296101  4719 raft_consensus.cc:2272] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.302664 12084 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.303294 12084 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.305536 12084 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:38.339015  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:38.345669  4719 tablet_replica.cc:333] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.358373  4719 raft_consensus.cc:2243] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.359200  4719 raft_consensus.cc:2272] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:38.348376  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:38.352591  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:38.386226  4719 tablet_replica.cc:333] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.389526  4719 raft_consensus.cc:2243] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.395027  4719 raft_consensus.cc:2272] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.398290  4719 tablet_replica.cc:333] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.398882  4719 raft_consensus.cc:2243] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.399485  4719 raft_consensus.cc:2272] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.401651  4719 tablet_replica.cc:333] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.402328  4719 raft_consensus.cc:2243] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:38.387059  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:38.402951  4719 raft_consensus.cc:2272] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.406313  4719 tablet_replica.cc:333] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.407033  4719 raft_consensus.cc:2243] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.407874  4719 raft_consensus.cc:2272] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.410497  4719 tablet_replica.cc:333] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.411242  4719 raft_consensus.cc:2243] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.412298  4719 raft_consensus.cc:2272] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.415035  4719 tablet_replica.cc:333] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.415743  4719 raft_consensus.cc:2243] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.416375  4719 raft_consensus.cc:2272] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:38.430367  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:38.455998 12068 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.456488 12068 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.458518 12068 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:38.462797  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:38.463438  6584 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
W20260620 13:58:38.469787  6551 leader_election.cc:336] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:38.470371  6551 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:38.471127 12084 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260620 13:58:38.473769  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:38.478175  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:38.485550  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:38.488346 12068 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:58:38.488725 12068 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.489064 12068 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:38.497174 12068 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.507743 12068 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:38.511935  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:38.512604  6584 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:38.521171  6584 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:58:38.539948  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:38.552258 12068 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:58:38.553570 12068 raft_consensus.cc:697] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:38.554569 12068 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:38.582180  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260620 13:58:38.603523 12086 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.605100 12086 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.610379 12086 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:38.648245  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:38.662220  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:38.662828  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:38.673509  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3924) could send its response
I20260620 13:58:38.678803  6578 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 21.
W20260620 13:58:38.679565  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 3925) could send its response
W20260620 13:58:38.680404  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3926) could send its response
W20260620 13:58:38.681149  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 3927) could send its response
W20260620 13:58:38.681916  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3928) could send its response
I20260620 13:58:38.694665  5778 catalog_manager.cc:5696] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 11 to 12, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 12 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:58:38.725709  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3929) could send its response
W20260620 13:58:38.729547  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3930) could send its response
W20260620 13:58:38.736650  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 3931) could send its response
I20260620 13:58:38.727209  5998 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:38.740676 12090 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260620 13:58:38.742039 12090 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.742673 12090 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Advancing to term 22
W20260620 13:58:38.763392  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3932) could send its response
W20260620 13:58:38.768421  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3933) could send its response
W20260620 13:58:38.775125  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3934) could send its response
W20260620 13:58:38.780037  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3935) could send its response
W20260620 13:58:38.776998  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:38.773319  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:38.789464  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3936) could send its response
W20260620 13:58:38.792557  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3937) could send its response
W20260620 13:58:38.796924  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3938) could send its response
W20260620 13:58:38.799152  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3939) could send its response
W20260620 13:58:38.802961  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3940) could send its response
W20260620 13:58:38.800758  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:38.779076 12090 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.808633 12090 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 22 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:38.812981  5997 connection.cc:573] client connection to 127.4.155.194:38517 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 13:58:38.812887  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:38.813665  6578 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Advancing to term 22
W20260620 13:58:38.816001  5997 leader_election.cc:336] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 13:58:38.816888  5997 leader_election.cc:336] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 13:58:38.822444  6578 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 22.
W20260620 13:58:38.840714  6551 connection.cc:573] client connection to 127.4.155.194:38517 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 13:58:38.850582  5997 leader_election.cc:336] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:38.850888  5998 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:38.852881  4719 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3921) could send its response
W20260620 13:58:38.853731  4719 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3922) could send its response
W20260620 13:58:38.854190  4719 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3923) could send its response
I20260620 13:58:38.857692 12076 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 22 FOLLOWER]: Leader election won for term 22
I20260620 13:58:38.858264 12076 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 22 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:38.864151 12076 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:38.904412  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 53855.5us
W20260620 13:58:38.907753  5997 leader_election.cc:336] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:38.932389  5778 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 21 to 22, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 22 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:38.937268 12080 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.937840 12080 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.941462 12080 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:38.952495  6551 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:38.967574  5997 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:38.978742  6552 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:38.979426  6552 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:38.982861 12080 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:38.986243 12084 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.986995 12084 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.989568 12084 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:38.992208  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:38.994323  6551 leader_election.cc:336] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:38.999094  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:39.002133 12084 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:39.012753  5997 consensus_peers.cc:597] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:39.038890  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:39.040819 12084 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:39.042526 12084 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:39.044593 12084 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:39.054796  6551 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:39.088851  6552 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:39.094569  6552 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:39.099129 12084 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:58:39.099530  6582 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260620 13:58:39.103368  5997 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:39.105715 12090 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260620 13:58:39.112090  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:39.115557 12090 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:39.116226 12090 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:39.118587 12090 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:39.124823  5997 leader_election.cc:336] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:39.126379  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:39.127137  6578 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:39.128479  5998 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:58:39.129436 12090 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:39.129899 12090 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:39.130334 12090 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:39.140884  5997 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.153864  5997 consensus_peers.cc:597] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.154405  5997 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.162954  6551 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.163517  6551 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:39.187577 12090 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:39.212159 12095 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:39.212908 12095 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:39.215358 12095 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:39.212971  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:39.214392 12090 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:39.225975  6552 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:39.226604  5997 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:39.227895  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:39.227538  5997 leader_election.cc:336] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:39.228574  6584 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:39.235854  5997 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.242173  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:39.242918  6551 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:39.243381  6551 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:39.245334 12084 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:39.247246  6584 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
W20260620 13:58:39.249969  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260620 13:58:39.251853  5998 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:58:39.252691 12086 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:58:39.253190 12086 raft_consensus.cc:697] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:39.254081 12086 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:39.263896  5997 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.265308  5997 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.271179  6551 consensus_peers.cc:597] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.273233  5997 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:39.284487  5778 catalog_manager.cc:5696] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 14 to 15, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 15 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:58:39.296700  6551 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.309983  5997 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.319339  5997 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:39.336105  6582 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 22 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260620 13:58:39.341236  6551 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:39.343466 12068 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260620 13:58:39.363534  5997 consensus_peers.cc:597] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.378974  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:39.380818  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:39.395272  5997 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.397169  6551 consensus_peers.cc:597] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.397693  6551 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.410759  5997 consensus_peers.cc:597] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:39.434207  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:39.434777  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:39.456257  5997 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.470671  6551 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.470806  5997 consensus_peers.cc:597] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.474349  6551 consensus_peers.cc:597] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.496963  6551 consensus_peers.cc:597] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.500140  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:39.516494  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:39.517815  5997 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.533210  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:39.541538  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:39.548290  5997 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.555229  6551 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.558611  5997 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.600554  5997 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.660005  6551 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.663257  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:39.677350  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:39.678110  6551 consensus_peers.cc:597] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.704437  5997 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.734918  5997 consensus_peers.cc:597] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:39.809520 12084 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:39.810096 12084 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:39.812382 12084 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:39.817464  6551 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.821269  6551 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:39.830004  6552 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:39.831139  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:39.831928 12084 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:39.855213  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 106461us
I20260620 13:58:39.876149  6578 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260620 13:58:39.877841 12068 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260620 13:58:39.883818  5998 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111) [suppressed 699 similar messages]
W20260620 13:58:39.889883  5997 consensus_peers.cc:597] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:39.902781  5997 consensus_peers.cc:597] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.907979  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:39.919528  5997 consensus_peers.cc:597] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:40.023269  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:40.054908  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.055425  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.113564  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:40.168144  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:40.210943  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.233105  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.268873  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:40.378186  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260620 13:58:40.500054  4719 tablet_server.cc:196] TabletServer@127.4.155.194:0 shutdown complete.
I20260620 13:58:40.634316  4719 tablet_server.cc:179] TabletServer@127.4.155.195:0 shutting down...
W20260620 13:58:40.641741  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:40.660141  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.674955  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:40.677762  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.697865  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.706166  6552 consensus_peers.cc:597] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:40.715010  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:58:40.716270  4719 tablet_replica.cc:333] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.717314  4719 raft_consensus.cc:2243] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.718098  4719 raft_consensus.cc:2272] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.721462  4719 tablet_replica.cc:333] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.722091  4719 raft_consensus.cc:2243] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.723031  4719 raft_consensus.cc:2272] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.725445  4719 tablet_replica.cc:333] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.727219  4719 raft_consensus.cc:2243] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.728200  4719 raft_consensus.cc:2272] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.730229  4719 tablet_replica.cc:333] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.730811  4719 raft_consensus.cc:2243] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.731621  4719 raft_consensus.cc:2272] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.733494  4719 tablet_replica.cc:333] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.734063  4719 raft_consensus.cc:2243] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.734539  4719 raft_consensus.cc:2272] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.736449  4719 tablet_replica.cc:333] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.737011  4719 raft_consensus.cc:2243] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.737646  4719 raft_consensus.cc:2272] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.741111  4719 tablet_replica.cc:333] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.741961  4719 raft_consensus.cc:2243] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.742868  4719 raft_consensus.cc:2272] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.745263  4719 tablet_replica.cc:333] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.745842  4719 raft_consensus.cc:2243] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.746670  4719 raft_consensus.cc:2272] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.747416 12084 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:40.747977 12084 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:40.749704  4719 tablet_replica.cc:333] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.750612  4719 raft_consensus.cc:2243] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.751235 12084 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:40.752470  4719 raft_consensus.cc:2272] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.755267  4719 tablet_replica.cc:333] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
W20260620 13:58:40.755697  6551 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:40.756053  4719 raft_consensus.cc:2243] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.757289  4719 raft_consensus.cc:2272] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.760895  4719 tablet_replica.cc:333] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.761719  4719 raft_consensus.cc:2243] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.762814  4719 raft_consensus.cc:2272] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.766287  4719 tablet_replica.cc:333] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.767138  4719 raft_consensus.cc:2243] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.767848  4719 raft_consensus.cc:2272] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:40.767879  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260620 13:58:40.771238  4719 tablet_replica.cc:333] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
W20260620 13:58:40.771206  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260620 13:58:40.772185  4719 raft_consensus.cc:2243] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 18 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.773350  4719 raft_consensus.cc:2272] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.776259  4719 tablet_replica.cc:333] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.777091  4719 raft_consensus.cc:2243] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.777768  4719 raft_consensus.cc:2272] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:40.777951  6552 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:40.778499  6552 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:40.779497  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260620 13:58:40.779932 12084 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:40.781536  4719 tablet_replica.cc:333] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.782394  4719 raft_consensus.cc:2243] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.783668  4719 raft_consensus.cc:2272] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.786398  4719 tablet_replica.cc:333] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.787292  4719 raft_consensus.cc:2243] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.788226  4719 raft_consensus.cc:2272] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.790743  4719 tablet_replica.cc:333] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.791436  4719 raft_consensus.cc:2243] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.793074  4719 raft_consensus.cc:2272] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.795910  4719 tablet_replica.cc:333] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.796658  4719 raft_consensus.cc:2243] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 22 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.797459  4719 raft_consensus.cc:2272] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.800377  4719 tablet_replica.cc:333] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.801738  4719 raft_consensus.cc:2243] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.803529  4719 raft_consensus.cc:2272] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.806703  4719 tablet_replica.cc:333] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.807730  4719 raft_consensus.cc:2243] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.808750  4719 raft_consensus.cc:2272] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.811355  4719 tablet_replica.cc:333] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
W20260620 13:58:40.811820  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:40.812167  4719 raft_consensus.cc:2243] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Raft consensus shutting down.
W20260620 13:58:40.812595  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:40.813509  4719 raft_consensus.cc:2272] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.816445  4719 tablet_replica.cc:333] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.817261  4719 raft_consensus.cc:2243] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.818754  4719 raft_consensus.cc:2272] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.821789  4719 tablet_replica.cc:333] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.822510  4719 raft_consensus.cc:2243] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.823251  4719 raft_consensus.cc:2272] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.825975  4719 tablet_replica.cc:333] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
W20260620 13:58:40.826237  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260620 13:58:40.826550  4719 raft_consensus.cc:2243] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Raft consensus shutting down.
W20260620 13:58:40.827183  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:40.827651  4719 raft_consensus.cc:2272] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.830657  4719 tablet_replica.cc:333] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.831316  4719 raft_consensus.cc:2243] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.832379  4719 raft_consensus.cc:2272] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.835232  4719 tablet_replica.cc:333] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.836072  4719 raft_consensus.cc:2243] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.837028  4719 raft_consensus.cc:2272] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.839617  4719 tablet_replica.cc:333] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.840349  4719 raft_consensus.cc:2243] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.841714  4719 raft_consensus.cc:2272] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.844363  4719 tablet_replica.cc:333] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
W20260620 13:58:40.844478  6552 consensus_peers.cc:597] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:40.845016  4719 raft_consensus.cc:2243] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.845669  4719 raft_consensus.cc:2272] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.848520  4719 tablet_replica.cc:333] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.849316  4719 raft_consensus.cc:2243] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.850342  4719 raft_consensus.cc:2272] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:40.851166  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:40.852632  4719 tablet_replica.cc:333] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.853291  4719 raft_consensus.cc:2243] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.854161  4719 raft_consensus.cc:2272] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.856217  4719 tablet_replica.cc:333] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.856750  4719 raft_consensus.cc:2243] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.857740  4719 raft_consensus.cc:2272] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.859826  4719 tablet_replica.cc:333] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.860441  4719 raft_consensus.cc:2243] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.861303  4719 raft_consensus.cc:2272] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.863591  4719 tablet_replica.cc:333] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.864171  4719 raft_consensus.cc:2243] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.864746  4719 raft_consensus.cc:2272] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.867331  4719 tablet_replica.cc:333] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.867887  4719 raft_consensus.cc:2243] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.868360  4719 raft_consensus.cc:2272] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.870357  4719 tablet_replica.cc:333] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.870990  4719 raft_consensus.cc:2243] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.871666  4719 raft_consensus.cc:2272] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.875140  4719 tablet_replica.cc:333] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.875937  4719 raft_consensus.cc:2243] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.877584  4719 raft_consensus.cc:2272] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.880785  4719 tablet_replica.cc:333] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.881569  4719 raft_consensus.cc:2243] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.882794  4719 raft_consensus.cc:2272] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.885458  4719 tablet_replica.cc:333] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.886353  4719 raft_consensus.cc:2243] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.887248  4719 raft_consensus.cc:2272] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:40.888777  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.889832  6552 consensus_peers.cc:597] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:40.890031  4719 tablet_replica.cc:333] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.890669  4719 raft_consensus.cc:2243] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.892351  4719 raft_consensus.cc:2272] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.896517  4719 tablet_replica.cc:333] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.897670  4719 raft_consensus.cc:2243] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.898583  4719 raft_consensus.cc:2272] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.902141  4719 tablet_replica.cc:333] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.902832  4719 raft_consensus.cc:2243] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.903841  4719 raft_consensus.cc:2272] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.905745  4719 tablet_replica.cc:333] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.906265  4719 raft_consensus.cc:2243] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.907259  4719 raft_consensus.cc:2272] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.909230  4719 tablet_replica.cc:333] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.909759  4719 raft_consensus.cc:2243] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.910223  4719 raft_consensus.cc:2272] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.912511  4719 tablet_replica.cc:333] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.913230  4719 raft_consensus.cc:2243] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.914655  4719 raft_consensus.cc:2272] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.917435  4719 tablet_replica.cc:333] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.917932  4719 raft_consensus.cc:2243] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.918735  4719 raft_consensus.cc:2272] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.920850  4719 tablet_replica.cc:333] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.921315  4719 raft_consensus.cc:2243] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.921957  4719 raft_consensus.cc:2272] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.927095 12084 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:40.927762 12084 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:40.930075 12084 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:40.935286  6552 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:40.935819  6551 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:40.936354  6551 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:40.937397 12084 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:40.948386  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4120 after lost signal to thread 4722
W20260620 13:58:40.949653  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb620 after lost signal to thread 5815
W20260620 13:58:40.950958  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003d67c0 after lost signal to thread 6057
W20260620 13:58:40.952193  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003371e0 after lost signal to thread 6611
W20260620 13:58:40.999677  6552 consensus_peers.cc:597] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:41.035208  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:41.035679  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:41.164930 12084 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:41.165370 12084 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:41.166987 12084 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:41.175511  6552 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:41.179807  6551 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:41.180215  6551 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:41.180794 12084 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260620 13:58:41.286689  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:41.295253  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:41.295791  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:41.378580  6551 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:41.480312  6551 consensus_peers.cc:597] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:41.642393  6551 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:41.724524  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260620 13:58:41.729844 12095 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:41.730489 12095 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:41.732698 12095 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:41.736642  6551 leader_election.cc:336] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:41.738847 12095 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:41.739760 12095 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:41.742091 12095 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:41.748479  6552 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:41.749048  6551 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:41.749562  6551 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:41.750545 12095 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:41.847361  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260620 13:58:41.861400 12095 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:41.861981 12095 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:41.864133 12095 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:41.868117  6551 leader_election.cc:336] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:41.873238  6551 consensus_peers.cc:597] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:41.883397 12095 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:41.884079 12095 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:41.886577 12095 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:41.889740 12095 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:41.890286 12095 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:41.890758  6551 leader_election.cc:336] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:41.892513 12095 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:41.896687  6552 leader_election.cc:336] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:41.906145  6551 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:41.932914  6551 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:41.979873 12095 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:41.980494 12095 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:41.982635 12095 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:41.986912  6551 leader_election.cc:336] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:41.988054 12095 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:41.988651 12095 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:41.990829 12095 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:41.993701 12095 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:41.994266 12095 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:41.995920  6552 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:41.997241 12095 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:42.003407  6552 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:42.004053  6551 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:42.004558  6551 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:42.005266 12095 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260620 13:58:42.021818  6551 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:42.021703 12095 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.022511 12095 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.025195 12095 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:42.029166 12095 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.029655 12095 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:42.030216  6551 consensus_peers.cc:597] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:42.031169  6552 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:42.031708 12095 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:42.036339  6551 leader_election.cc:336] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:42.044445  4719 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 6054)
W20260620 13:58:42.057778  6551 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:42.082697  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260620 13:58:42.101495  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:42.106489  6552 consensus_peers.cc:597] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:42.107084  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:42.107518  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:42.108631  6552 leader_election.cc:336] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.109010  6552 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.109730 12095 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260620 13:58:42.109875  6552 leader_election.cc:336] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.110381  6552 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.111073 12095 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:42.111254  6552 leader_election.cc:336] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.111721  6552 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.112423 12095 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:42.112572  6552 leader_election.cc:336] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.113036  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.113680 12095 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260620 13:58:42.113837  6552 leader_election.cc:336] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.114293  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.114936 12095 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:42.115084  6552 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.115553  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.116186 12095 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260620 13:58:42.116353  6552 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
W20260620 13:58:42.117194  6552 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.117545  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.118183 12095 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260620 13:58:42.118330  6552 leader_election.cc:336] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.118808  6552 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.119469 12095 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260620 13:58:42.128454  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260620 13:58:42.138808  6551 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:42.139884 12095 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.140444 12095 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.142961 12095 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:42.148124  6551 leader_election.cc:336] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:42.148823  6552 leader_election.cc:336] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.148892 12095 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.149238  6552 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.149942 12115 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:42.157333 12120 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.159883 12120 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.160905 12115 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.161408 12115 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.161903 12120 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:42.163760 12115 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:42.149564 12095 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.167004 12095 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:42.172206  6551 leader_election.cc:336] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:42.184641  6551 consensus_peers.cc:597] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:42.186241  6552 leader_election.cc:336] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
W20260620 13:58:42.186789  6552 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
W20260620 13:58:42.187222  6552 leader_election.cc:336] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.187564  6552 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.188359 12119 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260620 13:58:42.188740  6552 leader_election.cc:336] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:42.189226  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.189924 12119 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260620 13:58:42.190083  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:42.190698  6552 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:42.191056  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.191901 12119 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260620 13:58:42.227522 12119 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.228199 12119 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.234582 12119 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:42.238278  6551 leader_election.cc:336] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:42.241403  6552 leader_election.cc:336] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.241880  6552 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.242635 12119 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:42.256721  6551 consensus_peers.cc:597] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:42.262631  6551 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:42.281621 12119 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.282182 12119 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.284432 12119 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:42.289322  6551 leader_election.cc:336] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:42.290829  6552 leader_election.cc:336] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.291313  6552 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.292047 12119 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260620 13:58:42.295397  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260620 13:58:42.303328  6551 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:42.396570  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260620 13:58:42.457636  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260620 13:58:42.515949 12095 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:42.516587 12095 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.520565 12095 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:42.526247  6551 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:42.528584  6552 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:42.529008  6552 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:42.529711 12095 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:58:42.557906  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:42.685565  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260620 13:58:42.722952  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260620 13:58:42.777796  4719 tablet_server.cc:196] TabletServer@127.4.155.195:0 shutdown complete.
I20260620 13:58:42.897694  4719 tablet_server.cc:179] TabletServer@127.4.155.196:0 shutting down...
W20260620 13:58:42.914305  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260620 13:58:42.965586  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:58:42.966445  4719 tablet_replica.cc:333] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.967280  4719 raft_consensus.cc:2243] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:42.967875  4719 raft_consensus.cc:2272] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.971241  4719 tablet_replica.cc:333] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.972157  4719 raft_consensus.cc:2243] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:42.973263  4719 raft_consensus.cc:2272] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.976469  4719 tablet_replica.cc:333] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.977308  4719 raft_consensus.cc:2243] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 20 LEADER]: Raft consensus shutting down.
I20260620 13:58:42.978528  4719 raft_consensus.cc:2272] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.981031  4719 tablet_replica.cc:333] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.981724  4719 raft_consensus.cc:2243] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:42.982625  4719 raft_consensus.cc:2272] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.984767  4719 tablet_replica.cc:333] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.985376  4719 raft_consensus.cc:2243] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:42.986021  4719 raft_consensus.cc:2272] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.988165  4719 tablet_replica.cc:333] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.988788  4719 raft_consensus.cc:2243] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:42.989682  4719 raft_consensus.cc:2272] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.991811  4719 tablet_replica.cc:333] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.992375  4719 raft_consensus.cc:2243] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:42.992862  4719 raft_consensus.cc:2272] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.994956  4719 tablet_replica.cc:333] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.995534  4719 raft_consensus.cc:2243] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:42.996372  4719 raft_consensus.cc:2272] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.998422  4719 tablet_replica.cc:333] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.998998  4719 raft_consensus.cc:2243] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:42.999626  4719 raft_consensus.cc:2272] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.001577  4719 tablet_replica.cc:333] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.002280  4719 raft_consensus.cc:2243] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.003129  4719 raft_consensus.cc:2272] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.005179  4719 tablet_replica.cc:333] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.005731  4719 raft_consensus.cc:2243] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 18 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.006551  4719 raft_consensus.cc:2272] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.008739  4719 tablet_replica.cc:333] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.009414  4719 raft_consensus.cc:2243] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 20 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.010545  4719 raft_consensus.cc:2272] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.013646  4719 tablet_replica.cc:333] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.014557  4719 raft_consensus.cc:2243] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.015668  4719 raft_consensus.cc:2272] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.018592  4719 tablet_replica.cc:333] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.019460  4719 raft_consensus.cc:2243] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.020087  4719 raft_consensus.cc:2272] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.022972  4719 tablet_replica.cc:333] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.023480 12095 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:43.023824  4719 raft_consensus.cc:2243] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 18 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.024076 12095 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:43.024952  4719 raft_consensus.cc:2272] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.027707  4719 tablet_replica.cc:333] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.028347 12095 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:43.028528  4719 raft_consensus.cc:2243] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.029297  4719 raft_consensus.cc:2272] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.033164  4719 tablet_replica.cc:333] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
W20260620 13:58:43.033684  6551 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:43.034181  4719 raft_consensus.cc:2243] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.034977  4719 raft_consensus.cc:2272] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:43.036053  6552 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:43.036583  6552 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:43.037407 12095 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:43.038556  4719 tablet_replica.cc:333] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.039513  4719 raft_consensus.cc:2243] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.040253  4719 raft_consensus.cc:2272] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.043151  4719 tablet_replica.cc:333] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.044087  4719 raft_consensus.cc:2243] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.045444  4719 raft_consensus.cc:2272] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.048058  4719 tablet_replica.cc:333] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.048673  4719 raft_consensus.cc:2243] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.049521  4719 raft_consensus.cc:2272] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.051939  4719 tablet_replica.cc:333] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.052636  4719 raft_consensus.cc:2243] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.053529  4719 raft_consensus.cc:2272] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.056299  4719 tablet_replica.cc:333] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.056905  4719 raft_consensus.cc:2243] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.057374  4719 raft_consensus.cc:2272] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.059345  4719 tablet_replica.cc:333] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.059875  4719 raft_consensus.cc:2243] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.060329  4719 raft_consensus.cc:2272] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.062253  4719 tablet_replica.cc:333] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.062796  4719 raft_consensus.cc:2243] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.063768  4719 raft_consensus.cc:2272] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.065953  4719 tablet_replica.cc:333] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.066468  4719 raft_consensus.cc:2243] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.067360  4719 raft_consensus.cc:2272] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.069332  4719 tablet_replica.cc:333] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.069895  4719 raft_consensus.cc:2243] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.070699  4719 raft_consensus.cc:2272] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.072842  4719 tablet_replica.cc:333] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.073446  4719 raft_consensus.cc:2243] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.073956  4719 raft_consensus.cc:2272] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.076030  4719 tablet_replica.cc:333] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.076587  4719 raft_consensus.cc:2243] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.077839  4719 raft_consensus.cc:2272] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.080008  4719 tablet_replica.cc:333] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.080587  4719 raft_consensus.cc:2243] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.081564  4719 raft_consensus.cc:2272] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.083860  4719 tablet_replica.cc:333] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.084404  4719 raft_consensus.cc:2243] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.085283  4719 raft_consensus.cc:2272] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.087577  4719 tablet_replica.cc:333] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.088245  4719 raft_consensus.cc:2243] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.088698  4719 raft_consensus.cc:2272] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.091025  4719 tablet_replica.cc:333] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.091672  4719 raft_consensus.cc:2243] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.092478  4719 raft_consensus.cc:2272] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.094817  4719 tablet_replica.cc:333] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.095779  4719 raft_consensus.cc:2243] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.096877  4719 raft_consensus.cc:2272] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.100664  4719 tablet_replica.cc:333] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.101706  4719 raft_consensus.cc:2243] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.103145  4719 raft_consensus.cc:2272] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.105402  4719 tablet_replica.cc:333] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.105955  4719 raft_consensus.cc:2243] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.106490  4719 raft_consensus.cc:2272] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.108568  4719 tablet_replica.cc:333] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.109187  4719 raft_consensus.cc:2243] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.109670  4719 raft_consensus.cc:2272] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.112118  4719 tablet_replica.cc:333] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.112639  4719 raft_consensus.cc:2243] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 15 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.113677  4719 raft_consensus.cc:2272] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.115970  4719 tablet_replica.cc:333] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.116549  4719 raft_consensus.cc:2243] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.117341  4719 raft_consensus.cc:2272] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.119639  4719 tablet_replica.cc:333] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.120172  4719 raft_consensus.cc:2243] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.120663  4719 raft_consensus.cc:2272] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.122992  4719 tablet_replica.cc:333] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.123696  4719 raft_consensus.cc:2243] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.124608  4719 raft_consensus.cc:2272] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.126688  4719 tablet_replica.cc:333] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.127296  4719 raft_consensus.cc:2243] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.127863  4719 raft_consensus.cc:2272] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.129819  4719 tablet_replica.cc:333] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.130353  4719 raft_consensus.cc:2243] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.130833  4719 raft_consensus.cc:2272] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.651230  4719 tablet_server.cc:196] TabletServer@127.4.155.196:0 shutdown complete.
I20260620 13:58:43.723528  4719 master.cc:562] Master@127.4.155.254:37547 shutting down...
W20260620 13:58:43.760694  5829 auto_rebalancer.cc:835] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260620 13:58:43.760977  5829 auto_rebalancer.cc:863] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260620 13:58:43.761199  5829 auto_rebalancer.cc:301] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260620 13:58:43.764457  4719 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.765039  4719 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.765314  4719 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: stopping tablet replica
I20260620 13:58:43.901253  4719 master.cc:584] Master@127.4.155.254:37547 shutdown complete.
I20260620 13:58:43.946276  4719 test_util.cc:182] -----------------------------------------------
I20260620 13:58:43.946509  4719 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0

[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260620 13:54:15.165541  4719 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.155.254:36845
I20260620 13:54:15.167202  4719 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 13:54:15.168380  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:54:15.186106  4725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:54:15.186122  4726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:54:15.187362  4719 server_base.cc:1061] running on GCE node
W20260620 13:54:15.186126  4728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:54:16.385650  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:54:16.385944  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:54:16.386157  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963656386131 us; error 0 us; skew 500 ppm
I20260620 13:54:16.387037  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:54:16.393357  4719 webserver.cc:533] Webserver started at http://127.4.155.254:40945/ using document root <none> and password file <none>
I20260620 13:54:16.394527  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:54:16.394848  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:54:16.395435  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:54:16.404115  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/master-0-root/instance:
uuid: "8d8a4e3b23444658ad2f0071e4dc65f8"
format_stamp: "Formatted at 2026-06-20 13:54:16 on dist-test-slave-n70f"
I20260620 13:54:16.413437  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.004s
I20260620 13:54:16.419275  4734 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:16.420780  4719 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260620 13:54:16.421205  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/master-0-root
uuid: "8d8a4e3b23444658ad2f0071e4dc65f8"
format_stamp: "Formatted at 2026-06-20 13:54:16 on dist-test-slave-n70f"
I20260620 13:54:16.421581  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:54:16.488057  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:54:16.489785  4719 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 13:54:16.490330  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:54:16.568568  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.254:36845
I20260620 13:54:16.568603  4785 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.254:36845 every 8 connection(s)
I20260620 13:54:16.577216  4786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:16.600132  4786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8: Bootstrap starting.
I20260620 13:54:16.606122  4786 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:16.608171  4786 log.cc:826] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8: Log is configured to *not* fsync() on all Append() calls
I20260620 13:54:16.612911  4786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8: No bootstrap required, opened a new log
I20260620 13:54:16.637270  4786 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d8a4e3b23444658ad2f0071e4dc65f8" member_type: VOTER }
I20260620 13:54:16.637840  4786 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:16.638139  4786 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d8a4e3b23444658ad2f0071e4dc65f8, State: Initialized, Role: FOLLOWER
I20260620 13:54:16.639254  4786 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d8a4e3b23444658ad2f0071e4dc65f8" member_type: VOTER }
I20260620 13:54:16.639786  4786 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 13:54:16.640107  4786 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 13:54:16.640462  4786 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:16.644819  4786 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d8a4e3b23444658ad2f0071e4dc65f8" member_type: VOTER }
I20260620 13:54:16.645622  4786 leader_election.cc:304] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d8a4e3b23444658ad2f0071e4dc65f8; no voters: 
I20260620 13:54:16.647640  4786 leader_election.cc:290] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 13:54:16.647902  4789 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:16.651852  4789 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [term 1 LEADER]: Becoming Leader. State: Replica: 8d8a4e3b23444658ad2f0071e4dc65f8, State: Running, Role: LEADER
I20260620 13:54:16.652902  4789 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d8a4e3b23444658ad2f0071e4dc65f8" member_type: VOTER }
I20260620 13:54:16.654124  4786 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 13:54:16.664633  4791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d8a4e3b23444658ad2f0071e4dc65f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d8a4e3b23444658ad2f0071e4dc65f8" member_type: VOTER } }
I20260620 13:54:16.665208  4790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d8a4e3b23444658ad2f0071e4dc65f8. Latest consensus state: current_term: 1 leader_uuid: "8d8a4e3b23444658ad2f0071e4dc65f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d8a4e3b23444658ad2f0071e4dc65f8" member_type: VOTER } }
I20260620 13:54:16.665501  4791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [sys.catalog]: This master's current role is: LEADER
I20260620 13:54:16.665771  4790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [sys.catalog]: This master's current role is: LEADER
I20260620 13:54:16.669581  4798 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260620 13:54:16.682680  4798 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260620 13:54:16.684890  4719 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 13:54:16.700691  4798 catalog_manager.cc:1382] Generated new cluster ID: 94dd0b7efd254f12b699a311638f6a12
I20260620 13:54:16.701040  4798 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260620 13:54:16.721252  4798 catalog_manager.cc:1405] Generated new certificate authority record
I20260620 13:54:16.723179  4798 catalog_manager.cc:1539] Loading token signing keys...
I20260620 13:54:16.735997  4798 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8: Generated new TSK 0
I20260620 13:54:16.737053  4798 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260620 13:54:16.752806  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:54:16.762539  4808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:54:16.764312  4809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:54:16.768536  4811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:54:16.769346  4719 server_base.cc:1061] running on GCE node
I20260620 13:54:16.770251  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:54:16.770524  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:54:16.770748  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963656770729 us; error 0 us; skew 500 ppm
I20260620 13:54:16.771466  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:54:16.776541  4719 webserver.cc:533] Webserver started at http://127.4.155.193:44789/ using document root <none> and password file <none>
I20260620 13:54:16.777177  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:54:16.777421  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:54:16.777746  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:54:16.779002  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/ts-0-root/instance:
uuid: "3d3395064db742469140d8c045a1ef52"
format_stamp: "Formatted at 2026-06-20 13:54:16 on dist-test-slave-n70f"
I20260620 13:54:16.785645  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260620 13:54:16.790524  4816 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:16.791617  4719 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260620 13:54:16.791971  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/ts-0-root
uuid: "3d3395064db742469140d8c045a1ef52"
format_stamp: "Formatted at 2026-06-20 13:54:16 on dist-test-slave-n70f"
I20260620 13:54:16.792333  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:54:16.812239  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:54:16.813832  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:54:16.817118  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:54:16.822602  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:54:16.822872  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:16.823284  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:54:16.823464  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:16.945613  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.193:38317
I20260620 13:54:16.945715  4878 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.193:38317 every 8 connection(s)
I20260620 13:54:16.953397  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:54:16.969058  4884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:54:16.971235  4883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:54:16.989055  4886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:54:16.990207  4719 server_base.cc:1061] running on GCE node
I20260620 13:54:16.991433  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:54:16.991731  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:54:16.991982  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963656991960 us; error 0 us; skew 500 ppm
I20260620 13:54:16.992923  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:54:16.995461  4879 heartbeater.cc:344] Connected to a master server at 127.4.155.254:36845
I20260620 13:54:16.996068  4879 heartbeater.cc:461] Registering TS with master...
I20260620 13:54:16.997694  4879 heartbeater.cc:507] Master 127.4.155.254:36845 requested a full tablet report, sending...
I20260620 13:54:16.999846  4719 webserver.cc:533] Webserver started at http://127.4.155.194:39847/ using document root <none> and password file <none>
I20260620 13:54:17.000644  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:54:17.000962  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:54:17.001241  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:54:17.002317  4751 ts_manager.cc:194] Registered new tserver with Master: 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317)
I20260620 13:54:17.002442  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/ts-1-root/instance:
uuid: "f61dc2e8457c42b09772f9e664c67b47"
format_stamp: "Formatted at 2026-06-20 13:54:16 on dist-test-slave-n70f"
I20260620 13:54:17.005499  4751 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48014
I20260620 13:54:17.010600  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.001s
I20260620 13:54:17.016952  4891 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:17.018170  4719 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
I20260620 13:54:17.018601  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/ts-1-root
uuid: "f61dc2e8457c42b09772f9e664c67b47"
format_stamp: "Formatted at 2026-06-20 13:54:16 on dist-test-slave-n70f"
I20260620 13:54:17.018949  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:54:17.053401  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:54:17.054911  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:54:17.058171  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:54:17.062551  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:54:17.062820  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:17.063179  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:54:17.063396  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260620 13:54:17.170557  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.194:35197
I20260620 13:54:17.170696  4953 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.194:35197 every 8 connection(s)
I20260620 13:54:17.181954  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:54:17.194213  4958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:54:17.198449  4954 heartbeater.cc:344] Connected to a master server at 127.4.155.254:36845
I20260620 13:54:17.199133  4954 heartbeater.cc:461] Registering TS with master...
I20260620 13:54:17.200858  4954 heartbeater.cc:507] Master 127.4.155.254:36845 requested a full tablet report, sending...
I20260620 13:54:17.202324  4719 server_base.cc:1061] running on GCE node
I20260620 13:54:17.204254  4751 ts_manager.cc:194] Registered new tserver with Master: f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197)
W20260620 13:54:17.204254  4957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:54:17.204540  4960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:54:17.206007  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:54:17.206324  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:54:17.206545  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963657206526 us; error 0 us; skew 500 ppm
I20260620 13:54:17.206713  4751 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48016
I20260620 13:54:17.207417  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:54:17.211040  4719 webserver.cc:533] Webserver started at http://127.4.155.195:38257/ using document root <none> and password file <none>
I20260620 13:54:17.211707  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:54:17.211931  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:54:17.212263  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:54:17.213440  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/ts-2-root/instance:
uuid: "cd23e27c1393498daca3fba741403354"
format_stamp: "Formatted at 2026-06-20 13:54:17 on dist-test-slave-n70f"
I20260620 13:54:17.218796  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260620 13:54:17.222508  4965 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:17.223608  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260620 13:54:17.223920  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/ts-2-root
uuid: "cd23e27c1393498daca3fba741403354"
format_stamp: "Formatted at 2026-06-20 13:54:17 on dist-test-slave-n70f"
I20260620 13:54:17.224233  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1781963654985192-4719-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:54:17.248706  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:54:17.249979  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:54:17.251557  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:54:17.253711  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:54:17.253958  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:17.254225  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:54:17.254402  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:17.365392  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.195:39977
I20260620 13:54:17.365530  5027 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.195:39977 every 8 connection(s)
I20260620 13:54:17.386150  5028 heartbeater.cc:344] Connected to a master server at 127.4.155.254:36845
I20260620 13:54:17.386608  5028 heartbeater.cc:461] Registering TS with master...
I20260620 13:54:17.387914  5028 heartbeater.cc:507] Master 127.4.155.254:36845 requested a full tablet report, sending...
I20260620 13:54:17.390283  4751 ts_manager.cc:194] Registered new tserver with Master: cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:17.390865  4719 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016635962s
I20260620 13:54:17.392073  4751 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48030
I20260620 13:54:17.457535  4751 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48042:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260620 13:54:17.461503  4751 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 13:54:17.575981  4918 tablet_service.cc:1511] Processing CreateTablet for tablet d748d43c67664af88e57ce75b6be81e1 (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260620 13:54:17.575877  4919 tablet_service.cc:1511] Processing CreateTablet for tablet 0f55cacdeebd4cad83b3cd8753320b37 (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260620 13:54:17.578085  4916 tablet_service.cc:1511] Processing CreateTablet for tablet adfeaab3cb7d4d1d9eedd1282d3ac16d (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260620 13:54:17.579424  4917 tablet_service.cc:1511] Processing CreateTablet for tablet e0d11a1fc374477caf80fa0e24f0a281 (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260620 13:54:17.581238  4918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d748d43c67664af88e57ce75b6be81e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.584883  4917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d11a1fc374477caf80fa0e24f0a281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.582852  4915 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb86d5e1936485fb6531cefe3eb775b (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260620 13:54:17.590070  4915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb86d5e1936485fb6531cefe3eb775b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.604159  4914 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8cc4f789b24974a1859102de85d33d (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260620 13:54:17.607841  4914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8cc4f789b24974a1859102de85d33d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.611819  4916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adfeaab3cb7d4d1d9eedd1282d3ac16d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.621886  4913 tablet_service.cc:1511] Processing CreateTablet for tablet 22dd8bbdf26244a384b739fe2fdb7486 (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260620 13:54:17.632647  4844 tablet_service.cc:1511] Processing CreateTablet for tablet 0f55cacdeebd4cad83b3cd8753320b37 (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260620 13:54:17.636755  4843 tablet_service.cc:1511] Processing CreateTablet for tablet d748d43c67664af88e57ce75b6be81e1 (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260620 13:54:17.639142  4843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d748d43c67664af88e57ce75b6be81e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.640199  4919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f55cacdeebd4cad83b3cd8753320b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.651149  4913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22dd8bbdf26244a384b739fe2fdb7486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.652506  4844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f55cacdeebd4cad83b3cd8753320b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.653220  4993 tablet_service.cc:1511] Processing CreateTablet for tablet 0f55cacdeebd4cad83b3cd8753320b37 (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260620 13:54:17.661453  4992 tablet_service.cc:1511] Processing CreateTablet for tablet d748d43c67664af88e57ce75b6be81e1 (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260620 13:54:17.653647  4842 tablet_service.cc:1511] Processing CreateTablet for tablet e0d11a1fc374477caf80fa0e24f0a281 (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260620 13:54:17.676031  4837 tablet_service.cc:1511] Processing CreateTablet for tablet fd3e06006b244dfcb166b165bd0ed812 (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260620 13:54:17.676378  4840 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb86d5e1936485fb6531cefe3eb775b (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260620 13:54:17.659008  4841 tablet_service.cc:1511] Processing CreateTablet for tablet adfeaab3cb7d4d1d9eedd1282d3ac16d (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260620 13:54:17.676370  4991 tablet_service.cc:1511] Processing CreateTablet for tablet e0d11a1fc374477caf80fa0e24f0a281 (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260620 13:54:17.681504  4993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f55cacdeebd4cad83b3cd8753320b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.663959  4912 tablet_service.cc:1511] Processing CreateTablet for tablet fd3e06006b244dfcb166b165bd0ed812 (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260620 13:54:17.698993  4912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd3e06006b244dfcb166b165bd0ed812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.678108  4990 tablet_service.cc:1511] Processing CreateTablet for tablet adfeaab3cb7d4d1d9eedd1282d3ac16d (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260620 13:54:17.706841  4987 tablet_service.cc:1511] Processing CreateTablet for tablet 22dd8bbdf26244a384b739fe2fdb7486 (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260620 13:54:17.703951  4842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d11a1fc374477caf80fa0e24f0a281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.701155  4836 tablet_service.cc:1511] Processing CreateTablet for tablet 6c14e98376ac410fb2b5b189000e855f (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260620 13:54:17.692623  4839 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8cc4f789b24974a1859102de85d33d (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260620 13:54:17.682287  4988 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8cc4f789b24974a1859102de85d33d (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
W20260620 13:54:17.716368  4799 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:54:17.709626  4992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d748d43c67664af88e57ce75b6be81e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.719127  4837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd3e06006b244dfcb166b165bd0ed812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.724818  4991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d11a1fc374477caf80fa0e24f0a281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.708674  4989 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb86d5e1936485fb6531cefe3eb775b (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260620 13:54:17.722860  4911 tablet_service.cc:1511] Processing CreateTablet for tablet 6c14e98376ac410fb2b5b189000e855f (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260620 13:54:17.732728  4911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c14e98376ac410fb2b5b189000e855f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.734671  4839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8cc4f789b24974a1859102de85d33d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.744390  4990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adfeaab3cb7d4d1d9eedd1282d3ac16d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.725090  4838 tablet_service.cc:1511] Processing CreateTablet for tablet 22dd8bbdf26244a384b739fe2fdb7486 (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260620 13:54:17.747367  4986 tablet_service.cc:1511] Processing CreateTablet for tablet fd3e06006b244dfcb166b165bd0ed812 (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260620 13:54:17.742344  4985 tablet_service.cc:1511] Processing CreateTablet for tablet 6c14e98376ac410fb2b5b189000e855f (DEFAULT_TABLE table=test-workload [id=fbf7d15e361f486cacd9112979e2e375]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260620 13:54:17.752296  4841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adfeaab3cb7d4d1d9eedd1282d3ac16d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.758786  5046 tablet_bootstrap.cc:492] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47: Bootstrap starting.
I20260620 13:54:17.754386  4989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb86d5e1936485fb6531cefe3eb775b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.763703  4987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22dd8bbdf26244a384b739fe2fdb7486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.768419  4986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd3e06006b244dfcb166b165bd0ed812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.775692  4836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c14e98376ac410fb2b5b189000e855f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.786655  4838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22dd8bbdf26244a384b739fe2fdb7486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.788429  4840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb86d5e1936485fb6531cefe3eb775b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.785023  4985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c14e98376ac410fb2b5b189000e855f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.819429  4988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8cc4f789b24974a1859102de85d33d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:17.868988  5047 tablet_bootstrap.cc:492] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52: Bootstrap starting.
I20260620 13:54:17.892611  5046 tablet_bootstrap.cc:654] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:17.922024  5048 tablet_bootstrap.cc:492] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354: Bootstrap starting.
I20260620 13:54:17.940809  5047 tablet_bootstrap.cc:654] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:17.961772  5046 tablet_bootstrap.cc:492] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47: No bootstrap required, opened a new log
I20260620 13:54:17.962496  5046 ts_tablet_manager.cc:1403] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47: Time spent bootstrapping tablet: real 0.236s	user 0.016s	sys 0.023s
I20260620 13:54:17.971451  5046 raft_consensus.cc:359] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:17.972319  5046 raft_consensus.cc:385] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:17.972787  5046 raft_consensus.cc:740] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Initialized, Role: FOLLOWER
I20260620 13:54:17.974360  5046 consensus_queue.cc:260] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:17.976786  4954 heartbeater.cc:499] Master 127.4.155.254:36845 was elected leader, sending a full tablet report...
I20260620 13:54:17.977481  5047 tablet_bootstrap.cc:492] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52: No bootstrap required, opened a new log
I20260620 13:54:17.977928  5047 ts_tablet_manager.cc:1403] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52: Time spent bootstrapping tablet: real 0.131s	user 0.014s	sys 0.005s
I20260620 13:54:17.977993  5048 tablet_bootstrap.cc:654] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:17.981032  5047 raft_consensus.cc:359] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:17.981788  5047 raft_consensus.cc:385] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:17.982061  5047 raft_consensus.cc:740] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Initialized, Role: FOLLOWER
I20260620 13:54:17.982733  5047 consensus_queue.cc:260] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:17.984663  5046 ts_tablet_manager.cc:1434] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47: Time spent starting tablet: real 0.022s	user 0.000s	sys 0.007s
I20260620 13:54:17.986140  5046 tablet_bootstrap.cc:492] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47: Bootstrap starting.
I20260620 13:54:17.995231  5046 tablet_bootstrap.cc:654] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.009980  4879 heartbeater.cc:499] Master 127.4.155.254:36845 was elected leader, sending a full tablet report...
I20260620 13:54:18.015091  5047 ts_tablet_manager.cc:1434] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52: Time spent starting tablet: real 0.037s	user 0.013s	sys 0.023s
I20260620 13:54:18.016090  5047 tablet_bootstrap.cc:492] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52: Bootstrap starting.
I20260620 13:54:18.016367  5046 tablet_bootstrap.cc:492] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47: No bootstrap required, opened a new log
I20260620 13:54:18.016826  5046 ts_tablet_manager.cc:1403] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.006s
I20260620 13:54:18.019886  5046 raft_consensus.cc:359] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.020537  5048 tablet_bootstrap.cc:492] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354: No bootstrap required, opened a new log
I20260620 13:54:18.020774  5046 raft_consensus.cc:385] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.021163  5046 raft_consensus.cc:740] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.021319  5048 ts_tablet_manager.cc:1403] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354: Time spent bootstrapping tablet: real 0.126s	user 0.028s	sys 0.020s
I20260620 13:54:18.021978  5046 consensus_queue.cc:260] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.022768  5047 tablet_bootstrap.cc:654] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.024845  5046 ts_tablet_manager.cc:1434] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260620 13:54:18.025864  5046 tablet_bootstrap.cc:492] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47: Bootstrap starting.
I20260620 13:54:18.025962  5048 raft_consensus.cc:359] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.027015  5048 raft_consensus.cc:385] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.027416  5048 raft_consensus.cc:740] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd23e27c1393498daca3fba741403354, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.028469  5048 consensus_queue.cc:260] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.034688  5046 tablet_bootstrap.cc:654] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.035521  5047 tablet_bootstrap.cc:492] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52: No bootstrap required, opened a new log
I20260620 13:54:18.036021  5047 ts_tablet_manager.cc:1403] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260620 13:54:18.036123  5048 ts_tablet_manager.cc:1434] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.002s
I20260620 13:54:18.036927  5028 heartbeater.cc:499] Master 127.4.155.254:36845 was elected leader, sending a full tablet report...
I20260620 13:54:18.039671  5047 raft_consensus.cc:359] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.040635  5047 raft_consensus.cc:385] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.041788  5048 tablet_bootstrap.cc:492] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354: Bootstrap starting.
I20260620 13:54:18.041683  5047 raft_consensus.cc:740] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.042830  5047 consensus_queue.cc:260] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.045934  5047 ts_tablet_manager.cc:1434] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260620 13:54:18.047364  5047 tablet_bootstrap.cc:492] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52: Bootstrap starting.
I20260620 13:54:18.050218  5048 tablet_bootstrap.cc:654] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.054013  5046 tablet_bootstrap.cc:492] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47: No bootstrap required, opened a new log
I20260620 13:54:18.054527  5046 ts_tablet_manager.cc:1403] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.011s
I20260620 13:54:18.057967  5046 raft_consensus.cc:359] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.058763  5046 raft_consensus.cc:385] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.059094  5046 raft_consensus.cc:740] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.059477  5047 tablet_bootstrap.cc:654] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.059993  5046 consensus_queue.cc:260] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.062880  5046 ts_tablet_manager.cc:1434] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260620 13:54:18.063306  5048 tablet_bootstrap.cc:492] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354: No bootstrap required, opened a new log
I20260620 13:54:18.063844  5048 ts_tablet_manager.cc:1403] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.006s
I20260620 13:54:18.064064  5046 tablet_bootstrap.cc:492] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47: Bootstrap starting.
I20260620 13:54:18.067261  5048 raft_consensus.cc:359] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.068276  5048 raft_consensus.cc:385] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.068668  5048 raft_consensus.cc:740] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd23e27c1393498daca3fba741403354, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.069628  5048 consensus_queue.cc:260] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.072343  5048 ts_tablet_manager.cc:1434] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260620 13:54:18.072930  5046 tablet_bootstrap.cc:654] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.073516  5048 tablet_bootstrap.cc:492] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354: Bootstrap starting.
I20260620 13:54:18.081176  5048 tablet_bootstrap.cc:654] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.081099  5047 tablet_bootstrap.cc:492] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52: No bootstrap required, opened a new log
I20260620 13:54:18.081959  5047 ts_tablet_manager.cc:1403] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.004s
I20260620 13:54:18.084722  5046 tablet_bootstrap.cc:492] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47: No bootstrap required, opened a new log
I20260620 13:54:18.085216  5046 ts_tablet_manager.cc:1403] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47: Time spent bootstrapping tablet: real 0.021s	user 0.020s	sys 0.000s
I20260620 13:54:18.088199  5046 raft_consensus.cc:359] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.088991  5046 raft_consensus.cc:385] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.089310  5046 raft_consensus.cc:740] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.090071  5047 raft_consensus.cc:359] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.090103  5046 consensus_queue.cc:260] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.091081  5047 raft_consensus.cc:385] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.092110  5047 raft_consensus.cc:740] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.092506  5046 ts_tablet_manager.cc:1434] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 13:54:18.093741  5046 tablet_bootstrap.cc:492] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47: Bootstrap starting.
I20260620 13:54:18.093333  5047 consensus_queue.cc:260] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.096344  5047 ts_tablet_manager.cc:1434] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260620 13:54:18.097556  5047 tablet_bootstrap.cc:492] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52: Bootstrap starting.
I20260620 13:54:18.099092  5048 tablet_bootstrap.cc:492] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354: No bootstrap required, opened a new log
I20260620 13:54:18.099625  5048 ts_tablet_manager.cc:1403] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.003s
I20260620 13:54:18.102550  5048 raft_consensus.cc:359] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.103317  5048 raft_consensus.cc:385] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.103614  5048 raft_consensus.cc:740] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd23e27c1393498daca3fba741403354, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.104308  5048 consensus_queue.cc:260] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.106567  5048 ts_tablet_manager.cc:1434] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260620 13:54:18.105147  5047 tablet_bootstrap.cc:654] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.111410  5051 raft_consensus.cc:493] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:18.111994  5051 raft_consensus.cc:515] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.114365  5051 leader_election.cc:290] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.117843  5053 raft_consensus.cc:493] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:18.119976  5046 tablet_bootstrap.cc:654] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.120208  5053 raft_consensus.cc:515] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
W20260620 13:54:18.125976  5029 tablet.cc:2406] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 13:54:18.127579  5053 leader_election.cc:290] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.125713  5048 tablet_bootstrap.cc:492] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354: Bootstrap starting.
I20260620 13:54:18.172149  5056 raft_consensus.cc:493] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:18.172968  5056 raft_consensus.cc:515] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.180178  5047 tablet_bootstrap.cc:492] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52: No bootstrap required, opened a new log
I20260620 13:54:18.180799  5056 leader_election.cc:290] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197)
I20260620 13:54:18.180742  5047 ts_tablet_manager.cc:1403] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52: Time spent bootstrapping tablet: real 0.083s	user 0.027s	sys 0.002s
I20260620 13:54:18.183451  5046 tablet_bootstrap.cc:492] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47: No bootstrap required, opened a new log
I20260620 13:54:18.195535  5053 raft_consensus.cc:493] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:18.196069  5053 raft_consensus.cc:515] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.198076  5047 raft_consensus.cc:359] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.198877  5047 raft_consensus.cc:385] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.198877  5053 leader_election.cc:290] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.199338  5047 raft_consensus.cc:740] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.194983  5046 ts_tablet_manager.cc:1403] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47: Time spent bootstrapping tablet: real 0.101s	user 0.026s	sys 0.022s
I20260620 13:54:18.200346  5047 consensus_queue.cc:260] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.225649  5056 raft_consensus.cc:493] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:18.227694  5047 ts_tablet_manager.cc:1434] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.002s
I20260620 13:54:18.226320  5056 raft_consensus.cc:515] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.231024  5047 tablet_bootstrap.cc:492] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52: Bootstrap starting.
I20260620 13:54:18.253731  5056 leader_election.cc:290] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197)
I20260620 13:54:18.254928  5048 tablet_bootstrap.cc:654] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.265287  5046 raft_consensus.cc:359] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.266183  5046 raft_consensus.cc:385] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.266510  5046 raft_consensus.cc:740] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.267284  5046 consensus_queue.cc:260] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.268833  5051 raft_consensus.cc:493] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:18.269507  5051 raft_consensus.cc:515] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.271720  5051 leader_election.cc:290] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.273439  5047 tablet_bootstrap.cc:654] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.284094  5046 ts_tablet_manager.cc:1434] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.013s
I20260620 13:54:18.294701  5053 raft_consensus.cc:493] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:18.296051  5046 tablet_bootstrap.cc:492] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47: Bootstrap starting.
I20260620 13:54:18.296640  5053 raft_consensus.cc:515] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.305569  4854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb86d5e1936485fb6531cefe3eb775b" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52" is_pre_election: true
I20260620 13:54:18.309809  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d11a1fc374477caf80fa0e24f0a281" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52" is_pre_election: true
W20260620 13:54:18.313086  4895 leader_election.cc:343] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:54:18.317052  4895 leader_election.cc:343] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:18.322490  5053 leader_election.cc:290] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.331254  5003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb86d5e1936485fb6531cefe3eb775b" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354" is_pre_election: true
I20260620 13:54:18.333916  5001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d11a1fc374477caf80fa0e24f0a281" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354" is_pre_election: true
I20260620 13:54:18.334784  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f55cacdeebd4cad83b3cd8753320b37" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354" is_pre_election: true
I20260620 13:54:18.336709  5002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354" is_pre_election: true
I20260620 13:54:18.338070  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354" is_pre_election: true
I20260620 13:54:18.342003  4999 raft_consensus.cc:2468] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 0.
W20260620 13:54:18.343458  4893 leader_election.cc:343] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd23e27c1393498daca3fba741403354 (127.4.155.195:39977): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:18.340358  5048 tablet_bootstrap.cc:492] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354: No bootstrap required, opened a new log
I20260620 13:54:18.344627  5048 ts_tablet_manager.cc:1403] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354: Time spent bootstrapping tablet: real 0.226s	user 0.024s	sys 0.021s
I20260620 13:54:18.343902  4893 leader_election.cc:304] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f61dc2e8457c42b09772f9e664c67b47; no voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354
I20260620 13:54:18.341231  5000 raft_consensus.cc:2468] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 0.
I20260620 13:54:18.346999  5051 raft_consensus.cc:2749] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:54:18.349080  5051 raft_consensus.cc:493] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:54:18.350133  4893 leader_election.cc:343] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd23e27c1393498daca3fba741403354 (127.4.155.195:39977): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:18.350318  5051 raft_consensus.cc:515] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.350700  4893 leader_election.cc:304] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f61dc2e8457c42b09772f9e664c67b47; no voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354
I20260620 13:54:18.357591  5051 leader_election.cc:290] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.358309  5051 raft_consensus.cc:2749] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:54:18.358780  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354" is_pre_election: true
I20260620 13:54:18.359962  5000 raft_consensus.cc:2468] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 0.
W20260620 13:54:18.350353  4818 leader_election.cc:343] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd23e27c1393498daca3fba741403354 (127.4.155.195:39977): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:18.359295  5048 raft_consensus.cc:359] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.363029  5048 raft_consensus.cc:385] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.363436  5048 raft_consensus.cc:740] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd23e27c1393498daca3fba741403354, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.362396  4893 leader_election.cc:304] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd23e27c1393498daca3fba741403354, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:18.365974  5051 raft_consensus.cc:2804] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:18.366621  5046 tablet_bootstrap.cc:654] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.367820  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47" is_pre_election: true
I20260620 13:54:18.364248  5048 consensus_queue.cc:260] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.363862  4818 leader_election.cc:304] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: 
I20260620 13:54:18.366585  5051 raft_consensus.cc:493] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:18.371719  5051 raft_consensus.cc:3060] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.371330  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c14e98376ac410fb2b5b189000e855f" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47" is_pre_election: true
I20260620 13:54:18.372766  5053 raft_consensus.cc:2804] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:18.373157  5053 raft_consensus.cc:493] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:18.373490  5053 raft_consensus.cc:3060] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:54:18.374128  4968 leader_election.cc:343] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:18.379544  4818 leader_election.cc:304] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: 
I20260620 13:54:18.381453  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52" is_pre_election: true
I20260620 13:54:18.381875  5047 tablet_bootstrap.cc:492] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52: No bootstrap required, opened a new log
I20260620 13:54:18.382391  5047 ts_tablet_manager.cc:1403] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52: Time spent bootstrapping tablet: real 0.154s	user 0.008s	sys 0.013s
I20260620 13:54:18.384244  5053 raft_consensus.cc:515] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.381621  5077 raft_consensus.cc:493] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:18.387754  4853 raft_consensus.cc:2393] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f61dc2e8457c42b09772f9e664c67b47 in current term 1: Already voted for candidate 3d3395064db742469140d8c045a1ef52 in this term.
I20260620 13:54:18.387657  5077 raft_consensus.cc:515] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.390286  5077 leader_election.cc:290] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.391306  4927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f55cacdeebd4cad83b3cd8753320b37" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47" is_pre_election: true
I20260620 13:54:18.392016  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adfeaab3cb7d4d1d9eedd1282d3ac16d" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52" is_pre_election: true
I20260620 13:54:18.392879  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47" is_pre_election: true
I20260620 13:54:18.386489  5048 ts_tablet_manager.cc:1434] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
W20260620 13:54:18.394657  4895 leader_election.cc:343] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:18.395879  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adfeaab3cb7d4d1d9eedd1282d3ac16d" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354" is_pre_election: true
W20260620 13:54:18.397547  4819 leader_election.cc:343] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:18.398101  4926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:18.398650  5051 raft_consensus.cc:515] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.399417  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47" is_pre_election: true
I20260620 13:54:18.399758  4929 raft_consensus.cc:2393] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd23e27c1393498daca3fba741403354 in current term 1: Already voted for candidate f61dc2e8457c42b09772f9e664c67b47 in this term.
I20260620 13:54:18.400035  4928 raft_consensus.cc:2468] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 0.
W20260620 13:54:18.401383  4893 leader_election.cc:343] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd23e27c1393498daca3fba741403354 (127.4.155.195:39977): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:18.394804  5048 tablet_bootstrap.cc:492] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354: Bootstrap starting.
I20260620 13:54:18.400935  5047 raft_consensus.cc:359] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.401845  4893 leader_election.cc:304] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f61dc2e8457c42b09772f9e664c67b47; no voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354
I20260620 13:54:18.402081  5047 raft_consensus.cc:385] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.402406  5047 raft_consensus.cc:740] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.402626  5077 raft_consensus.cc:2749] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:54:18.403287  5047 consensus_queue.cc:260] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.404767  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:18.405170  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:18.405833  4853 raft_consensus.cc:2393] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f61dc2e8457c42b09772f9e664c67b47 in current term 1: Already voted for candidate 3d3395064db742469140d8c045a1ef52 in this term.
I20260620 13:54:18.405799  5000 raft_consensus.cc:3060] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.404147  5051 leader_election.cc:290] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.403416  4819 leader_election.cc:304] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, f61dc2e8457c42b09772f9e664c67b47; no voters: cd23e27c1393498daca3fba741403354
I20260620 13:54:18.411821  5053 leader_election.cc:290] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 election: Requested vote from peers f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.412853  5053 raft_consensus.cc:2804] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:18.415445  5053 raft_consensus.cc:493] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:18.415797  5053 raft_consensus.cc:3060] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.425536  5048 tablet_bootstrap.cc:654] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.426489  5078 raft_consensus.cc:2804] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:18.423465  5000 raft_consensus.cc:2468] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 1.
I20260620 13:54:18.428999  5053 raft_consensus.cc:515] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
W20260620 13:54:18.429427  4818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:39977, user_credentials={real_user=slave}} blocked reactor thread for 49954.9us
I20260620 13:54:18.430397  5078 raft_consensus.cc:493] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:18.431481  5078 raft_consensus.cc:3060] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.432659  4893 leader_election.cc:304] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd23e27c1393498daca3fba741403354, f61dc2e8457c42b09772f9e664c67b47; no voters: 3d3395064db742469140d8c045a1ef52
I20260620 13:54:18.432766  5047 ts_tablet_manager.cc:1434] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.014s
I20260620 13:54:18.435225  5051 raft_consensus.cc:2804] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:18.435899  5047 tablet_bootstrap.cc:492] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52: Bootstrap starting.
I20260620 13:54:18.436004  5051 raft_consensus.cc:697] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 1 LEADER]: Becoming Leader. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:18.434747  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:18.438735  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52" is_pre_election: true
I20260620 13:54:18.439568  4853 raft_consensus.cc:2393] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd23e27c1393498daca3fba741403354 in current term 1: Already voted for candidate 3d3395064db742469140d8c045a1ef52 in this term.
I20260620 13:54:18.438272  5051 consensus_queue.cc:237] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.442595  5000 raft_consensus.cc:2393] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d3395064db742469140d8c045a1ef52 in current term 1: Already voted for candidate f61dc2e8457c42b09772f9e664c67b47 in this term.
I20260620 13:54:18.444293  4969 leader_election.cc:304] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd23e27c1393498daca3fba741403354; no voters: 3d3395064db742469140d8c045a1ef52, f61dc2e8457c42b09772f9e664c67b47
I20260620 13:54:18.446354  5056 raft_consensus.cc:2749] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:54:18.445354  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c14e98376ac410fb2b5b189000e855f" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52" is_pre_election: true
I20260620 13:54:18.449329  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f55cacdeebd4cad83b3cd8753320b37" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:18.450698  5048 tablet_bootstrap.cc:492] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354: No bootstrap required, opened a new log
I20260620 13:54:18.450747  5046 tablet_bootstrap.cc:492] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47: No bootstrap required, opened a new log
W20260620 13:54:18.450867  4819 leader_election.cc:343] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:18.451314  5048 ts_tablet_manager.cc:1403] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.008s
I20260620 13:54:18.451382  5046 ts_tablet_manager.cc:1403] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47: Time spent bootstrapping tablet: real 0.159s	user 0.014s	sys 0.012s
I20260620 13:54:18.445262  4818 leader_election.cc:304] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3395064db742469140d8c045a1ef52; no voters: cd23e27c1393498daca3fba741403354, f61dc2e8457c42b09772f9e664c67b47
I20260620 13:54:18.452584  5053 leader_election.cc:290] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 election: Requested vote from peers f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.454310  5080 raft_consensus.cc:2749] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260620 13:54:18.455631  4969 leader_election.cc:343] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:18.456075  4969 leader_election.cc:304] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd23e27c1393498daca3fba741403354; no voters: 3d3395064db742469140d8c045a1ef52, f61dc2e8457c42b09772f9e664c67b47
I20260620 13:54:18.457459  5056 raft_consensus.cc:2749] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:54:18.454957  5047 tablet_bootstrap.cc:654] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.459218  5080 raft_consensus.cc:493] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:18.459757  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f55cacdeebd4cad83b3cd8753320b37" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:18.459738  5080 raft_consensus.cc:515] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.460541  5000 raft_consensus.cc:3060] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.461318  5046 raft_consensus.cc:359] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.462996  5046 raft_consensus.cc:385] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.463418  5046 raft_consensus.cc:740] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.460837  5048 raft_consensus.cc:359] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.465601  5048 raft_consensus.cc:385] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.465763  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8cc4f789b24974a1859102de85d33d" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47" is_pre_election: true
I20260620 13:54:18.466051  5048 raft_consensus.cc:740] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd23e27c1393498daca3fba741403354, State: Initialized, Role: FOLLOWER
W20260620 13:54:18.467054  4819 leader_election.cc:343] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:18.466930  5048 consensus_queue.cc:260] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.465178  5046 consensus_queue.cc:260] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.469153  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8cc4f789b24974a1859102de85d33d" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354" is_pre_election: true
I20260620 13:54:18.464682  5080 leader_election.cc:290] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
W20260620 13:54:18.472064  4818 leader_election.cc:343] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd23e27c1393498daca3fba741403354 (127.4.155.195:39977): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:18.472579  5000 raft_consensus.cc:2468] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 1.
I20260620 13:54:18.480095  5046 ts_tablet_manager.cc:1434] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260620 13:54:18.474488  5048 ts_tablet_manager.cc:1434] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.004s
I20260620 13:54:18.481849  5048 tablet_bootstrap.cc:492] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354: Bootstrap starting.
I20260620 13:54:18.483161  5046 tablet_bootstrap.cc:492] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47: Bootstrap starting.
I20260620 13:54:18.489488  4750 catalog_manager.cc:5696] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 reported cstate change: term changed from 0 to 1, leader changed from <none> to f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "f61dc2e8457c42b09772f9e664c67b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:18.472549  4818 leader_election.cc:304] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3395064db742469140d8c045a1ef52; no voters: cd23e27c1393498daca3fba741403354, f61dc2e8457c42b09772f9e664c67b47
I20260620 13:54:18.496260  4818 leader_election.cc:304] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: f61dc2e8457c42b09772f9e664c67b47
I20260620 13:54:18.497323  5053 raft_consensus.cc:2749] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:54:18.497648  5080 raft_consensus.cc:2804] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:18.498175  5080 raft_consensus.cc:697] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Becoming Leader. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Running, Role: LEADER
I20260620 13:54:18.500330  5080 consensus_queue.cc:237] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.515793  5048 tablet_bootstrap.cc:654] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.516812  5046 tablet_bootstrap.cc:654] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.521776  5047 tablet_bootstrap.cc:492] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52: No bootstrap required, opened a new log
I20260620 13:54:18.522258  5047 ts_tablet_manager.cc:1403] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52: Time spent bootstrapping tablet: real 0.087s	user 0.021s	sys 0.025s
I20260620 13:54:18.510818  5078 raft_consensus.cc:515] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.529716  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:18.530321  4929 raft_consensus.cc:3060] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.534726  5048 tablet_bootstrap.cc:492] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354: No bootstrap required, opened a new log
I20260620 13:54:18.538525  5048 ts_tablet_manager.cc:1403] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.005s
I20260620 13:54:18.541675  5048 raft_consensus.cc:359] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.542419  5048 raft_consensus.cc:385] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.527436  4748 catalog_manager.cc:5696] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3395064db742469140d8c045a1ef52 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "3d3395064db742469140d8c045a1ef52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:18.542734  4929 raft_consensus.cc:2468] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 1.
I20260620 13:54:18.532622  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:18.542738  5048 raft_consensus.cc:740] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd23e27c1393498daca3fba741403354, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.545490  5000 raft_consensus.cc:3060] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.530916  5078 leader_election.cc:290] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 election: Requested vote from peers f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.530699  5047 raft_consensus.cc:359] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.551712  5047 raft_consensus.cc:385] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.545854  5056 raft_consensus.cc:493] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:18.551900  4819 leader_election.cc:304] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:18.552047  5047 raft_consensus.cc:740] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.553628  5078 raft_consensus.cc:2804] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:18.553714  5048 consensus_queue.cc:260] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.554322  5078 raft_consensus.cc:697] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Becoming Leader. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Running, Role: LEADER
I20260620 13:54:18.554148  5047 consensus_queue.cc:260] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.552399  5056 raft_consensus.cc:515] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.556593  5047 ts_tablet_manager.cc:1434] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260620 13:54:18.555584  5078 consensus_queue.cc:237] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.557665  5047 tablet_bootstrap.cc:492] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52: Bootstrap starting.
I20260620 13:54:18.558415  5046 tablet_bootstrap.cc:492] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47: No bootstrap required, opened a new log
I20260620 13:54:18.558804  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd8bbdf26244a384b739fe2fdb7486" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52" is_pre_election: true
I20260620 13:54:18.559459  4853 raft_consensus.cc:2468] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 0.
I20260620 13:54:18.558506  5056 leader_election.cc:290] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197)
I20260620 13:54:18.561064  4969 leader_election.cc:304] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: 
I20260620 13:54:18.562103  5056 raft_consensus.cc:2804] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:18.562506  5056 raft_consensus.cc:493] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:18.562918  5056 raft_consensus.cc:3060] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.564743  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd8bbdf26244a384b739fe2fdb7486" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47" is_pre_election: true
I20260620 13:54:18.559430  5046 ts_tablet_manager.cc:1403] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47: Time spent bootstrapping tablet: real 0.076s	user 0.008s	sys 0.012s
W20260620 13:54:18.567430  4968 leader_election.cc:343] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:18.577000  5047 tablet_bootstrap.cc:654] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.577776  5000 raft_consensus.cc:2468] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 1.
I20260620 13:54:18.579741  5046 raft_consensus.cc:359] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.580909  5046 raft_consensus.cc:385] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.581238  5046 raft_consensus.cc:740] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.581425  5048 ts_tablet_manager.cc:1434] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354: Time spent starting tablet: real 0.043s	user 0.014s	sys 0.004s
I20260620 13:54:18.587759  5048 tablet_bootstrap.cc:492] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354: Bootstrap starting.
I20260620 13:54:18.588475  5056 raft_consensus.cc:515] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.589322  5046 consensus_queue.cc:260] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.591892  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd8bbdf26244a384b739fe2fdb7486" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:18.592904  4853 raft_consensus.cc:3060] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.596987  5056 leader_election.cc:290] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197)
I20260620 13:54:18.598233  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd8bbdf26244a384b739fe2fdb7486" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:18.599202  5046 ts_tablet_manager.cc:1434] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.003s
W20260620 13:54:18.599650  4968 leader_election.cc:343] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:18.600245  5046 tablet_bootstrap.cc:492] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47: Bootstrap starting.
I20260620 13:54:18.605489  4853 raft_consensus.cc:2468] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 1.
I20260620 13:54:18.606782  5047 tablet_bootstrap.cc:492] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52: No bootstrap required, opened a new log
I20260620 13:54:18.607342  5047 ts_tablet_manager.cc:1403] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.004s
I20260620 13:54:18.607159  4969 leader_election.cc:304] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: f61dc2e8457c42b09772f9e664c67b47
I20260620 13:54:18.608712  5048 tablet_bootstrap.cc:654] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.610680  5047 raft_consensus.cc:359] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.611531  5047 raft_consensus.cc:385] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.611937  5046 tablet_bootstrap.cc:654] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.608650  5056 raft_consensus.cc:2804] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:18.611900  5047 raft_consensus.cc:740] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.616150  5056 raft_consensus.cc:697] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 1 LEADER]: Becoming Leader. State: Replica: cd23e27c1393498daca3fba741403354, State: Running, Role: LEADER
I20260620 13:54:18.615854  5047 consensus_queue.cc:260] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.617553  5056 consensus_queue.cc:237] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.619412  5047 ts_tablet_manager.cc:1434] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260620 13:54:18.620705  5047 tablet_bootstrap.cc:492] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52: Bootstrap starting.
I20260620 13:54:18.631974  4751 catalog_manager.cc:5696] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd23e27c1393498daca3fba741403354 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "cd23e27c1393498daca3fba741403354" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: HEALTHY } } }
I20260620 13:54:18.634725  5048 tablet_bootstrap.cc:492] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354: No bootstrap required, opened a new log
I20260620 13:54:18.635249  5048 ts_tablet_manager.cc:1403] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.009s
I20260620 13:54:18.638351  5048 raft_consensus.cc:359] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.638960  5048 raft_consensus.cc:385] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.639299  5048 raft_consensus.cc:740] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd23e27c1393498daca3fba741403354, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.640205  5048 consensus_queue.cc:260] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.642462  5047 tablet_bootstrap.cc:654] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.643003  5048 ts_tablet_manager.cc:1434] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 13:54:18.645865  5048 tablet_bootstrap.cc:492] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354: Bootstrap starting.
I20260620 13:54:18.643841  5046 tablet_bootstrap.cc:492] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47: No bootstrap required, opened a new log
I20260620 13:54:18.649602  5046 ts_tablet_manager.cc:1403] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.024s
I20260620 13:54:18.652235  5046 raft_consensus.cc:359] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.652917  5046 raft_consensus.cc:385] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.653193  5046 raft_consensus.cc:740] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.653911  5046 consensus_queue.cc:260] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.661549  5046 ts_tablet_manager.cc:1434] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260620 13:54:18.662413  5046 tablet_bootstrap.cc:492] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47: Bootstrap starting.
I20260620 13:54:18.668193  5046 tablet_bootstrap.cc:654] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.671240  5048 tablet_bootstrap.cc:654] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.670486  4748 catalog_manager.cc:5696] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3395064db742469140d8c045a1ef52 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "3d3395064db742469140d8c045a1ef52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:18.679064  5047 tablet_bootstrap.cc:492] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52: No bootstrap required, opened a new log
I20260620 13:54:18.679553  5047 ts_tablet_manager.cc:1403] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.007s
I20260620 13:54:18.682152  5047 raft_consensus.cc:359] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.682893  5047 raft_consensus.cc:385] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.683244  5047 raft_consensus.cc:740] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.684247  5047 consensus_queue.cc:260] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.687021  5047 ts_tablet_manager.cc:1434] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260620 13:54:18.688251  5047 tablet_bootstrap.cc:492] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52: Bootstrap starting.
I20260620 13:54:18.692468  5046 tablet_bootstrap.cc:492] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47: No bootstrap required, opened a new log
I20260620 13:54:18.693084  5046 ts_tablet_manager.cc:1403] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.004s
I20260620 13:54:18.693917  5078 raft_consensus.cc:493] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:18.694476  5078 raft_consensus.cc:515] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.696735  5078 leader_election.cc:290] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.696187  5047 tablet_bootstrap.cc:654] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.697860  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adfeaab3cb7d4d1d9eedd1282d3ac16d" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47" is_pre_election: true
I20260620 13:54:18.698501  4929 raft_consensus.cc:2468] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 0.
I20260620 13:54:18.699229  5046 raft_consensus.cc:359] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.700001  5046 raft_consensus.cc:385] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.700459  5046 raft_consensus.cc:740] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.700595  4819 leader_election.cc:304] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:18.701467  5046 consensus_queue.cc:260] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.703802  5046 ts_tablet_manager.cc:1434] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260620 13:54:18.705041  5078 raft_consensus.cc:2804] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:18.705413  5078 raft_consensus.cc:493] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:18.705750  5078 raft_consensus.cc:3060] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.699491  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adfeaab3cb7d4d1d9eedd1282d3ac16d" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354" is_pre_election: true
I20260620 13:54:18.711426  5000 raft_consensus.cc:2468] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 0.
I20260620 13:54:18.713749  5048 tablet_bootstrap.cc:492] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354: No bootstrap required, opened a new log
I20260620 13:54:18.714249  5048 ts_tablet_manager.cc:1403] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354: Time spent bootstrapping tablet: real 0.069s	user 0.006s	sys 0.012s
I20260620 13:54:18.717078  5048 raft_consensus.cc:359] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.717864  5048 raft_consensus.cc:385] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.718170  5048 raft_consensus.cc:740] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd23e27c1393498daca3fba741403354, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.719245  5048 consensus_queue.cc:260] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.717001  5078 raft_consensus.cc:515] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.719786  5047 tablet_bootstrap.cc:492] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52: No bootstrap required, opened a new log
I20260620 13:54:18.721984  5078 leader_election.cc:290] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 election: Requested vote from peers f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.722817  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adfeaab3cb7d4d1d9eedd1282d3ac16d" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:18.723378  5047 ts_tablet_manager.cc:1403] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.007s
I20260620 13:54:18.723460  4929 raft_consensus.cc:3060] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:54:18.721215  4799 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:54:18.726456  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adfeaab3cb7d4d1d9eedd1282d3ac16d" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:18.726923  5048 ts_tablet_manager.cc:1434] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260620 13:54:18.727095  5000 raft_consensus.cc:3060] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.728029  5048 tablet_bootstrap.cc:492] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354: Bootstrap starting.
I20260620 13:54:18.734560  5048 tablet_bootstrap.cc:654] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:18.734634  5051 raft_consensus.cc:493] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:18.735266  5051 raft_consensus.cc:515] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.736876  5000 raft_consensus.cc:2468] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 1.
I20260620 13:54:18.737900  5051 leader_election.cc:290] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.738173  4818 leader_election.cc:304] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: 
I20260620 13:54:18.738216  5047 raft_consensus.cc:359] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.739766  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f55cacdeebd4cad83b3cd8753320b37" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52" is_pre_election: true
I20260620 13:54:18.740213  5078 raft_consensus.cc:2804] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:18.740872  5078 raft_consensus.cc:697] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Becoming Leader. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Running, Role: LEADER
I20260620 13:54:18.741933  5078 consensus_queue.cc:237] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.745497  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f55cacdeebd4cad83b3cd8753320b37" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354" is_pre_election: true
I20260620 13:54:18.746310  4999 raft_consensus.cc:2393] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f61dc2e8457c42b09772f9e664c67b47 in current term 1: Already voted for candidate 3d3395064db742469140d8c045a1ef52 in this term.
I20260620 13:54:18.747501  4893 leader_election.cc:304] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f61dc2e8457c42b09772f9e664c67b47; no voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354
I20260620 13:54:18.748459  5051 raft_consensus.cc:3060] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.748682  5047 raft_consensus.cc:385] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.749075  5047 raft_consensus.cc:740] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.749781  5047 consensus_queue.cc:260] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.751848  5047 ts_tablet_manager.cc:1434] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260620 13:54:18.753993  4929 raft_consensus.cc:2468] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 1.
I20260620 13:54:18.755339  5051 raft_consensus.cc:2749] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:54:18.747804  5048 tablet_bootstrap.cc:492] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354: No bootstrap required, opened a new log
I20260620 13:54:18.756186  5048 ts_tablet_manager.cc:1403] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.002s
I20260620 13:54:18.758906  5048 raft_consensus.cc:359] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.759744  5048 raft_consensus.cc:385] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:18.760022  5048 raft_consensus.cc:740] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd23e27c1393498daca3fba741403354, State: Initialized, Role: FOLLOWER
I20260620 13:54:18.760751  5048 consensus_queue.cc:260] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.760718  4748 catalog_manager.cc:5696] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3395064db742469140d8c045a1ef52 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "3d3395064db742469140d8c045a1ef52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:18.764317  5048 ts_tablet_manager.cc:1434] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260620 13:54:18.821004  5051 raft_consensus.cc:493] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:18.821606  5051 raft_consensus.cc:515] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.822091  5077 raft_consensus.cc:493] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:18.822521  5077 raft_consensus.cc:515] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.824465  5077 leader_election.cc:290] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.824965  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd8bbdf26244a384b739fe2fdb7486" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52" is_pre_election: true
I20260620 13:54:18.825740  4853 raft_consensus.cc:2393] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f61dc2e8457c42b09772f9e664c67b47 in current term 1: Already voted for candidate cd23e27c1393498daca3fba741403354 in this term.
I20260620 13:54:18.826107  4854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8cc4f789b24974a1859102de85d33d" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52" is_pre_election: true
I20260620 13:54:18.826638  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd8bbdf26244a384b739fe2fdb7486" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354" is_pre_election: true
I20260620 13:54:18.825551  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8cc4f789b24974a1859102de85d33d" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354" is_pre_election: true
I20260620 13:54:18.826732  4854 raft_consensus.cc:2468] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 0.
I20260620 13:54:18.828624  4999 raft_consensus.cc:2468] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 0.
I20260620 13:54:18.828805  4893 leader_election.cc:304] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f61dc2e8457c42b09772f9e664c67b47; no voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354
I20260620 13:54:18.829348  4895 leader_election.cc:304] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:18.829696  5077 raft_consensus.cc:3060] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.828130  5051 leader_election.cc:290] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.831368  5051 raft_consensus.cc:2804] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:18.831832  5051 raft_consensus.cc:493] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:18.832270  5051 raft_consensus.cc:3060] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.837815  5077 raft_consensus.cc:2749] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:54:18.841183  5051 raft_consensus.cc:515] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.843994  5051 leader_election.cc:290] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.844116  4854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8cc4f789b24974a1859102de85d33d" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:18.844231  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8cc4f789b24974a1859102de85d33d" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:18.844671  4854 raft_consensus.cc:3060] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.843854  5077 consensus_queue.cc:1048] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:54:18.844918  4999 raft_consensus.cc:3060] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.853070  4999 raft_consensus.cc:2468] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 1.
I20260620 13:54:18.853564  4854 raft_consensus.cc:2468] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 1.
I20260620 13:54:18.854529  4893 leader_election.cc:304] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd23e27c1393498daca3fba741403354, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:18.855479  5077 raft_consensus.cc:2804] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:18.856313  5077 raft_consensus.cc:697] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 1 LEADER]: Becoming Leader. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:18.857113  5077 consensus_queue.cc:237] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.869483  4750 catalog_manager.cc:5696] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 reported cstate change: term changed from 0 to 1, leader changed from <none> to f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "f61dc2e8457c42b09772f9e664c67b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:18.870560  5051 consensus_queue.cc:1048] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:18.915253  5051 raft_consensus.cc:493] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:18.915876  5051 raft_consensus.cc:515] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.919324  5051 leader_election.cc:290] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.919512  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c14e98376ac410fb2b5b189000e855f" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52" is_pre_election: true
I20260620 13:54:18.920116  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c14e98376ac410fb2b5b189000e855f" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354" is_pre_election: true
I20260620 13:54:18.920243  4853 raft_consensus.cc:2468] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 0.
I20260620 13:54:18.920807  4999 raft_consensus.cc:2468] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 0.
I20260620 13:54:18.921598  4895 leader_election.cc:304] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:18.922466  5051 raft_consensus.cc:2804] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:18.922873  5051 raft_consensus.cc:493] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:18.923202  5051 raft_consensus.cc:3060] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.928743  5051 raft_consensus.cc:515] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.930292  5051 leader_election.cc:290] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:18.931289  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c14e98376ac410fb2b5b189000e855f" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:18.931486  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c14e98376ac410fb2b5b189000e855f" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:18.931768  4853 raft_consensus.cc:3060] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.932145  4999 raft_consensus.cc:3060] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:18.936316  4853 raft_consensus.cc:2468] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 1.
I20260620 13:54:18.937345  4895 leader_election.cc:304] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:18.937994  5051 raft_consensus.cc:2804] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:18.938433  5051 raft_consensus.cc:697] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 1 LEADER]: Becoming Leader. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:18.939196  5051 consensus_queue.cc:237] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:18.939934  4999 raft_consensus.cc:2468] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 1.
I20260620 13:54:18.948575  4748 catalog_manager.cc:5696] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 reported cstate change: term changed from 0 to 1, leader changed from <none> to f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "f61dc2e8457c42b09772f9e664c67b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:19.016602  5056 raft_consensus.cc:493] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:19.017369  5056 raft_consensus.cc:515] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.019692  5056 leader_election.cc:290] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197)
I20260620 13:54:19.021297  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb86d5e1936485fb6531cefe3eb775b" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52" is_pre_election: true
I20260620 13:54:19.022325  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb86d5e1936485fb6531cefe3eb775b" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47" is_pre_election: true
I20260620 13:54:19.022861  4929 raft_consensus.cc:2468] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 0.
I20260620 13:54:19.023663  4853 raft_consensus.cc:2468] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 0.
I20260620 13:54:19.024044  4968 leader_election.cc:304] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd23e27c1393498daca3fba741403354, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:19.024926  5056 raft_consensus.cc:2804] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:19.025298  5056 raft_consensus.cc:493] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:19.025719  5056 raft_consensus.cc:3060] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:19.032378  5056 raft_consensus.cc:515] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.034505  5056 leader_election.cc:290] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197)
I20260620 13:54:19.035295  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb86d5e1936485fb6531cefe3eb775b" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:19.035615  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb86d5e1936485fb6531cefe3eb775b" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:19.035900  4853 raft_consensus.cc:3060] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:19.036123  4929 raft_consensus.cc:3060] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:19.042443  4929 raft_consensus.cc:2468] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 1.
I20260620 13:54:19.042443  4853 raft_consensus.cc:2468] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 1.
I20260620 13:54:19.043783  4969 leader_election.cc:304] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: 
I20260620 13:54:19.044516  5056 raft_consensus.cc:2804] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:19.045009  5056 raft_consensus.cc:697] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 1 LEADER]: Becoming Leader. State: Replica: cd23e27c1393498daca3fba741403354, State: Running, Role: LEADER
I20260620 13:54:19.045718  5056 consensus_queue.cc:237] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.054229  5078 raft_consensus.cc:493] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:19.054147  4748 catalog_manager.cc:5696] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd23e27c1393498daca3fba741403354 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "cd23e27c1393498daca3fba741403354" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: HEALTHY } } }
I20260620 13:54:19.054754  5078 raft_consensus.cc:515] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.057065  5078 leader_election.cc:290] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:19.057869  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d11a1fc374477caf80fa0e24f0a281" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47" is_pre_election: true
I20260620 13:54:19.058552  4929 raft_consensus.cc:2468] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 0.
I20260620 13:54:19.059823  4819 leader_election.cc:304] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:19.058790  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d11a1fc374477caf80fa0e24f0a281" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354" is_pre_election: true
I20260620 13:54:19.060700  4999 raft_consensus.cc:2468] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 0.
I20260620 13:54:19.061020  5078 raft_consensus.cc:2804] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:19.061540  5078 raft_consensus.cc:493] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:19.062031  5078 raft_consensus.cc:3060] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:19.067489  5078 raft_consensus.cc:515] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.069061  5078 leader_election.cc:290] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 election: Requested vote from peers f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:19.070117  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d11a1fc374477caf80fa0e24f0a281" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:19.070184  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d11a1fc374477caf80fa0e24f0a281" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:19.070713  4999 raft_consensus.cc:3060] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:19.070869  4929 raft_consensus.cc:3060] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:19.075410  4999 raft_consensus.cc:2468] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 1.
I20260620 13:54:19.076664  4818 leader_election.cc:304] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: 
I20260620 13:54:19.077452  5078 raft_consensus.cc:2804] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:19.077894  5078 raft_consensus.cc:697] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Becoming Leader. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Running, Role: LEADER
I20260620 13:54:19.078012  4929 raft_consensus.cc:2468] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 1.
I20260620 13:54:19.078743  5078 consensus_queue.cc:237] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.088433  4748 catalog_manager.cc:5696] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3395064db742469140d8c045a1ef52 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "3d3395064db742469140d8c045a1ef52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:19.099903  5078 consensus_queue.cc:1048] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:54:19.111196  5078 consensus_queue.cc:1048] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:19.154417  5056 consensus_queue.cc:1048] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:19.160454  5078 consensus_queue.cc:1048] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:54:19.165477  5116 consensus_queue.cc:1048] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:54:19.172137  5056 consensus_queue.cc:1048] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:54:19.249540  5080 consensus_queue.cc:1048] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:19.256089  5080 consensus_queue.cc:1048] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:54:19.357620  5077 consensus_queue.cc:1048] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:19.380764  5077 consensus_queue.cc:1048] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:19.384509  5077 consensus_queue.cc:1048] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:19.402504  5125 consensus_queue.cc:1048] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:19.412297  4929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
mode: GRACEFUL
new_leader_uuid: "3d3395064db742469140d8c045a1ef52"
 from {username='slave'} at 127.0.0.1:34172
I20260620 13:54:19.412998  4929 raft_consensus.cc:606] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 1 LEADER]: Received request to transfer leadership to TS 3d3395064db742469140d8c045a1ef52
I20260620 13:54:19.442463  5000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb86d5e1936485fb6531cefe3eb775b"
dest_uuid: "cd23e27c1393498daca3fba741403354"
mode: GRACEFUL
new_leader_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:40118
I20260620 13:54:19.442981  5000 raft_consensus.cc:606] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 1 LEADER]: Received request to transfer leadership to TS f61dc2e8457c42b09772f9e664c67b47
I20260620 13:54:19.451412  5000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22dd8bbdf26244a384b739fe2fdb7486"
dest_uuid: "cd23e27c1393498daca3fba741403354"
mode: GRACEFUL
new_leader_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:40118
I20260620 13:54:19.451931  5000 raft_consensus.cc:606] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 1 LEADER]: Received request to transfer leadership to TS f61dc2e8457c42b09772f9e664c67b47
I20260620 13:54:19.465826  4853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812"
dest_uuid: "3d3395064db742469140d8c045a1ef52"
mode: GRACEFUL
new_leader_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:49312
I20260620 13:54:19.466338  4853 raft_consensus.cc:606] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Received request to transfer leadership to TS f61dc2e8457c42b09772f9e664c67b47
I20260620 13:54:19.470943  5080 consensus_queue.cc:1048] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:19.475034  4929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c14e98376ac410fb2b5b189000e855f"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
mode: GRACEFUL
new_leader_uuid: "cd23e27c1393498daca3fba741403354"
 from {username='slave'} at 127.0.0.1:34172
I20260620 13:54:19.475735  4929 raft_consensus.cc:606] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 1 LEADER]: Received request to transfer leadership to TS cd23e27c1393498daca3fba741403354
I20260620 13:54:19.483861  5116 consensus_queue.cc:1048] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:19.497040  5089 consensus_queue.cc:1048] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:19.505178  5089 raft_consensus.cc:993] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354: : Instructing follower f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:19.505613  5089 raft_consensus.cc:1081] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 1 LEADER]: Signalling peer f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:19.508659  4928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bb86d5e1936485fb6531cefe3eb775b"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:34162
I20260620 13:54:19.509655  4928 raft_consensus.cc:493] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:19.510053  4928 raft_consensus.cc:3060] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:19.510907  5056 consensus_queue.cc:1048] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:19.518028  4928 raft_consensus.cc:515] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.521874  4854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb86d5e1936485fb6531cefe3eb775b" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:19.521906  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb86d5e1936485fb6531cefe3eb775b" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:19.522682  5000 raft_consensus.cc:3055] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:54:19.523058  5000 raft_consensus.cc:740] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd23e27c1393498daca3fba741403354, State: Running, Role: LEADER
I20260620 13:54:19.523947  5000 consensus_queue.cc:260] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.525269  5000 raft_consensus.cc:3060] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:19.534718  5000 raft_consensus.cc:2468] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 2.
I20260620 13:54:19.535357  4928 leader_election.cc:290] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 2 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:19.536520  4893 leader_election.cc:304] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd23e27c1393498daca3fba741403354, f61dc2e8457c42b09772f9e664c67b47; no voters: 3d3395064db742469140d8c045a1ef52
I20260620 13:54:19.537539  5105 raft_consensus.cc:2804] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:54:19.538040  5105 raft_consensus.cc:697] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Becoming Leader. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:19.538836  5105 consensus_queue.cc:237] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.545148  4748 catalog_manager.cc:5696] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 reported cstate change: term changed from 1 to 2, leader changed from cd23e27c1393498daca3fba741403354 (127.4.155.195) to f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194). New cstate: current_term: 2 leader_uuid: "f61dc2e8457c42b09772f9e664c67b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:19.639797  5089 raft_consensus.cc:993] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354: : Instructing follower f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:19.640239  5089 raft_consensus.cc:1081] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 1 LEADER]: Signalling peer f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:19.642122  4928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22dd8bbdf26244a384b739fe2fdb7486"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:34162
I20260620 13:54:19.642701  4928 raft_consensus.cc:493] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:19.643069  4928 raft_consensus.cc:3060] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:19.650143  4928 raft_consensus.cc:515] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.652230  4928 leader_election.cc:290] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 2 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:19.653810  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd8bbdf26244a384b739fe2fdb7486" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:19.654029  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd8bbdf26244a384b739fe2fdb7486" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:19.654433  5000 raft_consensus.cc:3055] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:54:19.654686  4853 raft_consensus.cc:3060] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:19.654826  5000 raft_consensus.cc:740] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd23e27c1393498daca3fba741403354, State: Running, Role: LEADER
I20260620 13:54:19.656163  5000 consensus_queue.cc:260] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.657572  5000 raft_consensus.cc:3060] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:19.660768  4853 raft_consensus.cc:2468] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 2.
I20260620 13:54:19.662209  4895 leader_election.cc:304] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:19.663341  5105 raft_consensus.cc:2804] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:54:19.664095  5105 raft_consensus.cc:697] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Becoming Leader. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:19.664948  5105 consensus_queue.cc:237] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.666438  5000 raft_consensus.cc:2468] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 2.
I20260620 13:54:19.672757  4748 catalog_manager.cc:5696] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 reported cstate change: term changed from 1 to 2, leader changed from cd23e27c1393498daca3fba741403354 (127.4.155.195) to f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194). New cstate: current_term: 2 leader_uuid: "f61dc2e8457c42b09772f9e664c67b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:19.691202  5078 raft_consensus.cc:993] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52: : Instructing follower f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:19.691695  5080 raft_consensus.cc:1081] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Signalling peer f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:19.693171  4928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:34150
I20260620 13:54:19.693722  4928 raft_consensus.cc:493] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:19.694089  4928 raft_consensus.cc:3060] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:19.701058  4928 raft_consensus.cc:515] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.703239  4928 leader_election.cc:290] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 2 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:19.704329  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:19.704226  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:19.704999  5000 raft_consensus.cc:3060] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:19.705144  4853 raft_consensus.cc:3055] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:54:19.705551  4853 raft_consensus.cc:740] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Running, Role: LEADER
I20260620 13:54:19.706346  4853 consensus_queue.cc:260] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.707403  4853 raft_consensus.cc:3060] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:19.712175  4853 raft_consensus.cc:2468] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 2.
I20260620 13:54:19.712787  5000 raft_consensus.cc:2468] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 2.
I20260620 13:54:19.713301  4895 leader_election.cc:304] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:19.714102  5105 raft_consensus.cc:2804] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:54:19.714506  5105 raft_consensus.cc:697] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Becoming Leader. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:19.715345  5105 consensus_queue.cc:237] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.723559  4748 catalog_manager.cc:5696] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 reported cstate change: term changed from 1 to 2, leader changed from 3d3395064db742469140d8c045a1ef52 (127.4.155.193) to f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194). New cstate: current_term: 2 leader_uuid: "f61dc2e8457c42b09772f9e664c67b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:19.969493  5077 raft_consensus.cc:993] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47: : Instructing follower cd23e27c1393498daca3fba741403354 to start an election
I20260620 13:54:19.969933  5105 raft_consensus.cc:1081] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 1 LEADER]: Signalling peer cd23e27c1393498daca3fba741403354 to start an election
I20260620 13:54:19.971632  5000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c14e98376ac410fb2b5b189000e855f"
dest_uuid: "cd23e27c1393498daca3fba741403354"
 from {username='slave'} at 127.0.0.1:40110
I20260620 13:54:19.972193  5000 raft_consensus.cc:493] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:19.972550  5000 raft_consensus.cc:3060] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:19.977654  5077 raft_consensus.cc:993] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47: : Instructing follower 3d3395064db742469140d8c045a1ef52 to start an election
I20260620 13:54:19.978144  5105 raft_consensus.cc:1081] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 1 LEADER]: Signalling peer 3d3395064db742469140d8c045a1ef52 to start an election
I20260620 13:54:19.979759  4853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1"
dest_uuid: "3d3395064db742469140d8c045a1ef52"
 from {username='slave'} at 127.0.0.1:49294
I20260620 13:54:19.979736  5000 raft_consensus.cc:515] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.980381  4853 raft_consensus.cc:493] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:19.980746  4853 raft_consensus.cc:3060] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:19.981786  5000 leader_election.cc:290] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 2 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197)
I20260620 13:54:19.982461  4854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c14e98376ac410fb2b5b189000e855f" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:19.983024  4854 raft_consensus.cc:3060] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:19.987526  4928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c14e98376ac410fb2b5b189000e855f" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:19.988222  4928 raft_consensus.cc:3055] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:54:19.988152  4853 raft_consensus.cc:515] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.988615  4928 raft_consensus.cc:740] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:19.989464  4928 consensus_queue.cc:260] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.990360  4854 raft_consensus.cc:2468] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 2.
I20260620 13:54:19.990716  4928 raft_consensus.cc:3060] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:19.991261  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:19.991828  4929 raft_consensus.cc:3055] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:54:19.991716  4969 leader_election.cc:304] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: 
I20260620 13:54:19.992282  4929 raft_consensus.cc:740] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:19.991577  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:19.993033  5000 raft_consensus.cc:3060] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:19.993299  4929 consensus_queue.cc:260] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.994385  4929 raft_consensus.cc:3060] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:19.995342  5089 raft_consensus.cc:2804] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:54:19.995851  5089 raft_consensus.cc:697] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 2 LEADER]: Becoming Leader. State: Replica: cd23e27c1393498daca3fba741403354, State: Running, Role: LEADER
I20260620 13:54:19.996937  4928 raft_consensus.cc:2468] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 2.
I20260620 13:54:19.996735  5089 consensus_queue.cc:237] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:19.999869  5000 raft_consensus.cc:2468] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 2.
I20260620 13:54:19.991762  4853 leader_election.cc:290] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 2 election: Requested vote from peers f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:20.001092  4818 leader_election.cc:304] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: 
I20260620 13:54:20.001313  4929 raft_consensus.cc:2468] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 2.
I20260620 13:54:20.001899  5080 raft_consensus.cc:2804] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:54:20.002405  5080 raft_consensus.cc:697] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 2 LEADER]: Becoming Leader. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Running, Role: LEADER
I20260620 13:54:20.003225  5080 consensus_queue.cc:237] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:20.008419  4748 catalog_manager.cc:5696] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 reported cstate change: term changed from 1 to 2, leader changed from f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194) to cd23e27c1393498daca3fba741403354 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "cd23e27c1393498daca3fba741403354" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: HEALTHY } } }
I20260620 13:54:20.012689  4751 catalog_manager.cc:5696] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 reported cstate change: term changed from 1 to 2, leader changed from f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194) to 3d3395064db742469140d8c045a1ef52 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "3d3395064db742469140d8c045a1ef52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:20.102315  5000 raft_consensus.cc:1275] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:20.103632  5105 consensus_queue.cc:1048] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:20.112224  4853 raft_consensus.cc:3060] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:20.119403  4853 raft_consensus.cc:1275] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:20.120972  5105 consensus_queue.cc:1048] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:54:20.158075  4853 raft_consensus.cc:1275] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:20.159492  5105 consensus_queue.cc:1048] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:20.166795  5000 raft_consensus.cc:1275] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:20.168406  5105 consensus_queue.cc:1048] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:20.246956  4853 raft_consensus.cc:1275] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:20.248375  5105 consensus_queue.cc:1048] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:20.256574  5000 raft_consensus.cc:1275] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:20.258520  5077 consensus_queue.cc:1048] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:20.412519  4929 raft_consensus.cc:1275] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Refusing update from remote peer cd23e27c1393498daca3fba741403354: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:20.413892  5089 consensus_queue.cc:1048] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:20.423801  4853 raft_consensus.cc:1275] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Refusing update from remote peer cd23e27c1393498daca3fba741403354: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:20.426045  5089 consensus_queue.cc:1048] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:20.483618  5000 raft_consensus.cc:1275] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Refusing update from remote peer 3d3395064db742469140d8c045a1ef52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:20.484967  5116 consensus_queue.cc:1048] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:20.494423  4929 raft_consensus.cc:1275] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Refusing update from remote peer 3d3395064db742469140d8c045a1ef52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:20.495945  5080 consensus_queue.cc:1048] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:22.507018  4719 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260620 13:54:22.507853  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:22.526764  4853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1"
dest_uuid: "3d3395064db742469140d8c045a1ef52"
mode: GRACEFUL
new_leader_uuid: "cd23e27c1393498daca3fba741403354"
 from {username='slave'} at 127.0.0.1:41346
I20260620 13:54:22.527343  4853 raft_consensus.cc:606] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 2 LEADER]: Received request to transfer leadership to TS cd23e27c1393498daca3fba741403354
I20260620 13:54:22.538579  4929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
mode: GRACEFUL
new_leader_uuid: "cd23e27c1393498daca3fba741403354"
 from {username='slave'} at 127.0.0.1:56140
I20260620 13:54:22.539086  4929 raft_consensus.cc:606] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Received request to transfer leadership to TS cd23e27c1393498daca3fba741403354
I20260620 13:54:22.540432  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260620 13:54:22.540882  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:22.577834  5080 raft_consensus.cc:993] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52: : Instructing follower cd23e27c1393498daca3fba741403354 to start an election
I20260620 13:54:22.578274  5080 raft_consensus.cc:1081] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 2 LEADER]: Signalling peer cd23e27c1393498daca3fba741403354 to start an election
I20260620 13:54:22.579668  4999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1"
dest_uuid: "cd23e27c1393498daca3fba741403354"
 from {username='slave'} at 127.0.0.1:40114
I20260620 13:54:22.580140  4999 raft_consensus.cc:493] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:22.580428  4999 raft_consensus.cc:3060] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:22.586194  4999 raft_consensus.cc:515] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:22.587785  4999 leader_election.cc:290] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 3 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197)
I20260620 13:54:22.588668  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:22.588941  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:22.589264  4853 raft_consensus.cc:3055] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:54:22.589447  4929 raft_consensus.cc:3060] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:22.589655  4853 raft_consensus.cc:740] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Running, Role: LEADER
I20260620 13:54:22.590468  4853 consensus_queue.cc:260] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:22.591670  4853 raft_consensus.cc:3060] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:22.596256  4929 raft_consensus.cc:2468] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 3.
I20260620 13:54:22.597678  4968 leader_election.cc:304] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd23e27c1393498daca3fba741403354, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:22.598366  4853 raft_consensus.cc:2468] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 3.
I20260620 13:54:22.598606  5144 raft_consensus.cc:2804] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:54:22.600147  5144 raft_consensus.cc:697] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 3 LEADER]: Becoming Leader. State: Replica: cd23e27c1393498daca3fba741403354, State: Running, Role: LEADER
I20260620 13:54:22.600919  5144 consensus_queue.cc:237] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:22.609933  4751 catalog_manager.cc:5696] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 reported cstate change: term changed from 2 to 3, leader changed from 3d3395064db742469140d8c045a1ef52 (127.4.155.193) to cd23e27c1393498daca3fba741403354 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "cd23e27c1393498daca3fba741403354" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: HEALTHY } } }
I20260620 13:54:22.904220  5160 raft_consensus.cc:993] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47: : Instructing follower cd23e27c1393498daca3fba741403354 to start an election
I20260620 13:54:22.904668  5077 raft_consensus.cc:1081] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Signalling peer cd23e27c1393498daca3fba741403354 to start an election
I20260620 13:54:22.906176  4999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812"
dest_uuid: "cd23e27c1393498daca3fba741403354"
 from {username='slave'} at 127.0.0.1:40110
I20260620 13:54:22.906684  4999 raft_consensus.cc:493] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:22.906985  4999 raft_consensus.cc:3060] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:22.911412  4999 raft_consensus.cc:515] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:22.912992  4999 leader_election.cc:290] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 3 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197)
I20260620 13:54:22.914088  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:22.914093  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:22.914670  4853 raft_consensus.cc:3060] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:22.914758  4929 raft_consensus.cc:3055] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:54:22.915081  4929 raft_consensus.cc:740] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:22.915783  4929 consensus_queue.cc:260] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:22.916663  4929 raft_consensus.cc:3060] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:22.918903  4853 raft_consensus.cc:2468] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 3.
I20260620 13:54:22.920066  4969 leader_election.cc:304] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: 
I20260620 13:54:22.920771  5144 raft_consensus.cc:2804] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:54:22.921121  4929 raft_consensus.cc:2468] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 3.
I20260620 13:54:22.921319  5144 raft_consensus.cc:697] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 3 LEADER]: Becoming Leader. State: Replica: cd23e27c1393498daca3fba741403354, State: Running, Role: LEADER
I20260620 13:54:22.922245  5144 consensus_queue.cc:237] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:22.929184  4751 catalog_manager.cc:5696] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 reported cstate change: term changed from 2 to 3, leader changed from f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194) to cd23e27c1393498daca3fba741403354 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "cd23e27c1393498daca3fba741403354" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: HEALTHY } } }
I20260620 13:54:22.989957  4853 raft_consensus.cc:1275] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Refusing update from remote peer cd23e27c1393498daca3fba741403354: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:54:22.991792  5144 consensus_queue.cc:1048] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:54:22.992259  4928 raft_consensus.cc:1275] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Refusing update from remote peer cd23e27c1393498daca3fba741403354: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:54:22.993556  5154 consensus_queue.cc:1048] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:54:23.310549  4928 raft_consensus.cc:1275] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Refusing update from remote peer cd23e27c1393498daca3fba741403354: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:54:23.311960  5144 consensus_queue.cc:1048] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:54:23.320859  4853 raft_consensus.cc:1275] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Refusing update from remote peer cd23e27c1393498daca3fba741403354: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:54:23.323804  5144 consensus_queue.cc:1048] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:54:23.541815  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:23.546686  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:23.547143  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:24.548090  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:24.552994  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:24.553429  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:25.554656  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:25.560748  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:25.561201  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:26.562300  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:26.566996  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:26.567442  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:27.568356  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:27.573333  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:27.573746  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:28.574707  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:28.580925  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:28.581393  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:29.582343  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:29.588702  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:29.589192  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:30.590360  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:30.595958  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:30.596377  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:31.597435  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:31.602099  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:31.602499  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:32.636613  4719 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260620 13:54:32.641806  4853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f55cacdeebd4cad83b3cd8753320b37"
dest_uuid: "3d3395064db742469140d8c045a1ef52"
mode: GRACEFUL
new_leader_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:49312
I20260620 13:54:32.642501  4853 raft_consensus.cc:606] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Received request to transfer leadership to TS f61dc2e8457c42b09772f9e664c67b47
I20260620 13:54:32.647985  5000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1"
dest_uuid: "cd23e27c1393498daca3fba741403354"
mode: GRACEFUL
new_leader_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:40118
I20260620 13:54:32.648458  5000 raft_consensus.cc:606] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 3 LEADER]: Received request to transfer leadership to TS f61dc2e8457c42b09772f9e664c67b47
I20260620 13:54:32.653141  4853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0d11a1fc374477caf80fa0e24f0a281"
dest_uuid: "3d3395064db742469140d8c045a1ef52"
mode: GRACEFUL
new_leader_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:49312
I20260620 13:54:32.653613  4853 raft_consensus.cc:606] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Received request to transfer leadership to TS f61dc2e8457c42b09772f9e664c67b47
I20260620 13:54:32.658566  4853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adfeaab3cb7d4d1d9eedd1282d3ac16d"
dest_uuid: "3d3395064db742469140d8c045a1ef52"
mode: GRACEFUL
new_leader_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:49312
I20260620 13:54:32.659291  4853 raft_consensus.cc:606] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Received request to transfer leadership to TS f61dc2e8457c42b09772f9e664c67b47
I20260620 13:54:32.671712  5000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812"
dest_uuid: "cd23e27c1393498daca3fba741403354"
mode: GRACEFUL
new_leader_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:40118
I20260620 13:54:32.672242  5000 raft_consensus.cc:606] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 3 LEADER]: Received request to transfer leadership to TS f61dc2e8457c42b09772f9e664c67b47
I20260620 13:54:32.741956  5171 raft_consensus.cc:993] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354: : Instructing follower f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:32.742527  5182 raft_consensus.cc:1081] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 3 LEADER]: Signalling peer f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:32.744289  4929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:34162
I20260620 13:54:32.744769  4929 raft_consensus.cc:493] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:32.745100  4929 raft_consensus.cc:3060] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:54:32.749926  4929 raft_consensus.cc:515] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:32.751539  4929 leader_election.cc:290] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 4 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:32.752660  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:32.752717  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:32.753334  5000 raft_consensus.cc:3055] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:54:32.753511  4853 raft_consensus.cc:3060] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:54:32.753619  5000 raft_consensus.cc:740] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd23e27c1393498daca3fba741403354, State: Running, Role: LEADER
I20260620 13:54:32.754604  5000 consensus_queue.cc:260] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:32.755970  5000 raft_consensus.cc:3060] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:54:32.759917  4853 raft_consensus.cc:2468] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 4.
I20260620 13:54:32.760829  5000 raft_consensus.cc:2468] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 4.
I20260620 13:54:32.761246  4895 leader_election.cc:304] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:32.762322  5178 raft_consensus.cc:2804] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:54:32.762789  5178 raft_consensus.cc:697] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 4 LEADER]: Becoming Leader. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:32.763736  5178 consensus_queue.cc:237] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:32.771575  4748 catalog_manager.cc:5696] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 reported cstate change: term changed from 3 to 4, leader changed from cd23e27c1393498daca3fba741403354 (127.4.155.195) to f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194). New cstate: current_term: 4 leader_uuid: "f61dc2e8457c42b09772f9e664c67b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:32.816982  5188 raft_consensus.cc:993] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52: : Instructing follower f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:32.817530  5172 raft_consensus.cc:1081] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Signalling peer f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:32.818845  4929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "adfeaab3cb7d4d1d9eedd1282d3ac16d"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:34150
I20260620 13:54:32.819236  4929 raft_consensus.cc:493] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:32.819466  4929 raft_consensus.cc:3060] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:32.823916  4929 raft_consensus.cc:515] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:32.825278  4929 leader_election.cc:290] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 2 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:32.826284  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adfeaab3cb7d4d1d9eedd1282d3ac16d" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:32.826288  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adfeaab3cb7d4d1d9eedd1282d3ac16d" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:32.826820  4853 raft_consensus.cc:3055] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:54:32.826907  5000 raft_consensus.cc:3060] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:32.827173  4853 raft_consensus.cc:740] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Running, Role: LEADER
I20260620 13:54:32.827891  4853 consensus_queue.cc:260] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:32.828711  4853 raft_consensus.cc:3060] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:32.831032  5000 raft_consensus.cc:2468] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 2.
I20260620 13:54:32.832003  4893 leader_election.cc:304] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd23e27c1393498daca3fba741403354, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:32.832670  5178 raft_consensus.cc:2804] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:54:32.832788  4853 raft_consensus.cc:2468] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 2.
I20260620 13:54:32.833439  5178 raft_consensus.cc:697] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Becoming Leader. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:32.834304  5178 consensus_queue.cc:237] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:32.840495  4748 catalog_manager.cc:5696] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 reported cstate change: term changed from 1 to 2, leader changed from 3d3395064db742469140d8c045a1ef52 (127.4.155.193) to f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194). New cstate: current_term: 2 leader_uuid: "f61dc2e8457c42b09772f9e664c67b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:32.901504  5188 raft_consensus.cc:993] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52: : Instructing follower f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:32.902040  5172 raft_consensus.cc:1081] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Signalling peer f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:32.903486  4929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0d11a1fc374477caf80fa0e24f0a281"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:34150
I20260620 13:54:32.903899  4929 raft_consensus.cc:493] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:32.904129  4929 raft_consensus.cc:3060] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:32.908056  4929 raft_consensus.cc:515] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:32.909775  4929 leader_election.cc:290] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 2 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:32.910511  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d11a1fc374477caf80fa0e24f0a281" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:32.910724  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d11a1fc374477caf80fa0e24f0a281" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:32.911062  4853 raft_consensus.cc:3055] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:54:32.911248  4999 raft_consensus.cc:3060] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:32.911448  4853 raft_consensus.cc:740] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Running, Role: LEADER
I20260620 13:54:32.912151  4853 consensus_queue.cc:260] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:32.912943  4853 raft_consensus.cc:3060] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:32.915706  4999 raft_consensus.cc:2468] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 2.
I20260620 13:54:32.916548  4893 leader_election.cc:304] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd23e27c1393498daca3fba741403354, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:32.917064  4853 raft_consensus.cc:2468] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 2.
I20260620 13:54:32.917234  5178 raft_consensus.cc:2804] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:54:32.917682  5178 raft_consensus.cc:697] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Becoming Leader. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:32.918543  5178 consensus_queue.cc:237] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:32.924813  4748 catalog_manager.cc:5696] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 reported cstate change: term changed from 1 to 2, leader changed from 3d3395064db742469140d8c045a1ef52 (127.4.155.193) to f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194). New cstate: current_term: 2 leader_uuid: "f61dc2e8457c42b09772f9e664c67b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:33.023458  5171 raft_consensus.cc:993] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354: : Instructing follower f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:33.023876  5182 raft_consensus.cc:1081] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 3 LEADER]: Signalling peer f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:33.025416  4929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:34162
I20260620 13:54:33.025882  4929 raft_consensus.cc:493] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:33.026213  4929 raft_consensus.cc:3060] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:54:33.030079  4929 raft_consensus.cc:515] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:33.031505  4929 leader_election.cc:290] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 4 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:33.032265  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:33.032336  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3e06006b244dfcb166b165bd0ed812" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:33.032907  4853 raft_consensus.cc:3060] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:54:33.032909  4999 raft_consensus.cc:3055] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:54:33.033419  4999 raft_consensus.cc:740] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd23e27c1393498daca3fba741403354, State: Running, Role: LEADER
I20260620 13:54:33.034232  4999 consensus_queue.cc:260] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:33.035326  4999 raft_consensus.cc:3060] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:54:33.037341  4853 raft_consensus.cc:2468] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 4.
I20260620 13:54:33.038290  4895 leader_election.cc:304] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:33.039062  5178 raft_consensus.cc:2804] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:54:33.039534  5178 raft_consensus.cc:697] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 4 LEADER]: Becoming Leader. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:33.040377  5178 consensus_queue.cc:237] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:33.039574  4999 raft_consensus.cc:2468] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 4.
I20260620 13:54:33.047014  4748 catalog_manager.cc:5696] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 reported cstate change: term changed from 3 to 4, leader changed from cd23e27c1393498daca3fba741403354 (127.4.155.195) to f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194). New cstate: current_term: 4 leader_uuid: "f61dc2e8457c42b09772f9e664c67b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:33.165099  5188 raft_consensus.cc:993] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52: : Instructing follower f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:33.165591  5172 raft_consensus.cc:1081] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Signalling peer f61dc2e8457c42b09772f9e664c67b47 to start an election
I20260620 13:54:33.166963  4929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f55cacdeebd4cad83b3cd8753320b37"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
 from {username='slave'} at 127.0.0.1:34150
I20260620 13:54:33.167439  4929 raft_consensus.cc:493] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:33.167737  4929 raft_consensus.cc:3060] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:33.172230  4929 raft_consensus.cc:515] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:33.174115  4929 leader_election.cc:290] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 2 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:33.175194  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f55cacdeebd4cad83b3cd8753320b37" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:33.175298  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f55cacdeebd4cad83b3cd8753320b37" candidate_uuid: "f61dc2e8457c42b09772f9e664c67b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:33.175653  4999 raft_consensus.cc:3060] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:33.175815  4853 raft_consensus.cc:3055] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:54:33.176144  4853 raft_consensus.cc:740] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Running, Role: LEADER
I20260620 13:54:33.176769  4853 consensus_queue.cc:260] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:33.177570  4853 raft_consensus.cc:3060] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:33.180159  4999 raft_consensus.cc:2468] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 2.
I20260620 13:54:33.181131  4893 leader_election.cc:304] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd23e27c1393498daca3fba741403354, f61dc2e8457c42b09772f9e664c67b47; no voters: 
I20260620 13:54:33.181613  4853 raft_consensus.cc:2468] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f61dc2e8457c42b09772f9e664c67b47 in term 2.
I20260620 13:54:33.181947  5178 raft_consensus.cc:2804] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:54:33.182493  5178 raft_consensus.cc:697] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Becoming Leader. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:33.183348  5178 consensus_queue.cc:237] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:33.189651  4748 catalog_manager.cc:5696] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 reported cstate change: term changed from 1 to 2, leader changed from 3d3395064db742469140d8c045a1ef52 (127.4.155.193) to f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194). New cstate: current_term: 2 leader_uuid: "f61dc2e8457c42b09772f9e664c67b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:33.246490  4999 raft_consensus.cc:1275] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 4 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:54:33.247614  5178 consensus_queue.cc:1048] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:54:33.259609  4853 raft_consensus.cc:1275] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 4 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:54:33.260782  5178 consensus_queue.cc:1048] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:54:33.277750  4999 raft_consensus.cc:1275] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:33.278982  5178 consensus_queue.cc:1048] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:33.287562  4853 raft_consensus.cc:1275] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:33.291244  5181 consensus_queue.cc:1048] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:54:33.382825  4853 raft_consensus.cc:1275] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:33.384279  5181 consensus_queue.cc:1048] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:33.393728  4999 raft_consensus.cc:1275] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:33.396050  5202 consensus_queue.cc:1048] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:54:33.444037  4854 raft_consensus.cc:1275] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 4 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:54:33.445384  5202 consensus_queue.cc:1048] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:54:33.454815  4999 raft_consensus.cc:1275] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 4 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:54:33.456951  5178 consensus_queue.cc:1048] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:54:33.563802  4999 raft_consensus.cc:1275] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:33.565054  5202 consensus_queue.cc:1048] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:33.574235  4854 raft_consensus.cc:1275] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Refusing update from remote peer f61dc2e8457c42b09772f9e664c67b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:33.576406  5178 consensus_queue.cc:1048] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:35.707621  4719 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260620 13:54:35.708482  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:35.715392  4929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb86d5e1936485fb6531cefe3eb775b"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
mode: GRACEFUL
new_leader_uuid: "3d3395064db742469140d8c045a1ef52"
 from {username='slave'} at 127.0.0.1:56140
I20260620 13:54:35.716065  4929 raft_consensus.cc:606] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Received request to transfer leadership to TS 3d3395064db742469140d8c045a1ef52
I20260620 13:54:35.718660  4929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f55cacdeebd4cad83b3cd8753320b37"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
mode: GRACEFUL
new_leader_uuid: "cd23e27c1393498daca3fba741403354"
 from {username='slave'} at 127.0.0.1:56140
I20260620 13:54:35.719079  4929 raft_consensus.cc:606] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Received request to transfer leadership to TS cd23e27c1393498daca3fba741403354
I20260620 13:54:35.721591  4929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22dd8bbdf26244a384b739fe2fdb7486"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
mode: GRACEFUL
new_leader_uuid: "cd23e27c1393498daca3fba741403354"
 from {username='slave'} at 127.0.0.1:56140
I20260620 13:54:35.721992  4929 raft_consensus.cc:606] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Received request to transfer leadership to TS cd23e27c1393498daca3fba741403354
I20260620 13:54:35.724177  4929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d8cc4f789b24974a1859102de85d33d"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
mode: GRACEFUL
new_leader_uuid: "3d3395064db742469140d8c045a1ef52"
 from {username='slave'} at 127.0.0.1:56140
I20260620 13:54:35.724593  4929 raft_consensus.cc:606] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 1 LEADER]: Received request to transfer leadership to TS 3d3395064db742469140d8c045a1ef52
I20260620 13:54:35.726850  4929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1"
dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
mode: GRACEFUL
new_leader_uuid: "3d3395064db742469140d8c045a1ef52"
 from {username='slave'} at 127.0.0.1:56140
I20260620 13:54:35.727298  4929 raft_consensus.cc:606] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 4 LEADER]: Received request to transfer leadership to TS 3d3395064db742469140d8c045a1ef52
I20260620 13:54:35.728295  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260620 13:54:35.728757  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:35.749871  5208 raft_consensus.cc:993] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47: : Instructing follower cd23e27c1393498daca3fba741403354 to start an election
I20260620 13:54:35.750512  5178 raft_consensus.cc:1081] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Signalling peer cd23e27c1393498daca3fba741403354 to start an election
I20260620 13:54:35.752295  4999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22dd8bbdf26244a384b739fe2fdb7486"
dest_uuid: "cd23e27c1393498daca3fba741403354"
 from {username='slave'} at 127.0.0.1:40110
I20260620 13:54:35.752864  4999 raft_consensus.cc:493] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:35.753278  4999 raft_consensus.cc:3060] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:35.758710  4999 raft_consensus.cc:515] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:35.760826  4999 leader_election.cc:290] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 3 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197)
I20260620 13:54:35.761919  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd8bbdf26244a384b739fe2fdb7486" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:35.762018  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd8bbdf26244a384b739fe2fdb7486" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:35.762763  4929 raft_consensus.cc:3055] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:54:35.762794  4853 raft_consensus.cc:3060] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:35.763093  4929 raft_consensus.cc:740] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:35.763814  4929 consensus_queue.cc:260] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:35.764696  4929 raft_consensus.cc:3060] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:35.767689  4853 raft_consensus.cc:2468] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 3.
I20260620 13:54:35.769083  4969 leader_election.cc:304] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: 
I20260620 13:54:35.769765  4929 raft_consensus.cc:2468] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 3.
I20260620 13:54:35.770148  5182 raft_consensus.cc:2804] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:54:35.771368  5182 raft_consensus.cc:697] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 3 LEADER]: Becoming Leader. State: Replica: cd23e27c1393498daca3fba741403354, State: Running, Role: LEADER
I20260620 13:54:35.772786  5182 consensus_queue.cc:237] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:35.779532  4748 catalog_manager.cc:5696] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 reported cstate change: term changed from 2 to 3, leader changed from f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194) to cd23e27c1393498daca3fba741403354 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "cd23e27c1393498daca3fba741403354" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: HEALTHY } } }
I20260620 13:54:35.832297  5208 raft_consensus.cc:993] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47: : Instructing follower 3d3395064db742469140d8c045a1ef52 to start an election
I20260620 13:54:35.832847  5178 raft_consensus.cc:1081] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 1 LEADER]: Signalling peer 3d3395064db742469140d8c045a1ef52 to start an election
I20260620 13:54:35.834385  4853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d8cc4f789b24974a1859102de85d33d"
dest_uuid: "3d3395064db742469140d8c045a1ef52"
 from {username='slave'} at 127.0.0.1:49294
I20260620 13:54:35.834793  4853 raft_consensus.cc:493] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:35.835014  4853 raft_consensus.cc:3060] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:35.839049  4853 raft_consensus.cc:515] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:35.841081  4853 leader_election.cc:290] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 2 election: Requested vote from peers f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:35.841946  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8cc4f789b24974a1859102de85d33d" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:35.842311  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8cc4f789b24974a1859102de85d33d" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:35.842458  4929 raft_consensus.cc:3055] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:54:35.842756  4929 raft_consensus.cc:740] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:35.842772  4999 raft_consensus.cc:3060] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:35.843540  4929 consensus_queue.cc:260] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:35.844388  4929 raft_consensus.cc:3060] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:35.847081  4999 raft_consensus.cc:2468] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 2.
I20260620 13:54:35.848312  4818 leader_election.cc:304] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: 
I20260620 13:54:35.848481  4929 raft_consensus.cc:2468] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 2.
I20260620 13:54:35.849992  5216 raft_consensus.cc:2804] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:54:35.851016  5216 raft_consensus.cc:697] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 2 LEADER]: Becoming Leader. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Running, Role: LEADER
I20260620 13:54:35.851743  5216 consensus_queue.cc:237] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:35.859493  4748 catalog_manager.cc:5696] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 reported cstate change: term changed from 1 to 2, leader changed from f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194) to 3d3395064db742469140d8c045a1ef52 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "3d3395064db742469140d8c045a1ef52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:35.956804  5208 raft_consensus.cc:993] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47: : Instructing follower cd23e27c1393498daca3fba741403354 to start an election
I20260620 13:54:35.957401  5219 raft_consensus.cc:1081] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Signalling peer cd23e27c1393498daca3fba741403354 to start an election
I20260620 13:54:35.959085  4999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f55cacdeebd4cad83b3cd8753320b37"
dest_uuid: "cd23e27c1393498daca3fba741403354"
 from {username='slave'} at 127.0.0.1:40110
I20260620 13:54:35.959501  4999 raft_consensus.cc:493] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:35.959725  4999 raft_consensus.cc:3060] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:35.963541  4999 raft_consensus.cc:515] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:35.964931  4999 leader_election.cc:290] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 3 election: Requested vote from peers 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317), f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197)
I20260620 13:54:35.966037  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f55cacdeebd4cad83b3cd8753320b37" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d3395064db742469140d8c045a1ef52"
I20260620 13:54:35.966184  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f55cacdeebd4cad83b3cd8753320b37" candidate_uuid: "cd23e27c1393498daca3fba741403354" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:35.966528  4853 raft_consensus.cc:3060] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:35.966789  4929 raft_consensus.cc:3055] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:54:35.967106  4929 raft_consensus.cc:740] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:35.967803  4929 consensus_queue.cc:260] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:35.968681  4929 raft_consensus.cc:3060] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:35.971397  4853 raft_consensus.cc:2468] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 3.
I20260620 13:54:35.972435  4969 leader_election.cc:304] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: 
I20260620 13:54:35.973162  5182 raft_consensus.cc:2804] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:54:35.973297  4929 raft_consensus.cc:2468] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd23e27c1393498daca3fba741403354 in term 3.
I20260620 13:54:35.973838  5182 raft_consensus.cc:697] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 3 LEADER]: Becoming Leader. State: Replica: cd23e27c1393498daca3fba741403354, State: Running, Role: LEADER
I20260620 13:54:35.974824  5182 consensus_queue.cc:237] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:35.981343  4748 catalog_manager.cc:5696] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 reported cstate change: term changed from 2 to 3, leader changed from f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194) to cd23e27c1393498daca3fba741403354 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "cd23e27c1393498daca3fba741403354" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: HEALTHY } } }
I20260620 13:54:36.144230  5208 raft_consensus.cc:993] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47: : Instructing follower 3d3395064db742469140d8c045a1ef52 to start an election
I20260620 13:54:36.144716  5219 raft_consensus.cc:1081] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Signalling peer 3d3395064db742469140d8c045a1ef52 to start an election
I20260620 13:54:36.146239  4853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bb86d5e1936485fb6531cefe3eb775b"
dest_uuid: "3d3395064db742469140d8c045a1ef52"
 from {username='slave'} at 127.0.0.1:49294
I20260620 13:54:36.146652  4853 raft_consensus.cc:493] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:36.146876  4853 raft_consensus.cc:3060] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:36.150665  4853 raft_consensus.cc:515] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:36.152251  4853 leader_election.cc:290] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 3 election: Requested vote from peers f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:36.153079  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb86d5e1936485fb6531cefe3eb775b" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:36.153304  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb86d5e1936485fb6531cefe3eb775b" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:36.153543  4929 raft_consensus.cc:3055] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:54:36.153801  4999 raft_consensus.cc:3060] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:36.153841  4929 raft_consensus.cc:740] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:36.154709  4929 consensus_queue.cc:260] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:36.155696  4929 raft_consensus.cc:3060] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:36.158088  4999 raft_consensus.cc:2468] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 3.
I20260620 13:54:36.159021  4818 leader_election.cc:304] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: 
I20260620 13:54:36.159865  5216 raft_consensus.cc:2804] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:54:36.159940  4929 raft_consensus.cc:2468] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 3.
I20260620 13:54:36.160487  5216 raft_consensus.cc:697] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [term 3 LEADER]: Becoming Leader. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Running, Role: LEADER
I20260620 13:54:36.161448  5216 consensus_queue.cc:237] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:36.167706  4748 catalog_manager.cc:5696] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 reported cstate change: term changed from 2 to 3, leader changed from f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194) to 3d3395064db742469140d8c045a1ef52 (127.4.155.193). New cstate: current_term: 3 leader_uuid: "3d3395064db742469140d8c045a1ef52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:36.188436  4929 raft_consensus.cc:1275] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Refusing update from remote peer cd23e27c1393498daca3fba741403354: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:54:36.189617  5182 consensus_queue.cc:1048] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:54:36.201045  4853 raft_consensus.cc:1275] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Refusing update from remote peer cd23e27c1393498daca3fba741403354: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:54:36.202606  5182 consensus_queue.cc:1048] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:54:36.222353  5208 raft_consensus.cc:993] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47: : Instructing follower 3d3395064db742469140d8c045a1ef52 to start an election
I20260620 13:54:36.222813  5219 raft_consensus.cc:1081] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 4 LEADER]: Signalling peer 3d3395064db742469140d8c045a1ef52 to start an election
I20260620 13:54:36.224197  4853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1"
dest_uuid: "3d3395064db742469140d8c045a1ef52"
 from {username='slave'} at 127.0.0.1:49294
I20260620 13:54:36.224627  4853 raft_consensus.cc:493] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:36.224897  4853 raft_consensus.cc:3060] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:54:36.229087  4853 raft_consensus.cc:515] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:36.230824  4853 leader_election.cc:290] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 5 election: Requested vote from peers f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194:35197), cd23e27c1393498daca3fba741403354 (127.4.155.195:39977)
I20260620 13:54:36.231613  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f61dc2e8457c42b09772f9e664c67b47"
I20260620 13:54:36.231905  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d748d43c67664af88e57ce75b6be81e1" candidate_uuid: "3d3395064db742469140d8c045a1ef52" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "cd23e27c1393498daca3fba741403354"
I20260620 13:54:36.232102  4929 raft_consensus.cc:3055] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:54:36.232393  4999 raft_consensus.cc:3060] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:54:36.232414  4929 raft_consensus.cc:740] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f61dc2e8457c42b09772f9e664c67b47, State: Running, Role: LEADER
I20260620 13:54:36.233214  4929 consensus_queue.cc:260] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:36.234051  4929 raft_consensus.cc:3060] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:54:36.236523  4999 raft_consensus.cc:2468] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 5.
I20260620 13:54:36.237459  4818 leader_election.cc:304] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3395064db742469140d8c045a1ef52, cd23e27c1393498daca3fba741403354; no voters: 
I20260620 13:54:36.238111  5216 raft_consensus.cc:2804] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:54:36.238229  4929 raft_consensus.cc:2468] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3395064db742469140d8c045a1ef52 in term 5.
I20260620 13:54:36.238541  5216 raft_consensus.cc:697] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 5 LEADER]: Becoming Leader. State: Replica: 3d3395064db742469140d8c045a1ef52, State: Running, Role: LEADER
I20260620 13:54:36.239408  5216 consensus_queue.cc:237] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } }
I20260620 13:54:36.245750  4750 catalog_manager.cc:5696] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 reported cstate change: term changed from 4 to 5, leader changed from f61dc2e8457c42b09772f9e664c67b47 (127.4.155.194) to 3d3395064db742469140d8c045a1ef52 (127.4.155.193). New cstate: current_term: 5 leader_uuid: "3d3395064db742469140d8c045a1ef52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:36.304692  4999 raft_consensus.cc:1275] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Refusing update from remote peer 3d3395064db742469140d8c045a1ef52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:36.306164  5216 consensus_queue.cc:1048] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:36.316257  4929 raft_consensus.cc:1275] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Refusing update from remote peer 3d3395064db742469140d8c045a1ef52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:36.318334  5217 consensus_queue.cc:1048] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:54:36.472139  4929 raft_consensus.cc:1275] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Refusing update from remote peer cd23e27c1393498daca3fba741403354: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:54:36.473551  5182 consensus_queue.cc:1048] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:54:36.482961  4853 raft_consensus.cc:1275] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Refusing update from remote peer cd23e27c1393498daca3fba741403354: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:54:36.484344  5182 consensus_queue.cc:1048] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3395064db742469140d8c045a1ef52" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:54:36.704885  4999 raft_consensus.cc:1275] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 5 FOLLOWER]: Refusing update from remote peer 3d3395064db742469140d8c045a1ef52: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260620 13:54:36.705967  5217 consensus_queue.cc:1048] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:54:36.715654  4929 raft_consensus.cc:1275] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 5 FOLLOWER]: Refusing update from remote peer 3d3395064db742469140d8c045a1ef52: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260620 13:54:36.717298  5230 consensus_queue.cc:1048] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:54:36.729911  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:36.736954  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:36.737468  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:36.744805  4999 raft_consensus.cc:1275] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Refusing update from remote peer 3d3395064db742469140d8c045a1ef52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:54:36.746107  5216 consensus_queue.cc:1048] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd23e27c1393498daca3fba741403354" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:54:36.747547  4929 raft_consensus.cc:1275] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Refusing update from remote peer 3d3395064db742469140d8c045a1ef52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:54:36.748886  5216 consensus_queue.cc:1048] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61dc2e8457c42b09772f9e664c67b47" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:54:37.738585  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:37.744379  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:37.744890  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:38.746069  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:38.751261  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:38.751610  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:39.752624  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:39.758507  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:39.758956  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:40.760102  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:40.765416  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:40.765878  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:41.767197  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:41.773473  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:41.773954  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:42.775060  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:42.780153  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:42.780503  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:43.781644  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:43.787206  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:43.787701  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:44.788755  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:44.793566  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:44.793996  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:45.825791  4719 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260620 13:54:45.826586  4719 tablet_server.cc:179] TabletServer@127.4.155.193:0 shutting down...
I20260620 13:54:45.859767  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:54:45.860646  4719 tablet_replica.cc:333] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52: stopping tablet replica
I20260620 13:54:45.861573  4719 raft_consensus.cc:2243] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:45.862236  4719 raft_consensus.cc:2272] T 6c14e98376ac410fb2b5b189000e855f P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:45.864809  4719 tablet_replica.cc:333] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52: stopping tablet replica
I20260620 13:54:45.865337  4719 raft_consensus.cc:2243] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:45.865823  4719 raft_consensus.cc:2272] T 22dd8bbdf26244a384b739fe2fdb7486 P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:45.867594  4719 tablet_replica.cc:333] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52: stopping tablet replica
I20260620 13:54:45.868081  4719 raft_consensus.cc:2243] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:45.868520  4719 raft_consensus.cc:2272] T e0d11a1fc374477caf80fa0e24f0a281 P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:45.870056  4719 tablet_replica.cc:333] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52: stopping tablet replica
I20260620 13:54:45.870707  4719 raft_consensus.cc:2243] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:45.871222  4719 raft_consensus.cc:2272] T 0f55cacdeebd4cad83b3cd8753320b37 P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:45.874001  4719 tablet_replica.cc:333] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52: stopping tablet replica
I20260620 13:54:45.874532  4719 raft_consensus.cc:2243] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 5 LEADER]: Raft consensus shutting down.
I20260620 13:54:45.875442  4719 raft_consensus.cc:2272] T d748d43c67664af88e57ce75b6be81e1 P 3d3395064db742469140d8c045a1ef52 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:45.877162  4719 tablet_replica.cc:333] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52: stopping tablet replica
I20260620 13:54:45.877710  4719 raft_consensus.cc:2243] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:54:45.878746  4719 raft_consensus.cc:2272] T 0bb86d5e1936485fb6531cefe3eb775b P 3d3395064db742469140d8c045a1ef52 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260620 13:54:45.880607  4969 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:54:45.881047  4719 tablet_replica.cc:333] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52: stopping tablet replica
I20260620 13:54:45.881597  4719 raft_consensus.cc:2243] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:54:45.882483  4719 raft_consensus.cc:2272] T 7d8cc4f789b24974a1859102de85d33d P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 13:54:45.884394  4969 consensus_peers.cc:597] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 -> Peer 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317): Couldn't send request to peer 3d3395064db742469140d8c045a1ef52. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:54:45.884991  4719 tablet_replica.cc:333] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52: stopping tablet replica
I20260620 13:54:45.885501  4719 raft_consensus.cc:2243] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:45.885990  4719 raft_consensus.cc:2272] T fd3e06006b244dfcb166b165bd0ed812 P 3d3395064db742469140d8c045a1ef52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:45.887704  4719 tablet_replica.cc:333] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52: stopping tablet replica
I20260620 13:54:45.888171  4719 raft_consensus.cc:2243] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:45.888625  4719 raft_consensus.cc:2272] T adfeaab3cb7d4d1d9eedd1282d3ac16d P 3d3395064db742469140d8c045a1ef52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:45.981709  4719 tablet_server.cc:196] TabletServer@127.4.155.193:0 shutdown complete.
W20260620 13:54:46.001397  4969 consensus_peers.cc:597] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 -> Peer 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317): Couldn't send request to peer 3d3395064db742469140d8c045a1ef52. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:38317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:54:46.007164  4719 tablet_server.cc:179] TabletServer@127.4.155.194:0 shutting down...
I20260620 13:54:46.034351  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:54:46.035220  4719 tablet_replica.cc:333] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47: stopping tablet replica
I20260620 13:54:46.035893  4719 raft_consensus.cc:2243] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:46.036377  4719 raft_consensus.cc:2272] T 22dd8bbdf26244a384b739fe2fdb7486 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.038154  4719 tablet_replica.cc:333] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47: stopping tablet replica
I20260620 13:54:46.038746  4719 raft_consensus.cc:2243] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:46.039316  4719 raft_consensus.cc:2272] T 6c14e98376ac410fb2b5b189000e855f P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.041626  4719 tablet_replica.cc:333] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47: stopping tablet replica
I20260620 13:54:46.042182  4719 raft_consensus.cc:2243] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:54:46.043273  4719 raft_consensus.cc:2272] T adfeaab3cb7d4d1d9eedd1282d3ac16d P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 13:54:46.043493  4969 consensus_peers.cc:597] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 -> Peer 3d3395064db742469140d8c045a1ef52 (127.4.155.193:38317): Couldn't send request to peer 3d3395064db742469140d8c045a1ef52. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:38317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:54:46.045050  4719 tablet_replica.cc:333] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47: stopping tablet replica
I20260620 13:54:46.045588  4719 raft_consensus.cc:2243] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 4 LEADER]: Raft consensus shutting down.
I20260620 13:54:46.046314  4719 raft_consensus.cc:2272] T fd3e06006b244dfcb166b165bd0ed812 P f61dc2e8457c42b09772f9e664c67b47 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.048030  4719 tablet_replica.cc:333] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47: stopping tablet replica
I20260620 13:54:46.048532  4719 raft_consensus.cc:2243] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:46.048956  4719 raft_consensus.cc:2272] T 7d8cc4f789b24974a1859102de85d33d P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.050474  4719 tablet_replica.cc:333] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47: stopping tablet replica
I20260620 13:54:46.050980  4719 raft_consensus.cc:2243] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:46.051452  4719 raft_consensus.cc:2272] T 0bb86d5e1936485fb6531cefe3eb775b P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.053020  4719 tablet_replica.cc:333] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47: stopping tablet replica
I20260620 13:54:46.053478  4719 raft_consensus.cc:2243] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:46.053889  4719 raft_consensus.cc:2272] T 0f55cacdeebd4cad83b3cd8753320b37 P f61dc2e8457c42b09772f9e664c67b47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.055555  4719 tablet_replica.cc:333] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47: stopping tablet replica
I20260620 13:54:46.056403  4719 raft_consensus.cc:2243] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:46.056937  4719 raft_consensus.cc:2272] T d748d43c67664af88e57ce75b6be81e1 P f61dc2e8457c42b09772f9e664c67b47 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.058811  4719 tablet_replica.cc:333] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47: stopping tablet replica
I20260620 13:54:46.059446  4719 raft_consensus.cc:2243] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:54:46.060441  4719 raft_consensus.cc:2272] T e0d11a1fc374477caf80fa0e24f0a281 P f61dc2e8457c42b09772f9e664c67b47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.090862  4719 tablet_server.cc:196] TabletServer@127.4.155.194:0 shutdown complete.
I20260620 13:54:46.108078  4719 tablet_server.cc:179] TabletServer@127.4.155.195:0 shutting down...
I20260620 13:54:46.140565  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:54:46.141366  4719 tablet_replica.cc:333] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354: stopping tablet replica
I20260620 13:54:46.141938  4719 raft_consensus.cc:2243] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:46.142393  4719 raft_consensus.cc:2272] T 0bb86d5e1936485fb6531cefe3eb775b P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.144110  4719 tablet_replica.cc:333] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354: stopping tablet replica
I20260620 13:54:46.144630  4719 raft_consensus.cc:2243] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:46.145012  4719 raft_consensus.cc:2272] T 7d8cc4f789b24974a1859102de85d33d P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.146535  4719 tablet_replica.cc:333] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354: stopping tablet replica
I20260620 13:54:46.146960  4719 raft_consensus.cc:2243] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:46.147363  4719 raft_consensus.cc:2272] T adfeaab3cb7d4d1d9eedd1282d3ac16d P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.148970  4719 tablet_replica.cc:333] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354: stopping tablet replica
I20260620 13:54:46.149408  4719 raft_consensus.cc:2243] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:46.149755  4719 raft_consensus.cc:2272] T fd3e06006b244dfcb166b165bd0ed812 P cd23e27c1393498daca3fba741403354 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.151492  4719 tablet_replica.cc:333] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354: stopping tablet replica
I20260620 13:54:46.151921  4719 raft_consensus.cc:2243] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:46.152236  4719 raft_consensus.cc:2272] T e0d11a1fc374477caf80fa0e24f0a281 P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.153663  4719 tablet_replica.cc:333] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354: stopping tablet replica
I20260620 13:54:46.154101  4719 raft_consensus.cc:2243] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:54:46.154876  4719 raft_consensus.cc:2272] T 0f55cacdeebd4cad83b3cd8753320b37 P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.156814  4719 tablet_replica.cc:333] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354: stopping tablet replica
I20260620 13:54:46.157303  4719 raft_consensus.cc:2243] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260620 13:54:46.157721  4719 raft_consensus.cc:2272] T d748d43c67664af88e57ce75b6be81e1 P cd23e27c1393498daca3fba741403354 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.159626  4719 tablet_replica.cc:333] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354: stopping tablet replica
I20260620 13:54:46.160077  4719 raft_consensus.cc:2243] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:54:46.160808  4719 raft_consensus.cc:2272] T 22dd8bbdf26244a384b739fe2fdb7486 P cd23e27c1393498daca3fba741403354 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.162371  4719 tablet_replica.cc:333] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354: stopping tablet replica
I20260620 13:54:46.162863  4719 raft_consensus.cc:2243] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:54:46.163594  4719 raft_consensus.cc:2272] T 6c14e98376ac410fb2b5b189000e855f P cd23e27c1393498daca3fba741403354 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.189225  4719 tablet_server.cc:196] TabletServer@127.4.155.195:0 shutdown complete.
I20260620 13:54:46.206909  4719 master.cc:562] Master@127.4.155.254:36845 shutting down...
I20260620 13:54:46.410929  4719 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:54:46.411689  4719 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:54:46.412043  4719 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8d8a4e3b23444658ad2f0071e4dc65f8: stopping tablet replica
I20260620 13:54:46.431744  4719 master.cc:584] Master@127.4.155.254:36845 shutdown complete.
3d3395064db742469140d8c045a1ef52  4
cd23e27c1393498daca3fba741403354  1
f61dc2e8457c42b09772f9e664c67b47  4
3d3395064db742469140d8c045a1ef52  3
cd23e27c1393498daca3fba741403354  3
f61dc2e8457c42b09772f9e664c67b47  3
3d3395064db742469140d8c045a1ef52  0
cd23e27c1393498daca3fba741403354  1
f61dc2e8457c42b09772f9e664c67b47  8
3d3395064db742469140d8c045a1ef52  3
cd23e27c1393498daca3fba741403354  3
f61dc2e8457c42b09772f9e664c67b47  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31311 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260620 13:54:46.473663  4719 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.155.254:34205
I20260620 13:54:46.474887  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:54:46.480679  5253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:54:46.481110  5254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:54:46.483606  5256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:54:46.485076  4719 server_base.cc:1061] running on GCE node
I20260620 13:54:46.485967  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:54:46.486194  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:54:46.486370  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963686486351 us; error 0 us; skew 500 ppm
I20260620 13:54:46.486871  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:54:46.489377  4719 webserver.cc:533] Webserver started at http://127.4.155.254:43201/ using document root <none> and password file <none>
I20260620 13:54:46.489902  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:54:46.490101  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:54:46.490370  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:54:46.493412  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/master-0-root/instance:
uuid: "10cd943d3034409394a1456ebce789d5"
format_stamp: "Formatted at 2026-06-20 13:54:46 on dist-test-slave-n70f"
I20260620 13:54:46.498481  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260620 13:54:46.502067  5261 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:46.503206  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260620 13:54:46.503466  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/master-0-root
uuid: "10cd943d3034409394a1456ebce789d5"
format_stamp: "Formatted at 2026-06-20 13:54:46 on dist-test-slave-n70f"
I20260620 13:54:46.503728  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:54:46.523007  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:54:46.524399  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:54:46.564798  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.254:34205
I20260620 13:54:46.564911  5312 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.254:34205 every 8 connection(s)
I20260620 13:54:46.569146  5313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:46.581451  5313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5: Bootstrap starting.
I20260620 13:54:46.586488  5313 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:46.591509  5313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5: No bootstrap required, opened a new log
I20260620 13:54:46.593683  5313 raft_consensus.cc:359] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10cd943d3034409394a1456ebce789d5" member_type: VOTER }
I20260620 13:54:46.594115  5313 raft_consensus.cc:385] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:46.594408  5313 raft_consensus.cc:740] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10cd943d3034409394a1456ebce789d5, State: Initialized, Role: FOLLOWER
I20260620 13:54:46.595059  5313 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10cd943d3034409394a1456ebce789d5" member_type: VOTER }
I20260620 13:54:46.595599  5313 raft_consensus.cc:399] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 13:54:46.595846  5313 raft_consensus.cc:493] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 13:54:46.596155  5313 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:46.600179  5313 raft_consensus.cc:515] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10cd943d3034409394a1456ebce789d5" member_type: VOTER }
I20260620 13:54:46.600706  5313 leader_election.cc:304] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10cd943d3034409394a1456ebce789d5; no voters: 
I20260620 13:54:46.601971  5313 leader_election.cc:290] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 13:54:46.602636  5316 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:46.604310  5316 raft_consensus.cc:697] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [term 1 LEADER]: Becoming Leader. State: Replica: 10cd943d3034409394a1456ebce789d5, State: Running, Role: LEADER
I20260620 13:54:46.605186  5316 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10cd943d3034409394a1456ebce789d5" member_type: VOTER }
I20260620 13:54:46.605667  5313 sys_catalog.cc:565] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 13:54:46.610312  5317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10cd943d3034409394a1456ebce789d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10cd943d3034409394a1456ebce789d5" member_type: VOTER } }
I20260620 13:54:46.611009  5317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [sys.catalog]: This master's current role is: LEADER
I20260620 13:54:46.610646  5318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10cd943d3034409394a1456ebce789d5. Latest consensus state: current_term: 1 leader_uuid: "10cd943d3034409394a1456ebce789d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10cd943d3034409394a1456ebce789d5" member_type: VOTER } }
I20260620 13:54:46.611677  5318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [sys.catalog]: This master's current role is: LEADER
I20260620 13:54:46.615629  5323 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260620 13:54:46.621517  5323 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260620 13:54:46.625078  4719 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 13:54:46.631798  5323 catalog_manager.cc:1382] Generated new cluster ID: caa0efd45726429782f2e47441508fb8
I20260620 13:54:46.632148  5323 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260620 13:54:46.674538  5323 catalog_manager.cc:1405] Generated new certificate authority record
I20260620 13:54:46.675956  5323 catalog_manager.cc:1539] Loading token signing keys...
I20260620 13:54:46.692994  5323 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5: Generated new TSK 0
I20260620 13:54:46.693643  5323 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260620 13:54:46.756748  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:54:46.762924  5334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:54:46.764240  5335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:54:46.767329  4719 server_base.cc:1061] running on GCE node
W20260620 13:54:46.767603  5337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:54:46.768595  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:54:46.768795  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:54:46.768965  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963686768949 us; error 0 us; skew 500 ppm
I20260620 13:54:46.769430  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:54:46.772429  4719 webserver.cc:533] Webserver started at http://127.4.155.193:46639/ using document root <none> and password file <none>
I20260620 13:54:46.772946  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:54:46.773128  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:54:46.773339  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:54:46.775094  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/ts-0-root/instance:
uuid: "ee9a7b222fbf4486ab305e75776b3aca"
format_stamp: "Formatted at 2026-06-20 13:54:46 on dist-test-slave-n70f"
I20260620 13:54:46.780022  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260620 13:54:46.783228  5342 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:46.784124  4719 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260620 13:54:46.784469  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/ts-0-root
uuid: "ee9a7b222fbf4486ab305e75776b3aca"
format_stamp: "Formatted at 2026-06-20 13:54:46 on dist-test-slave-n70f"
I20260620 13:54:46.784803  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:54:46.807163  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:54:46.808439  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:54:46.809986  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:54:46.812327  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:54:46.812573  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:46.812830  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:54:46.813026  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:46.854823  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.193:33455
I20260620 13:54:46.854910  5404 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.193:33455 every 8 connection(s)
I20260620 13:54:46.859927  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:54:46.867614  5409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:54:46.869562  5410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:54:46.872854  5412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:54:46.873579  4719 server_base.cc:1061] running on GCE node
I20260620 13:54:46.874672  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:54:46.875044  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:54:46.875317  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963686875281 us; error 0 us; skew 500 ppm
I20260620 13:54:46.876022  5405 heartbeater.cc:344] Connected to a master server at 127.4.155.254:34205
I20260620 13:54:46.876094  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:54:46.876471  5405 heartbeater.cc:461] Registering TS with master...
I20260620 13:54:46.877264  5405 heartbeater.cc:507] Master 127.4.155.254:34205 requested a full tablet report, sending...
I20260620 13:54:46.878793  4719 webserver.cc:533] Webserver started at http://127.4.155.194:39391/ using document root <none> and password file <none>
I20260620 13:54:46.879410  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:54:46.879602  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:54:46.879789  5278 ts_manager.cc:194] Registered new tserver with Master: ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455)
I20260620 13:54:46.879917  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:54:46.881274  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/ts-1-root/instance:
uuid: "617fb28b87054fdf87601ac234d57adb"
format_stamp: "Formatted at 2026-06-20 13:54:46 on dist-test-slave-n70f"
I20260620 13:54:46.881606  5278 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34622
I20260620 13:54:46.886229  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260620 13:54:46.891834  5417 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:46.893064  4719 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260620 13:54:46.893378  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/ts-1-root
uuid: "617fb28b87054fdf87601ac234d57adb"
format_stamp: "Formatted at 2026-06-20 13:54:46 on dist-test-slave-n70f"
I20260620 13:54:46.893846  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:54:46.919704  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:54:46.920895  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:54:46.922361  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:54:46.924623  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:54:46.924865  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:46.925484  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:54:46.925696  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:46.971717  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.194:46325
I20260620 13:54:46.971753  5479 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.194:46325 every 8 connection(s)
I20260620 13:54:46.976670  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:54:46.983791  5483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:54:46.986032  5484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:54:46.987635  4719 server_base.cc:1061] running on GCE node
W20260620 13:54:46.990309  5486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:54:46.991024  5480 heartbeater.cc:344] Connected to a master server at 127.4.155.254:34205
I20260620 13:54:46.991494  5480 heartbeater.cc:461] Registering TS with master...
I20260620 13:54:46.991542  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:54:46.991815  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:54:46.992013  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963686991984 us; error 0 us; skew 500 ppm
I20260620 13:54:46.992386  5480 heartbeater.cc:507] Master 127.4.155.254:34205 requested a full tablet report, sending...
I20260620 13:54:46.992656  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:54:46.994534  5278 ts_manager.cc:194] Registered new tserver with Master: 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325)
I20260620 13:54:46.995272  4719 webserver.cc:533] Webserver started at http://127.4.155.195:41567/ using document root <none> and password file <none>
I20260620 13:54:46.995786  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:54:46.995981  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:54:46.996173  5278 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34638
I20260620 13:54:46.996261  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:54:46.997748  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/ts-2-root/instance:
uuid: "6bc05a64f797432599d7670f8384e583"
format_stamp: "Formatted at 2026-06-20 13:54:46 on dist-test-slave-n70f"
I20260620 13:54:47.002367  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260620 13:54:47.006274  5491 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:47.007505  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260620 13:54:47.007874  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/ts-2-root
uuid: "6bc05a64f797432599d7670f8384e583"
format_stamp: "Formatted at 2026-06-20 13:54:46 on dist-test-slave-n70f"
I20260620 13:54:47.008179  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1781963654985192-4719-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:54:47.021773  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:54:47.022992  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:54:47.024608  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:54:47.027079  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:54:47.027379  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:47.027655  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:54:47.027827  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:54:47.072656  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.195:36475
I20260620 13:54:47.072750  5553 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.195:36475 every 8 connection(s)
I20260620 13:54:47.092263  5554 heartbeater.cc:344] Connected to a master server at 127.4.155.254:34205
I20260620 13:54:47.092800  5554 heartbeater.cc:461] Registering TS with master...
I20260620 13:54:47.093644  5554 heartbeater.cc:507] Master 127.4.155.254:34205 requested a full tablet report, sending...
I20260620 13:54:47.096470  5278 ts_manager.cc:194] Registered new tserver with Master: 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:47.097393  4719 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.021312288s
I20260620 13:54:47.097847  5278 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34646
I20260620 13:54:47.125790  5278 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34662:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260620 13:54:47.129093  5278 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 13:54:47.214128  5519 tablet_service.cc:1511] Processing CreateTablet for tablet 7ca4f9645ab748be8d9e3591e8673868 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260620 13:54:47.215611  5519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ca4f9645ab748be8d9e3591e8673868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.221532  5445 tablet_service.cc:1511] Processing CreateTablet for tablet 7ca4f9645ab748be8d9e3591e8673868 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260620 13:54:47.222886  5445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ca4f9645ab748be8d9e3591e8673868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.223623  5440 tablet_service.cc:1511] Processing CreateTablet for tablet 12a907b6fffa4cb089ec941716ecb23e (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260620 13:54:47.224200  5444 tablet_service.cc:1511] Processing CreateTablet for tablet aeff1f5fdaf54fb98b233b319e5df773 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260620 13:54:47.225378  5518 tablet_service.cc:1511] Processing CreateTablet for tablet aeff1f5fdaf54fb98b233b319e5df773 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260620 13:54:47.225997  5517 tablet_service.cc:1511] Processing CreateTablet for tablet 738a1bb1d40241f4b648f57287b7a4c0 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260620 13:54:47.226696  5518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeff1f5fdaf54fb98b233b319e5df773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.226490  5443 tablet_service.cc:1511] Processing CreateTablet for tablet 738a1bb1d40241f4b648f57287b7a4c0 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260620 13:54:47.227332  5517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738a1bb1d40241f4b648f57287b7a4c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.228802  5442 tablet_service.cc:1511] Processing CreateTablet for tablet a2f6cff325ad4e58a71efef78228a150 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260620 13:54:47.229462  5370 tablet_service.cc:1511] Processing CreateTablet for tablet 7ca4f9645ab748be8d9e3591e8673868 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260620 13:54:47.228830  5514 tablet_service.cc:1511] Processing CreateTablet for tablet 12a907b6fffa4cb089ec941716ecb23e (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260620 13:54:47.230769  5370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ca4f9645ab748be8d9e3591e8673868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.231326  5514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12a907b6fffa4cb089ec941716ecb23e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.231812  5439 tablet_service.cc:1511] Processing CreateTablet for tablet 19b1a2c08ac34521a95698ec62d6ab76 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260620 13:54:47.232455  5515 tablet_service.cc:1511] Processing CreateTablet for tablet 078959e5186647538a9f35d46354ace3 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260620 13:54:47.233803  5515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 078959e5186647538a9f35d46354ace3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.234156  5441 tablet_service.cc:1511] Processing CreateTablet for tablet 078959e5186647538a9f35d46354ace3 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260620 13:54:47.229976  5516 tablet_service.cc:1511] Processing CreateTablet for tablet a2f6cff325ad4e58a71efef78228a150 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260620 13:54:47.235863  5516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f6cff325ad4e58a71efef78228a150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.237265  5440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12a907b6fffa4cb089ec941716ecb23e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.239432  5441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 078959e5186647538a9f35d46354ace3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.243484  5444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeff1f5fdaf54fb98b233b319e5df773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.244179  5442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f6cff325ad4e58a71efef78228a150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.244822  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b1a2c08ac34521a95698ec62d6ab76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.245446  5443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738a1bb1d40241f4b648f57287b7a4c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.245083  5369 tablet_service.cc:1511] Processing CreateTablet for tablet aeff1f5fdaf54fb98b233b319e5df773 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260620 13:54:47.246507  5369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeff1f5fdaf54fb98b233b319e5df773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.265910  5368 tablet_service.cc:1511] Processing CreateTablet for tablet 738a1bb1d40241f4b648f57287b7a4c0 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260620 13:54:47.268369  5368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738a1bb1d40241f4b648f57287b7a4c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.277679  5367 tablet_service.cc:1511] Processing CreateTablet for tablet a2f6cff325ad4e58a71efef78228a150 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260620 13:54:47.279868  5367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f6cff325ad4e58a71efef78228a150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.284686  5438 tablet_service.cc:1511] Processing CreateTablet for tablet 003980ade3d545058353e551fcf2b30e (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260620 13:54:47.285410  5366 tablet_service.cc:1511] Processing CreateTablet for tablet 078959e5186647538a9f35d46354ace3 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260620 13:54:47.286109  5438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 003980ade3d545058353e551fcf2b30e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.288131  5366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 078959e5186647538a9f35d46354ace3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.293466  5365 tablet_service.cc:1511] Processing CreateTablet for tablet 12a907b6fffa4cb089ec941716ecb23e (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260620 13:54:47.295917  5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12a907b6fffa4cb089ec941716ecb23e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.301898  5364 tablet_service.cc:1511] Processing CreateTablet for tablet 19b1a2c08ac34521a95698ec62d6ab76 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260620 13:54:47.305603  5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b1a2c08ac34521a95698ec62d6ab76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.336756  5514 tablet_service.cc:1511] Processing CreateTablet for tablet 19b1a2c08ac34521a95698ec62d6ab76 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260620 13:54:47.337100  5363 tablet_service.cc:1511] Processing CreateTablet for tablet 003980ade3d545058353e551fcf2b30e (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260620 13:54:47.337096  5445 tablet_service.cc:1511] Processing CreateTablet for tablet 9998d988ea954edca90a6f5a3ad4c936 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260620 13:54:47.338299  5514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b1a2c08ac34521a95698ec62d6ab76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.338495  5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 003980ade3d545058353e551fcf2b30e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.339856  5445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9998d988ea954edca90a6f5a3ad4c936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.342166  5362 tablet_service.cc:1511] Processing CreateTablet for tablet 9998d988ea954edca90a6f5a3ad4c936 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260620 13:54:47.343581  5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9998d988ea954edca90a6f5a3ad4c936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.343137  5513 tablet_service.cc:1511] Processing CreateTablet for tablet 9998d988ea954edca90a6f5a3ad4c936 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260620 13:54:47.348995  5513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9998d988ea954edca90a6f5a3ad4c936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.356529  5569 tablet_bootstrap.cc:492] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca: Bootstrap starting.
I20260620 13:54:47.358361  5518 tablet_service.cc:1511] Processing CreateTablet for tablet 003980ade3d545058353e551fcf2b30e (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260620 13:54:47.359673  5518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 003980ade3d545058353e551fcf2b30e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.366025  5439 tablet_service.cc:1511] Processing CreateTablet for tablet 49ad12da8f8841dba69dc068b92c60e2 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260620 13:54:47.368083  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ad12da8f8841dba69dc068b92c60e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.368295  5570 tablet_bootstrap.cc:492] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb: Bootstrap starting.
I20260620 13:54:47.373622  5569 tablet_bootstrap.cc:654] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.408989  5571 tablet_bootstrap.cc:492] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583: Bootstrap starting.
I20260620 13:54:47.409926  5570 tablet_bootstrap.cc:654] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.409976  5569 tablet_bootstrap.cc:492] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca: No bootstrap required, opened a new log
I20260620 13:54:47.410638  5569 ts_tablet_manager.cc:1403] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca: Time spent bootstrapping tablet: real 0.055s	user 0.004s	sys 0.022s
I20260620 13:54:47.410612  5368 tablet_service.cc:1511] Processing CreateTablet for tablet 49ad12da8f8841dba69dc068b92c60e2 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260620 13:54:47.412472  5513 tablet_service.cc:1511] Processing CreateTablet for tablet 49ad12da8f8841dba69dc068b92c60e2 (DEFAULT_TABLE table=test-workload [id=5e6713cbdd6345d59d8cc245d7eed455]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260620 13:54:47.413690  5513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ad12da8f8841dba69dc068b92c60e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.414620  5569 raft_consensus.cc:359] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.415725  5569 raft_consensus.cc:385] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.416143  5569 raft_consensus.cc:740] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.417164  5569 consensus_queue.cc:260] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.421427  5571 tablet_bootstrap.cc:654] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.430616  5368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ad12da8f8841dba69dc068b92c60e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:54:47.432281  5569 ts_tablet_manager.cc:1434] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.011s
I20260620 13:54:47.432832  5571 tablet_bootstrap.cc:492] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583: No bootstrap required, opened a new log
I20260620 13:54:47.433303  5571 ts_tablet_manager.cc:1403] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.006s
I20260620 13:54:47.435535  5405 heartbeater.cc:499] Master 127.4.155.254:34205 was elected leader, sending a full tablet report...
I20260620 13:54:47.438426  5571 raft_consensus.cc:359] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.439291  5571 raft_consensus.cc:385] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.439595  5571 raft_consensus.cc:740] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.440882  5569 tablet_bootstrap.cc:492] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca: Bootstrap starting.
I20260620 13:54:47.440652  5571 consensus_queue.cc:260] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.435667  5574 raft_consensus.cc:493] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:47.443149  5574 raft_consensus.cc:515] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.445274  5570 tablet_bootstrap.cc:492] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb: No bootstrap required, opened a new log
I20260620 13:54:47.445971  5570 ts_tablet_manager.cc:1403] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.013s
I20260620 13:54:47.449904  5570 raft_consensus.cc:359] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.459543  5570 raft_consensus.cc:385] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.460003  5570 raft_consensus.cc:740] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.460831  5570 consensus_queue.cc:260] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.457526  5569 tablet_bootstrap.cc:654] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.467971  5569 tablet_bootstrap.cc:492] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca: No bootstrap required, opened a new log
I20260620 13:54:47.468483  5569 ts_tablet_manager.cc:1403] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.005s
I20260620 13:54:47.472003  5569 raft_consensus.cc:359] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.472769  5569 raft_consensus.cc:385] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.473066  5569 raft_consensus.cc:740] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.473731  5569 consensus_queue.cc:260] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.475703  5574 leader_election.cc:290] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:47.475967  5569 ts_tablet_manager.cc:1434] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260620 13:54:47.476900  5569 tablet_bootstrap.cc:492] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca: Bootstrap starting.
I20260620 13:54:47.480440  5570 ts_tablet_manager.cc:1434] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.011s
I20260620 13:54:47.481212  5480 heartbeater.cc:499] Master 127.4.155.254:34205 was elected leader, sending a full tablet report...
I20260620 13:54:47.482095  5570 tablet_bootstrap.cc:492] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb: Bootstrap starting.
I20260620 13:54:47.482574  5574 raft_consensus.cc:493] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:47.483024  5574 raft_consensus.cc:515] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.490384  5570 tablet_bootstrap.cc:654] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.492432  5569 tablet_bootstrap.cc:654] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.493294  5571 ts_tablet_manager.cc:1434] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583: Time spent starting tablet: real 0.060s	user 0.013s	sys 0.000s
I20260620 13:54:47.494360  5554 heartbeater.cc:499] Master 127.4.155.254:34205 was elected leader, sending a full tablet report...
I20260620 13:54:47.494891  5571 tablet_bootstrap.cc:492] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583: Bootstrap starting.
I20260620 13:54:47.501034  5583 raft_consensus.cc:493] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:47.501529  5583 raft_consensus.cc:515] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.505913  5574 leader_election.cc:290] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:47.511953  5571 tablet_bootstrap.cc:654] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.511700  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb" is_pre_election: true
I20260620 13:54:47.513314  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb" is_pre_election: true
I20260620 13:54:47.517436  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583" is_pre_election: true
I20260620 13:54:47.519327  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583" is_pre_election: true
I20260620 13:54:47.520546  5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f6cff325ad4e58a71efef78228a150" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca" is_pre_election: true
W20260620 13:54:47.521615  5344 leader_election.cc:343] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:54:47.522444  5493 leader_election.cc:343] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:54:47.522498  5344 leader_election.cc:343] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:47.523947  5569 tablet_bootstrap.cc:492] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca: No bootstrap required, opened a new log
W20260620 13:54:47.523831  5345 leader_election.cc:343] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:47.524407  5570 tablet_bootstrap.cc:492] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb: No bootstrap required, opened a new log
I20260620 13:54:47.524549  5569 ts_tablet_manager.cc:1403] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.007s
I20260620 13:54:47.524875  5570 ts_tablet_manager.cc:1403] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.011s
I20260620 13:54:47.524716  5345 leader_election.cc:304] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9a7b222fbf4486ab305e75776b3aca; no voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583
I20260620 13:54:47.526093  5574 raft_consensus.cc:2749] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:54:47.527514  5569 raft_consensus.cc:359] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } } peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } }
I20260620 13:54:47.527769  5570 raft_consensus.cc:359] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
W20260620 13:54:47.527910  5345 leader_election.cc:343] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:47.528455  5570 raft_consensus.cc:385] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.528790  5570 raft_consensus.cc:740] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.528854  5345 leader_election.cc:304] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9a7b222fbf4486ab305e75776b3aca; no voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583
I20260620 13:54:47.529433  5570 consensus_queue.cc:260] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.530030  5574 raft_consensus.cc:2749] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:54:47.528282  5569 raft_consensus.cc:385] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.531585  5569 raft_consensus.cc:740] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.532881  5569 consensus_queue.cc:260] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } } peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } }
I20260620 13:54:47.540668  5569 ts_tablet_manager.cc:1434] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260620 13:54:47.542052  5569 tablet_bootstrap.cc:492] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca: Bootstrap starting.
I20260620 13:54:47.544775  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f6cff325ad4e58a71efef78228a150" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb" is_pre_election: true
I20260620 13:54:47.545444  5454 raft_consensus.cc:2468] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 0.
I20260620 13:54:47.546887  5494 leader_election.cc:304] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583; no voters: ee9a7b222fbf4486ab305e75776b3aca
I20260620 13:54:47.547927  5577 raft_consensus.cc:2804] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:47.548321  5577 raft_consensus.cc:493] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:47.548725  5577 raft_consensus.cc:3060] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.550913  5569 tablet_bootstrap.cc:654] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.552588  5570 ts_tablet_manager.cc:1434] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260620 13:54:47.553521  5570 tablet_bootstrap.cc:492] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb: Bootstrap starting.
I20260620 13:54:47.557721  5577 raft_consensus.cc:515] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.559756  5570 tablet_bootstrap.cc:654] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.548302  5571 tablet_bootstrap.cc:492] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583: No bootstrap required, opened a new log
I20260620 13:54:47.560379  5571 ts_tablet_manager.cc:1403] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583: Time spent bootstrapping tablet: real 0.066s	user 0.002s	sys 0.040s
I20260620 13:54:47.562675  5583 leader_election.cc:290] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325)
I20260620 13:54:47.565187  5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f6cff325ad4e58a71efef78228a150" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
W20260620 13:54:47.567091  5493 leader_election.cc:343] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:47.568555  5577 leader_election.cc:290] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 election: Requested vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325)
I20260620 13:54:47.568825  5571 raft_consensus.cc:359] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.569703  5571 raft_consensus.cc:385] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.569692  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f6cff325ad4e58a71efef78228a150" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:54:47.570179  5571 raft_consensus.cc:740] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.570439  5454 raft_consensus.cc:3060] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.571166  5571 consensus_queue.cc:260] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.571969  5569 tablet_bootstrap.cc:492] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca: No bootstrap required, opened a new log
I20260620 13:54:47.572485  5569 ts_tablet_manager.cc:1403] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.006s
I20260620 13:54:47.572808  5570 tablet_bootstrap.cc:492] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb: No bootstrap required, opened a new log
I20260620 13:54:47.573289  5570 ts_tablet_manager.cc:1403] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.005s
I20260620 13:54:47.575502  5569 raft_consensus.cc:359] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.576406  5569 raft_consensus.cc:385] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.576767  5569 raft_consensus.cc:740] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.576087  5570 raft_consensus.cc:359] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.577586  5570 raft_consensus.cc:385] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.577857  5454 raft_consensus.cc:2468] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 1.
I20260620 13:54:47.578060  5571 ts_tablet_manager.cc:1434] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260620 13:54:47.578109  5570 raft_consensus.cc:740] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.579494  5571 tablet_bootstrap.cc:492] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583: Bootstrap starting.
I20260620 13:54:47.579427  5494 leader_election.cc:304] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583; no voters: ee9a7b222fbf4486ab305e75776b3aca
I20260620 13:54:47.579907  5570 consensus_queue.cc:260] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.580595  5577 raft_consensus.cc:2804] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:47.581080  5577 raft_consensus.cc:697] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 1 LEADER]: Becoming Leader. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Running, Role: LEADER
I20260620 13:54:47.582383  5570 ts_tablet_manager.cc:1434] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260620 13:54:47.581914  5577 consensus_queue.cc:237] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.587150  5571 tablet_bootstrap.cc:654] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.578526  5569 consensus_queue.cc:260] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.589617  5569 ts_tablet_manager.cc:1434] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260620 13:54:47.589800  5574 raft_consensus.cc:493] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:47.590294  5574 raft_consensus.cc:515] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } } peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } }
I20260620 13:54:47.590902  5569 tablet_bootstrap.cc:492] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca: Bootstrap starting.
I20260620 13:54:47.592552  5574 leader_election.cc:290] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:47.594542  5570 tablet_bootstrap.cc:492] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb: Bootstrap starting.
I20260620 13:54:47.595289  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca4f9645ab748be8d9e3591e8673868" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583" is_pre_election: true
W20260620 13:54:47.597553  5344 leader_election.cc:343] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:47.597061  5277 catalog_manager.cc:5696] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6bc05a64f797432599d7670f8384e583 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "6bc05a64f797432599d7670f8384e583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: HEALTHY } } }
I20260620 13:54:47.598047  5569 tablet_bootstrap.cc:654] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.601969  5570 tablet_bootstrap.cc:654] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.602351  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca4f9645ab748be8d9e3591e8673868" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb" is_pre_election: true
W20260620 13:54:47.603920  5345 leader_election.cc:343] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:47.604362  5345 leader_election.cc:304] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9a7b222fbf4486ab305e75776b3aca; no voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583
I20260620 13:54:47.605525  5576 raft_consensus.cc:2749] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:54:47.609117  5570 tablet_bootstrap.cc:492] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb: No bootstrap required, opened a new log
I20260620 13:54:47.609676  5570 ts_tablet_manager.cc:1403] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260620 13:54:47.613404  5571 tablet_bootstrap.cc:492] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583: No bootstrap required, opened a new log
I20260620 13:54:47.614037  5571 ts_tablet_manager.cc:1403] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.006s
I20260620 13:54:47.614303  5570 raft_consensus.cc:359] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } } peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } }
I20260620 13:54:47.614809  5570 raft_consensus.cc:385] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.614988  5570 raft_consensus.cc:740] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.615829  5570 consensus_queue.cc:260] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } } peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } }
I20260620 13:54:47.618357  5570 ts_tablet_manager.cc:1434] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260620 13:54:47.618443  5569 tablet_bootstrap.cc:492] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca: No bootstrap required, opened a new log
I20260620 13:54:47.618942  5569 ts_tablet_manager.cc:1403] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.015s
I20260620 13:54:47.619396  5570 tablet_bootstrap.cc:492] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb: Bootstrap starting.
W20260620 13:54:47.619758  5326 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:54:47.617802  5571 raft_consensus.cc:359] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.620414  5571 raft_consensus.cc:385] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.620709  5571 raft_consensus.cc:740] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.621542  5571 consensus_queue.cc:260] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.621829  5569 raft_consensus.cc:359] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.622464  5569 raft_consensus.cc:385] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.622751  5569 raft_consensus.cc:740] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.623576  5569 consensus_queue.cc:260] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.625797  5570 tablet_bootstrap.cc:654] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.629688  5569 ts_tablet_manager.cc:1434] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260620 13:54:47.630075  5571 ts_tablet_manager.cc:1434] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260620 13:54:47.630678  5569 tablet_bootstrap.cc:492] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca: Bootstrap starting.
I20260620 13:54:47.635030  5571 tablet_bootstrap.cc:492] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583: Bootstrap starting.
I20260620 13:54:47.637326  5570 tablet_bootstrap.cc:492] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb: No bootstrap required, opened a new log
I20260620 13:54:47.637404  5569 tablet_bootstrap.cc:654] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.637880  5570 ts_tablet_manager.cc:1403] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260620 13:54:47.640945  5570 raft_consensus.cc:359] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.641666  5570 raft_consensus.cc:385] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.641980  5570 raft_consensus.cc:740] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.642768  5571 tablet_bootstrap.cc:654] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.642904  5570 consensus_queue.cc:260] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.648262  5570 ts_tablet_manager.cc:1434] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260620 13:54:47.649188  5570 tablet_bootstrap.cc:492] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb: Bootstrap starting.
I20260620 13:54:47.654778  5570 tablet_bootstrap.cc:654] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.660403  5569 tablet_bootstrap.cc:492] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca: No bootstrap required, opened a new log
I20260620 13:54:47.660950  5569 ts_tablet_manager.cc:1403] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.012s
I20260620 13:54:47.661580  5570 tablet_bootstrap.cc:492] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb: No bootstrap required, opened a new log
I20260620 13:54:47.662110  5570 ts_tablet_manager.cc:1403] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260620 13:54:47.664505  5569 raft_consensus.cc:359] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.665369  5569 raft_consensus.cc:385] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.665155  5570 raft_consensus.cc:359] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.665723  5569 raft_consensus.cc:740] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.665928  5570 raft_consensus.cc:385] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.666246  5570 raft_consensus.cc:740] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.666921  5571 tablet_bootstrap.cc:492] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583: No bootstrap required, opened a new log
I20260620 13:54:47.666671  5569 consensus_queue.cc:260] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.667449  5571 ts_tablet_manager.cc:1403] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.009s
I20260620 13:54:47.666998  5570 consensus_queue.cc:260] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.669322  5569 ts_tablet_manager.cc:1434] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260620 13:54:47.669680  5570 ts_tablet_manager.cc:1434] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260620 13:54:47.670303  5569 tablet_bootstrap.cc:492] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca: Bootstrap starting.
I20260620 13:54:47.670611  5570 tablet_bootstrap.cc:492] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb: Bootstrap starting.
I20260620 13:54:47.670349  5571 raft_consensus.cc:359] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } } peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } }
I20260620 13:54:47.671168  5571 raft_consensus.cc:385] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.671481  5571 raft_consensus.cc:740] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.672727  5571 consensus_queue.cc:260] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } } peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } }
I20260620 13:54:47.677243  5570 tablet_bootstrap.cc:654] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.678026  5569 tablet_bootstrap.cc:654] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.688562  5571 ts_tablet_manager.cc:1434] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260620 13:54:47.689571  5571 tablet_bootstrap.cc:492] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583: Bootstrap starting.
I20260620 13:54:47.690687  5570 tablet_bootstrap.cc:492] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb: No bootstrap required, opened a new log
I20260620 13:54:47.691206  5570 ts_tablet_manager.cc:1403] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260620 13:54:47.693049  5569 tablet_bootstrap.cc:492] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca: No bootstrap required, opened a new log
I20260620 13:54:47.693642  5569 ts_tablet_manager.cc:1403] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.011s
I20260620 13:54:47.694468  5570 raft_consensus.cc:359] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.695255  5570 raft_consensus.cc:385] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.695585  5570 raft_consensus.cc:740] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.696292  5571 tablet_bootstrap.cc:654] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.696730  5570 consensus_queue.cc:260] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.697018  5569 raft_consensus.cc:359] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.697947  5569 raft_consensus.cc:385] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.698325  5569 raft_consensus.cc:740] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.699314  5569 consensus_queue.cc:260] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.701918  5570 ts_tablet_manager.cc:1434] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260620 13:54:47.702966  5570 tablet_bootstrap.cc:492] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb: Bootstrap starting.
I20260620 13:54:47.706597  5569 ts_tablet_manager.cc:1434] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260620 13:54:47.708038  5569 tablet_bootstrap.cc:492] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca: Bootstrap starting.
I20260620 13:54:47.709992  5570 tablet_bootstrap.cc:654] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.716317  5569 tablet_bootstrap.cc:654] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.719533  5571 tablet_bootstrap.cc:492] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583: No bootstrap required, opened a new log
I20260620 13:54:47.720366  5571 ts_tablet_manager.cc:1403] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.015s
I20260620 13:54:47.721279  5570 tablet_bootstrap.cc:492] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb: No bootstrap required, opened a new log
I20260620 13:54:47.721671  5570 ts_tablet_manager.cc:1403] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260620 13:54:47.723474  5570 raft_consensus.cc:359] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.723966  5570 raft_consensus.cc:385] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.724222  5570 raft_consensus.cc:740] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.724265  5571 raft_consensus.cc:359] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.725041  5571 raft_consensus.cc:385] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.725509  5571 raft_consensus.cc:740] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.725067  5570 consensus_queue.cc:260] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.726402  5571 consensus_queue.cc:260] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.730016  5576 raft_consensus.cc:493] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:47.730520  5576 raft_consensus.cc:515] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.732857  5576 leader_election.cc:290] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:47.733503  5570 ts_tablet_manager.cc:1434] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260620 13:54:47.734668  5570 tablet_bootstrap.cc:492] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb: Bootstrap starting.
I20260620 13:54:47.734772  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078959e5186647538a9f35d46354ace3" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583" is_pre_election: true
I20260620 13:54:47.736809  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078959e5186647538a9f35d46354ace3" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb" is_pre_election: true
I20260620 13:54:47.737391  5454 raft_consensus.cc:2468] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 0.
W20260620 13:54:47.738312  5344 leader_election.cc:343] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:47.739575  5345 leader_election.cc:304] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 6bc05a64f797432599d7670f8384e583
I20260620 13:54:47.741276  5571 ts_tablet_manager.cc:1434] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260620 13:54:47.742777  5570 tablet_bootstrap.cc:654] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.745507  5576 raft_consensus.cc:2804] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:47.745915  5576 raft_consensus.cc:493] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:47.746251  5576 raft_consensus.cc:3060] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.748927  5571 tablet_bootstrap.cc:492] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583: Bootstrap starting.
I20260620 13:54:47.755858  5570 tablet_bootstrap.cc:492] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb: No bootstrap required, opened a new log
I20260620 13:54:47.756320  5570 ts_tablet_manager.cc:1403] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260620 13:54:47.756814  5571 tablet_bootstrap.cc:654] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.757604  5569 tablet_bootstrap.cc:492] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca: No bootstrap required, opened a new log
I20260620 13:54:47.757367  5576 raft_consensus.cc:515] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.758219  5569 ts_tablet_manager.cc:1403] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca: Time spent bootstrapping tablet: real 0.050s	user 0.025s	sys 0.015s
I20260620 13:54:47.758843  5570 raft_consensus.cc:359] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.759539  5570 raft_consensus.cc:385] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.759812  5570 raft_consensus.cc:740] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.760531  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078959e5186647538a9f35d46354ace3" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:54:47.761077  5569 raft_consensus.cc:359] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.761533  5454 raft_consensus.cc:3060] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.761857  5569 raft_consensus.cc:385] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.760602  5570 consensus_queue.cc:260] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.762257  5569 raft_consensus.cc:740] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.763151  5569 consensus_queue.cc:260] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.764135  5570 ts_tablet_manager.cc:1434] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260620 13:54:47.765002  5570 tablet_bootstrap.cc:492] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb: Bootstrap starting.
I20260620 13:54:47.765481  5569 ts_tablet_manager.cc:1434] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 13:54:47.766384  5569 tablet_bootstrap.cc:492] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca: Bootstrap starting.
I20260620 13:54:47.769550  5579 raft_consensus.cc:493] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:47.770397  5570 tablet_bootstrap.cc:654] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.770220  5579 raft_consensus.cc:515] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.773641  5569 tablet_bootstrap.cc:654] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.773554  5579 leader_election.cc:290] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:47.804628  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078959e5186647538a9f35d46354ace3" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583"
W20260620 13:54:47.806921  5344 leader_election.cc:343] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:47.810029  5576 leader_election.cc:290] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 election: Requested vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:47.813066  5454 raft_consensus.cc:2468] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 1.
I20260620 13:54:47.823320  5345 leader_election.cc:304] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 6bc05a64f797432599d7670f8384e583
I20260620 13:54:47.824867  5576 raft_consensus.cc:2804] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:47.826423  5576 raft_consensus.cc:697] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 1 LEADER]: Becoming Leader. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:54:47.827564  5576 consensus_queue.cc:237] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.851128  5579 raft_consensus.cc:493] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:47.852070  5579 raft_consensus.cc:515] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.854959  5579 leader_election.cc:290] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:47.859047  5571 tablet_bootstrap.cc:492] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583: No bootstrap required, opened a new log
I20260620 13:54:47.860553  5571 ts_tablet_manager.cc:1403] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583: Time spent bootstrapping tablet: real 0.112s	user 0.043s	sys 0.061s
I20260620 13:54:47.862540  5569 tablet_bootstrap.cc:492] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca: No bootstrap required, opened a new log
I20260620 13:54:47.862725  5570 tablet_bootstrap.cc:492] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb: No bootstrap required, opened a new log
I20260620 13:54:47.863071  5569 ts_tablet_manager.cc:1403] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca: Time spent bootstrapping tablet: real 0.097s	user 0.044s	sys 0.048s
I20260620 13:54:47.863252  5570 ts_tablet_manager.cc:1403] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb: Time spent bootstrapping tablet: real 0.098s	user 0.035s	sys 0.052s
I20260620 13:54:47.866096  5570 raft_consensus.cc:359] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.866614  5570 raft_consensus.cc:385] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.866870  5570 raft_consensus.cc:740] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.867412  5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca" is_pre_election: true
I20260620 13:54:47.867877  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9998d988ea954edca90a6f5a3ad4c936" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca" is_pre_election: true
I20260620 13:54:47.867697  5570 consensus_queue.cc:260] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.868077  5380 raft_consensus.cc:2468] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 0.
I20260620 13:54:47.867385  5569 raft_consensus.cc:359] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.869370  5569 raft_consensus.cc:385] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.869351  5419 leader_election.cc:304] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:54:47.869760  5569 raft_consensus.cc:740] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.870343  5579 raft_consensus.cc:2804] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:47.869818  5276 catalog_manager.cc:5696] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca reported cstate change: term changed from 0 to 1, leader changed from <none> to ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193). New cstate: current_term: 1 leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:47.870463  5569 consensus_queue.cc:260] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.871630  5379 raft_consensus.cc:2468] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 0.
I20260620 13:54:47.872243  5570 ts_tablet_manager.cc:1434] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260620 13:54:47.873499  5571 raft_consensus.cc:359] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.874212  5571 raft_consensus.cc:385] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.870746  5579 raft_consensus.cc:493] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:47.874985  5579 raft_consensus.cc:3060] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.876197  5569 ts_tablet_manager.cc:1434] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260620 13:54:47.877312  5569 tablet_bootstrap.cc:492] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca: Bootstrap starting.
I20260620 13:54:47.874497  5571 raft_consensus.cc:740] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.878196  5571 consensus_queue.cc:260] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.881215  5579 raft_consensus.cc:515] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.881790  5571 ts_tablet_manager.cc:1434] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.003s
I20260620 13:54:47.882771  5571 tablet_bootstrap.cc:492] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583: Bootstrap starting.
I20260620 13:54:47.883425  5579 leader_election.cc:290] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 election: Requested vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:47.893365  5569 tablet_bootstrap.cc:654] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.895061  5577 raft_consensus.cc:493] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:47.896260  5571 tablet_bootstrap.cc:654] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.895584  5577 raft_consensus.cc:515] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.901490  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb" is_pre_election: true
I20260620 13:54:47.902556  5454 raft_consensus.cc:2393] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bc05a64f797432599d7670f8384e583 in current term 1: Already voted for candidate 617fb28b87054fdf87601ac234d57adb in this term.
I20260620 13:54:47.902750  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
I20260620 13:54:47.903512  5379 raft_consensus.cc:3060] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.908838  5571 tablet_bootstrap.cc:492] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583: No bootstrap required, opened a new log
I20260620 13:54:47.909410  5571 ts_tablet_manager.cc:1403] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.005s
I20260620 13:54:47.911720  5379 raft_consensus.cc:2468] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 1.
I20260620 13:54:47.913615  5608 raft_consensus.cc:493] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:47.914069  5608 raft_consensus.cc:515] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.912779  5419 leader_election.cc:304] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:54:47.914323  5583 raft_consensus.cc:493] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:47.915232  5577 leader_election.cc:290] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325)
I20260620 13:54:47.915423  5583 raft_consensus.cc:515] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.915964  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583" is_pre_election: true
I20260620 13:54:47.916301  5608 leader_election.cc:290] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:47.916603  5528 raft_consensus.cc:2468] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 0.
I20260620 13:54:47.916880  5608 raft_consensus.cc:2804] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:47.917223  5608 raft_consensus.cc:493] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:47.917546  5608 raft_consensus.cc:3060] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.917586  5583 leader_election.cc:290] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325)
I20260620 13:54:47.918534  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9998d988ea954edca90a6f5a3ad4c936" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583" is_pre_election: true
I20260620 13:54:47.920104  5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca" is_pre_election: true
I20260620 13:54:47.920943  5380 raft_consensus.cc:2468] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 0.
I20260620 13:54:47.921307  5419 leader_election.cc:304] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:54:47.921489  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:54:47.920156  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb" is_pre_election: true
I20260620 13:54:47.922128  5528 raft_consensus.cc:3060] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.922549  5454 raft_consensus.cc:2468] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 0.
W20260620 13:54:47.923269  5419 leader_election.cc:343] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:47.922236  5493 leader_election.cc:304] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bc05a64f797432599d7670f8384e583, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:54:47.924281  5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a907b6fffa4cb089ec941716ecb23e" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca" is_pre_election: true
I20260620 13:54:47.924904  5380 raft_consensus.cc:2468] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 0.
I20260620 13:54:47.925631  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a907b6fffa4cb089ec941716ecb23e" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583" is_pre_election: true
I20260620 13:54:47.926275  5529 raft_consensus.cc:2468] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 0.
I20260620 13:54:47.926784  5569 tablet_bootstrap.cc:492] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca: No bootstrap required, opened a new log
I20260620 13:54:47.927268  5569 ts_tablet_manager.cc:1403] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.017s
I20260620 13:54:47.928247  5583 raft_consensus.cc:2804] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:47.928597  5583 raft_consensus.cc:493] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:47.928936  5583 raft_consensus.cc:3060] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.912490  5571 raft_consensus.cc:359] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.920717  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca" is_pre_election: true
I20260620 13:54:47.929860  5571 raft_consensus.cc:385] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.930238  5379 raft_consensus.cc:2393] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bc05a64f797432599d7670f8384e583 in current term 1: Already voted for candidate 617fb28b87054fdf87601ac234d57adb in this term.
I20260620 13:54:47.930497  5419 leader_election.cc:304] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:54:47.931422  5579 raft_consensus.cc:2804] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:47.931490  5493 leader_election.cc:304] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bc05a64f797432599d7670f8384e583; no voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca
I20260620 13:54:47.929710  5608 raft_consensus.cc:515] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.934785  5608 leader_election.cc:290] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 election: Requested vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:47.935506  5608 raft_consensus.cc:2804] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:47.935947  5608 raft_consensus.cc:493] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:47.936313  5608 raft_consensus.cc:3060] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.937593  5569 raft_consensus.cc:359] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.930272  5571 raft_consensus.cc:740] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.938972  5569 raft_consensus.cc:385] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:47.939388  5569 raft_consensus.cc:740] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Initialized, Role: FOLLOWER
I20260620 13:54:47.940056  5528 raft_consensus.cc:2468] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 1.
I20260620 13:54:47.940266  5569 consensus_queue.cc:260] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.939956  5571 consensus_queue.cc:260] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.941154  5577 raft_consensus.cc:2749] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:54:47.949563  5569 ts_tablet_manager.cc:1434] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260620 13:54:47.953115  5583 raft_consensus.cc:515] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.953498  5608 raft_consensus.cc:515] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.956149  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
I20260620 13:54:47.956265  5608 leader_election.cc:290] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 election: Requested vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:47.956780  5379 raft_consensus.cc:3060] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.959583  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9998d988ea954edca90a6f5a3ad4c936" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:54:47.960749  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a907b6fffa4cb089ec941716ecb23e" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583"
W20260620 13:54:47.963212  5419 leader_election.cc:343] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:54:47.963413  5529 raft_consensus.cc:3060] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.964990  5571 ts_tablet_manager.cc:1434] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.016s
I20260620 13:54:47.965843  5576 raft_consensus.cc:493] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:47.966068  5571 tablet_bootstrap.cc:492] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583: Bootstrap starting.
I20260620 13:54:47.966287  5576 raft_consensus.cc:515] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.968672  5576 leader_election.cc:290] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:47.969441  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f6cff325ad4e58a71efef78228a150" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb" is_pre_election: true
I20260620 13:54:47.969883  5613 raft_consensus.cc:493] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:47.970219  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f6cff325ad4e58a71efef78228a150" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583" is_pre_election: true
I20260620 13:54:47.970317  5454 raft_consensus.cc:2393] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9a7b222fbf4486ab305e75776b3aca in current term 1: Already voted for candidate 6bc05a64f797432599d7670f8384e583 in this term.
I20260620 13:54:47.960891  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a907b6fffa4cb089ec941716ecb23e" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
I20260620 13:54:47.970464  5613 raft_consensus.cc:515] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } } peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } }
I20260620 13:54:47.971894  5344 leader_election.cc:304] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9a7b222fbf4486ab305e75776b3aca; no voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583
I20260620 13:54:47.959396  5380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9998d988ea954edca90a6f5a3ad4c936" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
I20260620 13:54:47.972654  5380 raft_consensus.cc:3060] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.970211  5529 raft_consensus.cc:2468] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 1.
I20260620 13:54:47.974118  5613 leader_election.cc:290] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455)
I20260620 13:54:47.975246  5419 leader_election.cc:304] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583; no voters: 
I20260620 13:54:47.976261  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca4f9645ab748be8d9e3591e8673868" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb" is_pre_election: true
I20260620 13:54:47.976394  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca4f9645ab748be8d9e3591e8673868" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca" is_pre_election: true
I20260620 13:54:47.976974  5454 raft_consensus.cc:2468] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 0.
I20260620 13:54:47.977052  5377 raft_consensus.cc:2468] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 0.
I20260620 13:54:47.978432  5494 leader_election.cc:304] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583; no voters: 
I20260620 13:54:47.972672  5576 raft_consensus.cc:3060] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.971383  5378 raft_consensus.cc:3060] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.979696  5613 raft_consensus.cc:2804] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:47.980073  5613 raft_consensus.cc:493] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:47.980365  5613 raft_consensus.cc:3060] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.981302  5380 raft_consensus.cc:2468] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 1.
I20260620 13:54:47.986115  5378 raft_consensus.cc:2468] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 1.
I20260620 13:54:47.986356  5571 tablet_bootstrap.cc:654] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:47.986721  5608 raft_consensus.cc:2804] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:47.987640  5608 raft_consensus.cc:697] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Becoming Leader. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Running, Role: LEADER
I20260620 13:54:47.989192  5608 consensus_queue.cc:237] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.992195  5576 raft_consensus.cc:2749] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:54:47.988263  5419 leader_election.cc:304] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 6bc05a64f797432599d7670f8384e583
I20260620 13:54:47.992587  5379 raft_consensus.cc:2468] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 1.
I20260620 13:54:47.993368  5583 leader_election.cc:290] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 election: Requested vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325)
I20260620 13:54:47.957350  5579 raft_consensus.cc:697] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Becoming Leader. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Running, Role: LEADER
I20260620 13:54:47.993799  5493 leader_election.cc:304] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bc05a64f797432599d7670f8384e583, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:54:47.994379  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:54:47.994711  5612 raft_consensus.cc:2804] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:47.994989  5454 raft_consensus.cc:3060] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:47.995204  5583 raft_consensus.cc:2804] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:47.994515  5579 consensus_queue.cc:237] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.996512  5583 raft_consensus.cc:697] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 1 LEADER]: Becoming Leader. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Running, Role: LEADER
I20260620 13:54:47.997479  5583 consensus_queue.cc:237] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:47.999053  5612 raft_consensus.cc:697] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Becoming Leader. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Running, Role: LEADER
I20260620 13:54:48.000407  5612 consensus_queue.cc:237] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.003280  5454 raft_consensus.cc:2468] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 1.
I20260620 13:54:48.004565  5613 raft_consensus.cc:515] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } } peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } }
I20260620 13:54:48.010443  5613 leader_election.cc:290] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 election: Requested vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455)
I20260620 13:54:48.013343  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca4f9645ab748be8d9e3591e8673868" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
I20260620 13:54:48.014411  5379 raft_consensus.cc:3060] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:48.017603  5571 tablet_bootstrap.cc:492] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583: No bootstrap required, opened a new log
I20260620 13:54:48.018064  5571 ts_tablet_manager.cc:1403] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.008s
I20260620 13:54:48.021066  5571 raft_consensus.cc:359] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.021839  5571 raft_consensus.cc:385] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:48.022230  5571 raft_consensus.cc:740] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Initialized, Role: FOLLOWER
I20260620 13:54:48.021656  5278 catalog_manager.cc:5696] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6bc05a64f797432599d7670f8384e583 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "6bc05a64f797432599d7670f8384e583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: HEALTHY } } }
I20260620 13:54:48.023375  5379 raft_consensus.cc:2468] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 1.
I20260620 13:54:48.023082  5571 consensus_queue.cc:260] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.025722  5493 leader_election.cc:304] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bc05a64f797432599d7670f8384e583, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:54:48.026180  5571 ts_tablet_manager.cc:1434] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260620 13:54:48.026607  5613 raft_consensus.cc:2804] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:48.023711  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca4f9645ab748be8d9e3591e8673868" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:54:48.027086  5613 raft_consensus.cc:697] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 1 LEADER]: Becoming Leader. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Running, Role: LEADER
I20260620 13:54:48.027346  5454 raft_consensus.cc:3060] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:48.028016  5613 consensus_queue.cc:237] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } } peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } }
I20260620 13:54:48.027038  5571 tablet_bootstrap.cc:492] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583: Bootstrap starting.
I20260620 13:54:48.042367  5571 tablet_bootstrap.cc:654] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:48.051941  5454 raft_consensus.cc:2468] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 1.
I20260620 13:54:48.052269  5278 catalog_manager.cc:5696] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb reported cstate change: term changed from 0 to 1, leader changed from <none> to 617fb28b87054fdf87601ac234d57adb (127.4.155.194). New cstate: current_term: 1 leader_uuid: "617fb28b87054fdf87601ac234d57adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:48.055344  5613 consensus_queue.cc:1048] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.059187  5612 raft_consensus.cc:493] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:48.059837  5612 raft_consensus.cc:515] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.063625  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b1a2c08ac34521a95698ec62d6ab76" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca" is_pre_election: true
I20260620 13:54:48.057834  5277 catalog_manager.cc:5696] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6bc05a64f797432599d7670f8384e583 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "6bc05a64f797432599d7670f8384e583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:48.064502  5378 raft_consensus.cc:2468] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 0.
I20260620 13:54:48.066385  5419 leader_election.cc:304] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:54:48.071780  5579 raft_consensus.cc:2804] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:48.072492  5579 raft_consensus.cc:493] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:48.072897  5579 raft_consensus.cc:3060] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:48.073074  5571 tablet_bootstrap.cc:492] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583: No bootstrap required, opened a new log
I20260620 13:54:48.073542  5571 ts_tablet_manager.cc:1403] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.012s
I20260620 13:54:48.074240  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b1a2c08ac34521a95698ec62d6ab76" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583" is_pre_election: true
I20260620 13:54:48.074860  5529 raft_consensus.cc:2468] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 0.
I20260620 13:54:48.077374  5613 consensus_queue.cc:1048] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.080076  5612 leader_election.cc:290] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:48.084324  5571 raft_consensus.cc:359] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.085032  5571 raft_consensus.cc:385] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:48.085319  5571 raft_consensus.cc:740] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Initialized, Role: FOLLOWER
I20260620 13:54:48.086186  5571 consensus_queue.cc:260] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.087738  5278 catalog_manager.cc:5696] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb reported cstate change: term changed from 0 to 1, leader changed from <none> to 617fb28b87054fdf87601ac234d57adb (127.4.155.194). New cstate: current_term: 1 leader_uuid: "617fb28b87054fdf87601ac234d57adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:48.089385  5278 catalog_manager.cc:5696] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb reported cstate change: term changed from 0 to 1, leader changed from <none> to 617fb28b87054fdf87601ac234d57adb (127.4.155.194). New cstate: current_term: 1 leader_uuid: "617fb28b87054fdf87601ac234d57adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:48.092396  5571 ts_tablet_manager.cc:1434] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.005s
I20260620 13:54:48.093770  5571 tablet_bootstrap.cc:492] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583: Bootstrap starting.
I20260620 13:54:48.093866  5576 raft_consensus.cc:493] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:48.094465  5576 raft_consensus.cc:515] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.096575  5576 leader_election.cc:290] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:48.098172  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003980ade3d545058353e551fcf2b30e" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb" is_pre_election: true
I20260620 13:54:48.098809  5455 raft_consensus.cc:2468] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 0.
I20260620 13:54:48.100531  5345 leader_election.cc:304] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:54:48.101434  5576 raft_consensus.cc:2804] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:48.101863  5576 raft_consensus.cc:493] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:48.102223  5576 raft_consensus.cc:3060] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:48.102821  5571 tablet_bootstrap.cc:654] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583: Neither blocks nor log segments found. Creating new log.
I20260620 13:54:48.103785  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003980ade3d545058353e551fcf2b30e" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583" is_pre_election: true
I20260620 13:54:48.104409  5529 raft_consensus.cc:2468] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 0.
I20260620 13:54:48.108640  5613 raft_consensus.cc:493] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:48.109094  5613 raft_consensus.cc:515] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.111768  5576 raft_consensus.cc:515] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.113315  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078959e5186647538a9f35d46354ace3" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca" is_pre_election: true
I20260620 13:54:48.114642  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003980ade3d545058353e551fcf2b30e" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:54:48.115224  5455 raft_consensus.cc:3060] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:48.118857  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078959e5186647538a9f35d46354ace3" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb" is_pre_election: true
I20260620 13:54:48.119691  5453 raft_consensus.cc:2393] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bc05a64f797432599d7670f8384e583 in current term 1: Already voted for candidate ee9a7b222fbf4486ab305e75776b3aca in this term.
I20260620 13:54:48.120975  5494 leader_election.cc:304] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bc05a64f797432599d7670f8384e583; no voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca
I20260620 13:54:48.121833  5577 raft_consensus.cc:3060] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:48.122529  5455 raft_consensus.cc:2468] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 1.
I20260620 13:54:48.123240  5613 leader_election.cc:290] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325)
I20260620 13:54:48.128328  5571 tablet_bootstrap.cc:492] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583: No bootstrap required, opened a new log
I20260620 13:54:48.128518  5577 raft_consensus.cc:2749] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:54:48.129673  5571 ts_tablet_manager.cc:1403] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.005s
I20260620 13:54:48.132647  5571 raft_consensus.cc:359] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.133502  5571 raft_consensus.cc:385] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:54:48.133896  5571 raft_consensus.cc:740] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Initialized, Role: FOLLOWER
I20260620 13:54:48.133704  5579 raft_consensus.cc:515] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.134819  5571 consensus_queue.cc:260] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.135489  5345 leader_election.cc:304] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:54:48.136327  5574 raft_consensus.cc:2804] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:48.136893  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003980ade3d545058353e551fcf2b30e" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:54:48.137458  5571 ts_tablet_manager.cc:1434] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 13:54:48.137864  5529 raft_consensus.cc:3060] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:48.146522  5529 raft_consensus.cc:2468] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 1.
I20260620 13:54:48.147480  5576 leader_election.cc:290] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 1 election: Requested vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:48.151212  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b1a2c08ac34521a95698ec62d6ab76" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
I20260620 13:54:48.151815  5378 raft_consensus.cc:3060] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:48.149098  5579 leader_election.cc:290] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 election: Requested vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:48.154310  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b1a2c08ac34521a95698ec62d6ab76" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:54:48.154979  5529 raft_consensus.cc:3060] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:48.156698  5579 raft_consensus.cc:493] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:48.157570  5579 raft_consensus.cc:515] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.159704  5579 leader_election.cc:290] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:48.163403  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ad12da8f8841dba69dc068b92c60e2" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583" is_pre_election: true
I20260620 13:54:48.164101  5528 raft_consensus.cc:2468] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 0.
I20260620 13:54:48.164804  5378 raft_consensus.cc:2468] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 1.
I20260620 13:54:48.165400  5574 raft_consensus.cc:697] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 1 LEADER]: Becoming Leader. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:54:48.166002  5419 leader_election.cc:304] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:54:48.166275  5574 consensus_queue.cc:237] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.166949  5579 raft_consensus.cc:2804] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:48.167142  5419 leader_election.cc:304] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583; no voters: 
I20260620 13:54:48.167534  5579 raft_consensus.cc:697] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Becoming Leader. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Running, Role: LEADER
I20260620 13:54:48.168036  5608 raft_consensus.cc:2804] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:54:48.168368  5608 raft_consensus.cc:493] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:54:48.168499  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ad12da8f8841dba69dc068b92c60e2" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca" is_pre_election: true
I20260620 13:54:48.168857  5608 raft_consensus.cc:3060] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:48.169170  5379 raft_consensus.cc:2468] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 0.
I20260620 13:54:48.169369  5579 consensus_queue.cc:237] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.170873  5529 raft_consensus.cc:2468] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 1.
I20260620 13:54:48.177906  5608 raft_consensus.cc:515] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.178013  5278 catalog_manager.cc:5696] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca reported cstate change: term changed from 0 to 1, leader changed from <none> to ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193). New cstate: current_term: 1 leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:48.179859  5608 leader_election.cc:290] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 election: Requested vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:48.179167  5276 catalog_manager.cc:5696] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb reported cstate change: term changed from 0 to 1, leader changed from <none> to 617fb28b87054fdf87601ac234d57adb (127.4.155.194). New cstate: current_term: 1 leader_uuid: "617fb28b87054fdf87601ac234d57adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:48.180873  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ad12da8f8841dba69dc068b92c60e2" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
I20260620 13:54:48.180873  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ad12da8f8841dba69dc068b92c60e2" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:54:48.181572  5529 raft_consensus.cc:3060] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:48.181533  5379 raft_consensus.cc:3060] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:48.188472  5379 raft_consensus.cc:2468] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 1.
I20260620 13:54:48.188468  5529 raft_consensus.cc:2468] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 1.
I20260620 13:54:48.189735  5419 leader_election.cc:304] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583; no voters: 
I20260620 13:54:48.190465  5608 raft_consensus.cc:2804] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:54:48.190994  5608 raft_consensus.cc:697] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Becoming Leader. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Running, Role: LEADER
I20260620 13:54:48.191732  5608 consensus_queue.cc:237] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.198576  5276 catalog_manager.cc:5696] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb reported cstate change: term changed from 0 to 1, leader changed from <none> to 617fb28b87054fdf87601ac234d57adb (127.4.155.194). New cstate: current_term: 1 leader_uuid: "617fb28b87054fdf87601ac234d57adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:48.294649  5574 consensus_queue.cc:1048] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.307314  5576 consensus_queue.cc:1048] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.320425  5529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ca4f9645ab748be8d9e3591e8673868"
dest_uuid: "6bc05a64f797432599d7670f8384e583"
mode: GRACEFUL
new_leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:56718
I20260620 13:54:48.321117  5529 raft_consensus.cc:606] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 1 LEADER]: Received request to transfer leadership to TS ee9a7b222fbf4486ab305e75776b3aca
I20260620 13:54:48.326869  5529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773"
dest_uuid: "6bc05a64f797432599d7670f8384e583"
mode: GRACEFUL
new_leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:56718
I20260620 13:54:48.327361  5529 raft_consensus.cc:606] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 1 LEADER]: Received request to transfer leadership to TS ee9a7b222fbf4486ab305e75776b3aca
I20260620 13:54:48.341033  5454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0"
dest_uuid: "617fb28b87054fdf87601ac234d57adb"
mode: GRACEFUL
new_leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:36018
I20260620 13:54:48.341562  5454 raft_consensus.cc:606] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Received request to transfer leadership to TS ee9a7b222fbf4486ab305e75776b3aca
W20260620 13:54:48.344098  5555 tablet.cc:2406] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 13:54:48.347049  5529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2f6cff325ad4e58a71efef78228a150"
dest_uuid: "6bc05a64f797432599d7670f8384e583"
mode: GRACEFUL
new_leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:56718
I20260620 13:54:48.347628  5529 raft_consensus.cc:606] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 1 LEADER]: Received request to transfer leadership to TS ee9a7b222fbf4486ab305e75776b3aca
I20260620 13:54:48.368731  5379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "003980ade3d545058353e551fcf2b30e"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
mode: GRACEFUL
new_leader_uuid: "617fb28b87054fdf87601ac234d57adb"
 from {username='slave'} at 127.0.0.1:47300
I20260620 13:54:48.369426  5379 raft_consensus.cc:606] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 1 LEADER]: Received request to transfer leadership to TS 617fb28b87054fdf87601ac234d57adb
I20260620 13:54:48.378113  5454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49ad12da8f8841dba69dc068b92c60e2"
dest_uuid: "617fb28b87054fdf87601ac234d57adb"
mode: GRACEFUL
new_leader_uuid: "6bc05a64f797432599d7670f8384e583"
 from {username='slave'} at 127.0.0.1:36018
I20260620 13:54:48.378669  5454 raft_consensus.cc:606] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Received request to transfer leadership to TS 6bc05a64f797432599d7670f8384e583
I20260620 13:54:48.393857  5608 consensus_queue.cc:1048] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.395359  5577 consensus_queue.cc:1048] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.406441  5583 raft_consensus.cc:493] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:54:48.406935  5583 raft_consensus.cc:515] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.409534  5583 leader_election.cc:290] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325)
I20260620 13:54:48.410974  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9998d988ea954edca90a6f5a3ad4c936" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca" is_pre_election: true
I20260620 13:54:48.411811  5378 raft_consensus.cc:2393] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bc05a64f797432599d7670f8384e583 in current term 1: Already voted for candidate 617fb28b87054fdf87601ac234d57adb in this term.
I20260620 13:54:48.412093  5577 consensus_queue.cc:1048] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.412882  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9998d988ea954edca90a6f5a3ad4c936" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617fb28b87054fdf87601ac234d57adb" is_pre_election: true
I20260620 13:54:48.414601  5494 leader_election.cc:304] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bc05a64f797432599d7670f8384e583; no voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca
I20260620 13:54:48.415083  5612 consensus_queue.cc:1048] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.415758  5577 raft_consensus.cc:3060] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:54:48.428218  5577 raft_consensus.cc:2749] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:54:48.429050  5613 raft_consensus.cc:993] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583: : Instructing follower ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:54:48.428555  5612 consensus_queue.cc:1048] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:54:48.429463  5613 raft_consensus.cc:1081] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 1 LEADER]: Signalling peer ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:54:48.431269  5379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:47268
I20260620 13:54:48.431881  5379 raft_consensus.cc:493] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:48.432233  5379 raft_consensus.cc:3060] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.438958  5611 raft_consensus.cc:993] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb: : Instructing follower ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:54:48.439519  5579 raft_consensus.cc:1081] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Signalling peer ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:54:48.439283  5379 raft_consensus.cc:515] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.441601  5380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:47284
I20260620 13:54:48.442157  5380 raft_consensus.cc:493] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:48.442502  5380 raft_consensus.cc:3060] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.443559  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:54:48.444103  5454 raft_consensus.cc:3060] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.445313  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:54:48.445897  5529 raft_consensus.cc:3055] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:54:48.446202  5529 raft_consensus.cc:740] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Running, Role: LEADER
I20260620 13:54:48.447027  5529 consensus_queue.cc:260] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.448276  5529 raft_consensus.cc:3060] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.448629  5579 consensus_queue.cc:1048] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.449383  5380 raft_consensus.cc:515] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.450896  5454 raft_consensus.cc:2468] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 2.
I20260620 13:54:48.451894  5378 raft_consensus.cc:1240] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Rejecting Update request from peer 617fb28b87054fdf87601ac234d57adb for earlier term 1. Current term is 2. Ops: []
I20260620 13:54:48.452174  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:54:48.452739  5455 raft_consensus.cc:3055] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:54:48.453059  5455 raft_consensus.cc:740] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Running, Role: LEADER
I20260620 13:54:48.453976  5455 consensus_queue.cc:260] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.454955  5455 raft_consensus.cc:3060] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.455029  5380 leader_election.cc:290] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 2 election: Requested vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:48.456305  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:54:48.458784  5529 raft_consensus.cc:2468] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 2.
I20260620 13:54:48.459787  5379 leader_election.cc:290] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 2 election: Requested vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:48.460247  5344 leader_election.cc:304] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bc05a64f797432599d7670f8384e583, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:54:48.461524  5455 raft_consensus.cc:2468] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 2.
I20260620 13:54:48.461927  5576 raft_consensus.cc:2804] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:54:48.462574  5576 raft_consensus.cc:697] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Becoming Leader. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:54:48.463006  5345 leader_election.cc:304] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 6bc05a64f797432599d7670f8384e583
I20260620 13:54:48.464203  5627 raft_consensus.cc:2804] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:54:48.463685  5576 consensus_queue.cc:237] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.464708  5627 raft_consensus.cc:697] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Becoming Leader. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:54:48.465613  5627 consensus_queue.cc:237] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.472397  5277 catalog_manager.cc:5696] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca reported cstate change: term changed from 1 to 2, leader changed from 6bc05a64f797432599d7670f8384e583 (127.4.155.195) to ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193). New cstate: current_term: 2 leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:48.483793  5579 consensus_queue.cc:1048] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.483968  5277 catalog_manager.cc:5696] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca reported cstate change: term changed from 1 to 2, leader changed from 617fb28b87054fdf87601ac234d57adb (127.4.155.194) to ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193). New cstate: current_term: 2 leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:48.494360  5611 consensus_queue.cc:1048] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:54:48.536018  5577 consensus_queue.cc:1048] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.542999  5613 raft_consensus.cc:993] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583: : Instructing follower ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:54:48.543576  5583 raft_consensus.cc:1081] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 1 LEADER]: Signalling peer ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:54:48.545696  5378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ca4f9645ab748be8d9e3591e8673868"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:47268
I20260620 13:54:48.548393  5378 raft_consensus.cc:493] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:48.548779  5378 raft_consensus.cc:3060] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.549667  5577 consensus_queue.cc:1048] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.559437  5378 raft_consensus.cc:515] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } } peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } }
I20260620 13:54:48.563074  5378 leader_election.cc:290] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 2 election: Requested vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:48.563365  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca4f9645ab748be8d9e3591e8673868" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:54:48.563730  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ca4f9645ab748be8d9e3591e8673868" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:54:48.564010  5455 raft_consensus.cc:3060] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.564267  5528 raft_consensus.cc:3055] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:54:48.564616  5528 raft_consensus.cc:740] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Running, Role: LEADER
I20260620 13:54:48.565423  5528 consensus_queue.cc:260] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } } peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } }
I20260620 13:54:48.566653  5528 raft_consensus.cc:3060] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.570837  5455 raft_consensus.cc:2468] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 2.
I20260620 13:54:48.572168  5345 leader_election.cc:304] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:54:48.572901  5627 raft_consensus.cc:2804] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:54:48.573369  5627 raft_consensus.cc:697] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Becoming Leader. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:54:48.574199  5528 raft_consensus.cc:2468] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 2.
I20260620 13:54:48.574209  5627 consensus_queue.cc:237] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } } peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } }
I20260620 13:54:48.580925  5278 catalog_manager.cc:5696] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca reported cstate change: term changed from 1 to 2, leader changed from 6bc05a64f797432599d7670f8384e583 (127.4.155.195) to ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193). New cstate: current_term: 2 leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: HEALTHY } } }
I20260620 13:54:48.585934  5612 consensus_queue.cc:1048] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.590104  5611 consensus_queue.cc:1048] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.593890  5612 raft_consensus.cc:993] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb: : Instructing follower 6bc05a64f797432599d7670f8384e583 to start an election
I20260620 13:54:48.594413  5612 raft_consensus.cc:1081] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Signalling peer 6bc05a64f797432599d7670f8384e583 to start an election
I20260620 13:54:48.601081  5611 consensus_queue.cc:1048] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.601898  5529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49ad12da8f8841dba69dc068b92c60e2"
dest_uuid: "6bc05a64f797432599d7670f8384e583"
 from {username='slave'} at 127.0.0.1:56712
I20260620 13:54:48.602488  5529 raft_consensus.cc:493] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:48.603010  5529 raft_consensus.cc:3060] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.612650  5611 consensus_queue.cc:1048] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.613838  5529 raft_consensus.cc:515] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.616978  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ad12da8f8841dba69dc068b92c60e2" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
I20260620 13:54:48.630218  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ad12da8f8841dba69dc068b92c60e2" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:54:48.630847  5455 raft_consensus.cc:3055] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:54:48.631251  5455 raft_consensus.cc:740] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Running, Role: LEADER
I20260620 13:54:48.633080  5583 raft_consensus.cc:993] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583: : Instructing follower ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:54:48.633562  5577 raft_consensus.cc:1081] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 1 LEADER]: Signalling peer ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:54:48.632529  5455 consensus_queue.cc:260] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.636340  5455 raft_consensus.cc:3060] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.637912  5378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2f6cff325ad4e58a71efef78228a150"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:47268
I20260620 13:54:48.638855  5378 raft_consensus.cc:493] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:48.639290  5378 raft_consensus.cc:3060] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.625362  5529 leader_election.cc:290] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 2 election: Requested vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325)
I20260620 13:54:48.644414  5378 raft_consensus.cc:515] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.647135  5455 raft_consensus.cc:2468] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 2.
I20260620 13:54:48.647547  5378 leader_election.cc:290] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 2 election: Requested vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:48.648456  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f6cff325ad4e58a71efef78228a150" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:54:48.648711  5494 leader_election.cc:304] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583; no voters: ee9a7b222fbf4486ab305e75776b3aca
I20260620 13:54:48.649061  5455 raft_consensus.cc:3060] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.649868  5583 raft_consensus.cc:2804] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:54:48.650454  5583 raft_consensus.cc:697] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [term 2 LEADER]: Becoming Leader. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Running, Role: LEADER
I20260620 13:54:48.651312  5583 consensus_queue.cc:237] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.652899  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f6cff325ad4e58a71efef78228a150" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:54:48.653530  5529 raft_consensus.cc:3055] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:54:48.654286  5529 raft_consensus.cc:740] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Running, Role: LEADER
I20260620 13:54:48.655676  5529 consensus_queue.cc:260] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.657079  5529 raft_consensus.cc:3060] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.660100  5455 raft_consensus.cc:2468] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 2.
I20260620 13:54:48.661430  5345 leader_election.cc:304] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:54:48.662328  5627 raft_consensus.cc:2804] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:54:48.662752  5627 raft_consensus.cc:697] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Becoming Leader. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:54:48.662914  5277 catalog_manager.cc:5696] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 reported cstate change: term changed from 1 to 2, leader changed from 617fb28b87054fdf87601ac234d57adb (127.4.155.194) to 6bc05a64f797432599d7670f8384e583 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "6bc05a64f797432599d7670f8384e583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: HEALTHY } } }
I20260620 13:54:48.663625  5627 consensus_queue.cc:237] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.665396  5529 raft_consensus.cc:2468] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 2.
I20260620 13:54:48.669806  5627 consensus_queue.cc:1048] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.671614  5276 catalog_manager.cc:5696] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca reported cstate change: term changed from 1 to 2, leader changed from 6bc05a64f797432599d7670f8384e583 (127.4.155.195) to ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193). New cstate: current_term: 2 leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:48.679250  5576 raft_consensus.cc:993] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca: : Instructing follower 617fb28b87054fdf87601ac234d57adb to start an election
I20260620 13:54:48.679665  5576 raft_consensus.cc:1081] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 1 LEADER]: Signalling peer 617fb28b87054fdf87601ac234d57adb to start an election
I20260620 13:54:48.686182  5454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "003980ade3d545058353e551fcf2b30e"
dest_uuid: "617fb28b87054fdf87601ac234d57adb"
 from {username='slave'} at 127.0.0.1:35994
I20260620 13:54:48.687012  5574 consensus_queue.cc:1048] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:54:48.689364  5454 raft_consensus.cc:493] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:48.689859  5454 raft_consensus.cc:3060] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.695556  5454 raft_consensus.cc:515] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.698580  5454 leader_election.cc:290] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 2 election: Requested vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:54:48.699383  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003980ade3d545058353e551fcf2b30e" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
I20260620 13:54:48.700191  5379 raft_consensus.cc:3055] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:54:48.700222  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003980ade3d545058353e551fcf2b30e" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:54:48.700704  5379 raft_consensus.cc:740] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:54:48.701624  5379 consensus_queue.cc:260] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.702831  5379 raft_consensus.cc:3060] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.708778  5379 raft_consensus.cc:2468] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 2.
I20260620 13:54:48.709852  5419 leader_election.cc:304] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 6bc05a64f797432599d7670f8384e583
I20260620 13:54:48.710669  5611 raft_consensus.cc:2804] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:54:48.711167  5611 raft_consensus.cc:697] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 2 LEADER]: Becoming Leader. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Running, Role: LEADER
I20260620 13:54:48.711913  5611 consensus_queue.cc:237] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:48.718551  5277 catalog_manager.cc:5696] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb reported cstate change: term changed from 1 to 2, leader changed from ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193) to 617fb28b87054fdf87601ac234d57adb (127.4.155.194). New cstate: current_term: 2 leader_uuid: "617fb28b87054fdf87601ac234d57adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:54:48.847277  5454 raft_consensus.cc:1275] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:48.848801  5574 consensus_queue.cc:1048] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:48.857389  5529 raft_consensus.cc:1275] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:48.860183  5627 consensus_queue.cc:1048] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:54:48.862213  5454 raft_consensus.cc:1275] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:48.864961  5627 consensus_queue.cc:1048] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:48.874965  5529 raft_consensus.cc:3060] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:48.886444  5529 raft_consensus.cc:1275] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:48.887799  5627 consensus_queue.cc:1048] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:49.042375  5454 raft_consensus.cc:1275] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Refusing update from remote peer 6bc05a64f797432599d7670f8384e583: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:49.043720  5583 consensus_queue.cc:1048] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:49.051136  5379 raft_consensus.cc:3060] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:49.058876  5379 raft_consensus.cc:1275] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Refusing update from remote peer 6bc05a64f797432599d7670f8384e583: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:49.060226  5583 consensus_queue.cc:1048] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:49.140614  5454 raft_consensus.cc:1275] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:49.140790  5529 raft_consensus.cc:1275] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:49.142117  5627 consensus_queue.cc:1048] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:49.142679  5574 consensus_queue.cc:1048] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:49.164496  5529 raft_consensus.cc:1275] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:49.165838  5574 consensus_queue.cc:1048] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:49.169847  5454 raft_consensus.cc:1275] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:49.171180  5574 consensus_queue.cc:1048] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:49.242723  5379 raft_consensus.cc:1275] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Refusing update from remote peer 617fb28b87054fdf87601ac234d57adb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:49.244144  5611 consensus_queue.cc:1048] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:49.252872  5529 raft_consensus.cc:3060] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:54:49.259895  5529 raft_consensus.cc:1275] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Refusing update from remote peer 617fb28b87054fdf87601ac234d57adb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:54:49.261415  5611 consensus_queue.cc:1048] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:54:51.413463  4719 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260620 13:54:51.414136  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:51.429811  5378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
mode: GRACEFUL
new_leader_uuid: "6bc05a64f797432599d7670f8384e583"
 from {username='slave'} at 127.0.0.1:47316
I20260620 13:54:51.430456  5378 raft_consensus.cc:606] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Received request to transfer leadership to TS 6bc05a64f797432599d7670f8384e583
I20260620 13:54:51.432976  5378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
mode: GRACEFUL
new_leader_uuid: "6bc05a64f797432599d7670f8384e583"
 from {username='slave'} at 127.0.0.1:47316
I20260620 13:54:51.433550  5378 raft_consensus.cc:606] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Received request to transfer leadership to TS 6bc05a64f797432599d7670f8384e583
I20260620 13:54:51.434582  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260620 13:54:51.435060  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:51.435304  5574 raft_consensus.cc:993] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca: : Instructing follower 6bc05a64f797432599d7670f8384e583 to start an election
I20260620 13:54:51.435719  5660 raft_consensus.cc:1081] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Signalling peer 6bc05a64f797432599d7670f8384e583 to start an election
I20260620 13:54:51.437043  5529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0"
dest_uuid: "6bc05a64f797432599d7670f8384e583"
 from {username='slave'} at 127.0.0.1:56700
I20260620 13:54:51.437393  5529 raft_consensus.cc:493] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:51.437603  5529 raft_consensus.cc:3060] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:51.441349  5529 raft_consensus.cc:515] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:51.442651  5529 leader_election.cc:290] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 3 election: Requested vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325)
I20260620 13:54:51.443707  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
I20260620 13:54:51.443717  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:54:51.444249  5378 raft_consensus.cc:3055] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:54:51.444342  5454 raft_consensus.cc:3060] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:51.444532  5378 raft_consensus.cc:740] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:54:51.445297  5378 consensus_queue.cc:260] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:51.446147  5378 raft_consensus.cc:3060] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:51.449432  5454 raft_consensus.cc:2468] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 3.
I20260620 13:54:51.450582  5494 leader_election.cc:304] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583; no voters: 
I20260620 13:54:51.451277  5651 raft_consensus.cc:2804] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:54:51.451424  5378 raft_consensus.cc:2468] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 3.
I20260620 13:54:51.452373  5651 raft_consensus.cc:697] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 3 LEADER]: Becoming Leader. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Running, Role: LEADER
I20260620 13:54:51.453231  5651 consensus_queue.cc:237] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:51.459990  5278 catalog_manager.cc:5696] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 reported cstate change: term changed from 2 to 3, leader changed from ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193) to 6bc05a64f797432599d7670f8384e583 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "6bc05a64f797432599d7670f8384e583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: HEALTHY } } }
I20260620 13:54:51.466616  5574 raft_consensus.cc:993] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca: : Instructing follower 6bc05a64f797432599d7670f8384e583 to start an election
I20260620 13:54:51.467094  5660 raft_consensus.cc:1081] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Signalling peer 6bc05a64f797432599d7670f8384e583 to start an election
I20260620 13:54:51.468649  5529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773"
dest_uuid: "6bc05a64f797432599d7670f8384e583"
 from {username='slave'} at 127.0.0.1:56700
I20260620 13:54:51.469233  5529 raft_consensus.cc:493] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:54:51.469574  5529 raft_consensus.cc:3060] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:51.474023  5529 raft_consensus.cc:515] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:51.475539  5529 leader_election.cc:290] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 3 election: Requested vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325)
I20260620 13:54:51.476298  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
I20260620 13:54:51.476608  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:54:51.476819  5378 raft_consensus.cc:3055] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:54:51.477129  5454 raft_consensus.cc:3060] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:51.477164  5378 raft_consensus.cc:740] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:54:51.477986  5378 consensus_queue.cc:260] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:51.478899  5378 raft_consensus.cc:3060] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:54:51.481855  5454 raft_consensus.cc:2468] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 3.
I20260620 13:54:51.482824  5494 leader_election.cc:304] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583; no voters: 
I20260620 13:54:51.483528  5651 raft_consensus.cc:2804] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:54:51.483605  5378 raft_consensus.cc:2468] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 3.
I20260620 13:54:51.483924  5651 raft_consensus.cc:697] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 3 LEADER]: Becoming Leader. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Running, Role: LEADER
I20260620 13:54:51.484773  5651 consensus_queue.cc:237] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:54:51.492008  5278 catalog_manager.cc:5696] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 reported cstate change: term changed from 2 to 3, leader changed from ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193) to 6bc05a64f797432599d7670f8384e583 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "6bc05a64f797432599d7670f8384e583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: HEALTHY } } }
I20260620 13:54:51.957221  5378 raft_consensus.cc:1275] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 3 FOLLOWER]: Refusing update from remote peer 6bc05a64f797432599d7670f8384e583: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:54:51.958830  5651 consensus_queue.cc:1048] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:54:51.965808  5454 raft_consensus.cc:1275] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 3 FOLLOWER]: Refusing update from remote peer 6bc05a64f797432599d7670f8384e583: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:54:51.967628  5661 consensus_queue.cc:1048] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:54:52.021893  5454 raft_consensus.cc:1275] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 3 FOLLOWER]: Refusing update from remote peer 6bc05a64f797432599d7670f8384e583: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:54:52.023126  5651 consensus_queue.cc:1048] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:54:52.031420  5378 raft_consensus.cc:1275] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 3 FOLLOWER]: Refusing update from remote peer 6bc05a64f797432599d7670f8384e583: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:54:52.033802  5670 consensus_queue.cc:1048] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:54:52.436223  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:52.442122  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:52.442564  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:53.443579  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:53.449106  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:53.449574  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:54.450740  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:54.457315  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:54.457824  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:55.459345  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:55.468041  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:55.468545  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:56.469866  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:56.477341  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:56.478032  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:57.479075  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:57.485291  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:57.485852  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:58.487068  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:58.492918  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:58.493477  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:54:59.494673  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:54:59.500864  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:54:59.501308  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:00.502405  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:00.508383  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:55:00.508832  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:01.542992  4719 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260620 13:55:01.550777  5529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773"
dest_uuid: "6bc05a64f797432599d7670f8384e583"
mode: GRACEFUL
new_leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:56718
I20260620 13:55:01.551402  5529 raft_consensus.cc:606] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 3 LEADER]: Received request to transfer leadership to TS ee9a7b222fbf4486ab305e75776b3aca
I20260620 13:55:01.557191  5529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0"
dest_uuid: "6bc05a64f797432599d7670f8384e583"
mode: GRACEFUL
new_leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:56718
I20260620 13:55:01.557605  5529 raft_consensus.cc:606] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 3 LEADER]: Received request to transfer leadership to TS ee9a7b222fbf4486ab305e75776b3aca
I20260620 13:55:01.569351  5455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12a907b6fffa4cb089ec941716ecb23e"
dest_uuid: "617fb28b87054fdf87601ac234d57adb"
mode: GRACEFUL
new_leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:36018
I20260620 13:55:01.569836  5455 raft_consensus.cc:606] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Received request to transfer leadership to TS ee9a7b222fbf4486ab305e75776b3aca
I20260620 13:55:01.574844  5455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19b1a2c08ac34521a95698ec62d6ab76"
dest_uuid: "617fb28b87054fdf87601ac234d57adb"
mode: GRACEFUL
new_leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:36018
I20260620 13:55:01.575352  5455 raft_consensus.cc:606] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Received request to transfer leadership to TS ee9a7b222fbf4486ab305e75776b3aca
I20260620 13:55:01.580067  5455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "003980ade3d545058353e551fcf2b30e"
dest_uuid: "617fb28b87054fdf87601ac234d57adb"
mode: GRACEFUL
new_leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:36018
I20260620 13:55:01.580534  5455 raft_consensus.cc:606] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 2 LEADER]: Received request to transfer leadership to TS ee9a7b222fbf4486ab305e75776b3aca
I20260620 13:55:01.611584  5684 raft_consensus.cc:993] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb: : Instructing follower ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:55:01.612218  5689 raft_consensus.cc:1081] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Signalling peer ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:55:01.613906  5378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12a907b6fffa4cb089ec941716ecb23e"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:47284
I20260620 13:55:01.614394  5378 raft_consensus.cc:493] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:01.614740  5378 raft_consensus.cc:3060] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:01.619832  5378 raft_consensus.cc:515] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:01.621604  5378 leader_election.cc:290] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 2 election: Requested vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:55:01.622581  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a907b6fffa4cb089ec941716ecb23e" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:55:01.622690  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a907b6fffa4cb089ec941716ecb23e" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:55:01.623320  5529 raft_consensus.cc:3060] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:01.623420  5455 raft_consensus.cc:3055] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:01.623884  5455 raft_consensus.cc:740] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Running, Role: LEADER
I20260620 13:55:01.625002  5455 consensus_queue.cc:260] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:01.626044  5455 raft_consensus.cc:3060] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:01.628539  5529 raft_consensus.cc:2468] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 2.
I20260620 13:55:01.629693  5344 leader_election.cc:304] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bc05a64f797432599d7670f8384e583, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:55:01.630445  5681 raft_consensus.cc:2804] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:01.630829  5681 raft_consensus.cc:697] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Becoming Leader. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:55:01.631556  5681 consensus_queue.cc:237] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:01.632454  5455 raft_consensus.cc:2468] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 2.
I20260620 13:55:01.639523  5278 catalog_manager.cc:5696] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca reported cstate change: term changed from 1 to 2, leader changed from 617fb28b87054fdf87601ac234d57adb (127.4.155.194) to ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193). New cstate: current_term: 2 leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:01.661801  5684 raft_consensus.cc:993] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb: : Instructing follower ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:55:01.662238  5684 raft_consensus.cc:1081] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Signalling peer ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:55:01.663727  5378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19b1a2c08ac34521a95698ec62d6ab76"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:47284
I20260620 13:55:01.664263  5378 raft_consensus.cc:493] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:01.664532  5378 raft_consensus.cc:3060] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:01.668843  5378 raft_consensus.cc:515] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:01.670260  5378 leader_election.cc:290] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 2 election: Requested vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:55:01.671090  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b1a2c08ac34521a95698ec62d6ab76" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:55:01.671161  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b1a2c08ac34521a95698ec62d6ab76" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:55:01.671780  5455 raft_consensus.cc:3055] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:01.671881  5529 raft_consensus.cc:3060] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:01.672089  5455 raft_consensus.cc:740] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Running, Role: LEADER
I20260620 13:55:01.672868  5455 consensus_queue.cc:260] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:01.673846  5455 raft_consensus.cc:3060] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:01.677023  5529 raft_consensus.cc:2468] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 2.
I20260620 13:55:01.678294  5344 leader_election.cc:304] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bc05a64f797432599d7670f8384e583, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:55:01.678928  5455 raft_consensus.cc:2468] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 2.
I20260620 13:55:01.679026  5681 raft_consensus.cc:2804] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:01.679610  5681 raft_consensus.cc:697] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Becoming Leader. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:55:01.680635  5681 consensus_queue.cc:237] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:01.687458  5278 catalog_manager.cc:5696] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca reported cstate change: term changed from 1 to 2, leader changed from 617fb28b87054fdf87601ac234d57adb (127.4.155.194) to ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193). New cstate: current_term: 2 leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:01.844981  5685 raft_consensus.cc:993] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583: : Instructing follower ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:55:01.845445  5685 raft_consensus.cc:1081] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 3 LEADER]: Signalling peer ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:55:01.847172  5378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:47268
I20260620 13:55:01.847625  5378 raft_consensus.cc:493] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:01.847886  5378 raft_consensus.cc:3060] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:55:01.853199  5378 raft_consensus.cc:515] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:01.854926  5378 leader_election.cc:290] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 4 election: Requested vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:55:01.856010  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:55:01.856032  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a1bb1d40241f4b648f57287b7a4c0" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:55:01.856689  5455 raft_consensus.cc:3060] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:55:01.856689  5529 raft_consensus.cc:3055] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:55:01.857193  5529 raft_consensus.cc:740] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Running, Role: LEADER
I20260620 13:55:01.857962  5529 consensus_queue.cc:260] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:01.859124  5529 raft_consensus.cc:3060] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:55:01.863219  5455 raft_consensus.cc:2468] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 4.
I20260620 13:55:01.864526  5345 leader_election.cc:304] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:55:01.865167  5529 raft_consensus.cc:2468] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 4.
I20260620 13:55:01.865337  5681 raft_consensus.cc:2804] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:55:01.865851  5681 raft_consensus.cc:697] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 4 LEADER]: Becoming Leader. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:55:01.866730  5681 consensus_queue.cc:237] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:01.874953  5278 catalog_manager.cc:5696] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca reported cstate change: term changed from 3 to 4, leader changed from 6bc05a64f797432599d7670f8384e583 (127.4.155.195) to ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193). New cstate: current_term: 4 leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:01.991343  5696 raft_consensus.cc:993] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583: : Instructing follower ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:55:01.991853  5685 raft_consensus.cc:1081] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 3 LEADER]: Signalling peer ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:55:01.993387  5378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:47268
I20260620 13:55:01.993914  5378 raft_consensus.cc:493] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:01.994189  5378 raft_consensus.cc:3060] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:55:01.999904  5378 raft_consensus.cc:515] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:02.001647  5378 leader_election.cc:290] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 4 election: Requested vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:55:02.002558  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:55:02.002650  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:55:02.003053  5455 raft_consensus.cc:3060] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:55:02.003202  5529 raft_consensus.cc:3055] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:55:02.003516  5529 raft_consensus.cc:740] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Running, Role: LEADER
I20260620 13:55:02.004082  5529 consensus_queue.cc:260] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:02.005151  5529 raft_consensus.cc:3060] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:55:02.006558  5689 raft_consensus.cc:993] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb: : Instructing follower ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:55:02.007005  5684 raft_consensus.cc:1081] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 2 LEADER]: Signalling peer ee9a7b222fbf4486ab305e75776b3aca to start an election
I20260620 13:55:02.008635  5378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "003980ade3d545058353e551fcf2b30e"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
 from {username='slave'} at 127.0.0.1:47284
I20260620 13:55:02.009260  5378 raft_consensus.cc:493] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:02.009402  5455 raft_consensus.cc:2468] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 4.
I20260620 13:55:02.009610  5378 raft_consensus.cc:3060] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:02.010454  5345 leader_election.cc:304] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:55:02.010989  5529 raft_consensus.cc:2468] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 4.
I20260620 13:55:02.011255  5681 raft_consensus.cc:2804] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:55:02.011701  5681 raft_consensus.cc:697] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 4 LEADER]: Becoming Leader. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:55:02.012531  5681 consensus_queue.cc:237] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:02.015417  5378 raft_consensus.cc:515] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:02.017733  5378 leader_election.cc:290] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 3 election: Requested vote from peers 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:55:02.018654  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003980ade3d545058353e551fcf2b30e" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:55:02.018956  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003980ade3d545058353e551fcf2b30e" candidate_uuid: "ee9a7b222fbf4486ab305e75776b3aca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:55:02.019223  5529 raft_consensus.cc:3060] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:02.019503  5455 raft_consensus.cc:3055] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:55:02.019778  5455 raft_consensus.cc:740] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Running, Role: LEADER
I20260620 13:55:02.019853  5278 catalog_manager.cc:5696] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca reported cstate change: term changed from 3 to 4, leader changed from 6bc05a64f797432599d7670f8384e583 (127.4.155.195) to ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193). New cstate: current_term: 4 leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:02.020573  5455 consensus_queue.cc:260] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:02.021737  5455 raft_consensus.cc:3060] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:02.025437  5529 raft_consensus.cc:2468] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 3.
I20260620 13:55:02.027640  5455 raft_consensus.cc:2468] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9a7b222fbf4486ab305e75776b3aca in term 3.
I20260620 13:55:02.028443  5344 leader_election.cc:304] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bc05a64f797432599d7670f8384e583, ee9a7b222fbf4486ab305e75776b3aca; no voters: 
I20260620 13:55:02.029261  5681 raft_consensus.cc:2804] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:55:02.029701  5681 raft_consensus.cc:697] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 3 LEADER]: Becoming Leader. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:55:02.030421  5681 consensus_queue.cc:237] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:02.037178  5278 catalog_manager.cc:5696] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca reported cstate change: term changed from 2 to 3, leader changed from 617fb28b87054fdf87601ac234d57adb (127.4.155.194) to ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193). New cstate: current_term: 3 leader_uuid: "ee9a7b222fbf4486ab305e75776b3aca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:02.062139  5529 raft_consensus.cc:1275] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:02.063253  5681 consensus_queue.cc:1048] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:02.072278  5455 raft_consensus.cc:1275] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:02.076135  5455 raft_consensus.cc:1275] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:02.075968  5681 consensus_queue.cc:1048] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:02.079303  5681 consensus_queue.cc:1048] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:02.095932  5529 raft_consensus.cc:1275] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:02.097715  5688 consensus_queue.cc:1048] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:02.423333  5528 raft_consensus.cc:1275] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 4 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:55:02.424790  5701 consensus_queue.cc:1048] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:02.435393  5455 raft_consensus.cc:1275] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 4 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:55:02.438122  5701 consensus_queue.cc:1048] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:02.440110  5528 raft_consensus.cc:1275] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 4 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:55:02.441428  5681 consensus_queue.cc:1048] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:02.452899  5455 raft_consensus.cc:1275] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 4 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:55:02.454535  5688 consensus_queue.cc:1048] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:02.488871  5455 raft_consensus.cc:1275] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 3 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:55:02.490236  5688 consensus_queue.cc:1048] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:02.501667  5528 raft_consensus.cc:1275] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 3 FOLLOWER]: Refusing update from remote peer ee9a7b222fbf4486ab305e75776b3aca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:55:02.503029  5707 consensus_queue.cc:1048] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:04.620239  4719 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260620 13:55:04.620865  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:04.629341  5378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "003980ade3d545058353e551fcf2b30e"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
mode: GRACEFUL
new_leader_uuid: "6bc05a64f797432599d7670f8384e583"
 from {username='slave'} at 127.0.0.1:47316
I20260620 13:55:04.629891  5378 raft_consensus.cc:606] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 3 LEADER]: Received request to transfer leadership to TS 6bc05a64f797432599d7670f8384e583
I20260620 13:55:04.633314  5378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "078959e5186647538a9f35d46354ace3"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
mode: GRACEFUL
new_leader_uuid: "617fb28b87054fdf87601ac234d57adb"
 from {username='slave'} at 127.0.0.1:47316
I20260620 13:55:04.633985  5378 raft_consensus.cc:606] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 1 LEADER]: Received request to transfer leadership to TS 617fb28b87054fdf87601ac234d57adb
I20260620 13:55:04.636363  5378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2f6cff325ad4e58a71efef78228a150"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
mode: GRACEFUL
new_leader_uuid: "617fb28b87054fdf87601ac234d57adb"
 from {username='slave'} at 127.0.0.1:47316
I20260620 13:55:04.636854  5378 raft_consensus.cc:606] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Received request to transfer leadership to TS 617fb28b87054fdf87601ac234d57adb
I20260620 13:55:04.639276  5378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773"
dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
mode: GRACEFUL
new_leader_uuid: "6bc05a64f797432599d7670f8384e583"
 from {username='slave'} at 127.0.0.1:47316
I20260620 13:55:04.639721  5378 raft_consensus.cc:606] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 4 LEADER]: Received request to transfer leadership to TS 6bc05a64f797432599d7670f8384e583
I20260620 13:55:04.640733  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260620 13:55:04.641332  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:04.801940  5715 raft_consensus.cc:993] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca: : Instructing follower 617fb28b87054fdf87601ac234d57adb to start an election
I20260620 13:55:04.802448  5681 raft_consensus.cc:1081] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 1 LEADER]: Signalling peer 617fb28b87054fdf87601ac234d57adb to start an election
I20260620 13:55:04.803870  5455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "078959e5186647538a9f35d46354ace3"
dest_uuid: "617fb28b87054fdf87601ac234d57adb"
 from {username='slave'} at 127.0.0.1:35994
I20260620 13:55:04.804291  5455 raft_consensus.cc:493] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:04.804517  5455 raft_consensus.cc:3060] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:04.809345  5455 raft_consensus.cc:515] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:04.811801  5455 leader_election.cc:290] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 2 election: Requested vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:55:04.812716  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078959e5186647538a9f35d46354ace3" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
I20260620 13:55:04.813040  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078959e5186647538a9f35d46354ace3" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:55:04.813271  5378 raft_consensus.cc:3055] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:04.813684  5378 raft_consensus.cc:740] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:55:04.813679  5529 raft_consensus.cc:3060] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:04.814640  5378 consensus_queue.cc:260] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:04.815832  5378 raft_consensus.cc:3060] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:04.818836  5529 raft_consensus.cc:2468] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 2.
I20260620 13:55:04.820058  5419 leader_election.cc:304] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583; no voters: 
I20260620 13:55:04.820785  5684 raft_consensus.cc:2804] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:04.821787  5684 raft_consensus.cc:697] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [term 2 LEADER]: Becoming Leader. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Running, Role: LEADER
I20260620 13:55:04.822150  5378 raft_consensus.cc:2468] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 2.
I20260620 13:55:04.822650  5684 consensus_queue.cc:237] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:04.829692  5277 catalog_manager.cc:5696] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb reported cstate change: term changed from 1 to 2, leader changed from ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193) to 617fb28b87054fdf87601ac234d57adb (127.4.155.194). New cstate: current_term: 2 leader_uuid: "617fb28b87054fdf87601ac234d57adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:04.922668  5715 raft_consensus.cc:993] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca: : Instructing follower 617fb28b87054fdf87601ac234d57adb to start an election
I20260620 13:55:04.923087  5681 raft_consensus.cc:1081] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Signalling peer 617fb28b87054fdf87601ac234d57adb to start an election
I20260620 13:55:04.924360  5455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2f6cff325ad4e58a71efef78228a150"
dest_uuid: "617fb28b87054fdf87601ac234d57adb"
 from {username='slave'} at 127.0.0.1:35994
I20260620 13:55:04.924794  5455 raft_consensus.cc:493] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:04.925021  5455 raft_consensus.cc:3060] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:04.929360  5455 raft_consensus.cc:515] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:04.930896  5455 leader_election.cc:290] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 3 election: Requested vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 6bc05a64f797432599d7670f8384e583 (127.4.155.195:36475)
I20260620 13:55:04.931586  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f6cff325ad4e58a71efef78228a150" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
I20260620 13:55:04.931830  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f6cff325ad4e58a71efef78228a150" candidate_uuid: "617fb28b87054fdf87601ac234d57adb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6bc05a64f797432599d7670f8384e583"
I20260620 13:55:04.932133  5378 raft_consensus.cc:3055] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:55:04.932291  5529 raft_consensus.cc:3060] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:04.932454  5378 raft_consensus.cc:740] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:55:04.932582  5715 raft_consensus.cc:993] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca: : Instructing follower 6bc05a64f797432599d7670f8384e583 to start an election
I20260620 13:55:04.933247  5715 raft_consensus.cc:1081] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 4 LEADER]: Signalling peer 6bc05a64f797432599d7670f8384e583 to start an election
I20260620 13:55:04.933423  5378 consensus_queue.cc:260] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:04.934820  5378 raft_consensus.cc:3060] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:04.935230  5528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773"
dest_uuid: "6bc05a64f797432599d7670f8384e583"
 from {username='slave'} at 127.0.0.1:56700
I20260620 13:55:04.935770  5528 raft_consensus.cc:493] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:04.936098  5528 raft_consensus.cc:3060] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:55:04.939314  5529 raft_consensus.cc:2468] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 3.
I20260620 13:55:04.940482  5419 leader_election.cc:304] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583; no voters: 
I20260620 13:55:04.941016  5528 raft_consensus.cc:515] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:04.941299  5684 raft_consensus.cc:2804] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:55:04.941771  5378 raft_consensus.cc:2468] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617fb28b87054fdf87601ac234d57adb in term 3.
I20260620 13:55:04.941910  5684 raft_consensus.cc:697] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 3 LEADER]: Becoming Leader. State: Replica: 617fb28b87054fdf87601ac234d57adb, State: Running, Role: LEADER
I20260620 13:55:04.942876  5684 consensus_queue.cc:237] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:04.943858  5528 leader_election.cc:290] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 5 election: Requested vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325)
I20260620 13:55:04.944826  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
I20260620 13:55:04.945276  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff1f5fdaf54fb98b233b319e5df773" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:55:04.945564  5378 raft_consensus.cc:3055] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:55:04.945775  5455 raft_consensus.cc:3060] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:55:04.945899  5378 raft_consensus.cc:740] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:55:04.946655  5378 consensus_queue.cc:260] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:04.947880  5378 raft_consensus.cc:3060] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:55:04.951742  5277 catalog_manager.cc:5696] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb reported cstate change: term changed from 2 to 3, leader changed from ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193) to 617fb28b87054fdf87601ac234d57adb (127.4.155.194). New cstate: current_term: 3 leader_uuid: "617fb28b87054fdf87601ac234d57adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:04.952244  5455 raft_consensus.cc:2468] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 5.
I20260620 13:55:04.953557  5494 leader_election.cc:304] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583; no voters: 
I20260620 13:55:04.954332  5685 raft_consensus.cc:2804] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:55:04.954464  5378 raft_consensus.cc:2468] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 5.
I20260620 13:55:04.955804  5685 raft_consensus.cc:697] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 5 LEADER]: Becoming Leader. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Running, Role: LEADER
I20260620 13:55:04.956648  5685 consensus_queue.cc:237] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:04.965081  5277 catalog_manager.cc:5696] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 reported cstate change: term changed from 4 to 5, leader changed from ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193) to 6bc05a64f797432599d7670f8384e583 (127.4.155.195). New cstate: current_term: 5 leader_uuid: "6bc05a64f797432599d7670f8384e583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:05.048471  5715 raft_consensus.cc:993] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca: : Instructing follower 6bc05a64f797432599d7670f8384e583 to start an election
I20260620 13:55:05.048961  5715 raft_consensus.cc:1081] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 3 LEADER]: Signalling peer 6bc05a64f797432599d7670f8384e583 to start an election
I20260620 13:55:05.050355  5528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "003980ade3d545058353e551fcf2b30e"
dest_uuid: "6bc05a64f797432599d7670f8384e583"
 from {username='slave'} at 127.0.0.1:56700
I20260620 13:55:05.050822  5528 raft_consensus.cc:493] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:05.051157  5528 raft_consensus.cc:3060] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:55:05.056123  5528 raft_consensus.cc:515] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:05.057610  5528 leader_election.cc:290] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 4 election: Requested vote from peers ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455), 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325)
I20260620 13:55:05.058524  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003980ade3d545058353e551fcf2b30e" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ee9a7b222fbf4486ab305e75776b3aca"
I20260620 13:55:05.058633  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003980ade3d545058353e551fcf2b30e" candidate_uuid: "6bc05a64f797432599d7670f8384e583" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "617fb28b87054fdf87601ac234d57adb"
I20260620 13:55:05.059001  5378 raft_consensus.cc:3055] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:55:05.059211  5455 raft_consensus.cc:3060] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:55:05.059346  5378 raft_consensus.cc:740] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee9a7b222fbf4486ab305e75776b3aca, State: Running, Role: LEADER
I20260620 13:55:05.059998  5378 consensus_queue.cc:260] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:05.060815  5378 raft_consensus.cc:3060] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:55:05.063546  5455 raft_consensus.cc:2468] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 4.
I20260620 13:55:05.064474  5494 leader_election.cc:304] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617fb28b87054fdf87601ac234d57adb, 6bc05a64f797432599d7670f8384e583; no voters: 
I20260620 13:55:05.065194  5685 raft_consensus.cc:2804] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:55:05.065532  5378 raft_consensus.cc:2468] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc05a64f797432599d7670f8384e583 in term 4.
I20260620 13:55:05.065583  5685 raft_consensus.cc:697] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 4 LEADER]: Becoming Leader. State: Replica: 6bc05a64f797432599d7670f8384e583, State: Running, Role: LEADER
I20260620 13:55:05.066728  5685 consensus_queue.cc:237] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } }
I20260620 13:55:05.073546  5277 catalog_manager.cc:5696] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 reported cstate change: term changed from 3 to 4, leader changed from ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193) to 6bc05a64f797432599d7670f8384e583 (127.4.155.195). New cstate: current_term: 4 leader_uuid: "6bc05a64f797432599d7670f8384e583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:05.261869  5528 raft_consensus.cc:1275] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Refusing update from remote peer 617fb28b87054fdf87601ac234d57adb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:05.263064  5684 consensus_queue.cc:1048] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:05.273975  5378 raft_consensus.cc:1275] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Refusing update from remote peer 617fb28b87054fdf87601ac234d57adb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:05.276193  5716 consensus_queue.cc:1048] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:05.330621  5378 raft_consensus.cc:1275] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 3 FOLLOWER]: Refusing update from remote peer 617fb28b87054fdf87601ac234d57adb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:55:05.331887  5729 consensus_queue.cc:1048] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:05.342352  5528 raft_consensus.cc:1275] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 3 FOLLOWER]: Refusing update from remote peer 617fb28b87054fdf87601ac234d57adb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:55:05.344342  5684 consensus_queue.cc:1048] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc05a64f797432599d7670f8384e583" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:05.372772  5378 raft_consensus.cc:1275] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 5 FOLLOWER]: Refusing update from remote peer 6bc05a64f797432599d7670f8384e583: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260620 13:55:05.376152  5685 consensus_queue.cc:1048] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:55:05.392943  5455 raft_consensus.cc:1275] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 5 FOLLOWER]: Refusing update from remote peer 6bc05a64f797432599d7670f8384e583: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260620 13:55:05.394541  5685 consensus_queue.cc:1048] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:05.452947  5455 raft_consensus.cc:1275] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 4 FOLLOWER]: Refusing update from remote peer 6bc05a64f797432599d7670f8384e583: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:55:05.454447  5685 consensus_queue.cc:1048] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "617fb28b87054fdf87601ac234d57adb" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 46325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:05.464617  5378 raft_consensus.cc:1275] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 4 FOLLOWER]: Refusing update from remote peer 6bc05a64f797432599d7670f8384e583: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:55:05.466176  5685 consensus_queue.cc:1048] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9a7b222fbf4486ab305e75776b3aca" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:05.643157  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:05.649535  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:55:05.650038  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:06.651163  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:06.656766  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:55:06.657259  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:07.658316  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:07.664471  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:55:07.665016  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:08.666414  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:08.673439  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:55:08.673863  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:09.674857  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:09.680301  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:55:09.680760  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:10.681727  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:10.687351  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:55:10.687827  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:11.689282  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:11.694694  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:55:11.695200  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:12.696378  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:12.703680  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:55:12.704080  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:13.704991  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:13.711577  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:55:13.712180  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:14.745169  4719 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260620 13:55:14.745661  4719 tablet_server.cc:179] TabletServer@127.4.155.193:0 shutting down...
I20260620 13:55:14.778908  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:55:14.779814  4719 tablet_replica.cc:333] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca: stopping tablet replica
I20260620 13:55:14.780586  4719 raft_consensus.cc:2243] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:55:14.781690  4719 raft_consensus.cc:2272] T 12a907b6fffa4cb089ec941716ecb23e P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.783771  4719 tablet_replica.cc:333] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca: stopping tablet replica
I20260620 13:55:14.784253  4719 raft_consensus.cc:2243] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:14.784641  4719 raft_consensus.cc:2272] T 49ad12da8f8841dba69dc068b92c60e2 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.786366  4719 tablet_replica.cc:333] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca: stopping tablet replica
I20260620 13:55:14.786808  4719 raft_consensus.cc:2243] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:55:14.787597  4719 raft_consensus.cc:2272] T 19b1a2c08ac34521a95698ec62d6ab76 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.789108  4719 tablet_replica.cc:333] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca: stopping tablet replica
I20260620 13:55:14.789706  4719 raft_consensus.cc:2243] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:14.790185  4719 raft_consensus.cc:2272] T 078959e5186647538a9f35d46354ace3 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 13:55:14.792001  5419 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260620 13:55:14.792201  4719 tablet_replica.cc:333] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca: stopping tablet replica
I20260620 13:55:14.792824  4719 raft_consensus.cc:2243] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:14.793303  4719 raft_consensus.cc:2272] T 9998d988ea954edca90a6f5a3ad4c936 P ee9a7b222fbf4486ab305e75776b3aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.795853  4719 tablet_replica.cc:333] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca: stopping tablet replica
W20260620 13:55:14.796309  5419 consensus_peers.cc:597] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb -> Peer ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455): Couldn't send request to peer ee9a7b222fbf4486ab305e75776b3aca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:14.796648  4719 raft_consensus.cc:2243] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:14.797358  4719 raft_consensus.cc:2272] T a2f6cff325ad4e58a71efef78228a150 P ee9a7b222fbf4486ab305e75776b3aca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.799041  4719 tablet_replica.cc:333] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca: stopping tablet replica
I20260620 13:55:14.799566  4719 raft_consensus.cc:2243] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 4 LEADER]: Raft consensus shutting down.
I20260620 13:55:14.800258  4719 raft_consensus.cc:2272] T 738a1bb1d40241f4b648f57287b7a4c0 P ee9a7b222fbf4486ab305e75776b3aca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.802060  4719 tablet_replica.cc:333] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca: stopping tablet replica
I20260620 13:55:14.802611  4719 raft_consensus.cc:2243] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 4 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:14.803014  4719 raft_consensus.cc:2272] T 003980ade3d545058353e551fcf2b30e P ee9a7b222fbf4486ab305e75776b3aca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.804661  4719 tablet_replica.cc:333] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca: stopping tablet replica
I20260620 13:55:14.805091  4719 raft_consensus.cc:2243] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:55:14.805915  4719 raft_consensus.cc:2272] T 7ca4f9645ab748be8d9e3591e8673868 P ee9a7b222fbf4486ab305e75776b3aca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.807775  4719 tablet_replica.cc:333] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca: stopping tablet replica
I20260620 13:55:14.808174  4719 raft_consensus.cc:2243] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 5 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:14.808532  4719 raft_consensus.cc:2272] T aeff1f5fdaf54fb98b233b319e5df773 P ee9a7b222fbf4486ab305e75776b3aca [term 5 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.840157  4719 tablet_server.cc:196] TabletServer@127.4.155.193:0 shutdown complete.
I20260620 13:55:14.864282  4719 tablet_server.cc:179] TabletServer@127.4.155.194:0 shutting down...
W20260620 13:55:14.874890  5494 consensus_peers.cc:597] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 -> Peer 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325): Couldn't send request to peer 617fb28b87054fdf87601ac234d57adb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:55:14.875420  5493 consensus_peers.cc:597] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 -> Peer ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455): Couldn't send request to peer ee9a7b222fbf4486ab305e75776b3aca. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:33455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:55:14.875708  5494 consensus_peers.cc:597] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 -> Peer 617fb28b87054fdf87601ac234d57adb (127.4.155.194:46325): Couldn't send request to peer 617fb28b87054fdf87601ac234d57adb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:14.899175  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:55:14.899982  4719 tablet_replica.cc:333] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb: stopping tablet replica
I20260620 13:55:14.900609  4719 raft_consensus.cc:2243] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:14.901120  4719 raft_consensus.cc:2272] T 003980ade3d545058353e551fcf2b30e P 617fb28b87054fdf87601ac234d57adb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.902998  4719 tablet_replica.cc:333] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb: stopping tablet replica
I20260620 13:55:14.903678  4719 raft_consensus.cc:2243] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:14.904183  4719 raft_consensus.cc:2272] T 49ad12da8f8841dba69dc068b92c60e2 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.906246  4719 tablet_replica.cc:333] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb: stopping tablet replica
I20260620 13:55:14.906847  4719 raft_consensus.cc:2243] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:14.907516  4719 raft_consensus.cc:2272] T 19b1a2c08ac34521a95698ec62d6ab76 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.909335  4719 tablet_replica.cc:333] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb: stopping tablet replica
I20260620 13:55:14.910108  4719 raft_consensus.cc:2243] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:14.910734  4719 raft_consensus.cc:2272] T 738a1bb1d40241f4b648f57287b7a4c0 P 617fb28b87054fdf87601ac234d57adb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.913049  4719 tablet_replica.cc:333] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb: stopping tablet replica
I20260620 13:55:14.913866  4719 raft_consensus.cc:2243] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:14.914556  4719 raft_consensus.cc:2272] T 7ca4f9645ab748be8d9e3591e8673868 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 13:55:14.917440  5419 consensus_peers.cc:597] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb -> Peer ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455): Couldn't send request to peer ee9a7b222fbf4486ab305e75776b3aca. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:33455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:14.917703  4719 tablet_replica.cc:333] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb: stopping tablet replica
I20260620 13:55:14.918386  4719 raft_consensus.cc:2243] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:14.918807  4719 raft_consensus.cc:2272] T aeff1f5fdaf54fb98b233b319e5df773 P 617fb28b87054fdf87601ac234d57adb [term 5 FOLLOWER]: Raft consensus is shut down!
W20260620 13:55:14.919054  5493 consensus_peers.cc:597] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 -> Peer ee9a7b222fbf4486ab305e75776b3aca (127.4.155.193:33455): Couldn't send request to peer ee9a7b222fbf4486ab305e75776b3aca. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:33455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:14.920696  4719 tablet_replica.cc:333] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb: stopping tablet replica
I20260620 13:55:14.921221  4719 raft_consensus.cc:2243] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:55:14.921973  4719 raft_consensus.cc:2272] T 9998d988ea954edca90a6f5a3ad4c936 P 617fb28b87054fdf87601ac234d57adb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.923761  4719 tablet_replica.cc:333] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb: stopping tablet replica
I20260620 13:55:14.924248  4719 raft_consensus.cc:2243] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:55:14.924981  4719 raft_consensus.cc:2272] T a2f6cff325ad4e58a71efef78228a150 P 617fb28b87054fdf87601ac234d57adb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.926730  4719 tablet_replica.cc:333] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb: stopping tablet replica
I20260620 13:55:14.927284  4719 raft_consensus.cc:2243] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:14.927716  4719 raft_consensus.cc:2272] T 12a907b6fffa4cb089ec941716ecb23e P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.929342  4719 tablet_replica.cc:333] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb: stopping tablet replica
I20260620 13:55:14.929792  4719 raft_consensus.cc:2243] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:55:14.930476  4719 raft_consensus.cc:2272] T 078959e5186647538a9f35d46354ace3 P 617fb28b87054fdf87601ac234d57adb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:14.961591  4719 tablet_server.cc:196] TabletServer@127.4.155.194:0 shutdown complete.
I20260620 13:55:14.981141  4719 tablet_server.cc:179] TabletServer@127.4.155.195:0 shutting down...
I20260620 13:55:15.008698  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:55:15.009446  4719 tablet_replica.cc:333] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583: stopping tablet replica
I20260620 13:55:15.010116  4719 raft_consensus.cc:2243] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 4 LEADER]: Raft consensus shutting down.
I20260620 13:55:15.010815  4719 raft_consensus.cc:2272] T 003980ade3d545058353e551fcf2b30e P 6bc05a64f797432599d7670f8384e583 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:15.012560  4719 tablet_replica.cc:333] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583: stopping tablet replica
I20260620 13:55:15.013190  4719 raft_consensus.cc:2243] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:55:15.014048  4719 raft_consensus.cc:2272] T 49ad12da8f8841dba69dc068b92c60e2 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:15.015901  4719 tablet_replica.cc:333] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583: stopping tablet replica
I20260620 13:55:15.016455  4719 raft_consensus.cc:2243] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:15.016872  4719 raft_consensus.cc:2272] T 19b1a2c08ac34521a95698ec62d6ab76 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:15.018607  4719 tablet_replica.cc:333] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583: stopping tablet replica
I20260620 13:55:15.019279  4719 raft_consensus.cc:2243] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:15.019918  4719 raft_consensus.cc:2272] T 078959e5186647538a9f35d46354ace3 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:15.022171  4719 tablet_replica.cc:333] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583: stopping tablet replica
I20260620 13:55:15.022840  4719 raft_consensus.cc:2243] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:15.023433  4719 raft_consensus.cc:2272] T 7ca4f9645ab748be8d9e3591e8673868 P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:15.025652  4719 tablet_replica.cc:333] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583: stopping tablet replica
I20260620 13:55:15.026330  4719 raft_consensus.cc:2243] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 5 LEADER]: Raft consensus shutting down.
I20260620 13:55:15.027027  4719 raft_consensus.cc:2272] T aeff1f5fdaf54fb98b233b319e5df773 P 6bc05a64f797432599d7670f8384e583 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:15.028908  4719 tablet_replica.cc:333] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583: stopping tablet replica
I20260620 13:55:15.029407  4719 raft_consensus.cc:2243] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:15.029856  4719 raft_consensus.cc:2272] T 12a907b6fffa4cb089ec941716ecb23e P 6bc05a64f797432599d7670f8384e583 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:15.031612  4719 tablet_replica.cc:333] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583: stopping tablet replica
I20260620 13:55:15.032083  4719 raft_consensus.cc:2243] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:15.032583  4719 raft_consensus.cc:2272] T 738a1bb1d40241f4b648f57287b7a4c0 P 6bc05a64f797432599d7670f8384e583 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:15.034458  4719 tablet_replica.cc:333] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583: stopping tablet replica
I20260620 13:55:15.034960  4719 raft_consensus.cc:2243] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:15.035454  4719 raft_consensus.cc:2272] T 9998d988ea954edca90a6f5a3ad4c936 P 6bc05a64f797432599d7670f8384e583 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:15.037129  4719 tablet_replica.cc:333] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583: stopping tablet replica
I20260620 13:55:15.037575  4719 raft_consensus.cc:2243] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:15.037973  4719 raft_consensus.cc:2272] T a2f6cff325ad4e58a71efef78228a150 P 6bc05a64f797432599d7670f8384e583 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:15.068001  4719 tablet_server.cc:196] TabletServer@127.4.155.195:0 shutdown complete.
I20260620 13:55:15.088433  4719 master.cc:562] Master@127.4.155.254:34205 shutting down...
I20260620 13:55:15.113132  4719 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:55:15.113837  4719 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:15.114131  4719 tablet_replica.cc:333] T 00000000000000000000000000000000 P 10cd943d3034409394a1456ebce789d5: stopping tablet replica
I20260620 13:55:15.134343  4719 master.cc:584] Master@127.4.155.254:34205 shutdown complete.
617fb28b87054fdf87601ac234d57adb  4
6bc05a64f797432599d7670f8384e583  1
ee9a7b222fbf4486ab305e75776b3aca  5
617fb28b87054fdf87601ac234d57adb  4
6bc05a64f797432599d7670f8384e583  3
ee9a7b222fbf4486ab305e75776b3aca  3
617fb28b87054fdf87601ac234d57adb  1
6bc05a64f797432599d7670f8384e583  1
ee9a7b222fbf4486ab305e75776b3aca  8
617fb28b87054fdf87601ac234d57adb  3
6bc05a64f797432599d7670f8384e583  3
ee9a7b222fbf4486ab305e75776b3aca  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28704 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260620 13:55:15.178967  4719 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.155.254:37547
I20260620 13:55:15.180817  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:55:15.190163  5756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:55:15.191155  5759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:55:15.191250  5757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:55:15.192253  4719 server_base.cc:1061] running on GCE node
I20260620 13:55:15.193491  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:55:15.193761  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:55:15.193939  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963715193923 us; error 0 us; skew 500 ppm
I20260620 13:55:15.194624  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:55:15.197455  4719 webserver.cc:533] Webserver started at http://127.4.155.254:34321/ using document root <none> and password file <none>
I20260620 13:55:15.198159  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:55:15.198410  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:55:15.198747  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:55:15.200500  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/master-0-root/instance:
uuid: "7635bbf8f82045f99dd7ac0f4a911859"
format_stamp: "Formatted at 2026-06-20 13:55:15 on dist-test-slave-n70f"
I20260620 13:55:15.206336  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260620 13:55:15.211850  5764 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:55:15.212731  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260620 13:55:15.213117  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/master-0-root
uuid: "7635bbf8f82045f99dd7ac0f4a911859"
format_stamp: "Formatted at 2026-06-20 13:55:15 on dist-test-slave-n70f"
I20260620 13:55:15.213543  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:55:15.224896  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:55:15.226177  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:55:15.268790  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.254:37547
I20260620 13:55:15.268888  5815 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.254:37547 every 8 connection(s)
I20260620 13:55:15.272732  5816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:15.282938  5816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: Bootstrap starting.
I20260620 13:55:15.287613  5816 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:15.291762  5816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: No bootstrap required, opened a new log
I20260620 13:55:15.293852  5816 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7635bbf8f82045f99dd7ac0f4a911859" member_type: VOTER }
I20260620 13:55:15.294221  5816 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:15.294489  5816 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7635bbf8f82045f99dd7ac0f4a911859, State: Initialized, Role: FOLLOWER
I20260620 13:55:15.295163  5816 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7635bbf8f82045f99dd7ac0f4a911859" member_type: VOTER }
I20260620 13:55:15.295639  5816 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 13:55:15.295874  5816 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 13:55:15.296168  5816 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:15.300318  5816 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7635bbf8f82045f99dd7ac0f4a911859" member_type: VOTER }
I20260620 13:55:15.300860  5816 leader_election.cc:304] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7635bbf8f82045f99dd7ac0f4a911859; no voters: 
I20260620 13:55:15.302142  5816 leader_election.cc:290] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 13:55:15.302711  5819 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:15.304121  5819 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [term 1 LEADER]: Becoming Leader. State: Replica: 7635bbf8f82045f99dd7ac0f4a911859, State: Running, Role: LEADER
I20260620 13:55:15.304853  5819 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7635bbf8f82045f99dd7ac0f4a911859" member_type: VOTER }
I20260620 13:55:15.305212  5816 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 13:55:15.309547  5820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7635bbf8f82045f99dd7ac0f4a911859" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7635bbf8f82045f99dd7ac0f4a911859" member_type: VOTER } }
I20260620 13:55:15.310141  5820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [sys.catalog]: This master's current role is: LEADER
I20260620 13:55:15.312215  5827 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260620 13:55:15.311985  5821 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7635bbf8f82045f99dd7ac0f4a911859. Latest consensus state: current_term: 1 leader_uuid: "7635bbf8f82045f99dd7ac0f4a911859" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7635bbf8f82045f99dd7ac0f4a911859" member_type: VOTER } }
I20260620 13:55:15.312633  5821 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [sys.catalog]: This master's current role is: LEADER
I20260620 13:55:15.317656  5827 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260620 13:55:15.320896  4719 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 13:55:15.326877  5827 catalog_manager.cc:1382] Generated new cluster ID: f7a5faaaaeef43ca8ef7c60dff10e265
I20260620 13:55:15.327219  5827 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260620 13:55:15.347852  5827 catalog_manager.cc:1405] Generated new certificate authority record
I20260620 13:55:15.349115  5827 catalog_manager.cc:1539] Loading token signing keys...
I20260620 13:55:15.362919  5827 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: Generated new TSK 0
I20260620 13:55:15.363586  5827 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260620 13:55:15.401464  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:55:15.409816  5839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:55:15.409759  5838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:55:15.411540  5841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:55:15.412109  4719 server_base.cc:1061] running on GCE node
I20260620 13:55:15.413180  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:55:15.413417  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:55:15.413599  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963715413566 us; error 0 us; skew 500 ppm
I20260620 13:55:15.414243  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:55:15.417255  4719 webserver.cc:533] Webserver started at http://127.4.155.193:35571/ using document root <none> and password file <none>
I20260620 13:55:15.417781  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:55:15.418020  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:55:15.418489  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:55:15.419992  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/instance:
uuid: "2e82c0c231624695ac5a813230bf5038"
format_stamp: "Formatted at 2026-06-20 13:55:15 on dist-test-slave-n70f"
I20260620 13:55:15.424868  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260620 13:55:15.428632  5846 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:55:15.429627  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260620 13:55:15.429981  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root
uuid: "2e82c0c231624695ac5a813230bf5038"
format_stamp: "Formatted at 2026-06-20 13:55:15 on dist-test-slave-n70f"
I20260620 13:55:15.430335  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:55:15.450400  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:55:15.452009  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:55:15.453747  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:55:15.456271  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:55:15.456518  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:55:15.456820  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:55:15.457032  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:55:15.503387  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.193:46177
I20260620 13:55:15.503494  5908 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.193:46177 every 8 connection(s)
I20260620 13:55:15.509009  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:55:15.517867  5913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:55:15.519064  5914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:55:15.522279  4719 server_base.cc:1061] running on GCE node
I20260620 13:55:15.523872  5909 heartbeater.cc:344] Connected to a master server at 127.4.155.254:37547
I20260620 13:55:15.524334  5909 heartbeater.cc:461] Registering TS with master...
W20260620 13:55:15.524654  5916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:55:15.525470  5909 heartbeater.cc:507] Master 127.4.155.254:37547 requested a full tablet report, sending...
I20260620 13:55:15.525580  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:55:15.525915  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:55:15.526108  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963715526054 us; error 0 us; skew 500 ppm
I20260620 13:55:15.527077  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:55:15.529032  5781 ts_manager.cc:194] Registered new tserver with Master: 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:55:15.531484  4719 webserver.cc:533] Webserver started at http://127.4.155.194:44899/ using document root <none> and password file <none>
I20260620 13:55:15.532148  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:55:15.532012  5781 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56594
I20260620 13:55:15.532727  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:55:15.533288  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:55:15.534888  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/instance:
uuid: "192c750f597c43858e1ad09e8d805685"
format_stamp: "Formatted at 2026-06-20 13:55:15 on dist-test-slave-n70f"
I20260620 13:55:15.539844  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260620 13:55:15.543604  5921 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:55:15.544723  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260620 13:55:15.545104  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root
uuid: "192c750f597c43858e1ad09e8d805685"
format_stamp: "Formatted at 2026-06-20 13:55:15 on dist-test-slave-n70f"
I20260620 13:55:15.545404  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:55:15.563735  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:55:15.565064  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:55:15.566694  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:55:15.569135  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:55:15.569375  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:55:15.569635  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:55:15.569820  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:55:15.615885  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.194:38517
I20260620 13:55:15.615950  5983 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.194:38517 every 8 connection(s)
I20260620 13:55:15.620698  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:55:15.629207  5987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:55:15.629424  5988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:55:15.633252  4719 server_base.cc:1061] running on GCE node
W20260620 13:55:15.633868  5990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:55:15.635038  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:55:15.635339  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:55:15.635569  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963715635551 us; error 0 us; skew 500 ppm
I20260620 13:55:15.635617  5984 heartbeater.cc:344] Connected to a master server at 127.4.155.254:37547
I20260620 13:55:15.636056  5984 heartbeater.cc:461] Registering TS with master...
I20260620 13:55:15.636230  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:55:15.636821  5984 heartbeater.cc:507] Master 127.4.155.254:37547 requested a full tablet report, sending...
I20260620 13:55:15.639048  4719 webserver.cc:533] Webserver started at http://127.4.155.195:34975/ using document root <none> and password file <none>
I20260620 13:55:15.639480  5781 ts_manager.cc:194] Registered new tserver with Master: 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:15.639747  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:55:15.640002  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:55:15.640307  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:55:15.641336  5781 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56610
I20260620 13:55:15.641939  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/instance:
uuid: "663684cf4ae54c929bf8240ca0b63a47"
format_stamp: "Formatted at 2026-06-20 13:55:15 on dist-test-slave-n70f"
I20260620 13:55:15.646827  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260620 13:55:15.650358  5995 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:55:15.651207  4719 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260620 13:55:15.651473  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root
uuid: "663684cf4ae54c929bf8240ca0b63a47"
format_stamp: "Formatted at 2026-06-20 13:55:15 on dist-test-slave-n70f"
I20260620 13:55:15.651783  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:55:15.662387  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:55:15.663681  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:55:15.665637  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:55:15.667922  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:55:15.668161  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:55:15.668411  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:55:15.668586  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:55:15.711567  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.195:41493
I20260620 13:55:15.711659  6057 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.195:41493 every 8 connection(s)
I20260620 13:55:15.725756  6058 heartbeater.cc:344] Connected to a master server at 127.4.155.254:37547
I20260620 13:55:15.726177  6058 heartbeater.cc:461] Registering TS with master...
I20260620 13:55:15.727245  6058 heartbeater.cc:507] Master 127.4.155.254:37547 requested a full tablet report, sending...
I20260620 13:55:15.729451  5781 ts_manager.cc:194] Registered new tserver with Master: 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:15.730178  4719 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015793219s
I20260620 13:55:15.731053  5781 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56624
I20260620 13:55:15.760264  5781 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56628:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260620 13:55:15.767241  5781 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 13:55:15.989084  6023 tablet_service.cc:1511] Processing CreateTablet for tablet 52b97878e9ad465684082e7bf1c482ad (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260620 13:55:15.989516  5948 tablet_service.cc:1511] Processing CreateTablet for tablet ed1d1d20a2be4ceeb9389e7e3dbd2b5b (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260620 13:55:15.990732  6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b97878e9ad465684082e7bf1c482ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:15.990839  6020 tablet_service.cc:1511] Processing CreateTablet for tablet 649259d8acc1429d8dddd2677f87f911 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260620 13:55:15.997762  6021 tablet_service.cc:1511] Processing CreateTablet for tablet 8c5eb52b96b44f7cb3569bfff54e9b1c (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260620 13:55:16.003782  5942 tablet_service.cc:1511] Processing CreateTablet for tablet fb8edcc5cb024ebebdb3cac403f19bc4 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260620 13:55:16.006492  6020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649259d8acc1429d8dddd2677f87f911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:15.994482  5946 tablet_service.cc:1511] Processing CreateTablet for tablet 649259d8acc1429d8dddd2677f87f911 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260620 13:55:16.008715  6018 tablet_service.cc:1511] Processing CreateTablet for tablet 8dbd1edec8054c1ba05721321572fbbf (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260620 13:55:15.998946  5949 tablet_service.cc:1511] Processing CreateTablet for tablet 52b97878e9ad465684082e7bf1c482ad (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260620 13:55:15.996491  6022 tablet_service.cc:1511] Processing CreateTablet for tablet ed1d1d20a2be4ceeb9389e7e3dbd2b5b (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260620 13:55:15.995754  5945 tablet_service.cc:1511] Processing CreateTablet for tablet e8078a89b618482f8e4978c463747569 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260620 13:55:15.997051  5944 tablet_service.cc:1511] Processing CreateTablet for tablet 8dbd1edec8054c1ba05721321572fbbf (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260620 13:55:16.010110  6018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dbd1edec8054c1ba05721321572fbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:15.990922  5948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed1d1d20a2be4ceeb9389e7e3dbd2b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.010954  5944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dbd1edec8054c1ba05721321572fbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:15.997386  5943 tablet_service.cc:1511] Processing CreateTablet for tablet efd3e1f0e5a34ba69029888abcdfb2f1 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260620 13:55:15.992276  5947 tablet_service.cc:1511] Processing CreateTablet for tablet 8c5eb52b96b44f7cb3569bfff54e9b1c (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260620 13:55:16.013697  6017 tablet_service.cc:1511] Processing CreateTablet for tablet efd3e1f0e5a34ba69029888abcdfb2f1 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260620 13:55:16.013943  5941 tablet_service.cc:1511] Processing CreateTablet for tablet 115c5e2556794dd8801d1f451aa245fb (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260620 13:55:16.013003  5942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8edcc5cb024ebebdb3cac403f19bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.015164  6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed1d1d20a2be4ceeb9389e7e3dbd2b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.015287  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b97878e9ad465684082e7bf1c482ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.016639  5946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649259d8acc1429d8dddd2677f87f911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.016410  6016 tablet_service.cc:1511] Processing CreateTablet for tablet fb8edcc5cb024ebebdb3cac403f19bc4 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260620 13:55:15.997498  6019 tablet_service.cc:1511] Processing CreateTablet for tablet e8078a89b618482f8e4978c463747569 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260620 13:55:16.020326  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c5eb52b96b44f7cb3569bfff54e9b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.024689  6016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8edcc5cb024ebebdb3cac403f19bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.026625  5947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c5eb52b96b44f7cb3569bfff54e9b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.027305  6019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8078a89b618482f8e4978c463747569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.031682  5941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115c5e2556794dd8801d1f451aa245fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.032370  5943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd3e1f0e5a34ba69029888abcdfb2f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.035502  6017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd3e1f0e5a34ba69029888abcdfb2f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.037714  6015 tablet_service.cc:1511] Processing CreateTablet for tablet 115c5e2556794dd8801d1f451aa245fb (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260620 13:55:16.039758  6015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115c5e2556794dd8801d1f451aa245fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.039824  5945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8078a89b618482f8e4978c463747569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.047994  5867 tablet_service.cc:1511] Processing CreateTablet for tablet fb8edcc5cb024ebebdb3cac403f19bc4 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260620 13:55:16.048310  5874 tablet_service.cc:1511] Processing CreateTablet for tablet 52b97878e9ad465684082e7bf1c482ad (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260620 13:55:16.049386  5867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8edcc5cb024ebebdb3cac403f19bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.050601  5873 tablet_service.cc:1511] Processing CreateTablet for tablet ed1d1d20a2be4ceeb9389e7e3dbd2b5b (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260620 13:55:16.052003  5873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed1d1d20a2be4ceeb9389e7e3dbd2b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.056361  5872 tablet_service.cc:1511] Processing CreateTablet for tablet 8c5eb52b96b44f7cb3569bfff54e9b1c (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260620 13:55:16.057755  5872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c5eb52b96b44f7cb3569bfff54e9b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.060281  5871 tablet_service.cc:1511] Processing CreateTablet for tablet 649259d8acc1429d8dddd2677f87f911 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260620 13:55:16.061604  5871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649259d8acc1429d8dddd2677f87f911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.063406  5940 tablet_service.cc:1511] Processing CreateTablet for tablet ba377ed0ce364307bbe22e24ddafa62e (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260620 13:55:16.064296  5870 tablet_service.cc:1511] Processing CreateTablet for tablet e8078a89b618482f8e4978c463747569 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260620 13:55:16.064850  5940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba377ed0ce364307bbe22e24ddafa62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.064452  5868 tablet_service.cc:1511] Processing CreateTablet for tablet efd3e1f0e5a34ba69029888abcdfb2f1 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260620 13:55:16.066406  5874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b97878e9ad465684082e7bf1c482ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.067546  5870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8078a89b618482f8e4978c463747569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.071849  5868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd3e1f0e5a34ba69029888abcdfb2f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.098953  5866 tablet_service.cc:1511] Processing CreateTablet for tablet 115c5e2556794dd8801d1f451aa245fb (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260620 13:55:16.100543  5866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115c5e2556794dd8801d1f451aa245fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.098953  5865 tablet_service.cc:1511] Processing CreateTablet for tablet ba377ed0ce364307bbe22e24ddafa62e (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260620 13:55:16.104769  5865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba377ed0ce364307bbe22e24ddafa62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.098955  5869 tablet_service.cc:1511] Processing CreateTablet for tablet 8dbd1edec8054c1ba05721321572fbbf (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260620 13:55:16.108219  5869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dbd1edec8054c1ba05721321572fbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.112317  5943 tablet_service.cc:1511] Processing CreateTablet for tablet 5119d05dc81b442f8653989b96a3626d (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260620 13:55:16.113631  5943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5119d05dc81b442f8653989b96a3626d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.125176  6022 tablet_service.cc:1511] Processing CreateTablet for tablet ba377ed0ce364307bbe22e24ddafa62e (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260620 13:55:16.126503  6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba377ed0ce364307bbe22e24ddafa62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.161319  6074 tablet_bootstrap.cc:492] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:16.167806  6014 tablet_service.cc:1511] Processing CreateTablet for tablet 5119d05dc81b442f8653989b96a3626d (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260620 13:55:16.169736  6014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5119d05dc81b442f8653989b96a3626d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.170166  6074 tablet_bootstrap.cc:654] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:16.185694  5946 tablet_service.cc:1511] Processing CreateTablet for tablet d1b89d9f1eec4bfba2f3b0052c49f040 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260620 13:55:16.188717  6016 tablet_service.cc:1511] Processing CreateTablet for tablet d1b89d9f1eec4bfba2f3b0052c49f040 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260620 13:55:16.190177  6016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b89d9f1eec4bfba2f3b0052c49f040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.197162  5946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b89d9f1eec4bfba2f3b0052c49f040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.199940  6073 tablet_bootstrap.cc:492] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:16.210258  5874 tablet_service.cc:1511] Processing CreateTablet for tablet d1b89d9f1eec4bfba2f3b0052c49f040 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260620 13:55:16.211609  5874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b89d9f1eec4bfba2f3b0052c49f040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.211292  5867 tablet_service.cc:1511] Processing CreateTablet for tablet dc919ad08d5e4a9d9870a33b6fc425e5 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260620 13:55:16.219307  5867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc919ad08d5e4a9d9870a33b6fc425e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.228938  6075 tablet_bootstrap.cc:492] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:16.229786  5949 tablet_service.cc:1511] Processing CreateTablet for tablet dc919ad08d5e4a9d9870a33b6fc425e5 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260620 13:55:16.231058  6073 tablet_bootstrap.cc:654] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:16.232219  5868 tablet_service.cc:1511] Processing CreateTablet for tablet 5119d05dc81b442f8653989b96a3626d (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260620 13:55:16.233606  5868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5119d05dc81b442f8653989b96a3626d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.231065  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc919ad08d5e4a9d9870a33b6fc425e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.258323  6021 tablet_service.cc:1511] Processing CreateTablet for tablet dc919ad08d5e4a9d9870a33b6fc425e5 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260620 13:55:16.259028  6074 tablet_bootstrap.cc:492] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:16.259572  6074 ts_tablet_manager.cc:1403] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.099s	user 0.008s	sys 0.006s
I20260620 13:55:16.260390  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc919ad08d5e4a9d9870a33b6fc425e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.265506  5866 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc24d0691404d29bfa069498ec57dd0 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260620 13:55:16.266800  6075 tablet_bootstrap.cc:654] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:16.266501  5945 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc24d0691404d29bfa069498ec57dd0 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260620 13:55:16.262585  6074 raft_consensus.cc:359] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.268410  5945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc24d0691404d29bfa069498ec57dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.268595  6074 raft_consensus.cc:385] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:16.269033  6074 raft_consensus.cc:740] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:16.266764  5866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc24d0691404d29bfa069498ec57dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.275414  6074 consensus_queue.cc:260] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.278054  6015 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc24d0691404d29bfa069498ec57dd0 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260620 13:55:16.279469  6015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc24d0691404d29bfa069498ec57dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.288836  6073 tablet_bootstrap.cc:492] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:16.289387  6073 ts_tablet_manager.cc:1403] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.090s	user 0.007s	sys 0.018s
I20260620 13:55:16.302073  5869 tablet_service.cc:1511] Processing CreateTablet for tablet 8838a101a5e8400c91d053b307be45ed (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260620 13:55:16.303515  5869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8838a101a5e8400c91d053b307be45ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.304168  5984 heartbeater.cc:499] Master 127.4.155.254:37547 was elected leader, sending a full tablet report...
I20260620 13:55:16.305267  6074 ts_tablet_manager.cc:1434] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260620 13:55:16.307770  6074 tablet_bootstrap.cc:492] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:16.304422  5946 tablet_service.cc:1511] Processing CreateTablet for tablet 8838a101a5e8400c91d053b307be45ed (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260620 13:55:16.309746  6079 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:16.310092  5946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8838a101a5e8400c91d053b307be45ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.312019  6073 raft_consensus.cc:359] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.312948  6073 raft_consensus.cc:385] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:16.313264  6073 raft_consensus.cc:740] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
W20260620 13:55:16.317008  5829 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:55:16.319618  6023 tablet_service.cc:1511] Processing CreateTablet for tablet 8838a101a5e8400c91d053b307be45ed (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260620 13:55:16.321033  6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8838a101a5e8400c91d053b307be45ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.321729  5867 tablet_service.cc:1511] Processing CreateTablet for tablet 50e28625b20048a398049a7734aaeaf8 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260620 13:55:16.323030  5867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e28625b20048a398049a7734aaeaf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.310339  6079 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.347568  6073 consensus_queue.cc:260] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.360862  6074 tablet_bootstrap.cc:654] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:16.346938  6079 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:16.363505  5868 tablet_service.cc:1511] Processing CreateTablet for tablet ec20d216461d4414813627ca62e330e4 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260620 13:55:16.363900  6023 tablet_service.cc:1511] Processing CreateTablet for tablet 50e28625b20048a398049a7734aaeaf8 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260620 13:55:16.364807  5868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec20d216461d4414813627ca62e330e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.365267  6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e28625b20048a398049a7734aaeaf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.369679  6015 tablet_service.cc:1511] Processing CreateTablet for tablet ec20d216461d4414813627ca62e330e4 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260620 13:55:16.370633  6015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec20d216461d4414813627ca62e330e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.378413  5866 tablet_service.cc:1511] Processing CreateTablet for tablet 735685c84e834b9cbaf7533d6fdf16e6 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260620 13:55:16.380079  5866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 735685c84e834b9cbaf7533d6fdf16e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.391177  6081 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:16.391857  6081 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.407755  6075 tablet_bootstrap.cc:492] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:16.408417  6075 ts_tablet_manager.cc:1403] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.180s	user 0.025s	sys 0.058s
I20260620 13:55:16.412401  6075 raft_consensus.cc:359] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.415195  5874 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0ab32eab32415c8e9ea1fda9508733 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260620 13:55:16.425577  5946 tablet_service.cc:1511] Processing CreateTablet for tablet 50e28625b20048a398049a7734aaeaf8 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260620 13:55:16.426368  5945 tablet_service.cc:1511] Processing CreateTablet for tablet ec20d216461d4414813627ca62e330e4 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260620 13:55:16.414507  6015 tablet_service.cc:1511] Processing CreateTablet for tablet 735685c84e834b9cbaf7533d6fdf16e6 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260620 13:55:16.436256  5874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0ab32eab32415c8e9ea1fda9508733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.436579  5946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e28625b20048a398049a7734aaeaf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.436925  6015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 735685c84e834b9cbaf7533d6fdf16e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.438660  5945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec20d216461d4414813627ca62e330e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.440115  6073 ts_tablet_manager.cc:1434] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.150s	user 0.004s	sys 0.026s
I20260620 13:55:16.441263  6073 tablet_bootstrap.cc:492] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:16.413353  6075 raft_consensus.cc:385] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:16.445889  5949 tablet_service.cc:1511] Processing CreateTablet for tablet 735685c84e834b9cbaf7533d6fdf16e6 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260620 13:55:16.451042  6058 heartbeater.cc:499] Master 127.4.155.254:37547 was elected leader, sending a full tablet report...
I20260620 13:55:16.464454  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:16.466418  5924 leader_election.cc:343] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:16.470587  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 735685c84e834b9cbaf7533d6fdf16e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.425472  6081 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:16.444743  6075 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:16.489687  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:55:16.491727  5924 leader_election.cc:343] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:16.492190  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:16.492949  6079 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:16.501787  6014 tablet_service.cc:1511] Processing CreateTablet for tablet 6c812d18f2bb4da29c562646eb81deb1 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260620 13:55:16.501808  6021 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0ab32eab32415c8e9ea1fda9508733 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260620 13:55:16.505816  6073 tablet_bootstrap.cc:654] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:16.503178  6014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c812d18f2bb4da29c562646eb81deb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.503180  5869 tablet_service.cc:1511] Processing CreateTablet for tablet 6c812d18f2bb4da29c562646eb81deb1 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260620 13:55:16.510587  5869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c812d18f2bb4da29c562646eb81deb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.511483  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0ab32eab32415c8e9ea1fda9508733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.525308  5940 tablet_service.cc:1511] Processing CreateTablet for tablet 6c812d18f2bb4da29c562646eb81deb1 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260620 13:55:16.525635  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:16.526978  5940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c812d18f2bb4da29c562646eb81deb1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 13:55:16.527417  5998 leader_election.cc:343] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:16.535826  5909 heartbeater.cc:499] Master 127.4.155.254:37547 was elected leader, sending a full tablet report...
I20260620 13:55:16.537818  6075 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.540000  5942 tablet_service.cc:1511] Processing CreateTablet for tablet 90f87066e519439ab8be15dccf1d2493 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260620 13:55:16.541359  5942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f87066e519439ab8be15dccf1d2493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.541159  5868 tablet_service.cc:1511] Processing CreateTablet for tablet 90f87066e519439ab8be15dccf1d2493 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260620 13:55:16.542711  5868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f87066e519439ab8be15dccf1d2493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.558137  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:16.545230  6074 tablet_bootstrap.cc:492] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:16.559711  6074 ts_tablet_manager.cc:1403] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.252s	user 0.016s	sys 0.039s
W20260620 13:55:16.559880  5997 leader_election.cc:343] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:16.564128  5997 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:16.565481  6081 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:16.540000  5946 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0ab32eab32415c8e9ea1fda9508733 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260620 13:55:16.568456  5946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0ab32eab32415c8e9ea1fda9508733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.572715  6074 raft_consensus.cc:359] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.575258  6074 raft_consensus.cc:385] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:16.575812  6074 raft_consensus.cc:740] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:16.577128  6021 tablet_service.cc:1511] Processing CreateTablet for tablet 90f87066e519439ab8be15dccf1d2493 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260620 13:55:16.580372  6075 ts_tablet_manager.cc:1434] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.172s	user 0.008s	sys 0.005s
I20260620 13:55:16.584686  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f87066e519439ab8be15dccf1d2493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.588387  5866 tablet_service.cc:1511] Processing CreateTablet for tablet 5757f55132b747db98400dba7b8056df (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260620 13:55:16.589875  5866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5757f55132b747db98400dba7b8056df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.584836  6075 tablet_bootstrap.cc:492] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:16.585227  6074 consensus_queue.cc:260] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.592785  6074 ts_tablet_manager.cc:1434] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260620 13:55:16.593876  6074 tablet_bootstrap.cc:492] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:16.594691  5945 tablet_service.cc:1511] Processing CreateTablet for tablet 5757f55132b747db98400dba7b8056df (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260620 13:55:16.601109  6073 tablet_bootstrap.cc:492] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:16.601964  6073 ts_tablet_manager.cc:1403] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.161s	user 0.008s	sys 0.006s
I20260620 13:55:16.601759  6014 tablet_service.cc:1511] Processing CreateTablet for tablet 5757f55132b747db98400dba7b8056df (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260620 13:55:16.603559  6014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5757f55132b747db98400dba7b8056df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.605783  6073 raft_consensus.cc:359] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.606747  6073 raft_consensus.cc:385] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:16.607803  6074 tablet_bootstrap.cc:654] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:16.616400  6073 raft_consensus.cc:740] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:16.613656  5945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5757f55132b747db98400dba7b8056df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.635825  6073 consensus_queue.cc:260] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.638639  6073 ts_tablet_manager.cc:1434] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.008s
I20260620 13:55:16.639746  6075 tablet_bootstrap.cc:654] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:16.639922  6073 tablet_bootstrap.cc:492] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:16.647074  6074 tablet_bootstrap.cc:492] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:16.647862  6074 ts_tablet_manager.cc:1403] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.007s
I20260620 13:55:16.651265  6073 tablet_bootstrap.cc:654] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:16.660960  5942 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3e3ff471834714a3885231e648b8ee (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260620 13:55:16.662313  5942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3e3ff471834714a3885231e648b8ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.661918  6074 raft_consensus.cc:359] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.662810  6074 raft_consensus.cc:385] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:16.663216  6074 raft_consensus.cc:740] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:16.664433  6074 consensus_queue.cc:260] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.667383  6074 ts_tablet_manager.cc:1434] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260620 13:55:16.668411  5874 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3e3ff471834714a3885231e648b8ee (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260620 13:55:16.668449  6074 tablet_bootstrap.cc:492] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:16.670024  5874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3e3ff471834714a3885231e648b8ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.678458  6075 tablet_bootstrap.cc:492] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:16.683740  6075 ts_tablet_manager.cc:1403] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.099s	user 0.010s	sys 0.012s
I20260620 13:55:16.721405  6074 tablet_bootstrap.cc:654] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:16.733389  6074 tablet_bootstrap.cc:492] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:16.734639  6021 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3e3ff471834714a3885231e648b8ee (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260620 13:55:16.735757  6074 ts_tablet_manager.cc:1403] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.068s	user 0.019s	sys 0.033s
I20260620 13:55:16.736137  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3e3ff471834714a3885231e648b8ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.736352  6075 raft_consensus.cc:359] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.737139  6075 raft_consensus.cc:385] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:16.737428  6075 raft_consensus.cc:740] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:16.739382  6075 consensus_queue.cc:260] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.739773  6074 raft_consensus.cc:359] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.740978  6074 raft_consensus.cc:385] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:16.741348  6074 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:16.741605  6075 ts_tablet_manager.cc:1434] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.003s
I20260620 13:55:16.742559  6075 tablet_bootstrap.cc:492] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:16.742347  6074 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.744199  5866 tablet_service.cc:1511] Processing CreateTablet for tablet 3fc69a9218a64fa6b346021a0d32eaad (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260620 13:55:16.745100  6074 ts_tablet_manager.cc:1434] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260620 13:55:16.745262  6073 tablet_bootstrap.cc:492] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:16.745471  5866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc69a9218a64fa6b346021a0d32eaad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.745879  6073 ts_tablet_manager.cc:1403] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.017s
I20260620 13:55:16.746480  6074 tablet_bootstrap.cc:492] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:16.749053  6073 raft_consensus.cc:359] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.749783  6073 raft_consensus.cc:385] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:16.750116  6073 raft_consensus.cc:740] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:16.750880  6073 consensus_queue.cc:260] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.754776  6073 ts_tablet_manager.cc:1434] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260620 13:55:16.755697  5940 tablet_service.cc:1511] Processing CreateTablet for tablet 3fc69a9218a64fa6b346021a0d32eaad (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260620 13:55:16.756286  6073 tablet_bootstrap.cc:492] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:16.757987  6074 tablet_bootstrap.cc:654] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:16.757146  5940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc69a9218a64fa6b346021a0d32eaad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.761674  6081 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:16.762210  6081 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.767470  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:16.768519  6083 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:16.769047  6083 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.772918  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:16.773782  6074 tablet_bootstrap.cc:492] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:16.774288  6074 ts_tablet_manager.cc:1403] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.007s
I20260620 13:55:16.775734  6073 tablet_bootstrap.cc:654] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:16.777479  6074 raft_consensus.cc:359] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:16.778563  5997 leader_election.cc:343] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:16.778580  6074 raft_consensus.cc:385] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:16.779155  6074 raft_consensus.cc:740] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:16.779314  6075 tablet_bootstrap.cc:654] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:16.779706  6081 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:16.780081  6074 consensus_queue.cc:260] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:16.782104  5998 leader_election.cc:343] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:16.782575  5998 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:16.783560  6074 ts_tablet_manager.cc:1434] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260620 13:55:16.784449  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:16.784898  6074 tablet_bootstrap.cc:492] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:16.786358  6083 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:16.786463  6081 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 13:55:16.787602  5998 leader_election.cc:343] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:16.788609  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:16.789898  5959 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 0.
I20260620 13:55:16.791774  6073 tablet_bootstrap.cc:492] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:16.792296  6073 ts_tablet_manager.cc:1403] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.007s
I20260620 13:55:16.793538  6014 tablet_service.cc:1511] Processing CreateTablet for tablet 3fc69a9218a64fa6b346021a0d32eaad (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260620 13:55:16.793973  5997 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:16.794823  6014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc69a9218a64fa6b346021a0d32eaad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.795342  6073 raft_consensus.cc:359] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.796041  6073 raft_consensus.cc:385] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:16.796345  6073 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:16.796456  6081 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:16.797130  6081 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:16.797562  6081 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:16.800666  6075 tablet_bootstrap.cc:492] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:16.801126  6075 ts_tablet_manager.cc:1403] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.011s
I20260620 13:55:16.797139  6073 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.802153  5869 tablet_service.cc:1511] Processing CreateTablet for tablet c3ee15f74e3e4771a050c854530121f3 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260620 13:55:16.803695  5869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ee15f74e3e4771a050c854530121f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.800112  5942 tablet_service.cc:1511] Processing CreateTablet for tablet f6d4fcf1f6a541c6ae1a7724f27750eb (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260620 13:55:16.805050  5942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6d4fcf1f6a541c6ae1a7724f27750eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.812024  6074 tablet_bootstrap.cc:654] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:16.813405  5874 tablet_service.cc:1511] Processing CreateTablet for tablet f6d4fcf1f6a541c6ae1a7724f27750eb (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260620 13:55:16.814839  5874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6d4fcf1f6a541c6ae1a7724f27750eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.816352  6075 raft_consensus.cc:359] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.817113  6075 raft_consensus.cc:385] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:16.817448  6075 raft_consensus.cc:740] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:16.818210  6075 consensus_queue.cc:260] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.818498  5946 tablet_service.cc:1511] Processing CreateTablet for tablet c3ee15f74e3e4771a050c854530121f3 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260620 13:55:16.821434  6075 ts_tablet_manager.cc:1434] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.020s	user 0.000s	sys 0.010s
I20260620 13:55:16.819808  5946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ee15f74e3e4771a050c854530121f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.819161  6073 ts_tablet_manager.cc:1434] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.003s
I20260620 13:55:16.822824  6079 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:16.823287  6079 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.825263  6079 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:16.826445  6073 tablet_bootstrap.cc:492] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:16.827466  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:55:16.828878  5924 leader_election.cc:343] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:16.816110  6021 tablet_service.cc:1511] Processing CreateTablet for tablet f6d4fcf1f6a541c6ae1a7724f27750eb (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260620 13:55:16.829741  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:16.831298  5924 leader_election.cc:343] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:16.831766  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:16.834056  6015 tablet_service.cc:1511] Processing CreateTablet for tablet c3ee15f74e3e4771a050c854530121f3 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260620 13:55:16.835361  6079 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:16.836081  6081 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.836851  5868 tablet_service.cc:1511] Processing CreateTablet for tablet 8b06407c45954213adfef7604a8c4f21 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260620 13:55:16.838851  5945 tablet_service.cc:1511] Processing CreateTablet for tablet 8b06407c45954213adfef7604a8c4f21 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260620 13:55:16.844249  5945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b06407c45954213adfef7604a8c4f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.830089  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6d4fcf1f6a541c6ae1a7724f27750eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.845757  6015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ee15f74e3e4771a050c854530121f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.846395  6023 tablet_service.cc:1511] Processing CreateTablet for tablet 8b06407c45954213adfef7604a8c4f21 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260620 13:55:16.847165  6079 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:16.847709  6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b06407c45954213adfef7604a8c4f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.847646  6079 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.849772  6079 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:16.851943  6089 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:16.852427  6089 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.857676  6089 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:16.852723  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:16.860251  5867 tablet_service.cc:1511] Processing CreateTablet for tablet b870adf0b6e5484ba90ad7b17d35cd52 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260620 13:55:16.863083  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:16.863746  5884 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:16.863901  6017 tablet_service.cc:1511] Processing CreateTablet for tablet b870adf0b6e5484ba90ad7b17d35cd52 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260620 13:55:16.865233  6017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b870adf0b6e5484ba90ad7b17d35cd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.866706  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:16.867827  5959 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:16.870618  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:16.871469  6079 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260620 13:55:16.871639  5924 leader_election.cc:343] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:16.871863  6079 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:16.872210  6079 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:16.876224  5866 tablet_service.cc:1511] Processing CreateTablet for tablet 86bd36dee6d64396bfbb86cd90a7bedd (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260620 13:55:16.876858  6089 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:16.877377  6089 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.877722  5959 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:55:16.879171  5997 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:16.879545  6089 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:16.880031  6083 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:16.880239  5940 tablet_service.cc:1511] Processing CreateTablet for tablet b870adf0b6e5484ba90ad7b17d35cd52 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260620 13:55:16.881542  5940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b870adf0b6e5484ba90ad7b17d35cd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.886119  6081 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:16.894913  5867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b870adf0b6e5484ba90ad7b17d35cd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.894922  6075 tablet_bootstrap.cc:492] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:16.900902  6073 tablet_bootstrap.cc:654] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:16.907079  5868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b06407c45954213adfef7604a8c4f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.907764  5866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86bd36dee6d64396bfbb86cd90a7bedd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.911659  5942 tablet_service.cc:1511] Processing CreateTablet for tablet 86bd36dee6d64396bfbb86cd90a7bedd (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260620 13:55:16.913033  5942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86bd36dee6d64396bfbb86cd90a7bedd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.913576  6079 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.898085  6083 raft_consensus.cc:697] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:16.925845  6074 tablet_bootstrap.cc:492] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:16.925339  6083 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.926360  6074 ts_tablet_manager.cc:1403] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.142s	user 0.011s	sys 0.005s
I20260620 13:55:16.928190  5873 tablet_service.cc:1511] Processing CreateTablet for tablet 020dbb4b944d4deeba944d1a7c6d5c76 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260620 13:55:16.930250  5873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 020dbb4b944d4deeba944d1a7c6d5c76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.934437  5949 tablet_service.cc:1511] Processing CreateTablet for tablet 020dbb4b944d4deeba944d1a7c6d5c76 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260620 13:55:16.935750  6089 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:16.936205  6089 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:16.936684  6017 tablet_service.cc:1511] Processing CreateTablet for tablet 020dbb4b944d4deeba944d1a7c6d5c76 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260620 13:55:16.937963  6017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 020dbb4b944d4deeba944d1a7c6d5c76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.938156  6089 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:16.939384  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:16.939960  5884 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:16.939898  5869 tablet_service.cc:1511] Processing CreateTablet for tablet ab83097997ba42219f9a63aad224f786 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260620 13:55:16.940070  5947 tablet_service.cc:1511] Processing CreateTablet for tablet ab83097997ba42219f9a63aad224f786 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260620 13:55:16.941216  5869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab83097997ba42219f9a63aad224f786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.941413  5947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab83097997ba42219f9a63aad224f786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.944882  6020 tablet_service.cc:1511] Processing CreateTablet for tablet ab83097997ba42219f9a63aad224f786 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260620 13:55:16.946600  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 020dbb4b944d4deeba944d1a7c6d5c76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.949605  6020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab83097997ba42219f9a63aad224f786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.960858  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:55:16.964834  5998 leader_election.cc:343] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:16.966490  5884 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:16.967881  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:16.970479  6074 raft_consensus.cc:359] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } }
I20260620 13:55:16.971335  6074 raft_consensus.cc:385] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:16.971686  6074 raft_consensus.cc:740] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:16.972498  6074 consensus_queue.cc:260] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } }
I20260620 13:55:16.979424  6079 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:16.999358  6021 tablet_service.cc:1511] Processing CreateTablet for tablet 86bd36dee6d64396bfbb86cd90a7bedd (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260620 13:55:17.000015  6023 tablet_service.cc:1511] Processing CreateTablet for tablet 6ad92842cd6b4c0082afb264bae0ec8d (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260620 13:55:17.000689  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86bd36dee6d64396bfbb86cd90a7bedd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.001613  6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ad92842cd6b4c0082afb264bae0ec8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.005616  6075 tablet_bootstrap.cc:654] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:17.005715  5865 tablet_service.cc:1511] Processing CreateTablet for tablet 81b2378deea24954b2003dda61c1b2c1 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260620 13:55:17.006018  5867 tablet_service.cc:1511] Processing CreateTablet for tablet 6ad92842cd6b4c0082afb264bae0ec8d (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260620 13:55:17.007055  5865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b2378deea24954b2003dda61c1b2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:16.989993  6079 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:17.031350  6015 tablet_service.cc:1511] Processing CreateTablet for tablet 81b2378deea24954b2003dda61c1b2c1 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260620 13:55:17.016196  5867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ad92842cd6b4c0082afb264bae0ec8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.035459  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:17.036309  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:55:17.037837  5849 leader_election.cc:343] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.038985  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:17.037434  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:17.040346  6030 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
W20260620 13:55:17.041923  5849 leader_election.cc:343] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.035730  6015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b2378deea24954b2003dda61c1b2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.042725  5849 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:17.017937  6079 raft_consensus.cc:697] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:17.043928  6079 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.044667  6089 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:17.045146  6089 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:17.045526  6089 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:17.052353  5872 tablet_service.cc:1511] Processing CreateTablet for tablet a4cd17345f80464287c5952767849dbb (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260620 13:55:17.053689  5872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4cd17345f80464287c5952767849dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.055347  5779 catalog_manager.cc:5696] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:17.060073  5940 tablet_service.cc:1511] Processing CreateTablet for tablet 81b2378deea24954b2003dda61c1b2c1 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260620 13:55:17.060483  5942 tablet_service.cc:1511] Processing CreateTablet for tablet a4cd17345f80464287c5952767849dbb (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260620 13:55:17.061436  5940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b2378deea24954b2003dda61c1b2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.062088  5942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4cd17345f80464287c5952767849dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.062141  6014 tablet_service.cc:1511] Processing CreateTablet for tablet a4cd17345f80464287c5952767849dbb (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260620 13:55:17.064320  6014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4cd17345f80464287c5952767849dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.076234  6074 ts_tablet_manager.cc:1434] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.150s	user 0.003s	sys 0.007s
I20260620 13:55:17.076841  5945 tablet_service.cc:1511] Processing CreateTablet for tablet 6ad92842cd6b4c0082afb264bae0ec8d (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260620 13:55:17.077340  6074 tablet_bootstrap.cc:492] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:17.080317  5873 tablet_service.cc:1511] Processing CreateTablet for tablet 2f67b5ea416143c1a0a6729eaaa909c2 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260620 13:55:17.087601  5945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ad92842cd6b4c0082afb264bae0ec8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.088796  6073 tablet_bootstrap.cc:492] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:17.089270  6073 ts_tablet_manager.cc:1403] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.263s	user 0.022s	sys 0.008s
I20260620 13:55:17.090675  6021 tablet_service.cc:1511] Processing CreateTablet for tablet 2f67b5ea416143c1a0a6729eaaa909c2 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260620 13:55:17.092023  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f67b5ea416143c1a0a6729eaaa909c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.092258  6073 raft_consensus.cc:359] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.093163  6073 raft_consensus.cc:385] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:17.093474  6073 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:17.094854  6073 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.097363  6073 ts_tablet_manager.cc:1434] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260620 13:55:17.098289  6073 tablet_bootstrap.cc:492] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:17.099970  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:17.100328  5874 tablet_service.cc:1511] Processing CreateTablet for tablet 923bfc4f20d94a57b0d84d45e40b12ae (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260620 13:55:17.101673  5874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923bfc4f20d94a57b0d84d45e40b12ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.101722  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:17.102391  5959 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:17.103672  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:17.109222  6103 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:17.109722  6103 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } }
I20260620 13:55:17.114898  6103 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:55:17.113430  6073 tablet_bootstrap.cc:654] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:17.119889  5873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f67b5ea416143c1a0a6729eaaa909c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.121122  5780 catalog_manager.cc:5696] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:17.129614  6089 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.132938  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:17.133530  6030 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:55:17.122242  5924 leader_election.cc:343] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.139294  6089 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:17.140391  5848 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:17.140882  5867 tablet_service.cc:1511] Processing CreateTablet for tablet 24c27735bbb449a98fab7edad2ba9837 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260620 13:55:17.141875  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:17.142433  5867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c27735bbb449a98fab7edad2ba9837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.142064  5848 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:17.143700  6103 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:17.144140  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:17.144814  5924 leader_election.cc:343] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.103992  6020 tablet_service.cc:1511] Processing CreateTablet for tablet 923bfc4f20d94a57b0d84d45e40b12ae (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260620 13:55:17.145865  6103 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.147094  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:17.148286  5946 tablet_service.cc:1511] Processing CreateTablet for tablet 923bfc4f20d94a57b0d84d45e40b12ae (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260620 13:55:17.148782  6030 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:17.149633  5946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923bfc4f20d94a57b0d84d45e40b12ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.150010  5949 tablet_service.cc:1511] Processing CreateTablet for tablet 2f67b5ea416143c1a0a6729eaaa909c2 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260620 13:55:17.150324  5849 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:17.151516  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f67b5ea416143c1a0a6729eaaa909c2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 13:55:17.154522  5924 leader_election.cc:343] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.148660  6103 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:17.155009  5924 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:17.155802  6103 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:17.157007  6089 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:17.157461  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:17.157666  6089 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:17.157994  6089 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:17.158341  6089 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:17.165562  6075 tablet_bootstrap.cc:492] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:17.166109  6075 ts_tablet_manager.cc:1403] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.271s	user 0.024s	sys 0.014s
I20260620 13:55:17.168879  6074 tablet_bootstrap.cc:654] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:17.171614  6020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923bfc4f20d94a57b0d84d45e40b12ae. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 13:55:17.183508  5924 leader_election.cc:343] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.188848  5868 tablet_service.cc:1511] Processing CreateTablet for tablet 14bccd20cc3f44b69eeefefc4f8b72f9 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260620 13:55:17.190114  5868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14bccd20cc3f44b69eeefefc4f8b72f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.190431  6023 tablet_service.cc:1511] Processing CreateTablet for tablet 24c27735bbb449a98fab7edad2ba9837 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260620 13:55:17.176111  5940 tablet_service.cc:1511] Processing CreateTablet for tablet 24c27735bbb449a98fab7edad2ba9837 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260620 13:55:17.191362  5947 tablet_service.cc:1511] Processing CreateTablet for tablet 14bccd20cc3f44b69eeefefc4f8b72f9 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260620 13:55:17.192229  5940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c27735bbb449a98fab7edad2ba9837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.192879  5947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14bccd20cc3f44b69eeefefc4f8b72f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.193809  6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c27735bbb449a98fab7edad2ba9837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.197165  5872 tablet_service.cc:1511] Processing CreateTablet for tablet 18f8f8a1b370453aade5f48cd3bedcbd (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260620 13:55:17.198411  5872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f8f8a1b370453aade5f48cd3bedcbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.199891  6021 tablet_service.cc:1511] Processing CreateTablet for tablet 14bccd20cc3f44b69eeefefc4f8b72f9 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260620 13:55:17.200019  5942 tablet_service.cc:1511] Processing CreateTablet for tablet 18f8f8a1b370453aade5f48cd3bedcbd (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260620 13:55:17.201005  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14bccd20cc3f44b69eeefefc4f8b72f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.200907  6014 tablet_service.cc:1511] Processing CreateTablet for tablet 18f8f8a1b370453aade5f48cd3bedcbd (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260620 13:55:17.202148  6014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f8f8a1b370453aade5f48cd3bedcbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.189060  6075 raft_consensus.cc:359] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } }
W20260620 13:55:17.217804  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 75845.7us
W20260620 13:55:17.224351  5848 leader_election.cc:343] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.218791  5942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f8f8a1b370453aade5f48cd3bedcbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.225205  5943 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7540e02ee04cdb9365701b0b6a9077 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260620 13:55:17.226657  5943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7540e02ee04cdb9365701b0b6a9077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.228938  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:17.229748  6030 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:17.231094  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:17.231890  5867 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7540e02ee04cdb9365701b0b6a9077 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260620 13:55:17.232254  6103 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260620 13:55:17.225240  5848 leader_election.cc:343] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.233228  5867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7540e02ee04cdb9365701b0b6a9077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.232708  6103 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:17.216894  6075 raft_consensus.cc:385] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260620 13:55:17.218695  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 68423.1us
I20260620 13:55:17.257854  5874 tablet_service.cc:1511] Processing CreateTablet for tablet b00b548648e441dbb777699ee0ef3f60 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260620 13:55:17.234954  6017 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7540e02ee04cdb9365701b0b6a9077 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260620 13:55:17.252019  6103 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:17.261185  5874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b00b548648e441dbb777699ee0ef3f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.272110  6017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7540e02ee04cdb9365701b0b6a9077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.272444  6109 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:17.252019  6075 raft_consensus.cc:740] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:17.276316  6109 raft_consensus.cc:697] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:17.286389  5946 tablet_service.cc:1511] Processing CreateTablet for tablet b00b548648e441dbb777699ee0ef3f60 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260620 13:55:17.287919  5946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b00b548648e441dbb777699ee0ef3f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.293597  5866 tablet_service.cc:1511] Processing CreateTablet for tablet 59266d6f1b524a25ac59ce6dd8f39c95 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260620 13:55:17.294847  6103 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.305124  6021 tablet_service.cc:1511] Processing CreateTablet for tablet b00b548648e441dbb777699ee0ef3f60 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260620 13:55:17.306780  6075 consensus_queue.cc:260] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } }
I20260620 13:55:17.308451  6074 tablet_bootstrap.cc:492] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:17.308240  6015 tablet_service.cc:1511] Processing CreateTablet for tablet 59266d6f1b524a25ac59ce6dd8f39c95 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260620 13:55:17.308887  6074 ts_tablet_manager.cc:1403] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.232s	user 0.016s	sys 0.013s
I20260620 13:55:17.309062  6075 ts_tablet_manager.cc:1434] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.143s	user 0.009s	sys 0.000s
I20260620 13:55:17.310122  6075 tablet_bootstrap.cc:492] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:17.310588  5945 tablet_service.cc:1511] Processing CreateTablet for tablet b53823dabce64d5284772ca73d71ddc9 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260620 13:55:17.301126  6073 tablet_bootstrap.cc:492] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:17.311507  6073 ts_tablet_manager.cc:1403] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.213s	user 0.014s	sys 0.008s
I20260620 13:55:17.311834  5945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53823dabce64d5284772ca73d71ddc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.311539  6089 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.295037  5866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59266d6f1b524a25ac59ce6dd8f39c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.315271  5944 tablet_service.cc:1511] Processing CreateTablet for tablet 29e2284e793941b4aa9829a72313998c (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260620 13:55:17.316594  5944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e2284e793941b4aa9829a72313998c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.316876  6089 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:55:17.319326  5829 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:55:17.325577  5868 tablet_service.cc:1511] Processing CreateTablet for tablet b53823dabce64d5284772ca73d71ddc9 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260620 13:55:17.319545  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:17.319505  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:17.326485  5959 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:17.326804  5868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53823dabce64d5284772ca73d71ddc9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 13:55:17.327502  5849 leader_election.cc:343] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.330004  5869 tablet_service.cc:1511] Processing CreateTablet for tablet 29e2284e793941b4aa9829a72313998c (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260620 13:55:17.331229  5869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e2284e793941b4aa9829a72313998c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.333101  5959 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:17.334162  5848 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:17.335531  6089 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:17.336202  6089 raft_consensus.cc:697] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:17.337054  6089 consensus_queue.cc:237] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.295925  6083 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:17.339587  6083 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.340098  5941 tablet_service.cc:1511] Processing CreateTablet for tablet d483a507ec73494da65730a6444e1fd6 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260620 13:55:17.341534  5941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d483a507ec73494da65730a6444e1fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.342583  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:17.342906  6083 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:55:17.344110  5998 leader_election.cc:343] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.345005  6110 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:17.345543  6110 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } }
I20260620 13:55:17.347992  5873 tablet_service.cc:1511] Processing CreateTablet for tablet d483a507ec73494da65730a6444e1fd6 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260620 13:55:17.348956  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:17.349223  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:17.349431  5873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d483a507ec73494da65730a6444e1fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.349630  5958 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
W20260620 13:55:17.350673  5849 leader_election.cc:343] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.351343  5848 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:17.352262  6110 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:17.352310  5949 tablet_service.cc:1511] Processing CreateTablet for tablet 59266d6f1b524a25ac59ce6dd8f39c95 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260620 13:55:17.352955  6110 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:17.353644  6110 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:17.354511  6110 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:17.325282  6016 tablet_service.cc:1511] Processing CreateTablet for tablet b53823dabce64d5284772ca73d71ddc9 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260620 13:55:17.322721  6075 tablet_bootstrap.cc:654] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:17.325042  6109 consensus_queue.cc:237] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.358556  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:17.355394  6020 tablet_service.cc:1511] Processing CreateTablet for tablet 29e2284e793941b4aa9829a72313998c (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260620 13:55:17.360387  5997 leader_election.cc:343] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.360839  6073 raft_consensus.cc:359] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.353950  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59266d6f1b524a25ac59ce6dd8f39c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.361557  6073 raft_consensus.cc:385] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:17.361478  5997 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:55:17.362834  6111 log.cc:927] Time spent T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260620 13:55:17.363504  6074 raft_consensus.cc:359] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.364216  6074 raft_consensus.cc:385] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:17.363936  6073 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:17.365039  6083 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:17.366014  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:55:17.367523  5924 leader_election.cc:343] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.370504  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:17.366707  6073 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.371071  6030 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:17.375593  6022 tablet_service.cc:1511] Processing CreateTablet for tablet d483a507ec73494da65730a6444e1fd6 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260620 13:55:17.374362  6103 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:17.306228  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b00b548648e441dbb777699ee0ef3f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.364637  6074 raft_consensus.cc:740] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:17.391270  5865 tablet_service.cc:1511] Processing CreateTablet for tablet 6da14809d5f043db80b3e1639afd8e25 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260620 13:55:17.392594  5865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da14809d5f043db80b3e1639afd8e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.396773  6015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59266d6f1b524a25ac59ce6dd8f39c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.401901  6073 ts_tablet_manager.cc:1434] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.001s
I20260620 13:55:17.403618  6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d483a507ec73494da65730a6444e1fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.407621  6016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53823dabce64d5284772ca73d71ddc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.410465  6110 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } }
I20260620 13:55:17.403036  6073 tablet_bootstrap.cc:492] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:17.396103  6030 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:17.428588  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:17.429921  6103 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:17.431622  6103 raft_consensus.cc:697] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:17.432425  6103 consensus_queue.cc:237] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.435863  5940 tablet_service.cc:1511] Processing CreateTablet for tablet 6da14809d5f043db80b3e1639afd8e25 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260620 13:55:17.437201  5940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da14809d5f043db80b3e1639afd8e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.440471  6030 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:17.449199  6021 tablet_service.cc:1511] Processing CreateTablet for tablet 6da14809d5f043db80b3e1639afd8e25 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260620 13:55:17.419502  6020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e2284e793941b4aa9829a72313998c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 13:55:17.456940  5998 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:17.471287  6110 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:17.471750  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:17.471926  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:17.473145  5959 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:55:17.475288  5849 leader_election.cc:343] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.420353  6074 consensus_queue.cc:260] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.485755  6074 ts_tablet_manager.cc:1434] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.177s	user 0.006s	sys 0.001s
I20260620 13:55:17.492611  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da14809d5f043db80b3e1639afd8e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.501227  5942 tablet_service.cc:1511] Processing CreateTablet for tablet 49ee9750110f428fa454f96aaeb360ef (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260620 13:55:17.507421  6083 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:17.510078  6079 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:17.510711  6079 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.515800  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:55:17.518563  5924 leader_election.cc:343] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.525872  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:17.528087  6105 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:17.532193  5942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ee9750110f428fa454f96aaeb360ef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 13:55:17.532526  5924 leader_election.cc:343] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.532979  5924 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:17.533814  6105 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:17.541689  6083 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:17.542337  6083 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.543936  5872 tablet_service.cc:1511] Processing CreateTablet for tablet 49ee9750110f428fa454f96aaeb360ef (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260620 13:55:17.531422  6079 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:17.539017  6073 tablet_bootstrap.cc:654] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:17.550338  6105 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:17.555775  5872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ee9750110f428fa454f96aaeb360ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.554677  5781 catalog_manager.cc:5696] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:17.565631  5867 tablet_service.cc:1511] Processing CreateTablet for tablet 99f357751cae4b6b87b5972ef2a1fda4 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260620 13:55:17.567174  5867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f357751cae4b6b87b5972ef2a1fda4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.569986  6075 tablet_bootstrap.cc:492] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:17.570477  6075 ts_tablet_manager.cc:1403] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.261s	user 0.030s	sys 0.035s
I20260620 13:55:17.572104  6014 tablet_service.cc:1511] Processing CreateTablet for tablet 49ee9750110f428fa454f96aaeb360ef (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260620 13:55:17.573359  6014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ee9750110f428fa454f96aaeb360ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.573375  6075 raft_consensus.cc:359] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.574690  6075 raft_consensus.cc:385] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:17.575038  6075 raft_consensus.cc:740] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:17.575978  6075 consensus_queue.cc:260] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.578225  6075 ts_tablet_manager.cc:1434] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260620 13:55:17.583484  5959 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:17.585202  6101 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:17.613894  6021 tablet_service.cc:1511] Processing CreateTablet for tablet 99f357751cae4b6b87b5972ef2a1fda4 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260620 13:55:17.614885  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:17.617456  5949 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd646f84cb04514aa9889ea5f67db81 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260620 13:55:17.619727  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd646f84cb04514aa9889ea5f67db81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.620267  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:17.620820  6074 tablet_bootstrap.cc:492] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:17.621850  5998 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:17.601604  6101 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.617362  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f357751cae4b6b87b5972ef2a1fda4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.618309  6075 tablet_bootstrap.cc:492] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:17.615164  5848 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:17.629438  6101 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:17.630618  6110 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:17.631129  6110 raft_consensus.cc:697] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:17.631357  5942 tablet_service.cc:1511] Processing CreateTablet for tablet 08f835b507484456a3c708ba0e6fb982 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260620 13:55:17.631961  6110 consensus_queue.cc:237] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } }
I20260620 13:55:17.632525  5942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f835b507484456a3c708ba0e6fb982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.611696  6083 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:17.640242  5781 catalog_manager.cc:5696] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:17.642050  6016 tablet_service.cc:1511] Processing CreateTablet for tablet 08f835b507484456a3c708ba0e6fb982 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260620 13:55:17.642915  5873 tablet_service.cc:1511] Processing CreateTablet for tablet 08f835b507484456a3c708ba0e6fb982 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260620 13:55:17.615088  5945 tablet_service.cc:1511] Processing CreateTablet for tablet 99f357751cae4b6b87b5972ef2a1fda4 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260620 13:55:17.644186  5873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f835b507484456a3c708ba0e6fb982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.643992  5867 tablet_service.cc:1511] Processing CreateTablet for tablet b8a351afb91f46e2b6e724165bc600c1 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260620 13:55:17.644980  5945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f357751cae4b6b87b5972ef2a1fda4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.645031  5867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a351afb91f46e2b6e724165bc600c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.676973  6016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f835b507484456a3c708ba0e6fb982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.686425  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:17.674901  5941 tablet_service.cc:1511] Processing CreateTablet for tablet b8a351afb91f46e2b6e724165bc600c1 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260620 13:55:17.703699  5780 catalog_manager.cc:5696] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:17.681123  6014 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd646f84cb04514aa9889ea5f67db81 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260620 13:55:17.710036  6014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd646f84cb04514aa9889ea5f67db81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.710211  6075 tablet_bootstrap.cc:654] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:17.708726  6101 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:55:17.720441  6021 tablet_service.cc:1511] Processing CreateTablet for tablet b8a351afb91f46e2b6e724165bc600c1 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260620 13:55:17.721750  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a351afb91f46e2b6e724165bc600c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.725229  5942 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1025714d0b439cb56cc08764cb5fce (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260620 13:55:17.707996  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 86255.9us
I20260620 13:55:17.692456  5865 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd646f84cb04514aa9889ea5f67db81 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260620 13:55:17.715657  5997 leader_election.cc:343] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:17.753907  5848 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:17.755326  6073 tablet_bootstrap.cc:492] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:17.756017  6073 ts_tablet_manager.cc:1403] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.353s	user 0.021s	sys 0.007s
I20260620 13:55:17.737593  6074 tablet_bootstrap.cc:654] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:17.756352  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:17.736963  5942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1025714d0b439cb56cc08764cb5fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.735013  5865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd646f84cb04514aa9889ea5f67db81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.770563  5941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a351afb91f46e2b6e724165bc600c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.770650  6075 tablet_bootstrap.cc:492] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:17.763051  5940 tablet_service.cc:1511] Processing CreateTablet for tablet 71fbe22bd18849f1b94912bb0bdf5bbe (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260620 13:55:17.772749  5940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fbe22bd18849f1b94912bb0bdf5bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.775245  6110 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:17.775740  6110 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.777818  6110 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:17.778549  6075 ts_tablet_manager.cc:1403] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.170s	user 0.011s	sys 0.007s
I20260620 13:55:17.778477  5949 tablet_service.cc:1511] Processing CreateTablet for tablet 59b6ab17fde545f5b655c12383d08351 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260620 13:55:17.779088  5998 leader_election.cc:343] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.779557  5998 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:17.779917  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b6ab17fde545f5b655c12383d08351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.779946  6073 raft_consensus.cc:359] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.780647  6101 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:17.780901  6073 raft_consensus.cc:385] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:17.781340  6073 raft_consensus.cc:740] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:17.782059  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:17.768376  5867 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1025714d0b439cb56cc08764cb5fce (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260620 13:55:17.784677  5867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1025714d0b439cb56cc08764cb5fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.791443  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:17.791623  5883 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:17.792850  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:17.782166  6073 consensus_queue.cc:260] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.781471  6075 raft_consensus.cc:359] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.813619  6075 raft_consensus.cc:385] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:17.814095  6075 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:17.815179  6075 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.818493  6075 ts_tablet_manager.cc:1434] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260620 13:55:17.823570  6101 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:17.824098  6101 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.825682  6021 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1025714d0b439cb56cc08764cb5fce (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260620 13:55:17.826277  6101 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:17.826820  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1025714d0b439cb56cc08764cb5fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.827877  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:17.828715  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:17.829218  5998 leader_election.cc:343] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.831396  6014 tablet_service.cc:1511] Processing CreateTablet for tablet 71fbe22bd18849f1b94912bb0bdf5bbe (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260620 13:55:17.832486  6014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fbe22bd18849f1b94912bb0bdf5bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.841449  6075 tablet_bootstrap.cc:492] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:17.841570  5873 tablet_service.cc:1511] Processing CreateTablet for tablet 71fbe22bd18849f1b94912bb0bdf5bbe (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260620 13:55:17.842938  5873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fbe22bd18849f1b94912bb0bdf5bbe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 13:55:17.843266  5997 leader_election.cc:343] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:17.850118  5997 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:17.850237  6109 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:17.851065  5872 tablet_service.cc:1511] Processing CreateTablet for tablet 59b6ab17fde545f5b655c12383d08351 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260620 13:55:17.851527  6101 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:17.854503  6073 ts_tablet_manager.cc:1434] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.000s
I20260620 13:55:17.855397  5872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b6ab17fde545f5b655c12383d08351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.855762  6073 tablet_bootstrap.cc:492] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:17.863118  6073 tablet_bootstrap.cc:654] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:17.865052  5949 tablet_service.cc:1511] Processing CreateTablet for tablet 0120e0a908b041479e2847fb24268985 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260620 13:55:17.866291  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0120e0a908b041479e2847fb24268985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.875434  6110 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:17.884459  6021 tablet_service.cc:1511] Processing CreateTablet for tablet 59b6ab17fde545f5b655c12383d08351 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260620 13:55:17.885630  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b6ab17fde545f5b655c12383d08351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.890560  6075 tablet_bootstrap.cc:654] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:17.906513  6110 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:17.911878  6074 tablet_bootstrap.cc:492] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:17.912379  6074 ts_tablet_manager.cc:1403] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.292s	user 0.018s	sys 0.014s
I20260620 13:55:17.913911  5941 tablet_service.cc:1511] Processing CreateTablet for tablet d562ae472315433ca373f0a47f931afa (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260620 13:55:17.915223  5941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d562ae472315433ca373f0a47f931afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.915081  6074 raft_consensus.cc:359] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.915968  6074 raft_consensus.cc:385] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:17.916244  6074 raft_consensus.cc:740] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:17.917073  6074 consensus_queue.cc:260] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.919351  6074 ts_tablet_manager.cc:1434] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260620 13:55:17.920392  6074 tablet_bootstrap.cc:492] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:17.919906  5872 tablet_service.cc:1511] Processing CreateTablet for tablet 0120e0a908b041479e2847fb24268985 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260620 13:55:17.921592  5872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0120e0a908b041479e2847fb24268985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.924149  5781 catalog_manager.cc:5696] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:17.929028  6021 tablet_service.cc:1511] Processing CreateTablet for tablet 0120e0a908b041479e2847fb24268985 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260620 13:55:17.930248  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0120e0a908b041479e2847fb24268985. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 13:55:17.938195  5849 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:17.943984  6074 tablet_bootstrap.cc:654] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
W20260620 13:55:17.945370  5924 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:17.949640  6021 tablet_service.cc:1511] Processing CreateTablet for tablet d562ae472315433ca373f0a47f931afa (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260620 13:55:17.951089  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d562ae472315433ca373f0a47f931afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.958307  6073 tablet_bootstrap.cc:492] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:17.958771  6073 ts_tablet_manager.cc:1403] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.005s
I20260620 13:55:17.966419  5949 tablet_service.cc:1511] Processing CreateTablet for tablet bab45d487c864870aba1aee58d01ca95 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260620 13:55:17.967726  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bab45d487c864870aba1aee58d01ca95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.964390  6073 raft_consensus.cc:359] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.971354  6073 raft_consensus.cc:385] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:17.971735  6073 raft_consensus.cc:740] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:17.972605  6073 consensus_queue.cc:260] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:17.974310  5867 tablet_service.cc:1511] Processing CreateTablet for tablet bab45d487c864870aba1aee58d01ca95 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260620 13:55:17.975142  6073 ts_tablet_manager.cc:1434] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260620 13:55:17.975571  5867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bab45d487c864870aba1aee58d01ca95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:17.977960  6073 tablet_bootstrap.cc:492] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:17.984797  6073 tablet_bootstrap.cc:654] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:17.997915  6075 tablet_bootstrap.cc:492] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:17.998553  6075 ts_tablet_manager.cc:1403] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.157s	user 0.022s	sys 0.019s
I20260620 13:55:17.956022  5865 tablet_service.cc:1511] Processing CreateTablet for tablet d562ae472315433ca373f0a47f931afa (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260620 13:55:18.001652  6075 raft_consensus.cc:359] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.006562  6075 raft_consensus.cc:385] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.006981  6075 raft_consensus.cc:740] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.008950  6075 consensus_queue.cc:260] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.012383  6075 ts_tablet_manager.cc:1434] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260620 13:55:18.014478  5865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d562ae472315433ca373f0a47f931afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:18.022816  6074 tablet_bootstrap.cc:492] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:18.023427  6074 ts_tablet_manager.cc:1403] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.103s	user 0.028s	sys 0.020s
I20260620 13:55:18.026842  6021 tablet_service.cc:1511] Processing CreateTablet for tablet bab45d487c864870aba1aee58d01ca95 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260620 13:55:18.027076  6074 raft_consensus.cc:359] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.027833  6074 raft_consensus.cc:385] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.027987  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bab45d487c864870aba1aee58d01ca95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:18.028126  6074 raft_consensus.cc:740] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.028848  6074 consensus_queue.cc:260] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.029996  6075 tablet_bootstrap.cc:492] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:18.031093  6074 ts_tablet_manager.cc:1434] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 13:55:18.032248  6074 tablet_bootstrap.cc:492] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:18.034708  5872 tablet_service.cc:1511] Processing CreateTablet for tablet a1bc98eaf2354afeb378f85e462f31ab (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260620 13:55:18.027980  6073 tablet_bootstrap.cc:492] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:18.035951  5872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1bc98eaf2354afeb378f85e462f31ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:18.043730  6073 ts_tablet_manager.cc:1403] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.002s
I20260620 13:55:18.037813  6074 tablet_bootstrap.cc:654] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.038931  5949 tablet_service.cc:1511] Processing CreateTablet for tablet a1bc98eaf2354afeb378f85e462f31ab (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260620 13:55:18.039968  6016 tablet_service.cc:1511] Processing CreateTablet for tablet a1bc98eaf2354afeb378f85e462f31ab (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260620 13:55:18.046437  6073 raft_consensus.cc:359] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.047331  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1bc98eaf2354afeb378f85e462f31ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:18.047075  6109 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:18.047451  6016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1bc98eaf2354afeb378f85e462f31ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:18.047425  6073 raft_consensus.cc:385] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.048209  6073 raft_consensus.cc:740] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.049026  6073 consensus_queue.cc:260] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.054442  6073 ts_tablet_manager.cc:1434] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260620 13:55:18.055500  6073 tablet_bootstrap.cc:492] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:18.061733  6103 consensus_queue.cc:1048] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:18.064798  6073 tablet_bootstrap.cc:654] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.071048  5867 tablet_service.cc:1511] Processing CreateTablet for tablet fd6ebbc0e9aa474f80952cef69b0ac25 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260620 13:55:18.072444  5867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6ebbc0e9aa474f80952cef69b0ac25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:18.080049  6073 tablet_bootstrap.cc:492] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:18.080628  6073 ts_tablet_manager.cc:1403] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.006s
W20260620 13:55:18.081074  5849 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:18.083916  6073 raft_consensus.cc:359] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.084775  6073 raft_consensus.cc:385] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.085106  6073 raft_consensus.cc:740] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.085494  6075 tablet_bootstrap.cc:654] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.085940  6073 consensus_queue.cc:260] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.088390  6073 ts_tablet_manager.cc:1434] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260620 13:55:18.089334  6073 tablet_bootstrap.cc:492] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:18.091065  5940 tablet_service.cc:1511] Processing CreateTablet for tablet fd6ebbc0e9aa474f80952cef69b0ac25 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260620 13:55:18.091425  6021 tablet_service.cc:1511] Processing CreateTablet for tablet fd6ebbc0e9aa474f80952cef69b0ac25 (DEFAULT_TABLE table=test-workload [id=bc35799e3b2249d98d34fa7405c72870]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260620 13:55:18.092177  5940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6ebbc0e9aa474f80952cef69b0ac25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:18.092499  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6ebbc0e9aa474f80952cef69b0ac25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:18.116420  6073 tablet_bootstrap.cc:654] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.121702  6075 tablet_bootstrap.cc:492] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:18.122288  6075 ts_tablet_manager.cc:1403] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.000s
I20260620 13:55:18.125106  6075 raft_consensus.cc:359] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.125746  6075 raft_consensus.cc:385] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.126062  6073 tablet_bootstrap.cc:492] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:18.126065  6075 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.126578  6073 ts_tablet_manager.cc:1403] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.002s
I20260620 13:55:18.127094  6075 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.129086  6075 ts_tablet_manager.cc:1434] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260620 13:55:18.129339  6073 raft_consensus.cc:359] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } }
I20260620 13:55:18.129998  6075 tablet_bootstrap.cc:492] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:18.130015  6073 raft_consensus.cc:385] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.130506  6073 raft_consensus.cc:740] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.131306  6073 consensus_queue.cc:260] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } }
I20260620 13:55:18.131975  6110 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.132640  6110 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.133738  6073 ts_tablet_manager.cc:1434] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260620 13:55:18.134660  6073 tablet_bootstrap.cc:492] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:18.135829  6075 tablet_bootstrap.cc:654] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.139082  6101 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.139747  6101 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.142465  6101 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:18.143481  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:18.145181  5848 leader_election.cc:343] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:18.145855  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:18.146953  6110 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.148231  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:18.149148  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:18.149957  6030 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:18.150828  5997 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:18.151377  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:55:18.152513  6101 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:18.156420  6073 tablet_bootstrap.cc:654] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.157683  6110 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:18.161379  5958 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.162832  6075 tablet_bootstrap.cc:492] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:18.163183  6073 tablet_bootstrap.cc:492] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:18.163578  6073 ts_tablet_manager.cc:1403] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.000s
I20260620 13:55:18.163465  6075 ts_tablet_manager.cc:1403] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.034s	user 0.026s	sys 0.007s
I20260620 13:55:18.166594  6073 raft_consensus.cc:359] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.167317  6073 raft_consensus.cc:385] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.167488  6101 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.167613  6073 raft_consensus.cc:740] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.167922  6101 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.158087  6110 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:18.168295  6073 consensus_queue.cc:260] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.168882  6110 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.169922  6101 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:18.170274  6073 ts_tablet_manager.cc:1434] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260620 13:55:18.171192  6073 tablet_bootstrap.cc:492] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:18.172616  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:18.173943  5998 leader_election.cc:343] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:18.166822  6075 raft_consensus.cc:359] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.175233  6075 raft_consensus.cc:385] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.175588  6075 raft_consensus.cc:740] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.176299  6075 consensus_queue.cc:260] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.176928  6073 tablet_bootstrap.cc:654] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.178558  6075 ts_tablet_manager.cc:1434] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260620 13:55:18.175581  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:18.180178  5959 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 0.
I20260620 13:55:18.181798  5997 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:18.182951  6101 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:18.183350  6101 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:18.183683  6101 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.181761  6075 tablet_bootstrap.cc:492] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:18.206714  6074 tablet_bootstrap.cc:492] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:18.194399  6101 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.207247  6074 ts_tablet_manager.cc:1403] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.175s	user 0.048s	sys 0.043s
I20260620 13:55:18.211743  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:18.212157  6075 tablet_bootstrap.cc:654] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.213418  6074 raft_consensus.cc:359] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:18.213750  5998 leader_election.cc:343] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:18.214133  6074 raft_consensus.cc:385] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.214419  6074 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.214793  6110 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.215070  6074 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.216018  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:18.216605  5959 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.217908  6110 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.220296  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:18.220952  5957 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.221356  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:18.221917  6030 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.228454  5957 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:18.229770  5848 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:18.230005  5959 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:55:18.230630  6110 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:18.231139  6110 raft_consensus.cc:697] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:18.231712  5997 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:18.231992  6110 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.232652  6126 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:18.218277  6074 ts_tablet_manager.cc:1434] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260620 13:55:18.219502  6103 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.237391  6103 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.239615  6103 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.241379  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:18.241847  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:18.242698  6032 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
W20260620 13:55:18.243078  5924 leader_election.cc:343] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:18.241865  6074 tablet_bootstrap.cc:492] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:18.244277  6141 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.244982  6141 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.247943  6141 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.249609  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:18.252956  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:18.253777  6103 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:18.254199  6103 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:18.254613  6103 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.256166  6030 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:18.258826  6074 tablet_bootstrap.cc:654] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.262368  6103 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.262961  6101 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:18.265506  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:55:18.266891  5924 leader_election.cc:343] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:18.253407  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:18.268597  6103 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.269418  5848 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:18.272162  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:18.273033  6075 tablet_bootstrap.cc:492] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:18.273082  6032 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.273875  6075 ts_tablet_manager.cc:1403] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.092s	user 0.033s	sys 0.009s
I20260620 13:55:18.277554  6075 raft_consensus.cc:359] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.278059  6141 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:18.280675  6075 raft_consensus.cc:385] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.281813  6075 raft_consensus.cc:740] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.284158  6074 tablet_bootstrap.cc:492] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:18.285629  6074 ts_tablet_manager.cc:1403] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.009s
I20260620 13:55:18.289374  6075 consensus_queue.cc:260] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.294407  6126 raft_consensus.cc:697] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:18.291913  6074 raft_consensus.cc:359] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.295378  6074 raft_consensus.cc:385] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.296264  6074 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.296156  6126 consensus_queue.cc:237] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.295902  6075 ts_tablet_manager.cc:1434] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260620 13:55:18.298873  6075 tablet_bootstrap.cc:492] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:18.297463  6074 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.310395  6074 ts_tablet_manager.cc:1434] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260620 13:55:18.325935  6075 tablet_bootstrap.cc:654] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.326360  6074 tablet_bootstrap.cc:492] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:18.321053  6073 tablet_bootstrap.cc:492] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:18.330626  6073 ts_tablet_manager.cc:1403] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.160s	user 0.057s	sys 0.092s
I20260620 13:55:18.333425  6074 tablet_bootstrap.cc:654] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.302388  6032 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:18.334796  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:18.333223  6073 raft_consensus.cc:359] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.335734  6073 raft_consensus.cc:385] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.336082  6073 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.336078  6103 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:18.336855  6103 raft_consensus.cc:697] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:18.337555  6073 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.339519  5779 catalog_manager.cc:5696] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:18.341341  6073 ts_tablet_manager.cc:1434] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.005s
I20260620 13:55:18.342231  6073 tablet_bootstrap.cc:492] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:18.342803  5781 catalog_manager.cc:5696] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:18.338136  6103 consensus_queue.cc:237] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.345676  6075 tablet_bootstrap.cc:492] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:18.346122  6075 ts_tablet_manager.cc:1403] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.010s
I20260620 13:55:18.348570  6073 tablet_bootstrap.cc:654] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.349080  6075 raft_consensus.cc:359] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.349978  6075 raft_consensus.cc:385] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.350346  6075 raft_consensus.cc:740] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.351203  6075 consensus_queue.cc:260] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:18.342492  5829 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:55:18.354910  6075 ts_tablet_manager.cc:1434] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260620 13:55:18.356233  6075 tablet_bootstrap.cc:492] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:18.357488  6110 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.358096  6110 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.362402  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:18.363157  6075 tablet_bootstrap.cc:654] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.363049  6032 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:18.364399  5849 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:18.365252  6141 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:18.365600  6141 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:18.366041  6141 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.368577  6110 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.372822  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:18.374336  5848 leader_election.cc:343] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:18.377388  6073 tablet_bootstrap.cc:492] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:18.377843  6073 ts_tablet_manager.cc:1403] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.036s	user 0.027s	sys 0.003s
I20260620 13:55:18.382151  6073 raft_consensus.cc:359] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.382788  6073 raft_consensus.cc:385] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.383035  6073 raft_consensus.cc:740] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.378592  6141 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.383720  6073 consensus_queue.cc:260] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.385670  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:18.385916  6141 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:55:18.387161  5848 leader_election.cc:343] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:18.387552  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:18.388111  6032 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.388432  6074 tablet_bootstrap.cc:492] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:18.387780  5781 catalog_manager.cc:5696] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:18.388960  6074 ts_tablet_manager.cc:1403] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.004s
I20260620 13:55:18.391407  6074 raft_consensus.cc:359] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.392056  6074 raft_consensus.cc:385] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.392305  6074 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.392948  6074 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.388432  6073 ts_tablet_manager.cc:1434] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260620 13:55:18.396634  6073 tablet_bootstrap.cc:492] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:18.398721  6032 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:18.399987  5849 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:55:18.401325  6103 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.401888  6103 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.403342  6075 tablet_bootstrap.cc:492] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:18.403780  6075 ts_tablet_manager.cc:1403] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.004s
I20260620 13:55:18.404976  6073 tablet_bootstrap.cc:654] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.405292  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:18.405999  5883 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:18.406328  6075 raft_consensus.cc:359] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.407557  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:18.407761  6075 raft_consensus.cc:385] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.408281  6075 raft_consensus.cc:740] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.408453  6079 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:18.408526  6141 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:18.408870  6079 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:18.409281  6079 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.409157  6075 consensus_queue.cc:260] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.410503  6141 raft_consensus.cc:697] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:18.411090  6110 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.411478  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:18.411597  6110 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.412093  6030 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:18.411754  6141 consensus_queue.cc:237] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.413094  6105 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.413693  6105 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.414749  6103 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.395092  6074 ts_tablet_manager.cc:1434] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260620 13:55:18.416522  6074 tablet_bootstrap.cc:492] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:18.417857  6075 ts_tablet_manager.cc:1434] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260620 13:55:18.418764  6075 tablet_bootstrap.cc:492] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:18.423775  6110 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.424329  6105 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.425289  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:18.425702  6075 tablet_bootstrap.cc:654] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.426163  6030 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:18.427762  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:18.428812  6110 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:18.429185  6110 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:18.429534  6110 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.430256  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:18.433254  5985 tablet.cc:2406] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 13:55:18.434065  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:18.434890  6031 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:18.422626  6079 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.437317  6079 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.439586  6031 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.442701  6110 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.443981  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:18.444816  5958 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:18.446954  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:18.447067  6110 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.447616  5883 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.447680  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:18.448284  6030 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.449350  6075 tablet_bootstrap.cc:492] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:18.449653  6075 ts_tablet_manager.cc:1403] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.003s
I20260620 13:55:18.452052  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:18.452124  6075 raft_consensus.cc:359] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.453138  6033 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.453281  6075 raft_consensus.cc:385] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.453615  6075 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.454355  6075 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.455610  6073 tablet_bootstrap.cc:492] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:18.456029  6073 ts_tablet_manager.cc:1403] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.060s	user 0.024s	sys 0.022s
I20260620 13:55:18.457190  6075 ts_tablet_manager.cc:1434] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260620 13:55:18.458484  6075 tablet_bootstrap.cc:492] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:18.461257  6073 raft_consensus.cc:359] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.462356  6073 raft_consensus.cc:385] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.462597  6073 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.463192  6073 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.463691  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:55:18.464928  5924 leader_election.cc:343] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:18.466703  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:18.467381  6079 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:18.467784  6079 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:18.468192  6079 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.459412  5883 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:18.475955  6033 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:18.467397  5958 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.477569  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:18.478354  6105 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:18.478811  6105 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:18.479662  6126 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.479624  6105 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.480182  6126 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } }
I20260620 13:55:18.480613  6073 ts_tablet_manager.cc:1434] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260620 13:55:18.481529  6073 tablet_bootstrap.cc:492] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:18.482239  6126 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:55:18.484226  6030 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:18.487886  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:18.488307  5778 catalog_manager.cc:5696] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:18.488811  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:18.491096  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:18.492419  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:18.496675  6110 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:18.497159  5958 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:18.505208  6110 raft_consensus.cc:697] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:18.507192  6073 tablet_bootstrap.cc:654] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.506682  6110 consensus_queue.cc:237] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.499344  6126 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:18.518514  6074 tablet_bootstrap.cc:654] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.520301  6079 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.528072  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:18.528716  5884 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.534566  6075 tablet_bootstrap.cc:654] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.538479  5781 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:18.543910  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:18.544651  6079 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.544736  6031 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.550020  5884 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:18.554181  6073 tablet_bootstrap.cc:492] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:18.554708  6073 ts_tablet_manager.cc:1403] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.016s
I20260620 13:55:18.555879  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:18.557022  6031 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:18.557205  6079 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:18.560783  6079 raft_consensus.cc:697] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:18.562357  6079 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.563383  5781 catalog_manager.cc:5696] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:18.568962  5884 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.582007  6126 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.582756  6126 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.587800  6126 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:18.588483  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:18.589756  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:18.590456  5998 leader_election.cc:343] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:18.591609  5997 leader_election.cc:343] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:18.591609  6073 raft_consensus.cc:359] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.592207  5997 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:18.592463  6073 raft_consensus.cc:385] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.592739  6073 raft_consensus.cc:740] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.593297  6126 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:18.593503  6073 consensus_queue.cc:260] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.597677  6075 tablet_bootstrap.cc:492] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:18.598054  6074 tablet_bootstrap.cc:492] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:18.598112  6075 ts_tablet_manager.cc:1403] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.140s	user 0.021s	sys 0.002s
I20260620 13:55:18.598999  6074 ts_tablet_manager.cc:1403] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.183s	user 0.010s	sys 0.004s
I20260620 13:55:18.598699  6073 ts_tablet_manager.cc:1434] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.044s	user 0.012s	sys 0.019s
I20260620 13:55:18.600556  6073 tablet_bootstrap.cc:492] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:18.601641  6075 raft_consensus.cc:359] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.602437  6075 raft_consensus.cc:385] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.602110  6074 raft_consensus.cc:359] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.602721  6075 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.602964  6074 raft_consensus.cc:385] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.603322  6074 raft_consensus.cc:740] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.607095  6074 consensus_queue.cc:260] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.608407  6073 tablet_bootstrap.cc:654] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.609632  6074 ts_tablet_manager.cc:1434] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260620 13:55:18.611406  6074 tablet_bootstrap.cc:492] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:18.616598  6075 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.616163  5778 catalog_manager.cc:5696] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:18.618681  6075 ts_tablet_manager.cc:1434] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.003s
I20260620 13:55:18.619973  6075 tablet_bootstrap.cc:492] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:18.623620  6079 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.624327  6079 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.627949  6079 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.629920  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:18.630873  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:18.632160  6031 raft_consensus.cc:2393] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 1: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:55:18.633700  6073 tablet_bootstrap.cc:492] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:18.633746  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:18.634285  6073 ts_tablet_manager.cc:1403] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.034s	user 0.029s	sys 0.000s
I20260620 13:55:18.635154  6079 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.635766  6074 tablet_bootstrap.cc:654] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.637185  6073 raft_consensus.cc:359] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.637931  6073 raft_consensus.cc:385] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.638283  6073 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.638978  6073 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.640686  6075 tablet_bootstrap.cc:654] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.641247  6073 ts_tablet_manager.cc:1434] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260620 13:55:18.645273  6073 tablet_bootstrap.cc:492] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:18.653048  6073 tablet_bootstrap.cc:654] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.653756  6074 tablet_bootstrap.cc:492] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:18.654335  6074 ts_tablet_manager.cc:1403] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.006s
I20260620 13:55:18.655504  6110 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.655968  6110 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.658061  6110 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.660387  6075 tablet_bootstrap.cc:492] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:18.660529  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:18.662093  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:18.665349  5958 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:55:18.667876  5848 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:18.668709  6075 ts_tablet_manager.cc:1403] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.006s
I20260620 13:55:18.669605  6110 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.670799  6074 raft_consensus.cc:359] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.671882  6079 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:18.673136  6074 raft_consensus.cc:385] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.673630  6074 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.674772  6153 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.675467  6153 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.681077  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:18.681073  6110 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:18.683614  6109 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 13:55:18.684087  5998 leader_election.cc:343] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:18.685235  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:18.685899  6075 raft_consensus.cc:359] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.686419  6075 raft_consensus.cc:385] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.686691  6075 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.687383  6075 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:18.688951  5997 leader_election.cc:343] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:18.689594  5997 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:18.690785  6126 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:18.692824  6153 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:18.695128  6031 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.700872  6075 ts_tablet_manager.cc:1434] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.032s	user 0.002s	sys 0.003s
I20260620 13:55:18.701797  6075 tablet_bootstrap.cc:492] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:18.708328  6075 tablet_bootstrap.cc:654] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.710121  6110 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:18.725049  6126 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:18.733626  6074 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.736920  6074 ts_tablet_manager.cc:1434] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260620 13:55:18.738158  6074 tablet_bootstrap.cc:492] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:18.747960  6153 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:18.752120  6110 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.752671  6110 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.754794  6073 tablet_bootstrap.cc:492] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:18.755352  6073 ts_tablet_manager.cc:1403] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.110s	user 0.043s	sys 0.050s
I20260620 13:55:18.754837  6110 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.758045  6073 raft_consensus.cc:359] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.758744  6073 raft_consensus.cc:385] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.759960  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:18.760598  6033 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:18.760993  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:18.762058  5957 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:18.762516  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:18.759011  6073 raft_consensus.cc:740] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.763578  6110 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:18.764020  6110 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:18.764456  6110 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.763808  6073 consensus_queue.cc:260] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.767069  6073 ts_tablet_manager.cc:1434] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260620 13:55:18.768085  6073 tablet_bootstrap.cc:492] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:18.774806  6110 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.778440  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:18.779176  5958 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.775035  6073 tablet_bootstrap.cc:654] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.791492  6110 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.794016  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:18.794651  6031 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.796654  5958 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:18.802201  5848 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:18.803375  6110 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:18.803902  6110 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:18.805011  6110 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.805999  6075 tablet_bootstrap.cc:492] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:18.812126  6075 ts_tablet_manager.cc:1403] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.025s
I20260620 13:55:18.812309  6074 tablet_bootstrap.cc:654] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.837333  6075 raft_consensus.cc:359] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.838294  6075 raft_consensus.cc:385] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.838598  6075 raft_consensus.cc:740] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.839535  6031 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:18.839751  6075 consensus_queue.cc:260] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.806674  6109 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.843729  6073 tablet_bootstrap.cc:492] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:18.844231  6073 ts_tablet_manager.cc:1403] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.010s
I20260620 13:55:18.847393  6073 raft_consensus.cc:359] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.848097  6073 raft_consensus.cc:385] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.848347  6075 ts_tablet_manager.cc:1434] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.000s
I20260620 13:55:18.848398  6073 raft_consensus.cc:740] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.848220  5778 catalog_manager.cc:5696] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:18.849794  6109 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.849749  6073 consensus_queue.cc:260] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.850752  5884 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.852087  6073 ts_tablet_manager.cc:1434] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260620 13:55:18.853670  6073 tablet_bootstrap.cc:492] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:18.862414  6073 tablet_bootstrap.cc:654] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.862095  6079 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:18.863976  6109 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.864568  6075 tablet_bootstrap.cc:492] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:18.867545  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:18.869138  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:18.870055  6031 raft_consensus.cc:2393] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:18.871389  6079 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:18.871968  6075 tablet_bootstrap.cc:654] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.872539  5848 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:18.879007  6109 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:18.890661  6109 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.891263  6109 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.893592  6109 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.893819  6074 tablet_bootstrap.cc:492] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:18.894147  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:18.895248  6074 ts_tablet_manager.cc:1403] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.157s	user 0.024s	sys 0.035s
W20260620 13:55:18.895489  5848 leader_election.cc:343] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:18.896015  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:18.896683  6033 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:18.898070  6075 tablet_bootstrap.cc:492] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:18.897840  5849 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:55:18.897838  6074 raft_consensus.cc:359] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.898636  6075 ts_tablet_manager.cc:1403] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.008s
I20260620 13:55:18.898669  6074 raft_consensus.cc:385] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.898804  6109 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:18.899171  6074 raft_consensus.cc:740] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.899358  6109 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:18.899749  6109 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:18.899878  6074 consensus_queue.cc:260] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.901492  6074 ts_tablet_manager.cc:1434] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260620 13:55:18.901433  6075 raft_consensus.cc:359] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.902326  6075 raft_consensus.cc:385] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:18.902720  6075 raft_consensus.cc:740] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:18.903210  6074 tablet_bootstrap.cc:492] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:18.904500  6075 consensus_queue.cc:260] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.910663  6075 ts_tablet_manager.cc:1434] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260620 13:55:18.912849  6075 tablet_bootstrap.cc:492] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:18.919416  6169 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:18.935621  6153 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.936336  6126 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.936182  6153 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.936802  6126 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.938148  6074 tablet_bootstrap.cc:654] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:18.938288  6153 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:18.938839  6126 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:18.939416  6110 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:18.940485  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:18.941743  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:18.946470  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:18.946338  6105 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:18.961404  6079 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.963809  6079 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:18.966826  5997 leader_election.cc:343] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:18.958400  6126 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:18.968230  6079 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:18.968045  6126 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.970099  6126 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:55:18.962380  5998 leader_election.cc:343] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:18.970321  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:18.960279  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:18.973749  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:18.974817  6033 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:18.976006  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:18.959528  6109 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:18.991199  5884 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 0.
I20260620 13:55:18.995977  6105 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:18.996399  6105 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:55:18.978906  5997 leader_election.cc:343] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.049778  6075 tablet_bootstrap.cc:654] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.016253  5882 raft_consensus.cc:2393] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 1: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:55:18.996721  6105 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:19.014320  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:19.018460  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:18.996716  6109 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:19.025092  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:19.023492  6110 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:19.008823  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:55:19.061468  6073 tablet_bootstrap.cc:492] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:19.072273  6073 ts_tablet_manager.cc:1403] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.219s	user 0.028s	sys 0.023s
I20260620 13:55:19.063169  6030 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:19.068300  6169 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:19.068475  5997 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:19.074940  6153 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:19.076809  6153 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:19.077260  6153 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:19.078544  6126 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:19.091398  6079 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:19.135092  6110 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.135144  6074 tablet_bootstrap.cc:492] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:19.136335  6074 ts_tablet_manager.cc:1403] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.233s	user 0.024s	sys 0.019s
I20260620 13:55:19.141180  6074 raft_consensus.cc:359] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.141985  6074 raft_consensus.cc:385] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.142114  6110 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:19.142292  6074 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.143201  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:19.143851  6031 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:19.143479  6074 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.145141  5849 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:19.146462  6074 ts_tablet_manager.cc:1434] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260620 13:55:19.147639  6074 tablet_bootstrap.cc:492] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:19.148619  6109 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:19.148999  6109 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:19.149351  6109 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:55:19.144173  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 135253us
W20260620 13:55:19.150964  5998 leader_election.cc:343] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.149085  6105 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.156286  5959 raft_consensus.cc:2393] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:19.163781  6073 raft_consensus.cc:359] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.164748  6073 raft_consensus.cc:385] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.165118  6073 raft_consensus.cc:740] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.166016  6073 consensus_queue.cc:260] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.175297  6073 ts_tablet_manager.cc:1434] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.103s	user 0.012s	sys 0.000s
I20260620 13:55:19.176841  6073 tablet_bootstrap.cc:492] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:19.160923  6110 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260620 13:55:19.167938  6105 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:55:19.169899  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 87265.8us
I20260620 13:55:19.186383  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:19.187278  5883 raft_consensus.cc:2393] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 1: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:55:19.187278  6109 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.189982  6109 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:55:19.195780  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 228232us
I20260620 13:55:19.200595  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:19.204450  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:19.205858  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:19.206440  6031 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:55:19.206974  5997 leader_election.cc:343] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.209642  5997 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:19.211304  6101 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:19.214099  6074 tablet_bootstrap.cc:654] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.219696  6075 tablet_bootstrap.cc:492] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:19.220199  6075 ts_tablet_manager.cc:1403] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.308s	user 0.035s	sys 0.041s
I20260620 13:55:19.225052  6110 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:19.226655  6101 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:19.227165  6101 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.229943  6101 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:19.230007  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:19.230226  6030 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:19.231452  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:19.233176  6073 tablet_bootstrap.cc:654] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.233536  5849 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:19.234210  6075 raft_consensus.cc:359] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.234869  6110 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:19.235401  6110 raft_consensus.cc:697] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:19.234934  6075 raft_consensus.cc:385] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.237375  6075 raft_consensus.cc:740] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.236321  6110 consensus_queue.cc:237] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.238194  6075 consensus_queue.cc:260] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:19.239326  5998 leader_election.cc:343] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.242110  6075 ts_tablet_manager.cc:1434] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260620 13:55:19.243594  6075 tablet_bootstrap.cc:492] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:19.248363  6073 tablet_bootstrap.cc:492] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:19.248600  6109 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:19.248812  6073 ts_tablet_manager.cc:1403] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.072s	user 0.005s	sys 0.007s
I20260620 13:55:19.249101  6109 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.250758  6073 raft_consensus.cc:359] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.251088  6109 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:19.251479  6073 raft_consensus.cc:385] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.251756  6073 raft_consensus.cc:740] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.252262  6073 consensus_queue.cc:260] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.253789  6073 ts_tablet_manager.cc:1434] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260620 13:55:19.254458  6073 tablet_bootstrap.cc:492] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:19.255442  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:19.231215  6153 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.261597  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:19.262282  6033 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:19.263813  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:19.265753  6075 tablet_bootstrap.cc:654] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.259797  6153 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:19.265436  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:19.264851  6169 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:19.272228  6169 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:19.275264  6169 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:19.270104  5959 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:19.270053  6031 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:19.274925  5778 catalog_manager.cc:5696] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:19.277429  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:19.296957  5849 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:19.316008  6203 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260620 13:55:19.322422  6208 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260620 13:55:19.322901  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:19.324747  6105 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260620 13:55:19.314867  5997 leader_election.cc:343] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.327000  5997 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:19.330503  6101 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:19.331207  6079 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:19.332541  6169 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.332959  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:19.334666  6169 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:19.317027  6110 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
W20260620 13:55:19.341122  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 44861.2us
I20260620 13:55:19.364210  6073 tablet_bootstrap.cc:654] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.366258  6074 tablet_bootstrap.cc:492] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:19.366750  6074 ts_tablet_manager.cc:1403] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.219s	user 0.023s	sys 0.015s
W20260620 13:55:19.363135  5848 leader_election.cc:343] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.367604  6110 raft_consensus.cc:697] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:55:19.375464  6211 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260620 13:55:19.407866  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:19.410499  6032 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:19.416749  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:19.417496  5881 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:55:19.411803  5848 leader_election.cc:343] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.408500  6110 consensus_queue.cc:237] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:19.428234  5848 leader_election.cc:343] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.428355  6074 raft_consensus.cc:359] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.429493  6074 raft_consensus.cc:385] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.429888  6074 raft_consensus.cc:740] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.430711  6074 consensus_queue.cc:260] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.431156  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:19.434473  6074 ts_tablet_manager.cc:1434] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260620 13:55:19.437770  6074 tablet_bootstrap.cc:492] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:19.450518  5881 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:55:19.451809  5959 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
W20260620 13:55:19.452262  5848 leader_election.cc:343] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.455783  6214 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260620 13:55:19.457679  5997 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:19.466202  6074 tablet_bootstrap.cc:654] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.458945  6032 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:19.458882  6153 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:19.472007  6153 raft_consensus.cc:697] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:19.472895  6153 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.485368  6075 tablet_bootstrap.cc:492] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:19.486119  6075 ts_tablet_manager.cc:1403] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.243s	user 0.024s	sys 0.044s
I20260620 13:55:19.485961  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:55:19.487965  6110 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:19.488682  6110 raft_consensus.cc:697] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:19.490029  6110 consensus_queue.cc:237] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:19.496109  5829 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:55:19.501282  6101 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:19.501966  6101 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.505877  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:19.509102  6101 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:19.511250  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:19.513171  5997 leader_election.cc:343] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.525990  6074 tablet_bootstrap.cc:492] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:19.524941  5780 catalog_manager.cc:5696] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:19.528090  6074 ts_tablet_manager.cc:1403] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.091s	user 0.019s	sys 0.003s
I20260620 13:55:19.526611  5778 catalog_manager.cc:5696] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
W20260620 13:55:19.533023  5998 leader_election.cc:343] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.533510  5998 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:19.534461  6074 raft_consensus.cc:359] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.540831  6073 tablet_bootstrap.cc:492] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:19.541424  6073 ts_tablet_manager.cc:1403] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.287s	user 0.027s	sys 0.018s
I20260620 13:55:19.541149  6075 raft_consensus.cc:359] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.535379  6153 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:19.541909  6075 raft_consensus.cc:385] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.541985  6074 raft_consensus.cc:385] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.542312  6075 raft_consensus.cc:740] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.542534  6074 raft_consensus.cc:740] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.543180  6075 consensus_queue.cc:260] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.543896  6074 consensus_queue.cc:260] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.545854  6074 ts_tablet_manager.cc:1434] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260620 13:55:19.545701  6073 raft_consensus.cc:359] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.546049  6075 ts_tablet_manager.cc:1434] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260620 13:55:19.546339  6073 raft_consensus.cc:385] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.546605  6073 raft_consensus.cc:740] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.546999  6075 tablet_bootstrap.cc:492] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:19.547727  6073 consensus_queue.cc:260] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.549747  6073 ts_tablet_manager.cc:1434] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260620 13:55:19.550833  6073 tablet_bootstrap.cc:492] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:19.552628  6074 tablet_bootstrap.cc:492] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:19.566174  6073 tablet_bootstrap.cc:654] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.569089  6075 tablet_bootstrap.cc:654] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.568274  6074 tablet_bootstrap.cc:654] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.593855  6074 tablet_bootstrap.cc:492] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:19.594458  6074 ts_tablet_manager.cc:1403] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.003s
I20260620 13:55:19.597620  6074 raft_consensus.cc:359] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.598590  6074 raft_consensus.cc:385] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.601922  6074 raft_consensus.cc:740] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.602970  6074 consensus_queue.cc:260] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.601642  6073 tablet_bootstrap.cc:492] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:19.604348  6073 ts_tablet_manager.cc:1403] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.006s
I20260620 13:55:19.607688  6073 raft_consensus.cc:359] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.610193  6073 raft_consensus.cc:385] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.610579  6073 raft_consensus.cc:740] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.611537  6073 consensus_queue.cc:260] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.613742  6073 ts_tablet_manager.cc:1434] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260620 13:55:19.609869  6074 ts_tablet_manager.cc:1434] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260620 13:55:19.614841  6074 tablet_bootstrap.cc:492] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:19.617221  6073 tablet_bootstrap.cc:492] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:19.630110  6073 tablet_bootstrap.cc:654] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.622264  6074 tablet_bootstrap.cc:654] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.645905  6073 tablet_bootstrap.cc:492] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:19.647851  6105 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:19.648566  6105 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.650141  6074 tablet_bootstrap.cc:492] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:19.650719  6074 ts_tablet_manager.cc:1403] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.036s	user 0.004s	sys 0.010s
I20260620 13:55:19.651469  6203 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:19.652096  6203 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.648108  6073 ts_tablet_manager.cc:1403] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.007s
I20260620 13:55:19.654560  6074 raft_consensus.cc:359] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.655043  6203 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:19.664093  5779 catalog_manager.cc:5696] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:19.657944  6073 raft_consensus.cc:359] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.662338  6105 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:19.658066  6074 raft_consensus.cc:385] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.670145  6074 raft_consensus.cc:740] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.670358  6110 consensus_queue.cc:1048] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:19.670948  6074 consensus_queue.cc:260] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.673547  6074 ts_tablet_manager.cc:1434] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260620 13:55:19.674664  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:19.677140  6074 tablet_bootstrap.cc:492] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:19.679212  6073 raft_consensus.cc:385] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.679535  6073 raft_consensus.cc:740] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.680197  6073 consensus_queue.cc:260] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.682202  6073 ts_tablet_manager.cc:1434] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.002s
I20260620 13:55:19.683202  6073 tablet_bootstrap.cc:492] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:19.684638  6074 tablet_bootstrap.cc:654] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.688585  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:19.696388  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:19.697314  6032 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 1: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:55:19.697858  6075 tablet_bootstrap.cc:492] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:19.698412  6075 ts_tablet_manager.cc:1403] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.151s	user 0.032s	sys 0.098s
I20260620 13:55:19.699249  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:19.700148  6032 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 1: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:55:19.699941  5924 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:19.702126  6197 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:19.702293  6074 tablet_bootstrap.cc:492] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:19.702435  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:19.702808  6074 ts_tablet_manager.cc:1403] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.001s
I20260620 13:55:19.705518  6105 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:19.706607  6073 tablet_bootstrap.cc:654] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.707859  6075 raft_consensus.cc:359] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.708649  6075 raft_consensus.cc:385] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.708988  6075 raft_consensus.cc:740] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.711740  6075 consensus_queue.cc:260] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.713739  6075 ts_tablet_manager.cc:1434] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260620 13:55:19.714603  6075 tablet_bootstrap.cc:492] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:19.720572  6105 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:19.725400  6110 consensus_queue.cc:1048] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:19.728012  6197 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:19.734325  6074 raft_consensus.cc:359] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.735164  6074 raft_consensus.cc:385] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.735528  6074 raft_consensus.cc:740] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.736261  6074 consensus_queue.cc:260] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.738549  6074 ts_tablet_manager.cc:1434] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.001s
I20260620 13:55:19.742638  6074 tablet_bootstrap.cc:492] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:19.746682  6101 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:19.748768  6101 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.753758  6126 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:19.754271  6126 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.754983  6101 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:19.756127  6126 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:19.759682  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:19.760335  5958 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 0.
I20260620 13:55:19.760753  6073 tablet_bootstrap.cc:492] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:19.761199  6073 ts_tablet_manager.cc:1403] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.002s
I20260620 13:55:19.766538  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:19.767053  5997 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:19.768440  6074 tablet_bootstrap.cc:654] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.769313  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:19.769917  6126 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:19.770298  6126 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:19.770627  6126 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:19.772331  6075 tablet_bootstrap.cc:654] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.769433  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:19.775094  5998 leader_election.cc:343] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:19.777593  5998 leader_election.cc:343] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:19.779093  5997 leader_election.cc:343] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.785220  6073 raft_consensus.cc:359] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.785969  6073 raft_consensus.cc:385] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.786150  6073 raft_consensus.cc:740] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.786859  6073 consensus_queue.cc:260] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.785677  5997 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:19.787916  6153 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:19.794461  6075 tablet_bootstrap.cc:492] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:19.808264  6075 ts_tablet_manager.cc:1403] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.094s	user 0.017s	sys 0.001s
I20260620 13:55:19.810842  6075 raft_consensus.cc:359] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.811548  6075 raft_consensus.cc:385] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.811818  6075 raft_consensus.cc:740] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.812500  6075 consensus_queue.cc:260] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.791935  6126 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.817919  6126 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:19.815061  6075 ts_tablet_manager.cc:1434] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260620 13:55:19.818878  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:19.818969  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:19.819490  6075 tablet_bootstrap.cc:492] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:19.819522  5959 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:19.820035  6074 tablet_bootstrap.cc:492] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:19.820461  6074 ts_tablet_manager.cc:1403] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.078s	user 0.026s	sys 0.005s
W20260620 13:55:19.820523  5998 leader_election.cc:343] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.823007  6074 raft_consensus.cc:359] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.823701  6074 raft_consensus.cc:385] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.823967  6074 raft_consensus.cc:740] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.824633  6074 consensus_queue.cc:260] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.825766  6075 tablet_bootstrap.cc:654] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.789247  6073 ts_tablet_manager.cc:1434] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260620 13:55:19.826722  6074 ts_tablet_manager.cc:1434] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260620 13:55:19.827819  6074 tablet_bootstrap.cc:492] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:19.829911  6126 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:19.830471  6073 tablet_bootstrap.cc:492] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:19.830364  6126 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.833070  6126 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:19.833207  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:19.835023  5998 leader_election.cc:343] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.837818  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:19.838533  5959 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
W20260620 13:55:19.839252  5997 leader_election.cc:343] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.839694  5997 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:19.841115  6126 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:19.841852  5997 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:19.842885  6126 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:19.843540  6126 raft_consensus.cc:697] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:19.844600  6126 consensus_queue.cc:237] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.848083  6073 tablet_bootstrap.cc:654] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.862052  6073 tablet_bootstrap.cc:492] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:19.862896  6074 tablet_bootstrap.cc:654] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.862912  6073 ts_tablet_manager.cc:1403] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.004s
I20260620 13:55:19.864607  6075 tablet_bootstrap.cc:492] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:19.865047  6075 ts_tablet_manager.cc:1403] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.002s
I20260620 13:55:19.867581  6153 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:19.873255  6153 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:19.873736  6153 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.889240  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:19.891595  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:19.893316  5998 leader_election.cc:343] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.892714  5781 catalog_manager.cc:5696] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:19.891664  6153 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:19.887068  6073 raft_consensus.cc:359] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.887526  6075 raft_consensus.cc:359] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.895041  6073 raft_consensus.cc:385] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.895177  6075 raft_consensus.cc:385] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.895432  6073 raft_consensus.cc:740] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.895586  6075 raft_consensus.cc:740] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.896477  6075 consensus_queue.cc:260] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.897735  6073 consensus_queue.cc:260] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:19.898308  5997 leader_election.cc:343] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:19.902758  6075 ts_tablet_manager.cc:1434] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.037s	user 0.013s	sys 0.004s
I20260620 13:55:19.903738  6075 tablet_bootstrap.cc:492] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:19.906677  5997 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:19.911026  6153 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:19.913982  6126 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:19.918861  6073 ts_tablet_manager.cc:1434] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260620 13:55:19.919809  6073 tablet_bootstrap.cc:492] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:19.932752  6073 tablet_bootstrap.cc:654] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.934516  6075 tablet_bootstrap.cc:654] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.940717  6169 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:19.957454  6075 tablet_bootstrap.cc:492] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:19.958048  6075 ts_tablet_manager.cc:1403] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.008s
I20260620 13:55:19.958252  6105 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:19.958839  6105 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.959841  6074 tablet_bootstrap.cc:492] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:19.960274  6074 ts_tablet_manager.cc:1403] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.133s	user 0.013s	sys 0.017s
I20260620 13:55:19.960996  6105 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:19.963936  6110 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:19.975063  6110 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.977211  6110 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:19.964273  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:19.978340  5881 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:19.964572  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:19.979815  6032 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:19.981757  5924 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:19.981978  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:19.964593  6169 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:19.963666  6074 raft_consensus.cc:359] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.983851  6074 raft_consensus.cc:385] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:19.983629  6169 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.984110  6074 raft_consensus.cc:740] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.984753  6074 consensus_queue.cc:260] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:19.985553  6169 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:19.986047  6073 tablet_bootstrap.cc:492] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:19.986472  6073 ts_tablet_manager.cc:1403] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.002s
I20260620 13:55:19.986603  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:19.987382  6074 ts_tablet_manager.cc:1434] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260620 13:55:19.988261  6074 tablet_bootstrap.cc:492] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:19.988611  6105 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:19.991186  6105 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:19.991142  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:19.992871  5957 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:19.992406  6105 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:19.993395  6110 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:19.998404  6074 tablet_bootstrap.cc:654] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:19.991911  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:19.994105  5848 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:19.987272  6031 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:19.995630  6197 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.008497  6197 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.010562  6197 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.011384  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:20.009999  6105 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.012501  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:20.004029  5959 raft_consensus.cc:2393] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:55:19.961426  6075 raft_consensus.cc:359] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.013389  6031 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:20.013754  6075 raft_consensus.cc:385] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.014096  6075 raft_consensus.cc:740] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:19.989164  6073 raft_consensus.cc:359] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.014957  6073 raft_consensus.cc:385] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.015341  6073 raft_consensus.cc:740] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.015131  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:20.016261  6073 consensus_queue.cc:260] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.007782  6110 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:20.018061  6202 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:20.018213  6110 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:20.018522  6202 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:20.018603  6110 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.019075  6202 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.023207  6075 consensus_queue.cc:260] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.024205  5881 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:20.027052  6212 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.027493  6212 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.028314  6214 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.028812  6214 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.029572  6212 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.030894  6214 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.032967  6074 tablet_bootstrap.cc:492] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:20.033088  6075 ts_tablet_manager.cc:1434] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.002s
I20260620 13:55:20.033680  6074 ts_tablet_manager.cc:1403] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.007s
I20260620 13:55:20.033963  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:20.034446  6075 tablet_bootstrap.cc:492] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:20.034529  6030 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:20.031924  6073 ts_tablet_manager.cc:1434] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260620 13:55:20.036173  6212 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:20.036334  6074 raft_consensus.cc:359] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.036939  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:20.037245  6203 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.037876  6073 tablet_bootstrap.cc:492] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:20.037673  6203 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.036955  6074 raft_consensus.cc:385] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.042372  6074 raft_consensus.cc:740] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.043288  6074 consensus_queue.cc:260] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.043291  6212 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:20.047808  6212 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:20.048230  6212 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.046664  6202 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.047116  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:20.052637  6031 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:20.046648  6110 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.054072  5849 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:20.054946  6169 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:20.055426  6169 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:20.055907  6169 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.058890  6073 tablet_bootstrap.cc:654] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.063948  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:20.064931  6031 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.065778  6203 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.061249  6075 tablet_bootstrap.cc:654] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.061734  6105 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.062744  6110 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.070923  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:20.071584  5881 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.073242  5848 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:20.074290  6110 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.074944  6074 ts_tablet_manager.cc:1434] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.041s	user 0.011s	sys 0.000s
I20260620 13:55:20.088275  6073 tablet_bootstrap.cc:492] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:20.137087  6073 ts_tablet_manager.cc:1403] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.099s	user 0.019s	sys 0.006s
I20260620 13:55:20.139545  6073 raft_consensus.cc:359] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.140146  6073 raft_consensus.cc:385] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.140395  6073 raft_consensus.cc:740] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.140576  6074 tablet_bootstrap.cc:492] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:20.140950  6073 consensus_queue.cc:260] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.142478  6073 ts_tablet_manager.cc:1434] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260620 13:55:20.088083  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:20.102424  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:20.143502  6032 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:20.144484  6073 tablet_bootstrap.cc:492] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:20.148568  5924 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:20.149550  6105 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:20.149915  6105 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:20.150089  6075 tablet_bootstrap.cc:492] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:20.150255  6105 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.150544  6075 ts_tablet_manager.cc:1403] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.116s	user 0.008s	sys 0.028s
I20260620 13:55:20.150938  6074 tablet_bootstrap.cc:654] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.112763  6031 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:20.061692  6212 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.113941  6169 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.088742  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:20.154321  6033 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.155083  6075 raft_consensus.cc:359] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.073257  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:20.095415  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:20.122176  5881 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:20.122314  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:20.125701  6101 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.156425  5957 raft_consensus.cc:2393] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:20.156668  5958 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.156721  6101 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.097882  6202 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.127300  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:20.158494  5882 raft_consensus.cc:2393] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 1: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:55:20.158167  5924 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:20.131448  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:20.159024  6101 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:20.159230  6075 raft_consensus.cc:385] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.159336  6029 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.159551  6075 raft_consensus.cc:740] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.127482  6110 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:20.160249  6075 consensus_queue.cc:260] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.155293  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:20.161338  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:20.164482  6202 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
W20260620 13:55:20.164999  5997 leader_election.cc:343] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.165012  6202 raft_consensus.cc:697] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:20.168154  6202 consensus_queue.cc:237] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.170087  5958 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:20.171365  6212 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.172071  5883 raft_consensus.cc:2393] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 1: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:55:20.172577  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:20.170087  6029 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:20.175043  6073 tablet_bootstrap.cc:654] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.134660  6256 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:20.175921  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:20.179841  6249 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:20.185977  6075 ts_tablet_manager.cc:1434] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260620 13:55:20.186993  6075 tablet_bootstrap.cc:492] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:20.180310  6249 raft_consensus.cc:697] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:20.192553  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:20.190455  6254 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:20.193674  6031 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.194021  6254 raft_consensus.cc:697] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:20.195181  6254 consensus_queue.cc:237] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.196202  6105 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.192555  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:20.187003  6033 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:20.201040  6105 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.201483  5959 raft_consensus.cc:2393] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:20.201723  6249 consensus_queue.cc:237] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.205457  5781 catalog_manager.cc:5696] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:20.207275  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:55:20.203917  5998 leader_election.cc:343] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.208278  5998 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:20.209884  6101 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:20.211302  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:20.212096  5882 raft_consensus.cc:2393] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 1: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:55:20.213153  5924 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:20.213918  6197 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260620 13:55:20.216431  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:20.209995  6169 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.232560  6031 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:20.243301  6033 raft_consensus.cc:2393] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:20.244606  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:55:20.246102  6254 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:20.246975  6254 raft_consensus.cc:697] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:20.209223  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:20.249787  6074 tablet_bootstrap.cc:492] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:20.250243  6074 ts_tablet_manager.cc:1403] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.110s	user 0.020s	sys 0.024s
I20260620 13:55:20.252230  5781 catalog_manager.cc:5696] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:20.248128  6254 consensus_queue.cc:237] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.255445  5848 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:20.256624  6074 raft_consensus.cc:359] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.257390  6074 raft_consensus.cc:385] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.257629  6074 raft_consensus.cc:740] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.256631  6169 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260620 13:55:20.258862  6074 consensus_queue.cc:260] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.271222  6074 ts_tablet_manager.cc:1434] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.000s
I20260620 13:55:20.274996  6074 tablet_bootstrap.cc:492] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:20.280150  5780 catalog_manager.cc:5696] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:20.284494  6073 tablet_bootstrap.cc:492] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:20.284951  6073 ts_tablet_manager.cc:1403] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.142s	user 0.013s	sys 0.006s
I20260620 13:55:20.285357  6075 tablet_bootstrap.cc:654] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.287230  6101 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.287676  6101 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.287640  6073 raft_consensus.cc:359] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.288604  6073 raft_consensus.cc:385] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.288890  6073 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.289556  6073 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.289973  6101 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:20.290704  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:20.291685  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:20.292340  6073 ts_tablet_manager.cc:1434] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260620 13:55:20.292502  6105 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:55:20.292968  5997 leader_election.cc:343] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.292898  6105 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.294350  6073 tablet_bootstrap.cc:492] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:20.285413  6074 tablet_bootstrap.cc:654] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.295470  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:20.296083  5882 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:20.297305  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:20.298048  6249 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:20.298394  6249 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:20.298710  6249 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:55:20.300290  5998 leader_election.cc:343] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.300756  5998 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:20.302171  6101 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:20.303069  6241 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.317018  6241 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.319908  6241 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:20.321321  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:20.307467  6105 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.321552  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:20.321960  5882 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 0.
I20260620 13:55:20.313971  6073 tablet_bootstrap.cc:654] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.315030  6075 tablet_bootstrap.cc:492] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:20.324020  5998 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:20.324673  6075 ts_tablet_manager.cc:1403] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.138s	user 0.017s	sys 0.004s
I20260620 13:55:20.326000  6241 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:20.326381  6241 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:20.326722  6241 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.327268  6075 raft_consensus.cc:359] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.327917  6075 raft_consensus.cc:385] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.328197  6075 raft_consensus.cc:740] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.328858  6075 consensus_queue.cc:260] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.308929  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:20.306133  6249 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.330636  5957 raft_consensus.cc:2393] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:20.331633  6249 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.332738  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:20.333372  6075 ts_tablet_manager.cc:1434] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260620 13:55:20.334252  6075 tablet_bootstrap.cc:492] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:20.334368  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:20.334936  5882 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.335898  6241 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.337054  6033 raft_consensus.cc:2393] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 1: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:55:20.341074  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:20.342981  5882 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:20.344537  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:20.345327  6074 tablet_bootstrap.cc:492] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:20.345839  6074 ts_tablet_manager.cc:1403] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.007s
I20260620 13:55:20.347350  5780 catalog_manager.cc:5696] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:20.348632  6074 raft_consensus.cc:359] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.349287  6074 raft_consensus.cc:385] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.349522  6074 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.350121  6074 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.350931  6105 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:20.351461  6105 raft_consensus.cc:697] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:20.352355  6105 consensus_queue.cc:237] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.358753  6075 tablet_bootstrap.cc:654] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.362145  6074 ts_tablet_manager.cc:1434] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260620 13:55:20.363976  6241 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:20.364137  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:20.365676  5997 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:20.366811  6241 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260620 13:55:20.368753  6073 tablet_bootstrap.cc:492] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:20.369159  6073 ts_tablet_manager.cc:1403] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.075s	user 0.022s	sys 0.011s
I20260620 13:55:20.370965  6073 raft_consensus.cc:359] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.371452  6249 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.371698  6073 raft_consensus.cc:385] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.372044  6073 raft_consensus.cc:740] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.371927  6249 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.372726  6073 consensus_queue.cc:260] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.374668  6249 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.377549  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:20.378613  6073 ts_tablet_manager.cc:1434] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260620 13:55:20.378683  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:20.379340  6033 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:20.379658  6073 tablet_bootstrap.cc:492] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
W20260620 13:55:20.381335  5924 leader_election.cc:343] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.382012  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:20.383278  6249 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:20.383620  6249 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:20.383965  6249 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.363222  6074 tablet_bootstrap.cc:492] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:20.393667  6249 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.393484  5781 catalog_manager.cc:5696] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:20.395514  6249 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.395510  6073 tablet_bootstrap.cc:654] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.398414  6075 tablet_bootstrap.cc:492] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:20.398854  6075 ts_tablet_manager.cc:1403] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.008s
I20260620 13:55:20.399051  6074 tablet_bootstrap.cc:654] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.399516  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:20.400703  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:20.401314  6033 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.402351  6075 raft_consensus.cc:359] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.403832  6075 raft_consensus.cc:385] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.404201  6075 raft_consensus.cc:740] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.405251  6075 consensus_queue.cc:260] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:20.408238  5924 leader_election.cc:343] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.416265  6075 ts_tablet_manager.cc:1434] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260620 13:55:20.419617  6241 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:20.429945  6033 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:20.431782  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:20.432786  6249 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:20.433362  6249 raft_consensus.cc:697] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:20.434191  6249 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.443089  6241 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:20.445089  6074 tablet_bootstrap.cc:492] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:20.445554  6074 ts_tablet_manager.cc:1403] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.083s	user 0.023s	sys 0.023s
I20260620 13:55:20.447962  6073 tablet_bootstrap.cc:492] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:20.448884  6073 ts_tablet_manager.cc:1403] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.069s	user 0.027s	sys 0.020s
I20260620 13:55:20.451371  6073 raft_consensus.cc:359] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.452021  6073 raft_consensus.cc:385] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.452286  6073 raft_consensus.cc:740] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.452085  6074 raft_consensus.cc:359] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.452977  6073 consensus_queue.cc:260] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.454978  6073 ts_tablet_manager.cc:1434] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260620 13:55:20.455857  6073 tablet_bootstrap.cc:492] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:20.452924  6074 raft_consensus.cc:385] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.456319  6074 raft_consensus.cc:740] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.457203  6074 consensus_queue.cc:260] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.459995  6074 ts_tablet_manager.cc:1434] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260620 13:55:20.461124  6074 tablet_bootstrap.cc:492] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:20.462894  6073 tablet_bootstrap.cc:654] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.470045  6074 tablet_bootstrap.cc:654] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.484175  6073 tablet_bootstrap.cc:492] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:20.484669  6073 ts_tablet_manager.cc:1403] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.000s
I20260620 13:55:20.487819  6073 raft_consensus.cc:359] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.487039  5780 catalog_manager.cc:5696] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:20.488554  6169 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.492000  6073 raft_consensus.cc:385] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.492383  6073 raft_consensus.cc:740] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.492092  6169 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.490183  6075 tablet_bootstrap.cc:492] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:20.493046  6073 consensus_queue.cc:260] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.495060  6073 ts_tablet_manager.cc:1434] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.000s
I20260620 13:55:20.495751  6169 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.498397  6073 tablet_bootstrap.cc:492] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:20.498914  6074 tablet_bootstrap.cc:492] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:20.499374  6074 ts_tablet_manager.cc:1403] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.012s
I20260620 13:55:20.499409  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:20.500098  6033 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:20.501274  5849 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:20.502455  6254 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:20.502830  6254 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:20.503178  6254 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.503523  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:20.505017  6073 tablet_bootstrap.cc:654] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.512634  5957 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:20.516577  6254 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.521047  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:20.521653  5957 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.531250  6074 raft_consensus.cc:359] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.532040  6074 raft_consensus.cc:385] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.532286  6074 raft_consensus.cc:740] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.533047  6074 consensus_queue.cc:260] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.535748  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:20.536355  6033 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.539417  5957 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:20.541078  5848 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:20.543141  6169 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:20.543251  6033 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:20.543673  6169 raft_consensus.cc:697] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:20.544755  6169 consensus_queue.cc:237] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.547785  6075 tablet_bootstrap.cc:654] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.552135  6256 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.552623  6256 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.556602  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:20.558472  5957 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:20.559660  6256 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.559726  5848 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:20.561010  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:20.562124  6029 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:20.563925  6073 tablet_bootstrap.cc:492] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:20.564512  6073 ts_tablet_manager.cc:1403] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.024s
I20260620 13:55:20.564587  6212 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:20.565028  6212 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:20.565385  6212 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.567278  6073 raft_consensus.cc:359] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.567978  6073 raft_consensus.cc:385] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.569406  6073 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.570040  6073 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.571768  6074 ts_tablet_manager.cc:1434] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.000s
I20260620 13:55:20.572125  6254 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.573523  6073 ts_tablet_manager.cc:1434] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260620 13:55:20.574582  6074 tablet_bootstrap.cc:492] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:20.578781  6212 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:20.580219  5829 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:55:20.582054  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:20.582767  5957 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.590962  6073 tablet_bootstrap.cc:492] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:20.592105  6249 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:20.594235  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:20.595104  6033 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.598228  6073 tablet_bootstrap.cc:654] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.598677  6212 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.603394  6073 tablet_bootstrap.cc:492] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:20.603852  6073 ts_tablet_manager.cc:1403] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260620 13:55:20.603986  5957 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:20.605198  6033 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:20.605845  6075 tablet_bootstrap.cc:492] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:20.606281  6075 ts_tablet_manager.cc:1403] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.014s
I20260620 13:55:20.606905  5849 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:20.606956  6073 raft_consensus.cc:359] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.607972  6212 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:20.608208  6073 raft_consensus.cc:385] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.608436  6212 raft_consensus.cc:697] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:20.608624  6073 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.608834  6075 raft_consensus.cc:359] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.609496  6075 raft_consensus.cc:385] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.609324  6212 consensus_queue.cc:237] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.609781  6075 raft_consensus.cc:740] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.609695  6073 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.610535  6075 consensus_queue.cc:260] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.612950  6073 ts_tablet_manager.cc:1434] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260620 13:55:20.613164  6075 ts_tablet_manager.cc:1434] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260620 13:55:20.614156  6075 tablet_bootstrap.cc:492] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:20.614158  6073 tablet_bootstrap.cc:492] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:20.618948  6254 consensus_queue.cc:1048] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:20.637384  6073 tablet_bootstrap.cc:654] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.641880  6074 tablet_bootstrap.cc:654] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.653298  6254 consensus_queue.cc:1048] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:20.658666  6075 tablet_bootstrap.cc:654] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.678485  6153 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.679245  6153 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.680641  6105 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:20.683360  6153 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:20.685101  6249 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.688642  6073 tablet_bootstrap.cc:492] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:20.689285  6073 ts_tablet_manager.cc:1403] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.005s
I20260620 13:55:20.687049  6249 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.692288  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:20.696844  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:20.697746  5997 leader_election.cc:343] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.698195  5881 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:20.698671  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:20.699764  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
W20260620 13:55:20.700485  5998 leader_election.cc:343] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.700706  6202 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:20.701237  6202 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:20.701740  6202 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.705229  6074 tablet_bootstrap.cc:492] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:20.701079  5998 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:20.705832  6074 ts_tablet_manager.cc:1403] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.131s	user 0.009s	sys 0.001s
I20260620 13:55:20.709522  6153 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:20.710865  6249 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.715721  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:20.716552  6031 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:20.722743  6212 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:20.709892  6074 raft_consensus.cc:359] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.726032  6074 raft_consensus.cc:385] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.726317  6074 raft_consensus.cc:740] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.730893  6073 raft_consensus.cc:359] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.731777  6073 raft_consensus.cc:385] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.727005  6074 consensus_queue.cc:260] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.734320  6074 ts_tablet_manager.cc:1434] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260620 13:55:20.732100  6073 raft_consensus.cc:740] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.722982  6202 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.740958  6202 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.743294  6074 tablet_bootstrap.cc:492] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:20.746373  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:20.747211  5882 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.750566  6153 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.751209  6153 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.754770  6105 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.755599  6105 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.758869  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:20.760603  5998 leader_election.cc:343] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.763376  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:20.764253  6033 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.767318  6241 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.768656  6241 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.770242  6105 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.771204  6153 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:20.742072  6073 consensus_queue.cc:260] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.783581  6073 ts_tablet_manager.cc:1434] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.094s	user 0.009s	sys 0.000s
I20260620 13:55:20.784479  6073 tablet_bootstrap.cc:492] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:20.792240  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:20.786345  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:20.793946  5998 leader_election.cc:343] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.792282  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:20.794814  6241 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:20.795158  6031 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:20.787391  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:20.796967  6075 tablet_bootstrap.cc:492] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:20.778064  5780 catalog_manager.cc:5696] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:20.797838  6075 ts_tablet_manager.cc:1403] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.184s	user 0.039s	sys 0.068s
I20260620 13:55:20.779835  6105 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260620 13:55:20.802771  5780 catalog_manager.cc:5696] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:20.801810  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:20.804060  5997 leader_election.cc:343] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.806210  5997 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:20.807164  6101 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 13:55:20.807559  5997 leader_election.cc:343] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.808004  5997 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:20.811513  5882 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:20.812085  6075 raft_consensus.cc:359] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.800287  6202 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260620 13:55:20.812731  6075 raft_consensus.cc:385] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.813055  6075 raft_consensus.cc:740] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.813419  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:20.814014  6075 consensus_queue.cc:260] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.814114  6197 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:20.816926  6197 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:20.817312  6197 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:55:20.821623  5924 leader_election.cc:343] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.815200  6241 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:20.824002  6075 ts_tablet_manager.cc:1434] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260620 13:55:20.825101  6075 tablet_bootstrap.cc:492] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:20.831843  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:20.832634  6202 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:20.833123  6202 raft_consensus.cc:697] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:20.832895  6197 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.834270  6202 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.836740  6289 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:20.839646  6033 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:20.844019  6073 tablet_bootstrap.cc:654] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.844410  6074 tablet_bootstrap.cc:654] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.856525  6197 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:20.868048  6254 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:20.870677  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:20.872169  6032 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:20.872758  6289 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:20.873788  6075 tablet_bootstrap.cc:654] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.871017  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:55:20.884557  5924 leader_election.cc:343] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.897001  6101 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.888805  6032 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:20.902266  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:20.903215  6289 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:20.903776  6289 raft_consensus.cc:697] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:20.899487  6101 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.905102  6289 consensus_queue.cc:237] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:20.915915  5924 consensus_peers.cc:597] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:20.917484  6074 tablet_bootstrap.cc:492] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:20.919535  6074 ts_tablet_manager.cc:1403] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.184s	user 0.014s	sys 0.008s
I20260620 13:55:20.917625  6101 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:20.927868  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:20.931182  5997 leader_election.cc:343] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.927745  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:20.935209  5998 leader_election.cc:343] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.937285  5998 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:20.938668  6101 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:20.941507  6073 tablet_bootstrap.cc:492] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:20.941972  6073 ts_tablet_manager.cc:1403] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.158s	user 0.009s	sys 0.009s
I20260620 13:55:20.939522  6241 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:20.944973  6241 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.943938  6074 raft_consensus.cc:359] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.948758  6074 raft_consensus.cc:385] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.949311  6074 raft_consensus.cc:740] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.952889  6073 raft_consensus.cc:359] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.953670  6073 raft_consensus.cc:385] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.953933  6073 raft_consensus.cc:740] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.954677  6073 consensus_queue.cc:260] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.956228  6073 ts_tablet_manager.cc:1434] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260620 13:55:20.955880  6074 consensus_queue.cc:260] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.957301  6073 tablet_bootstrap.cc:492] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:20.961397  6075 tablet_bootstrap.cc:492] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:20.961804  6075 ts_tablet_manager.cc:1403] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.137s	user 0.006s	sys 0.015s
I20260620 13:55:20.964162  6074 ts_tablet_manager.cc:1434] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.002s
I20260620 13:55:20.965785  6254 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:20.962935  6241 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:20.971503  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:20.971454  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:20.977918  6075 raft_consensus.cc:359] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.986265  6075 raft_consensus.cc:385] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:20.986572  6075 raft_consensus.cc:740] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:20.987319  6075 consensus_queue.cc:260] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:20.988412  5882 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 0.
I20260620 13:55:20.989521  6214 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:20.989732  6075 ts_tablet_manager.cc:1434] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260620 13:55:20.991807  5998 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:55:20.992660  5997 leader_election.cc:343] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:20.996016  6073 tablet_bootstrap.cc:654] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:20.990995  6075 tablet_bootstrap.cc:492] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:20.979753  6074 tablet_bootstrap.cc:492] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:21.005934  6300 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:21.006500  6300 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:21.007122  6300 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:21.013074  6074 tablet_bootstrap.cc:654] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.014046  6073 tablet_bootstrap.cc:492] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:21.014513  6073 ts_tablet_manager.cc:1403] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.001s
I20260620 13:55:21.014405  6289 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:21.016186  6075 tablet_bootstrap.cc:654] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.017109  6073 raft_consensus.cc:359] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.017762  6073 raft_consensus.cc:385] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.018013  6073 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.018630  6073 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.030107  6073 ts_tablet_manager.cc:1434] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260620 13:55:21.030706  6075 tablet_bootstrap.cc:492] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:21.031056  6073 tablet_bootstrap.cc:492] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:21.031163  6075 ts_tablet_manager.cc:1403] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.005s
I20260620 13:55:21.034448  6075 raft_consensus.cc:359] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.035192  6075 raft_consensus.cc:385] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.035614  6075 raft_consensus.cc:740] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.037145  6214 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:21.047329  6073 tablet_bootstrap.cc:654] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.049712  6074 tablet_bootstrap.cc:492] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:21.050314  6074 ts_tablet_manager.cc:1403] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.006s
I20260620 13:55:21.025354  5781 catalog_manager.cc:5696] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:21.054471  5781 catalog_manager.cc:5696] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:21.042214  6300 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.052871  6074 raft_consensus.cc:359] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.064639  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:21.071533  5882 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:21.068184  6073 tablet_bootstrap.cc:492] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:21.070402  6075 consensus_queue.cc:260] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.073460  6075 ts_tablet_manager.cc:1434] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260620 13:55:21.073999  6073 ts_tablet_manager.cc:1403] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.010s
I20260620 13:55:21.074631  6075 tablet_bootstrap.cc:492] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:21.076745  6073 raft_consensus.cc:359] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.078114  6153 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:21.080885  6074 raft_consensus.cc:385] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.081220  6074 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.080971  6153 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.081938  6074 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.083081  6153 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:21.084828  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:21.085510  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:21.087039  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:21.088390  5997 leader_election.cc:343] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:21.088421  5998 leader_election.cc:343] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:21.089474  5997 leader_election.cc:343] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:21.080651  6073 raft_consensus.cc:385] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.090653  6073 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.089919  5997 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:21.092638  6074 ts_tablet_manager.cc:1434] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260620 13:55:21.093940  6074 tablet_bootstrap.cc:492] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:21.083081  6300 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:21.095328  6153 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:21.097054  6075 tablet_bootstrap.cc:654] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.101380  5882 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:55:21.103057  5998 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:55:21.105259  6073 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.106307  6153 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:21.106822  6153 raft_consensus.cc:697] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:21.107679  6153 consensus_queue.cc:237] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.108230  6073 ts_tablet_manager.cc:1434] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260620 13:55:21.109506  6073 tablet_bootstrap.cc:492] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:21.119688  6074 tablet_bootstrap.cc:654] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.125232  6075 tablet_bootstrap.cc:492] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:21.125989  6075 ts_tablet_manager.cc:1403] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.003s
I20260620 13:55:21.128052  6212 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:21.128648  6073 tablet_bootstrap.cc:654] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.128582  6075 raft_consensus.cc:359] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.129302  6075 raft_consensus.cc:385] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.129592  6075 raft_consensus.cc:740] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.130278  6075 consensus_queue.cc:260] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.132380  6075 ts_tablet_manager.cc:1434] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260620 13:55:21.133500  6075 tablet_bootstrap.cc:492] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:21.139521  6075 tablet_bootstrap.cc:654] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.168550  6074 tablet_bootstrap.cc:492] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:21.169275  6074 ts_tablet_manager.cc:1403] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.076s	user 0.026s	sys 0.020s
I20260620 13:55:21.169376  6075 tablet_bootstrap.cc:492] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:21.170305  6075 ts_tablet_manager.cc:1403] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.004s
I20260620 13:55:21.173409  5781 catalog_manager.cc:5696] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:21.173902  6074 raft_consensus.cc:359] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.174727  6074 raft_consensus.cc:385] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.174794  6073 tablet_bootstrap.cc:492] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:21.175122  6074 raft_consensus.cc:740] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.175396  6073 ts_tablet_manager.cc:1403] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.066s	user 0.028s	sys 0.021s
I20260620 13:55:21.175962  6074 consensus_queue.cc:260] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.177837  6073 raft_consensus.cc:359] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.178340  6074 ts_tablet_manager.cc:1434] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260620 13:55:21.178505  6073 raft_consensus.cc:385] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.178818  6073 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.179893  6074 tablet_bootstrap.cc:492] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:21.179687  6075 raft_consensus.cc:359] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.180367  6075 raft_consensus.cc:385] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.180640  6075 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.181277  6075 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.179913  6073 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.184707  6075 ts_tablet_manager.cc:1434] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260620 13:55:21.185283  6073 ts_tablet_manager.cc:1434] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.004s
I20260620 13:55:21.186021  6075 tablet_bootstrap.cc:492] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:21.186132  6073 tablet_bootstrap.cc:492] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:21.186492  6074 tablet_bootstrap.cc:654] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.193416  6075 tablet_bootstrap.cc:654] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.194283  6212 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:21.194780  6212 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.198470  6256 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:21.198922  6256 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.200055  6153 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:21.200796  6256 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:21.200680  6153 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.203143  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:21.204278  6033 raft_consensus.cc:2393] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:21.204820  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:21.205399  6029 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:21.206023  6212 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:21.207418  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:21.208293  6074 tablet_bootstrap.cc:492] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:21.208770  6074 ts_tablet_manager.cc:1403] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.029s	user 0.003s	sys 0.012s
I20260620 13:55:21.208621  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:21.209300  5958 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:21.211437  5849 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:21.212307  6074 raft_consensus.cc:359] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.212621  6212 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:21.213199  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:21.213521  6212 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:21.213915  6212 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:21.215201  5848 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:21.217453  6256 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:21.220296  6073 tablet_bootstrap.cc:654] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
W20260620 13:55:21.227948  5998 leader_election.cc:343] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:21.229228  6300 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:21.229972  6300 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.234515  6300 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:21.234824  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:21.235885  5958 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 0.
I20260620 13:55:21.237756  5997 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:21.238998  6300 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:21.239559  6300 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:21.240059  6300 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:21.242784  6153 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:21.244956  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:21.246755  5997 leader_election.cc:343] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:21.243440  6074 raft_consensus.cc:385] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.248046  6074 raft_consensus.cc:740] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.250772  6074 consensus_queue.cc:260] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.256081  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:21.257004  6202 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:21.257016  5882 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 0.
I20260620 13:55:21.247891  6212 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.266767  6212 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:21.269938  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:21.270774  6029 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:21.268635  6074 ts_tablet_manager.cc:1434] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260620 13:55:21.247560  5997 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:21.285426  6153 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:21.287283  6074 tablet_bootstrap.cc:492] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:21.289953  6300 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.299497  6300 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:21.300169  6073 tablet_bootstrap.cc:492] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:21.300706  6073 ts_tablet_manager.cc:1403] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.115s	user 0.044s	sys 0.042s
I20260620 13:55:21.303589  6073 raft_consensus.cc:359] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.304360  6073 raft_consensus.cc:385] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.304664  6073 raft_consensus.cc:740] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.305220  6074 tablet_bootstrap.cc:654] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.305836  6073 consensus_queue.cc:260] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.308452  6073 ts_tablet_manager.cc:1434] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 13:55:21.309430  6073 tablet_bootstrap.cc:492] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:21.310817  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:21.311650  5882 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:21.315444  6073 tablet_bootstrap.cc:654] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.317741  6197 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:21.318259  6197 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.320252  6197 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:21.322101  6241 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:21.323050  6241 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.325829  6241 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:21.304845  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:21.327507  5958 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:21.329088  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:21.330551  6073 tablet_bootstrap.cc:492] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:21.331013  6073 ts_tablet_manager.cc:1403] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260620 13:55:21.333339  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:21.334395  5959 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:55:21.334380  5997 leader_election.cc:343] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:21.348129  6300 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:21.356526  6300 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.357409  5959 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:21.358660  6256 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:21.334419  6073 raft_consensus.cc:359] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.361449  6073 raft_consensus.cc:385] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.361528  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:21.364548  6153 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:21.364816  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:21.365366  6153 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.367151  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:21.367801  6033 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:21.368827  6153 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:21.369246  5882 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:55:21.362190  6073 raft_consensus.cc:740] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.372933  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:21.374506  6073 consensus_queue.cc:260] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.376377  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:21.378123  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:21.388839  6073 ts_tablet_manager.cc:1434] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
W20260620 13:55:21.383309  5998 leader_election.cc:343] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:21.392447  5998 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:21.393046  6073 tablet_bootstrap.cc:492] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:21.394044  5998 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:21.381529  6300 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:21.395358  6101 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 13:55:21.391431  5997 leader_election.cc:343] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:21.383950  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:21.394961  5998 leader_election.cc:343] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:21.398200  5998 leader_election.cc:343] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:21.398681  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:21.401098  5848 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:21.402458  6256 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:21.402999  6256 raft_consensus.cc:697] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:21.403304  6300 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:21.403754  6241 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:21.403944  6256 consensus_queue.cc:237] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:21.405409  5997 leader_election.cc:343] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:21.406400  5997 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:21.392077  6029 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:21.409547  5958 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:55:21.409795  6153 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:21.411621  6300 raft_consensus.cc:697] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:21.412822  6300 consensus_queue.cc:237] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:21.416801  5924 leader_election.cc:343] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:21.417667  6202 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260620 13:55:21.421077  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:21.422317  6202 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:21.422683  6202 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:21.423036  6202 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:21.430536  6073 tablet_bootstrap.cc:654] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.433043  6075 tablet_bootstrap.cc:492] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:21.433670  6075 ts_tablet_manager.cc:1403] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.248s	user 0.085s	sys 0.116s
I20260620 13:55:21.434805  6214 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:21.439252  6214 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.442113  6214 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:21.442903  6075 raft_consensus.cc:359] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.444146  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:21.444393  6074 tablet_bootstrap.cc:492] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:21.449891  6075 raft_consensus.cc:385] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.450325  6074 ts_tablet_manager.cc:1403] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.163s	user 0.017s	sys 0.000s
I20260620 13:55:21.450363  6075 raft_consensus.cc:740] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.446589  6202 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.451431  6075 consensus_queue.cc:260] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.454785  6075 ts_tablet_manager.cc:1434] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.007s
I20260620 13:55:21.455704  6075 tablet_bootstrap.cc:492] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:21.459846  5778 catalog_manager.cc:5696] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:21.464725  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:21.466251  6197 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:21.467981  6197 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.475955  5848 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:21.477128  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:21.477607  6256 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:21.477931  5884 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:21.482292  6197 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:21.491010  6074 raft_consensus.cc:359] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.491961  6074 raft_consensus.cc:385] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.492239  6074 raft_consensus.cc:740] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.503425  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:21.505923  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:21.493079  6074 consensus_queue.cc:260] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.508630  6029 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:21.508764  6197 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:21.509503  6202 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:21.509658  6197 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:21.510066  6197 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:21.515187  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:21.517585  5958 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:21.517814  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:21.518422  6031 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:21.522148  6074 ts_tablet_manager.cc:1434] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260620 13:55:21.525223  6031 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
W20260620 13:55:21.527477  5924 leader_election.cc:343] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:21.529062  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:21.527508  5779 catalog_manager.cc:5696] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:21.530673  6249 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:21.532392  6321 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:21.532740  5883 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:21.537528  6197 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.539556  6197 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:21.542407  6289 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:21.542905  6289 raft_consensus.cc:697] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:21.543744  6289 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.545622  6153 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:21.554167  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:21.554479  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:21.554828  5881 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:21.555047  6033 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:21.557348  6074 tablet_bootstrap.cc:492] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:21.573531  6073 tablet_bootstrap.cc:492] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:21.584594  6153 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:21.607885  6073 ts_tablet_manager.cc:1403] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.215s	user 0.015s	sys 0.008s
I20260620 13:55:21.599776  5881 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:21.594981  6033 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:21.625204  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:21.628780  6197 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:21.629289  6197 raft_consensus.cc:697] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:21.630082  6197 consensus_queue.cc:237] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.638068  6073 raft_consensus.cc:359] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.641606  5778 catalog_manager.cc:5696] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:21.644359  6073 raft_consensus.cc:385] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.644719  6073 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.646004  6073 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.654635  6073 ts_tablet_manager.cc:1434] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.002s
I20260620 13:55:21.655506  6073 tablet_bootstrap.cc:492] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
W20260620 13:55:21.755056  6332 log.cc:927] Time spent T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260620 13:55:21.759312  6074 tablet_bootstrap.cc:654] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.763566  6075 tablet_bootstrap.cc:654] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
W20260620 13:55:21.775209  5829 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:55:21.775882  6073 tablet_bootstrap.cc:654] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.787518  5779 catalog_manager.cc:5696] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:21.831637  6241 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:21.835340  6241 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.846206  6153 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:21.846748  6153 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.849769  6153 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:21.851943  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:21.852387  6074 tablet_bootstrap.cc:492] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:21.852859  6074 ts_tablet_manager.cc:1403] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.296s	user 0.015s	sys 0.022s
I20260620 13:55:21.854751  6241 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:21.856004  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:21.857512  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:21.857717  5997 leader_election.cc:343] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:21.859583  5998 leader_election.cc:343] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:21.860057  5998 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:21.860425  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:21.861115  6241 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 13:55:21.861726  5997 leader_election.cc:343] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:21.863351  6169 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:21.863567  6074 raft_consensus.cc:359] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.864436  6074 raft_consensus.cc:385] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260620 13:55:21.863353  5998 leader_election.cc:343] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:21.864769  6074 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.865247  5998 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:21.865712  6074 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.866645  6241 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:21.866572  6212 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:21.869844  6074 ts_tablet_manager.cc:1434] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260620 13:55:21.871011  6074 tablet_bootstrap.cc:492] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:21.874274  6073 tablet_bootstrap.cc:492] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:21.874890  6073 ts_tablet_manager.cc:1403] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.220s	user 0.013s	sys 0.021s
I20260620 13:55:21.879406  6241 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:21.886384  6075 tablet_bootstrap.cc:492] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:21.886956  6075 ts_tablet_manager.cc:1403] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.431s	user 0.019s	sys 0.037s
I20260620 13:55:21.891973  6073 raft_consensus.cc:359] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.892827  6073 raft_consensus.cc:385] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.892629  6075 raft_consensus.cc:359] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.893136  6073 raft_consensus.cc:740] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.893327  6075 raft_consensus.cc:385] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.893646  6075 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.895030  6075 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.897441  6074 tablet_bootstrap.cc:654] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.898111  6075 ts_tablet_manager.cc:1434] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260620 13:55:21.898942  6075 tablet_bootstrap.cc:492] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:21.898790  6073 consensus_queue.cc:260] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.900934  6073 ts_tablet_manager.cc:1434] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260620 13:55:21.902665  6073 tablet_bootstrap.cc:492] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:21.950179  6075 tablet_bootstrap.cc:654] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.950927  6073 tablet_bootstrap.cc:654] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:21.960753  6074 tablet_bootstrap.cc:492] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:21.961241  6074 ts_tablet_manager.cc:1403] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.090s	user 0.007s	sys 0.011s
I20260620 13:55:21.964044  6074 raft_consensus.cc:359] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.964694  6074 raft_consensus.cc:385] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.964987  6074 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.964777  6241 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:21.974469  6289 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:21.981112  6075 tablet_bootstrap.cc:492] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:21.981594  6075 ts_tablet_manager.cc:1403] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.000s
I20260620 13:55:21.984869  6075 raft_consensus.cc:359] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.986661  6075 raft_consensus.cc:385] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:21.987059  6075 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:21.987967  6075 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.991456  6074 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:21.996443  6074 ts_tablet_manager.cc:1434] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.002s
I20260620 13:55:21.997749  6074 tablet_bootstrap.cc:492] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:21.990928  6075 ts_tablet_manager.cc:1434] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260620 13:55:22.005136  6075 tablet_bootstrap.cc:492] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:22.011880  6073 tablet_bootstrap.cc:492] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:22.013289  6073 ts_tablet_manager.cc:1403] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.111s	user 0.025s	sys 0.010s
I20260620 13:55:22.016251  6073 raft_consensus.cc:359] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.017015  6073 raft_consensus.cc:385] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.017331  6074 tablet_bootstrap.cc:654] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.017369  6073 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.018739  6073 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.020592  6075 tablet_bootstrap.cc:654] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.020900  6073 ts_tablet_manager.cc:1434] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260620 13:55:22.021880  6073 tablet_bootstrap.cc:492] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:22.027279  5884 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.029821  6073 tablet_bootstrap.cc:654] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.032047  6075 tablet_bootstrap.cc:492] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:22.032509  6075 ts_tablet_manager.cc:1403] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.001s
I20260620 13:55:22.036409  6074 tablet_bootstrap.cc:492] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:22.036854  6074 ts_tablet_manager.cc:1403] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.003s
I20260620 13:55:22.041558  6249 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:22.041566  6074 raft_consensus.cc:359] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.050427  6074 raft_consensus.cc:385] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.050931  6074 raft_consensus.cc:740] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.035005  6075 raft_consensus.cc:359] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.051733  6075 raft_consensus.cc:385] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.051833  6074 consensus_queue.cc:260] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.052078  6075 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.053732  6075 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.055588  6074 ts_tablet_manager.cc:1434] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.002s
I20260620 13:55:22.055930  6075 ts_tablet_manager.cc:1434] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260620 13:55:22.057633  6075 tablet_bootstrap.cc:492] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:22.057881  6074 tablet_bootstrap.cc:492] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:22.058831  6073 tablet_bootstrap.cc:492] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:22.059502  6073 ts_tablet_manager.cc:1403] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.018s
I20260620 13:55:22.065279  6074 tablet_bootstrap.cc:654] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.067116  6075 tablet_bootstrap.cc:654] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.068418  6073 raft_consensus.cc:359] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.073216  6073 raft_consensus.cc:385] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.073658  6073 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.074267  6169 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.074782  6169 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.074766  6073 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.077067  6169 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.077458  6073 ts_tablet_manager.cc:1434] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260620 13:55:22.078917  6073 tablet_bootstrap.cc:492] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:22.079033  6074 tablet_bootstrap.cc:492] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:22.079494  6074 ts_tablet_manager.cc:1403] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260620 13:55:22.082337  6074 raft_consensus.cc:359] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.083081  6074 raft_consensus.cc:385] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.083542  6074 raft_consensus.cc:740] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.084702  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:22.084508  6074 consensus_queue.cc:260] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.085099  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:55:22.086299  5848 leader_election.cc:343] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.086498  6032 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:22.088200  5849 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:55:22.089190  6212 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:22.089547  6212 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:22.090060  6212 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.089582  6074 ts_tablet_manager.cc:1434] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260620 13:55:22.091945  6074 tablet_bootstrap.cc:492] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:22.091953  6073 tablet_bootstrap.cc:654] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.098610  6074 tablet_bootstrap.cc:654] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.099653  6212 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.116914  6073 tablet_bootstrap.cc:492] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:22.118546  6073 ts_tablet_manager.cc:1403] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.000s
I20260620 13:55:22.121157  6073 raft_consensus.cc:359] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.121917  6073 raft_consensus.cc:385] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.122228  6073 raft_consensus.cc:740] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.123129  6073 consensus_queue.cc:260] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.123615  6249 consensus_queue.cc:1048] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:22.125123  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:22.125766  6073 ts_tablet_manager.cc:1434] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260620 13:55:22.126778  5848 leader_election.cc:343] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.127903  6073 tablet_bootstrap.cc:492] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:22.135667  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:22.137902  6031 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.138586  6074 tablet_bootstrap.cc:492] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:22.139199  6074 ts_tablet_manager.cc:1403] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.012s
I20260620 13:55:22.142414  6241 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.142971  6241 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.145038  6249 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.145519  6249 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.146052  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:22.147915  5998 leader_election.cc:343] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.148079  6241 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:22.148804  6031 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:22.149835  5849 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:55:22.150347  6249 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.150542  6256 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:22.151017  6256 raft_consensus.cc:697] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:22.151543  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:22.152177  6256 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.152830  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:22.153043  5997 leader_election.cc:343] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.147131  6074 raft_consensus.cc:359] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.153625  6074 raft_consensus.cc:385] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.153473  5997 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:22.153944  6074 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.154656  6241 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:22.154621  6074 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.135278  6212 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.160588  6073 tablet_bootstrap.cc:654] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
W20260620 13:55:22.162992  5924 leader_election.cc:343] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.165844  6074 ts_tablet_manager.cc:1434] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260620 13:55:22.166661  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:22.167281  6031 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:22.167572  6074 tablet_bootstrap.cc:492] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:22.172953  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:22.173849  6202 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:22.174224  6202 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:22.174603  6202 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.177531  6075 tablet_bootstrap.cc:492] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:22.178002  6075 ts_tablet_manager.cc:1403] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.121s	user 0.012s	sys 0.001s
I20260620 13:55:22.185963  6249 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.186482  6249 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.188678  6249 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.198783  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:22.198673  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:22.199949  6033 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:22.202052  6202 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.209054  6289 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.209698  6289 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.212097  6075 raft_consensus.cc:359] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.212788  6075 raft_consensus.cc:385] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.213037  6075 raft_consensus.cc:740] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.222401  6074 tablet_bootstrap.cc:654] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.221875  5779 catalog_manager.cc:5696] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:22.223497  6075 consensus_queue.cc:260] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.224395  5884 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:22.225121  6241 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.225575  6241 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.228543  6075 ts_tablet_manager.cc:1434] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.002s
I20260620 13:55:22.229465  6075 tablet_bootstrap.cc:492] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:22.230747  6241 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:22.231541  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:22.231736  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:22.232865  5998 leader_election.cc:343] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:22.233332  5997 leader_election.cc:343] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.233712  5997 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:22.234375  6241 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:22.236806  6202 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.236907  6289 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.238642  6075 tablet_bootstrap.cc:654] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.213354  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:22.240092  6356 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:22.240556  6356 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:22.241005  6356 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.245085  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:22.246376  6028 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.247366  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:22.248092  5883 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:22.250669  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:22.251991  6031 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:22.245363  6289 consensus_queue.cc:1048] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:22.256799  6074 tablet_bootstrap.cc:492] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:22.257520  6074 ts_tablet_manager.cc:1403] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.090s	user 0.010s	sys 0.005s
I20260620 13:55:22.257516  5924 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:22.261157  6249 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:22.261270  6074 raft_consensus.cc:359] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.262266  6074 raft_consensus.cc:385] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.262538  6074 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.263315  6074 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.261613  6249 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:22.264376  6249 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.265543  6073 tablet_bootstrap.cc:492] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:22.269078  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:22.271826  6028 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:22.285146  6073 ts_tablet_manager.cc:1403] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.157s	user 0.035s	sys 0.025s
I20260620 13:55:22.289110  6074 ts_tablet_manager.cc:1434] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260620 13:55:22.280278  6249 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.278709  6356 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.293577  6075 tablet_bootstrap.cc:492] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:22.289359  6073 raft_consensus.cc:359] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.294095  6073 raft_consensus.cc:385] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.294273  6075 ts_tablet_manager.cc:1403] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.000s
I20260620 13:55:22.291499  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:55:22.297241  5924 leader_election.cc:343] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.300439  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:22.300959  6333 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:22.301272  5884 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.301579  6333 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:22.292150  6074 tablet_bootstrap.cc:492] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:22.301651  6075 raft_consensus.cc:359] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.302721  6075 raft_consensus.cc:385] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.303151  6075 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.304023  6075 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.292021  6249 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.305682  6073 raft_consensus.cc:740] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.306710  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:22.307543  5882 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.302603  6333 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.310405  5884 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:22.314746  5924 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:22.316092  6202 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:22.316659  6202 raft_consensus.cc:697] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:22.316887  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:22.316751  5882 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:22.317490  6031 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.318675  6249 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.317603  6202 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.319478  6249 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.322003  6249 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.326797  6031 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:22.317945  6073 consensus_queue.cc:260] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.295868  6356 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.330778  6356 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.331748  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:22.326982  6074 tablet_bootstrap.cc:654] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.332401  6033 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:22.331230  6356 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.318151  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:22.333405  6028 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.334359  6356 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.329849  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:22.336442  6289 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:22.337106  6289 raft_consensus.cc:697] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:22.338078  6289 consensus_queue.cc:237] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.340415  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:22.306993  6075 ts_tablet_manager.cc:1434] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260620 13:55:22.345434  6074 tablet_bootstrap.cc:492] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:22.345609  6075 tablet_bootstrap.cc:492] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:22.345947  6074 ts_tablet_manager.cc:1403] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.011s
I20260620 13:55:22.351603  6074 raft_consensus.cc:359] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.352301  6074 raft_consensus.cc:385] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.352569  6074 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.353567  6073 ts_tablet_manager.cc:1434] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.002s
I20260620 13:55:22.353509  6074 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.355782  6074 ts_tablet_manager.cc:1434] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260620 13:55:22.356868  6074 tablet_bootstrap.cc:492] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:22.362031  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:22.362603  5924 leader_election.cc:343] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.363937  6074 tablet_bootstrap.cc:654] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.364451  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:22.364895  6356 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.365264  6033 raft_consensus.cc:2393] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 1: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:55:22.365383  6356 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.361979  6073 tablet_bootstrap.cc:492] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:22.372733  6356 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.375871  6074 tablet_bootstrap.cc:492] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:22.376382  6074 ts_tablet_manager.cc:1403] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260620 13:55:22.379441  6075 tablet_bootstrap.cc:654] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.379066  6074 raft_consensus.cc:359] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.379873  6074 raft_consensus.cc:385] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.380174  6074 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.380403  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:22.380966  6074 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.382441  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:22.385386  6073 tablet_bootstrap.cc:654] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.389298  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:22.389966  6031 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:22.390115  6075 tablet_bootstrap.cc:492] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:22.390748  6075 ts_tablet_manager.cc:1403] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260620 13:55:22.393496  6075 raft_consensus.cc:359] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.394151  6075 raft_consensus.cc:385] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.394402  6075 raft_consensus.cc:740] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.395663  6249 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:22.396162  6249 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:22.396682  6249 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.396886  6074 ts_tablet_manager.cc:1434] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.004s
I20260620 13:55:22.398844  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:22.399757  6075 consensus_queue.cc:260] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.400120  5778 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:22.402299  6075 ts_tablet_manager.cc:1434] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260620 13:55:22.402834  5778 catalog_manager.cc:5696] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:22.407660  6075 tablet_bootstrap.cc:492] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:22.408656  6249 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.409461  6074 tablet_bootstrap.cc:492] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:22.432287  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:22.433008  6333 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:22.433387  6333 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:22.433717  6333 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.435837  6075 tablet_bootstrap.cc:654] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.435983  6249 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.437295  6074 tablet_bootstrap.cc:654] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.437608  6073 tablet_bootstrap.cc:492] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:22.438068  6073 ts_tablet_manager.cc:1403] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.003s
I20260620 13:55:22.408954  6028 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
W20260620 13:55:22.450119  5924 leader_election.cc:343] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.451624  6289 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.456902  6073 raft_consensus.cc:359] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.456923  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:22.457810  6073 raft_consensus.cc:385] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.458166  6073 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.460332  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:22.460932  6031 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.458920  6073 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:22.466668  5924 leader_election.cc:343] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.472662  6333 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.474701  6333 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.475346  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:55:22.478312  5924 leader_election.cc:343] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.478770  6073 ts_tablet_manager.cc:1434] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.005s
I20260620 13:55:22.480752  6073 tablet_bootstrap.cc:492] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:22.483989  6289 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:22.481701  6031 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:22.484082  6241 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.484794  6241 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.487748  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:22.487871  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:22.488966  6300 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:55:22.489228  5997 leader_election.cc:343] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.489463  6300 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.491643  6300 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:55:22.492609  5998 leader_election.cc:343] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.492816  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:22.493089  5998 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:22.494325  6333 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:22.494796  6333 raft_consensus.cc:697] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:22.494910  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:22.495648  6333 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.497406  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:22.498793  5998 leader_election.cc:343] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:22.499321  5997 leader_election.cc:343] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.499534  6300 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:22.499733  5997 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:22.500397  6300 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:22.489804  6241 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:22.502039  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:22.502655  6031 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.508158  6073 tablet_bootstrap.cc:654] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.509089  6075 tablet_bootstrap.cc:492] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:22.509613  6075 ts_tablet_manager.cc:1403] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.102s	user 0.018s	sys 0.021s
I20260620 13:55:22.509346  5779 catalog_manager.cc:5696] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:22.513303  6075 raft_consensus.cc:359] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.514345  6075 raft_consensus.cc:385] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.520855  6075 raft_consensus.cc:740] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.521644  6075 consensus_queue.cc:260] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.526660  6031 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:22.527990  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:22.528694  6333 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:22.529182  6333 raft_consensus.cc:697] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:22.529986  6333 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.530776  6074 tablet_bootstrap.cc:492] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:22.534065  6074 ts_tablet_manager.cc:1403] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.135s	user 0.016s	sys 0.018s
I20260620 13:55:22.536617  6074 raft_consensus.cc:359] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.537333  6074 raft_consensus.cc:385] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.537587  6074 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.540504  5778 catalog_manager.cc:5696] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:22.543740  6073 tablet_bootstrap.cc:492] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:22.544201  6073 ts_tablet_manager.cc:1403] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.011s
I20260620 13:55:22.525228  6075 ts_tablet_manager.cc:1434] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260620 13:55:22.547277  6075 tablet_bootstrap.cc:492] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:22.551789  6073 raft_consensus.cc:359] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.552863  6073 raft_consensus.cc:385] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.554039  6074 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.556150  6075 tablet_bootstrap.cc:654] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.554780  6073 raft_consensus.cc:740] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.561110  6074 ts_tablet_manager.cc:1434] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260620 13:55:22.562363  6074 tablet_bootstrap.cc:492] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:22.566468  6075 tablet_bootstrap.cc:492] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:22.567036  6075 ts_tablet_manager.cc:1403] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260620 13:55:22.568138  6073 consensus_queue.cc:260] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.569902  6075 raft_consensus.cc:359] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.570650  6075 raft_consensus.cc:385] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.570160  5781 catalog_manager.cc:5696] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:22.570966  6075 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.571899  6075 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.574095  6075 ts_tablet_manager.cc:1434] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260620 13:55:22.575730  6075 tablet_bootstrap.cc:492] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:22.578814  6289 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.579387  6289 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.581365  6074 tablet_bootstrap.cc:654] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.581454  6289 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.581585  6075 tablet_bootstrap.cc:654] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.583885  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:22.584539  6028 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:22.586442  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:22.588279  6241 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.588914  6241 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.593655  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:22.593871  6256 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.594445  5959 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 0.
I20260620 13:55:22.594515  6256 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.596078  5997 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:22.596984  6300 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:22.597342  6300 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:22.597685  6300 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:55:22.597882  5924 leader_election.cc:343] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.598757  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:22.599123  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:22.600976  5998 leader_election.cc:343] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.601574  6197 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:22.601969  6197 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:22.602547  6197 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.605906  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:22.606106  6300 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.606930  6028 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:22.609107  5849 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:22.610129  6169 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:22.609977  6197 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.610524  6169 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:22.610586  6256 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.610936  6169 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.612643  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:55:22.624557  5998 leader_election.cc:343] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.614298  6300 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:22.578814  6073 ts_tablet_manager.cc:1434] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260620 13:55:22.627883  6073 tablet_bootstrap.cc:492] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:22.615248  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:22.615481  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:22.631409  5959 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.626080  6241 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:22.633050  6169 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.640192  6169 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:55:22.640450  5848 leader_election.cc:343] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.642316  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:55:22.643664  5848 leader_election.cc:343] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.643785  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:22.644603  6028 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.660233  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:22.660828  6031 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.660799  5959 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:55:22.663810  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:22.657936  6197 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.667420  5997 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:22.669265  6073 tablet_bootstrap.cc:654] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.669392  6241 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:22.670033  6241 raft_consensus.cc:697] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:22.670909  6241 consensus_queue.cc:237] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.670017  6031 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
W20260620 13:55:22.674371  5924 leader_election.cc:343] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.677512  6075 tablet_bootstrap.cc:492] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:22.677999  6075 ts_tablet_manager.cc:1403] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.102s	user 0.036s	sys 0.062s
I20260620 13:55:22.678272  6212 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.678750  6212 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.686028  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:22.680656  6075 raft_consensus.cc:359] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.700810  6075 raft_consensus.cc:385] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.701152  6075 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.697009  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:22.703063  6033 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:22.701759  6075 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.704978  6202 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:22.707762  6075 ts_tablet_manager.cc:1434] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260620 13:55:22.709214  6075 tablet_bootstrap.cc:492] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:22.706457  6202 raft_consensus.cc:697] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:22.693668  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:22.680619  6212 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.717330  6074 tablet_bootstrap.cc:492] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:22.717808  6074 ts_tablet_manager.cc:1403] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.156s	user 0.036s	sys 0.022s
I20260620 13:55:22.721148  6256 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:22.710610  6202 consensus_queue.cc:237] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.733361  6169 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.733942  6169 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.731807  6212 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:22.735517  6212 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.747372  6028 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:22.747593  6169 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.759697  5848 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:22.743031  6212 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:22.762615  6212 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:22.762423  6256 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:22.766944  5781 catalog_manager.cc:5696] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:22.763010  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:22.793617  5848 leader_election.cc:343] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:22.854874  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:22.864899  6074 raft_consensus.cc:359] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.865620  6074 raft_consensus.cc:385] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.865909  6074 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.868043  6075 tablet_bootstrap.cc:654] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:22.866542  6074 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.879006  6074 ts_tablet_manager.cc:1434] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.161s	user 0.035s	sys 0.019s
I20260620 13:55:22.879706  6073 tablet_bootstrap.cc:492] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:22.880326  6073 ts_tablet_manager.cc:1403] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.253s	user 0.010s	sys 0.006s
I20260620 13:55:22.880368  6074 tablet_bootstrap.cc:492] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:22.867581  6197 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260620 13:55:22.897914  6073 raft_consensus.cc:359] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.898792  6073 raft_consensus.cc:385] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:22.899148  6073 raft_consensus.cc:740] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:22.899928  6073 consensus_queue.cc:260] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.904573  6212 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:22.922953  6073 ts_tablet_manager.cc:1434] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260620 13:55:22.927273  6073 tablet_bootstrap.cc:492] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
W20260620 13:55:22.927794  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 84212.7us
I20260620 13:55:22.933645  5849 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:55:22.935377  6377 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:22.936111  6377 raft_consensus.cc:697] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:22.938000  5778 catalog_manager.cc:5696] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:22.959347  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:22.959723  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:22.960230  6031 raft_consensus.cc:2393] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:22.960376  6032 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:22.936952  6377 consensus_queue.cc:237] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:22.977941  6382 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260620 13:55:22.978983  6289 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:22.980154  6075 tablet_bootstrap.cc:492] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:22.981361  6075 ts_tablet_manager.cc:1403] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.272s	user 0.021s	sys 0.056s
I20260620 13:55:23.007946  6074 tablet_bootstrap.cc:654] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:23.017699  6385 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:23.024699  6385 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.026768  6385 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:23.033816  6075 raft_consensus.cc:359] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.034389  6075 raft_consensus.cc:385] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:23.034657  6075 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:23.035302  6075 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:23.036019  5829 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:55:23.036902  6075 ts_tablet_manager.cc:1434] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.055s	user 0.000s	sys 0.004s
I20260620 13:55:23.041790  6075 tablet_bootstrap.cc:492] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:23.042415  5849 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:23.043231  6169 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:23.043722  5849 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:55:23.045528  6256 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:23.045892  6256 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:23.046236  6256 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:23.056633  6256 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.060370  6256 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:23.082418  6169 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:23.092396  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:23.093075  6031 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:23.093230  6385 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:23.093585  6382 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 13:55:23.100162  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 55005.8us
I20260620 13:55:23.096252  6300 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:23.131491  5924 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:23.133818  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:23.103427  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:55:23.146246  5924 leader_election.cc:343] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:23.144102  6382 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:23.164017  6073 tablet_bootstrap.cc:654] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:23.163867  6377 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:23.142592  6385 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:23.179330  6385 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:23.179767  6385 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:23.173921  5778 catalog_manager.cc:5696] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:23.133050  6300 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:23.196731  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 92966.8us
W20260620 13:55:23.214254  5848 leader_election.cc:343] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:23.180590  6377 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.224907  6075 tablet_bootstrap.cc:654] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:23.219965  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:23.238149  5881 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:23.242497  6392 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:23.244637  6300 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:23.244730  6392 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.243152  6028 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:23.268961  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:23.256955  6202 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:23.275758  6074 tablet_bootstrap.cc:492] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:23.276788  6074 ts_tablet_manager.cc:1403] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.397s	user 0.019s	sys 0.002s
W20260620 13:55:23.278244  5998 leader_election.cc:343] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:23.303571  6377 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:23.304359  6397 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:23.314307  6392 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:55:23.316723  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 103183us
I20260620 13:55:23.318027  6385 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.319339  6075 tablet_bootstrap.cc:492] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:23.319969  6075 ts_tablet_manager.cc:1403] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.278s	user 0.012s	sys 0.006s
I20260620 13:55:23.282258  6202 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:23.323589  6398 log.cc:927] Time spent T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260620 13:55:23.324033  6073 tablet_bootstrap.cc:492] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:23.329630  6073 ts_tablet_manager.cc:1403] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.406s	user 0.031s	sys 0.010s
I20260620 13:55:23.304863  6397 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.340332  6073 raft_consensus.cc:359] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.341315  6073 raft_consensus.cc:385] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:23.341656  6073 raft_consensus.cc:740] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:23.343918  6397 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:23.342525  6073 consensus_queue.cc:260] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.351030  6202 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:23.352277  6028 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:23.356276  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:23.361240  6073 ts_tablet_manager.cc:1434] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260620 13:55:23.361713  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:23.364593  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:23.365191  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:23.368952  6073 tablet_bootstrap.cc:492] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:23.368043  6074 raft_consensus.cc:359] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.370319  6074 raft_consensus.cc:385] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:23.370611  6074 raft_consensus.cc:740] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:23.370972  5958 raft_consensus.cc:2393] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:55:23.371284  6074 consensus_queue.cc:260] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:23.375738  6405 log.cc:927] Time spent T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260620 13:55:23.373380  6385 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:23.386885  6074 ts_tablet_manager.cc:1434] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.000s
I20260620 13:55:23.388012  5849 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:55:23.389660  6397 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260620 13:55:23.378000  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:23.398747  6074 tablet_bootstrap.cc:492] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:23.397186  6375 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:23.396478  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:23.409073  6375 raft_consensus.cc:697] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:23.400064  6385 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260620 13:55:23.396245  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:23.399904  6249 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260620 13:55:23.412068  6375 consensus_queue.cc:237] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:23.420428  5998 leader_election.cc:343] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:23.427083  6101 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260620 13:55:23.448796  6075 raft_consensus.cc:359] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.449797  6075 raft_consensus.cc:385] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:23.450232  6075 raft_consensus.cc:740] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:23.456691  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:23.457403  6033 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:23.464846  6075 consensus_queue.cc:260] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.470044  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:23.474968  5883 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:55:23.495882  5997 leader_election.cc:343] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:23.496668  5997 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:55:23.498064  5997 leader_election.cc:343] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:23.498607  5997 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:23.478559  6029 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:23.504633  6300 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:23.531288  5880 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:23.532660  6075 ts_tablet_manager.cc:1434] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.212s	user 0.020s	sys 0.022s
I20260620 13:55:23.530939  6399 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:23.533790  6075 tablet_bootstrap.cc:492] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
W20260620 13:55:23.551369  6408 log.cc:927] Time spent T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260620 13:55:23.562077  5848 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:23.567694  6075 tablet_bootstrap.cc:654] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:23.597781  6074 tablet_bootstrap.cc:654] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:23.604146  5849 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:23.613945  5849 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:23.610625  6397 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:23.616714  6397 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.602015  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:23.628371  6073 tablet_bootstrap.cc:654] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:23.619024  6397 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:23.621645  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:23.689405  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:23.718400  6388 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:23.720809  6388 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:23.687981  6376 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:23.633396  6356 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.110s
I20260620 13:55:23.688663  6395 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:23.675321  6382 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:23.658926  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:23.690730  6029 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:23.690922  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:23.712422  6202 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:23.772605  6073 tablet_bootstrap.cc:492] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:23.753012  6202 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:23.773180  6073 ts_tablet_manager.cc:1403] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.404s	user 0.011s	sys 0.009s
W20260620 13:55:23.768044  5998 leader_election.cc:343] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:23.751063  6382 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.775007  6202 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:23.804641  6073 raft_consensus.cc:359] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.805359  6073 raft_consensus.cc:385] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:23.805617  6073 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:23.806242  6073 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.815058  6073 ts_tablet_manager.cc:1434] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.002s
I20260620 13:55:23.807325  6382 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:23.824200  6074 tablet_bootstrap.cc:492] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:23.824844  6074 ts_tablet_manager.cc:1403] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.427s	user 0.017s	sys 0.028s
I20260620 13:55:23.826169  5778 catalog_manager.cc:5696] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:23.858731  6075 tablet_bootstrap.cc:492] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
W20260620 13:55:23.855822  5997 leader_election.cc:343] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:23.861627  5997 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:23.864202  6075 ts_tablet_manager.cc:1403] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.331s	user 0.021s	sys 0.021s
I20260620 13:55:23.866865  6397 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:23.882936  6075 raft_consensus.cc:359] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.884402  6074 raft_consensus.cc:359] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.885089  6074 raft_consensus.cc:385] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:23.885357  6074 raft_consensus.cc:740] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:23.884910  6075 raft_consensus.cc:385] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:23.885960  6074 consensus_queue.cc:260] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.855343  6202 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.894548  6075 raft_consensus.cc:740] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:23.890908  5924 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:23.917052  6075 consensus_queue.cc:260] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.917541  6249 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:23.918154  6249 raft_consensus.cc:697] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:23.892042  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:23.919123  6249 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.896291  6202 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:23.896811  6074 ts_tablet_manager.cc:1434] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.001s
I20260620 13:55:23.923599  6074 tablet_bootstrap.cc:492] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:23.923784  6384 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:23.915515  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:23.889556  6073 tablet_bootstrap.cc:492] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:23.925736  6027 raft_consensus.cc:2393] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 1: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:55:23.928779  5924 leader_election.cc:343] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:23.932974  6074 tablet_bootstrap.cc:654] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
W20260620 13:55:23.933415  5924 leader_election.cc:343] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:23.933482  6407 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:23.939060  6073 tablet_bootstrap.cc:654] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:23.941887  6075 ts_tablet_manager.cc:1434] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.001s
I20260620 13:55:23.943123  6395 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:23.943677  6395 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:23.946151  6395 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:23.950822  6075 tablet_bootstrap.cc:492] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:23.963508  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:23.964409  6027 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:23.972612  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:23.974076  6075 tablet_bootstrap.cc:654] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:23.975270  6212 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:23.975936  6212 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:23.976426  6212 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:23.970681  6384 consensus_queue.cc:1048] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260620 13:55:24.020226  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:24.021481  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:24.022037  6212 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.030275  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:24.030701  6074 tablet_bootstrap.cc:492] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:24.031201  6074 ts_tablet_manager.cc:1403] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.108s	user 0.024s	sys 0.016s
I20260620 13:55:24.032359  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:24.032625  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:24.031003  6026 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:24.025424  6212 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:24.044915  6407 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:24.048688  6073 tablet_bootstrap.cc:492] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:24.022076  6027 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:24.059523  6075 tablet_bootstrap.cc:492] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:24.060034  6075 ts_tablet_manager.cc:1403] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.117s	user 0.004s	sys 0.015s
I20260620 13:55:24.076525  6073 ts_tablet_manager.cc:1403] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.187s	user 0.018s	sys 0.026s
W20260620 13:55:24.069967  5924 leader_election.cc:343] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:24.079257  6074 raft_consensus.cc:359] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.086706  5781 catalog_manager.cc:5696] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:24.089900  6074 raft_consensus.cc:385] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:24.090253  6074 raft_consensus.cc:740] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:24.093444  5958 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:24.093729  6074 consensus_queue.cc:260] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.095543  6027 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:24.082940  6075 raft_consensus.cc:359] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.096120  6075 raft_consensus.cc:385] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:24.096386  6075 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:24.100688  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:24.096979  6075 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:24.101408  5848 leader_election.cc:343] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:24.105439  6382 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:24.106405  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:24.103009  6074 ts_tablet_manager.cc:1434] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
W20260620 13:55:24.117522  5848 leader_election.cc:343] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:24.106033  6382 raft_consensus.cc:697] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:24.121697  6382 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.124698  6074 tablet_bootstrap.cc:492] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:24.128814  6075 ts_tablet_manager.cc:1434] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.006s
I20260620 13:55:24.135089  6075 tablet_bootstrap.cc:492] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:24.141633  6407 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:24.106055  6026 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:24.148214  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:55:24.164268  6075 tablet_bootstrap.cc:654] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:24.180330  6212 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:24.186244  6212 raft_consensus.cc:697] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:24.187084  6212 consensus_queue.cc:237] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:24.187363  6441 log.cc:927] Time spent T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260620 13:55:24.239328  6442 log.cc:927] Time spent T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260620 13:55:24.241868  5829 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:55:24.191226  6383 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:55:24.245083  6073 raft_consensus.cc:359] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.245818  6073 raft_consensus.cc:385] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:24.246081  6073 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:24.246749  6073 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.259570  6074 tablet_bootstrap.cc:654] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:24.271864  6399 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:24.272447  6399 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.274284  6073 ts_tablet_manager.cc:1434] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.194s	user 0.008s	sys 0.000s
I20260620 13:55:24.275009  6073 tablet_bootstrap.cc:492] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:24.291015  6202 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:24.292714  6202 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.294697  6202 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:24.288165  6375 consensus_queue.cc:1048] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260620 13:55:24.251965  6383 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.321137  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:24.327378  6447 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:24.327951  6447 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.329175  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:24.330236  6447 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:24.332589  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:24.335040  5998 leader_election.cc:343] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:24.335634  6073 tablet_bootstrap.cc:654] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
W20260620 13:55:24.335821  5998 leader_election.cc:343] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:24.339339  5924 leader_election.cc:343] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:24.337246  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:24.345095  6075 tablet_bootstrap.cc:492] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:24.345556  6075 ts_tablet_manager.cc:1403] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.211s	user 0.018s	sys 0.022s
W20260620 13:55:24.350440  6444 log.cc:927] Time spent T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260620 13:55:24.352591  6399 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:24.357296  6074 tablet_bootstrap.cc:492] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:24.357860  6074 ts_tablet_manager.cc:1403] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.233s	user 0.019s	sys 0.019s
I20260620 13:55:24.370937  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:24.369983  6075 raft_consensus.cc:359] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.376545  6075 raft_consensus.cc:385] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:24.376958  6075 raft_consensus.cc:740] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:24.377799  6075 consensus_queue.cc:260] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.393479  6074 raft_consensus.cc:359] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:24.393828  5924 leader_election.cc:343] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:24.394255  6074 raft_consensus.cc:385] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:24.394495  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:24.394562  6074 raft_consensus.cc:740] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:24.398939  6074 consensus_queue.cc:260] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.406941  6075 ts_tablet_manager.cc:1434] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260620 13:55:24.419487  6074 ts_tablet_manager.cc:1434] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260620 13:55:24.426723  6074 tablet_bootstrap.cc:492] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:24.420954  6075 tablet_bootstrap.cc:492] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:24.399302  6385 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:24.421015  6300 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:24.434504  6300 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.445565  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:24.446265  5881 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 0.
I20260620 13:55:24.454375  6300 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:24.457660  6073 tablet_bootstrap.cc:492] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:24.458154  6073 ts_tablet_manager.cc:1403] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.183s	user 0.020s	sys 0.017s
I20260620 13:55:24.460736  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:55:24.461165  6445 log.cc:927] Time spent T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260620 13:55:24.462375  6399 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:24.462726  6399 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:24.464064  6399 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:24.471338  6073 raft_consensus.cc:359] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.473716  6073 raft_consensus.cc:385] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:24.474037  6073 raft_consensus.cc:740] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:24.480028  6074 tablet_bootstrap.cc:654] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:24.485739  5878 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:24.486370  6202 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:24.488250  6073 consensus_queue.cc:260] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.497534  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:24.499446  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:24.502554  6073 ts_tablet_manager.cc:1434] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.002s
I20260620 13:55:24.504267  6383 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:55:24.505234  5997 leader_election.cc:343] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:24.505780  5997 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:24.507911  6447 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:24.487880  6202 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.526788  6075 tablet_bootstrap.cc:654] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:24.517048  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:24.523921  6202 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:24.532618  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:24.536758  5883 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:24.530640  5957 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 0.
I20260620 13:55:24.551899  6073 tablet_bootstrap.cc:492] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:24.542073  5924 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:24.544075  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:24.544847  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:24.558676  6356 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:24.559134  6356 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:24.559466  6356 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:24.548729  5781 catalog_manager.cc:5696] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:24.564044  5848 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:55:24.567531  5997 leader_election.cc:343] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:24.567989  5997 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:24.566771  6383 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:55:24.575459  6451 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:24.577975  6394 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:24.533227  6399 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.580937  6407 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:24.578509  6394 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.587775  6026 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 1: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:55:24.590729  6399 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:24.591361  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:55:24.587813  5924 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:24.590667  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:24.593459  5883 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:24.593338  6249 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:24.594415  6394 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:24.595530  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:24.596148  6026 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:24.597198  5849 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:24.595532  6073 tablet_bootstrap.cc:654] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:24.597190  6356 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.597908  6383 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:55:24.600988  6383 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:24.601364  6383 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:24.607877  5778 catalog_manager.cc:5696] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:24.604545  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:24.612035  6356 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:24.612154  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:24.613613  5956 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:24.613988  6074 tablet_bootstrap.cc:492] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:24.614476  6074 ts_tablet_manager.cc:1403] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.188s	user 0.012s	sys 0.033s
I20260620 13:55:24.623721  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:24.624550  6026 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 1: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:55:24.630302  5924 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:24.632642  6356 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260620 13:55:24.634341  6074 raft_consensus.cc:359] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.635241  6074 raft_consensus.cc:385] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:24.635936  6074 raft_consensus.cc:740] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:24.636675  6074 consensus_queue.cc:260] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.641391  5883 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:55:24.651753  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:55:24.652441  6074 ts_tablet_manager.cc:1434] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.002s
I20260620 13:55:24.652863  6399 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:24.653478  6399 raft_consensus.cc:697] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:24.654531  6074 tablet_bootstrap.cc:492] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:24.655035  6399 consensus_queue.cc:237] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.665936  6075 tablet_bootstrap.cc:492] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:24.662993  6074 tablet_bootstrap.cc:654] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:24.666482  6075 ts_tablet_manager.cc:1403] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.246s	user 0.016s	sys 0.013s
I20260620 13:55:24.670058  6075 raft_consensus.cc:359] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.673676  6075 raft_consensus.cc:385] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:24.672608  6383 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.674333  6075 raft_consensus.cc:740] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:24.675699  5878 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260620 13:55:24.677459  6074 tablet_bootstrap.cc:492] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:24.678040  6074 ts_tablet_manager.cc:1403] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.011s
I20260620 13:55:24.678664  6300 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:24.679214  6300 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.681617  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:24.682154  6074 raft_consensus.cc:359] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.682976  6074 raft_consensus.cc:385] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:24.683531  6074 raft_consensus.cc:740] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:24.684168  6073 tablet_bootstrap.cc:492] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:24.684011  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:24.684444  6074 consensus_queue.cc:260] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.685181  6073 ts_tablet_manager.cc:1403] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.133s	user 0.011s	sys 0.028s
I20260620 13:55:24.685202  5952 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 0.
I20260620 13:55:24.687220  6074 ts_tablet_manager.cc:1434] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260620 13:55:24.687311  5997 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:24.688099  6074 tablet_bootstrap.cc:492] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:24.688066  6451 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:24.688493  6451 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:24.688809  6451 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:24.689481  6073 raft_consensus.cc:359] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.685421  6383 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:24.690258  6073 raft_consensus.cc:385] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:24.690688  6073 raft_consensus.cc:740] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:24.691421  6073 consensus_queue.cc:260] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.693780  6073 ts_tablet_manager.cc:1434] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260620 13:55:24.695286  6073 tablet_bootstrap.cc:492] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:24.695572  6074 tablet_bootstrap.cc:654] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:24.696246  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:24.696560  6075 consensus_queue.cc:260] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:24.698601  5998 leader_election.cc:343] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:24.699451  6300 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:24.700054  6075 ts_tablet_manager.cc:1434] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.004s
I20260620 13:55:24.702984  6073 tablet_bootstrap.cc:654] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:24.703833  6075 tablet_bootstrap.cc:492] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:24.705200  6451 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.710650  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:24.712015  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:55:24.721320  5998 leader_election.cc:343] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:24.725008  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:24.725955  5952 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:24.726743  6202 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:24.727444  6202 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.729494  6202 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:24.740089  6075 tablet_bootstrap.cc:654] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:24.741394  5848 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:24.742754  6376 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:55:24.746922  6383 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260620 13:55:24.760751  6074 tablet_bootstrap.cc:492] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:24.763125  6074 ts_tablet_manager.cc:1403] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.027s
I20260620 13:55:24.762748  6356 consensus_queue.cc:1059] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:24.744597  6451 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:24.771162  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:24.771617  6356 raft_consensus.cc:3055] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:24.772084  6356 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:24.780546  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:24.781500  6026 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:24.773000  6356 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.786437  6074 raft_consensus.cc:359] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.788334  6074 raft_consensus.cc:385] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:24.783424  5779 catalog_manager.cc:5696] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:24.789522  6074 raft_consensus.cc:740] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:24.791239  6202 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:24.791622  6074 consensus_queue.cc:260] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.793696  6074 ts_tablet_manager.cc:1434] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260620 13:55:24.794610  6074 tablet_bootstrap.cc:492] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
W20260620 13:55:24.790729  5924 leader_election.cc:343] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:24.805873  6073 tablet_bootstrap.cc:492] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:24.813234  6073 ts_tablet_manager.cc:1403] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.118s	user 0.026s	sys 0.038s
I20260620 13:55:24.819736  5953 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:24.804124  5952 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:55:24.800239  6356 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:24.832803  5997 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:24.838551  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:24.840181  6451 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:24.841881  6388 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:24.858242  6073 raft_consensus.cc:359] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.859464  6073 raft_consensus.cc:385] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:24.859977  6073 raft_consensus.cc:740] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:24.854647  6388 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:24.855809  6451 raft_consensus.cc:697] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:24.861709  6388 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:24.866938  6073 consensus_queue.cc:260] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.872222  6075 tablet_bootstrap.cc:492] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:24.872839  6075 ts_tablet_manager.cc:1403] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.169s	user 0.006s	sys 0.017s
I20260620 13:55:24.893327  6073 ts_tablet_manager.cc:1434] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.000s
I20260620 13:55:24.894613  6073 tablet_bootstrap.cc:492] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:24.900231  6451 consensus_queue.cc:237] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.910346  6075 raft_consensus.cc:359] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.916923  6075 raft_consensus.cc:385] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:24.917346  6075 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:24.918184  6075 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.920491  6395 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:24.921747  6074 tablet_bootstrap.cc:654] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:24.926736  6075 ts_tablet_manager.cc:1434] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260620 13:55:24.948663  6388 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.952751  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:24.954783  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:55:24.956166  5924 leader_election.cc:343] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:24.955451  6030 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:24.955765  6388 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:24.963579  6074 tablet_bootstrap.cc:492] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:24.965548  6030 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:24.965819  6074 ts_tablet_manager.cc:1403] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.171s	user 0.013s	sys 0.006s
I20260620 13:55:24.965322  6073 tablet_bootstrap.cc:654] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:24.967010  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:24.968003  6289 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:24.971776  6075 tablet_bootstrap.cc:492] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:24.974970  6289 raft_consensus.cc:697] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:24.977774  6289 consensus_queue.cc:237] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.980116  6074 raft_consensus.cc:359] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.981688  6074 raft_consensus.cc:385] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:24.981979  6074 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:24.982630  6074 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:24.993120  6074 ts_tablet_manager.cc:1434] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260620 13:55:24.994077  6074 tablet_bootstrap.cc:492] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:24.996045  5778 catalog_manager.cc:5696] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:25.042095  6074 tablet_bootstrap.cc:654] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:25.043548  6075 tablet_bootstrap.cc:654] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:25.042508  5779 catalog_manager.cc:5696] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:25.051213  6465 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.051754  6465 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.056039  6465 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:25.056142  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:25.057219  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:25.057585  5998 leader_election.cc:343] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:25.059293  5997 leader_election.cc:343] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:25.059716  5997 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:25.064457  6465 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:25.066660  6073 tablet_bootstrap.cc:492] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:25.067389  6073 ts_tablet_manager.cc:1403] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.173s	user 0.009s	sys 0.020s
I20260620 13:55:25.070827  6073 raft_consensus.cc:359] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.071803  6073 raft_consensus.cc:385] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:25.072328  6073 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:25.073210  6073 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.075551  6073 ts_tablet_manager.cc:1434] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260620 13:55:25.077373  6074 tablet_bootstrap.cc:492] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:25.077872  6074 ts_tablet_manager.cc:1403] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.005s
I20260620 13:55:25.078142  6073 tablet_bootstrap.cc:492] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:25.086238  6073 tablet_bootstrap.cc:654] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:25.090657  6074 raft_consensus.cc:359] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.091455  6074 raft_consensus.cc:385] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:25.091714  6074 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:25.092386  6376 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.092840  6376 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.092332  6074 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.094585  6074 ts_tablet_manager.cc:1434] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260620 13:55:25.095829  6074 tablet_bootstrap.cc:492] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:25.096487  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:25.099968  6465 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.100307  6376 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:25.100512  6465 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.104095  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:25.105901  6465 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:25.106798  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:25.107530  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:25.108633  5998 leader_election.cc:343] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:25.109123  5997 leader_election.cc:343] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:25.109472  5848 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:25.111231  6256 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:25.102389  6075 tablet_bootstrap.cc:492] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:25.109527  5997 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:25.101802  6074 tablet_bootstrap.cc:654] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:25.112911  6465 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:25.116636  6075 ts_tablet_manager.cc:1403] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.145s	user 0.012s	sys 0.014s
I20260620 13:55:25.119570  6075 raft_consensus.cc:359] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.120350  6075 raft_consensus.cc:385] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:25.120620  6075 raft_consensus.cc:740] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:25.121387  6075 consensus_queue.cc:260] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.123175  6075 ts_tablet_manager.cc:1434] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260620 13:55:25.126005  6074 tablet_bootstrap.cc:492] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:25.126513  6074 ts_tablet_manager.cc:1403] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.005s
I20260620 13:55:25.129545  6074 raft_consensus.cc:359] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.130604  6074 raft_consensus.cc:385] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:25.130890  6074 raft_consensus.cc:740] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:25.132750  6073 tablet_bootstrap.cc:492] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:25.132791  6075 tablet_bootstrap.cc:492] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:25.133460  6073 ts_tablet_manager.cc:1403] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.004s
I20260620 13:55:25.136253  6073 raft_consensus.cc:359] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.136979  6073 raft_consensus.cc:385] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:25.137243  6073 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:25.131649  6074 consensus_queue.cc:260] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.137912  6073 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.140285  6074 ts_tablet_manager.cc:1434] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260620 13:55:25.140296  6073 ts_tablet_manager.cc:1434] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260620 13:55:25.141299  6074 tablet_bootstrap.cc:492] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:25.141599  6073 tablet_bootstrap.cc:492] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47: Bootstrap starting.
I20260620 13:55:25.154197  6075 tablet_bootstrap.cc:654] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:25.158736  6074 tablet_bootstrap.cc:654] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:25.160023  5884 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.171723  6376 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.185608  6376 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.187755  6376 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:25.192452  6073 tablet_bootstrap.cc:654] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:25.194689  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:25.195474  6030 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:25.196604  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:25.178512  6074 tablet_bootstrap.cc:492] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:25.197305  6384 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:25.197724  6384 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:25.198045  6384 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.199159  6074 ts_tablet_manager.cc:1403] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.004s
I20260620 13:55:25.201926  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:25.202582  5952 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 0.
I20260620 13:55:25.205019  6074 raft_consensus.cc:359] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.205740  6074 raft_consensus.cc:385] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:25.206074  6074 raft_consensus.cc:740] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:25.205596  6384 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.206710  6074 consensus_queue.cc:260] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.208515  6384 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:25.210168  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:25.210738  6030 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.211061  6074 ts_tablet_manager.cc:1434] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260620 13:55:25.212700  6074 tablet_bootstrap.cc:492] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:25.218425  6030 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:25.220081  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:25.221036  6384 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:25.221572  6384 raft_consensus.cc:697] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:25.222446  6384 consensus_queue.cc:237] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.228690  6075 tablet_bootstrap.cc:492] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:25.229208  6075 ts_tablet_manager.cc:1403] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.097s	user 0.022s	sys 0.028s
I20260620 13:55:25.230847  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:25.231564  5952 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.233785  6074 tablet_bootstrap.cc:654] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:25.243361  6075 raft_consensus.cc:359] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.244231  6075 raft_consensus.cc:385] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:25.246089  6075 raft_consensus.cc:740] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:25.247032  6075 consensus_queue.cc:260] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.244585  6073 tablet_bootstrap.cc:492] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47: No bootstrap required, opened a new log
I20260620 13:55:25.249130  6073 ts_tablet_manager.cc:1403] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.025s
I20260620 13:55:25.249723  6075 ts_tablet_manager.cc:1434] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260620 13:55:25.252050  6073 raft_consensus.cc:359] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.258447  6465 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:25.267575  6073 raft_consensus.cc:385] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:25.267899  6073 raft_consensus.cc:740] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Initialized, Role: FOLLOWER
I20260620 13:55:25.269121  6075 tablet_bootstrap.cc:492] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:25.264761  5952 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:55:25.278847  6465 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.279464  6465 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.281742  6465 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:25.284418  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:55:25.286558  5998 leader_election.cc:343] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:25.286417  6465 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:25.288162  6075 tablet_bootstrap.cc:654] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:25.289551  6289 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.290041  6289 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.287616  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:25.296698  5997 leader_election.cc:343] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:25.297138  5997 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:25.297835  6465 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:25.298349  6289 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:25.279470  6073 consensus_queue.cc:260] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.309381  6073 ts_tablet_manager.cc:1434] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.000s
I20260620 13:55:25.315959  6376 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.316567  6376 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.319164  6376 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:25.320247  5779 catalog_manager.cc:5696] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:25.321686  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:25.327400  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:25.328543  5878 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:25.331161  6074 tablet_bootstrap.cc:492] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:25.332309  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:25.332896  6030 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:25.334460  6074 ts_tablet_manager.cc:1403] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.016s
I20260620 13:55:25.346081  5883 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.347874  6074 raft_consensus.cc:359] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.348716  6074 raft_consensus.cc:385] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:25.349104  6074 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:25.356020  6074 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.359745  6074 ts_tablet_manager.cc:1434] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260620 13:55:25.359882  6465 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:25.360726  6074 tablet_bootstrap.cc:492] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:25.353888  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:25.367733  6249 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.373610  6249 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.375674  6289 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:25.376125  6289 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:25.376488  6289 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.387676  6399 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.388388  6399 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.392328  6289 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.395598  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:25.426712  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:25.415262  6356 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.422732  6399 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:25.429738  6356 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:25.429733  5998 leader_election.cc:343] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:25.431800  6356 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:25.419391  6249 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:25.433470  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:25.434103  6028 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:25.436096  6333 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.436537  6333 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.437062  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:25.438531  6333 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:25.438838  6356 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:25.439278  6356 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:25.436537  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:25.439929  6028 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:25.440622  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:25.441076  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:25.424443  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:25.441411  5957 raft_consensus.cc:2393] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:55:25.449255  6075 tablet_bootstrap.cc:492] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:25.443711  6356 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.449790  6075 ts_tablet_manager.cc:1403] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.181s	user 0.019s	sys 0.003s
I20260620 13:55:25.452971  6075 raft_consensus.cc:359] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.453771  6075 raft_consensus.cc:385] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:25.454107  6075 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:25.454779  6075 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.456470  6075 ts_tablet_manager.cc:1434] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260620 13:55:25.457617  6075 tablet_bootstrap.cc:492] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:25.452978  6289 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:25.461395  6074 tablet_bootstrap.cc:654] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
W20260620 13:55:25.466852  5997 leader_election.cc:343] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:25.468499  6356 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.468088  5997 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:25.467772  6465 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260620 13:55:25.469756  6451 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:25.471982  6356 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:55:25.468307  5924 leader_election.cc:343] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:25.479338  5924 leader_election.cc:343] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:25.482473  5829 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:55:25.487061  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:25.490933  6074 tablet_bootstrap.cc:492] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:25.491482  6074 ts_tablet_manager.cc:1403] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.131s	user 0.009s	sys 0.004s
I20260620 13:55:25.491389  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:25.492041  6030 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:25.492049  5848 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:25.493031  6384 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:25.493664  6075 tablet_bootstrap.cc:654] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:25.494158  6074 raft_consensus.cc:359] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.494729  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:25.494859  6074 raft_consensus.cc:385] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:25.495410  5878 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.495823  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:25.496500  5884 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.499195  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:25.500432  6485 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:25.500779  6485 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:25.501078  6485 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.504195  5884 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:25.506227  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:25.507778  6028 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.508602  6075 tablet_bootstrap.cc:492] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:25.508986  6075 ts_tablet_manager.cc:1403] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.004s
I20260620 13:55:25.509507  6485 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.507076  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:25.507119  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:25.511526  6030 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.511945  6485 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:25.495867  6074 raft_consensus.cc:740] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:25.510843  6075 raft_consensus.cc:359] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.512974  6075 raft_consensus.cc:385] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:25.513967  6075 raft_consensus.cc:740] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:25.512984  6074 consensus_queue.cc:260] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.513414  6485 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:25.515980  6485 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:25.515980  6075 consensus_queue.cc:260] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.516439  6485 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.516390  6074 ts_tablet_manager.cc:1434] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260620 13:55:25.569373  6028 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:25.579658  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:25.583563  6356 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.584416  6356 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.597589  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:25.599220  5878 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:25.599607  6356 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:25.599258  6028 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.631067  6451 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.633929  6451 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.640857  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:25.642752  6074 tablet_bootstrap.cc:492] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
W20260620 13:55:25.643313  5998 leader_election.cc:343] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:25.649973  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:25.653198  5997 leader_election.cc:343] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:25.653937  5997 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:25.656772  6399 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:25.658381  6451 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:55:25.655345  5924 leader_election.cc:343] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:25.659456  6030 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:25.668473  6075 ts_tablet_manager.cc:1434] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.159s	user 0.009s	sys 0.001s
I20260620 13:55:25.671483  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
W20260620 13:55:25.672549  5924 leader_election.cc:343] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:25.672513  6356 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:25.673324  6356 raft_consensus.cc:697] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:25.674271  6074 tablet_bootstrap.cc:654] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:25.677351  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:25.678579  6491 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
W20260620 13:55:25.678845  5924 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:25.674419  6485 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.679440  6491 raft_consensus.cc:697] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:25.683602  6333 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.684859  6075 tablet_bootstrap.cc:492] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:25.684535  6333 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.685570  6491 consensus_queue.cc:237] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.687093  6333 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:25.679917  6356 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.696692  6485 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:25.701329  6028 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:25.723824  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:25.726608  6031 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:25.730432  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:25.758894  6075 tablet_bootstrap.cc:654] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:25.760869  6074 tablet_bootstrap.cc:492] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:25.761468  6074 ts_tablet_manager.cc:1403] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.119s	user 0.021s	sys 0.015s
I20260620 13:55:25.768740  6074 raft_consensus.cc:359] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.769490  6074 raft_consensus.cc:385] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:25.769917  6074 raft_consensus.cc:740] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:25.770614  6074 consensus_queue.cc:260] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.774345  6333 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:25.775384  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:25.776541  6356 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:25.776744  6384 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.777367  6356 raft_consensus.cc:697] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:25.777707  6384 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.778875  6356 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.782377  6074 ts_tablet_manager.cc:1434] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260620 13:55:25.785205  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:25.786077  6333 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:25.786546  6333 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:25.787164  6333 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.788584  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:25.789597  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:25.792719  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:25.793468  6030 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:25.795305  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:25.795967  6030 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.797814  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:25.798877  6027 raft_consensus.cc:2393] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:25.799659  6074 tablet_bootstrap.cc:492] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685: Bootstrap starting.
I20260620 13:55:25.806301  6384 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:55:25.817570  5924 leader_election.cc:343] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:25.822497  6333 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.830085  6333 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:55:25.863515  5924 leader_election.cc:343] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:25.864217  5924 leader_election.cc:343] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:25.864789  6376 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:25.867358  6030 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:25.869303  6074 tablet_bootstrap.cc:654] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:25.872649  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:25.880590  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:25.889286  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:25.891659  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:25.892023  6075 tablet_bootstrap.cc:492] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:25.892428  6075 ts_tablet_manager.cc:1403] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.211s	user 0.006s	sys 0.017s
I20260620 13:55:25.893348  6388 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:25.894877  5848 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:25.890333  6485 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:25.896394  6485 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:25.896746  6485 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.896783  6384 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.899479  6376 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:25.907415  6485 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.909552  6485 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:25.915833  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:25.916661  6031 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.925499  6075 raft_consensus.cc:359] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.926306  6075 raft_consensus.cc:385] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:25.926604  6075 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:25.927361  6075 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.909811  6384 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:25.942548  6031 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:25.947070  6075 ts_tablet_manager.cc:1434] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.003s
I20260620 13:55:25.947760  6388 raft_consensus.cc:697] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:25.948814  6388 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:25.948212  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 53730.2us
W20260620 13:55:25.951628  5924 leader_election.cc:343] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:25.952561  6074 tablet_bootstrap.cc:492] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685: No bootstrap required, opened a new log
I20260620 13:55:25.953609  6074 ts_tablet_manager.cc:1403] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.003s
I20260620 13:55:25.960995  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:25.964974  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:25.968508  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:25.969159  6027 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:25.969395  6074 raft_consensus.cc:359] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.969981  6074 raft_consensus.cc:385] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:25.970216  6074 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Initialized, Role: FOLLOWER
I20260620 13:55:25.970548  6500 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:25.972167  6075 tablet_bootstrap.cc:492] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:25.971318  6500 raft_consensus.cc:697] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:25.970779  6074 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.978109  6500 consensus_queue.cc:237] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.981171  6074 ts_tablet_manager.cc:1434] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.002s
I20260620 13:55:25.982035  6027 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:25.986896  6356 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:25.987496  6356 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:25.991602  6356 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:25.997947  6075 tablet_bootstrap.cc:654] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:25.998600  5779 catalog_manager.cc:5696] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:26.000144  5779 catalog_manager.cc:5696] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:26.008306  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:26.010062  6485 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:26.010573  6485 raft_consensus.cc:697] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:26.011389  6485 consensus_queue.cc:237] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.002203  5779 catalog_manager.cc:5696] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:26.038741  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:26.042230  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:26.043231  6027 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:26.047492  6333 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:26.048206  6333 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.050876  6333 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:55:26.060496  5924 leader_election.cc:343] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:26.046962  6075 tablet_bootstrap.cc:492] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:26.064787  6075 ts_tablet_manager.cc:1403] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.004s
I20260620 13:55:26.068893  6075 raft_consensus.cc:359] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.069430  6075 raft_consensus.cc:385] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:26.069687  6075 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:26.070323  6075 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.072389  6075 ts_tablet_manager.cc:1434] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260620 13:55:26.073496  6075 tablet_bootstrap.cc:492] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
W20260620 13:55:26.065764  5924 leader_election.cc:343] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:26.079926  6075 tablet_bootstrap.cc:654] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:26.080859  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:26.081460  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:26.082140  6027 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 0.
I20260620 13:55:26.094203  5924 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:26.095283  6500 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:26.095780  6500 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:26.096621  6500 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:26.111447  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:26.112785  6485 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:55:26.113302  6485 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:55:26.114231  6485 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:55:26.123600  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 46720.7us
I20260620 13:55:26.124642  6485 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.126667  6485 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:26.130162  6500 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.132285  6500 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:26.139210  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:26.139792  6027 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:26.137586  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:26.139976  6075 tablet_bootstrap.cc:492] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:26.140483  6075 ts_tablet_manager.cc:1403] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.025s
W20260620 13:55:26.138278  5924 leader_election.cc:343] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:55:26.144107  5924 leader_election.cc:343] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:26.146035  6075 raft_consensus.cc:359] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.146708  6075 raft_consensus.cc:385] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:26.147001  6075 raft_consensus.cc:740] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:26.147987  6027 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:26.147900  6075 consensus_queue.cc:260] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.149973  6075 ts_tablet_manager.cc:1434] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260620 13:55:26.144557  5779 catalog_manager.cc:5696] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:26.145105  6388 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:26.150936  6075 tablet_bootstrap.cc:492] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:26.155046  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:26.157050  6376 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:26.157547  6376 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.158612  6075 tablet_bootstrap.cc:654] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:26.159461  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:26.163410  6028 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:26.165156  6075 tablet_bootstrap.cc:492] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:26.165668  6075 ts_tablet_manager.cc:1403] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.006s
I20260620 13:55:26.162568  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:26.167501  6031 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:26.168769  6376 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:26.170940  6075 raft_consensus.cc:359] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.172674  6075 raft_consensus.cc:385] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:26.173148  6075 raft_consensus.cc:740] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:26.157074  5779 catalog_manager.cc:5696] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:26.174026  6075 consensus_queue.cc:260] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.172608  6028 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:55:26.175824  6075 ts_tablet_manager.cc:1434] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260620 13:55:26.174819  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:26.176512  6333 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:26.176998  6075 tablet_bootstrap.cc:492] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:26.177107  5924 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:26.177021  6333 raft_consensus.cc:697] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:26.177824  6485 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:55:26.178337  6485 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:26.178527  6333 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.179157  6485 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.183980  6075 tablet_bootstrap.cc:654] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:26.184119  5779 catalog_manager.cc:5696] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:26.191293  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:55:26.193215  5924 leader_election.cc:343] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:55:26.187259  6376 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:26.199440  6376 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.212968  6399 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:55:26.213613  6399 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.215798  6399 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:26.220486  6376 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:26.225302  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:26.226218  5884 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 2: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:55:26.228180  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:26.229031  6031 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:26.230427  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:26.231268  5953 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:26.231823  5848 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:26.232932  6512 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:26.235699  5997 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:26.236989  6399 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:55:26.237448  6399 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:55:26.237862  6399 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:26.244076  6512 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:26.261631  6075 tablet_bootstrap.cc:492] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:26.262228  6075 ts_tablet_manager.cc:1403] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.086s	user 0.035s	sys 0.032s
I20260620 13:55:26.265097  6075 raft_consensus.cc:359] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.265331  6399 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.265856  6075 raft_consensus.cc:385] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:26.266284  6075 raft_consensus.cc:740] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:26.267058  6075 consensus_queue.cc:260] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.269204  6075 ts_tablet_manager.cc:1434] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260620 13:55:26.270284  6075 tablet_bootstrap.cc:492] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: Bootstrap starting.
I20260620 13:55:26.269657  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:26.267428  6399 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:26.272286  5884 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 2: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:55:26.274616  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:26.274775  6485 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:26.277635  5779 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:26.278717  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:26.281018  5953 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:26.282436  5997 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:26.283134  6485 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:26.283445  6465 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:26.283990  6465 raft_consensus.cc:697] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:26.284976  6465 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.283468  5779 catalog_manager.cc:5696] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:26.288789  6075 tablet_bootstrap.cc:654] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: Neither blocks nor log segments found. Creating new log.
I20260620 13:55:26.290907  5848 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:26.292390  6376 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:26.299738  6376 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:26.303117  6485 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:26.306816  6376 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:26.307436  6376 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.311084  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:26.312196  6028 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:26.314482  6376 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:26.317894  6394 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:26.318400  6394 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.320729  6394 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:26.322949  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:26.323882  6028 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:26.327517  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:26.330098  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:26.334784  5848 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:26.335956  6394 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:26.340694  5781 catalog_manager.cc:5696] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:26.352232  5848 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:26.353240  6394 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:26.353506  6512 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:26.364131  6512 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 13:55:26.368129  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 58666.2us
I20260620 13:55:26.370798  6075 tablet_bootstrap.cc:492] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: No bootstrap required, opened a new log
I20260620 13:55:26.371305  6075 ts_tablet_manager.cc:1403] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: Time spent bootstrapping tablet: real 0.101s	user 0.025s	sys 0.042s
I20260620 13:55:26.373715  6075 raft_consensus.cc:359] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.374260  6075 raft_consensus.cc:385] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:55:26.374506  6075 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Initialized, Role: FOLLOWER
I20260620 13:55:26.375012  6075 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.377156  6075 ts_tablet_manager.cc:1434] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260620 13:55:26.391602  5880 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:26.404340  6490 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:26.407325  6394 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:26.408469  6394 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.411623  6394 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:26.411682  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:26.411824  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:26.412671  6028 raft_consensus.cc:2393] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 1: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:55:26.414342  6512 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:55:26.415035  6512 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:26.417807  6512 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:26.418685  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:26.419289  5848 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:26.419862  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:26.420325  6394 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:55:26.420735  5958 raft_consensus.cc:2410] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260620 13:55:26.420907  6485 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:26.426961  5848 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:26.427928  6333 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:26.428915  6394 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:55:26.432083  6394 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:55:26.439054  6500 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:26.448554  6490 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:26.455430  6388 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:55:26.494797  6388 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:26.580080  6333 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:26.592012  6499 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:26.638193  6490 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:26.652470  6333 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:26.673309  6490 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:26.703474  5952 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:26.705551  6399 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:26.716195  5884 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:26.718233  6465 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:55:28.254805  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:55:28.286065  6541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:55:28.286217  6544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:55:28.286298  6542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:55:28.286846  4719 server_base.cc:1061] running on GCE node
I20260620 13:55:28.288316  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:55:28.288623  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:55:28.288789  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963728288777 us; error 0 us; skew 500 ppm
I20260620 13:55:28.289263  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:55:28.293331  4719 webserver.cc:533] Webserver started at http://127.4.155.196:42755/ using document root <none> and password file <none>
I20260620 13:55:28.293973  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:55:28.294327  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:55:28.294759  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:55:28.296478  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-3-root/instance:
uuid: "b0ce39342d8c4a64904b30b98de02b9f"
format_stamp: "Formatted at 2026-06-20 13:55:28 on dist-test-slave-n70f"
I20260620 13:55:28.302412  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260620 13:55:28.309692  6549 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:55:28.310750  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260620 13:55:28.311357  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-3-root
uuid: "b0ce39342d8c4a64904b30b98de02b9f"
format_stamp: "Formatted at 2026-06-20 13:55:28 on dist-test-slave-n70f"
I20260620 13:55:28.311717  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:55:28.337179  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:55:28.338498  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:55:28.340366  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:55:28.344357  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:55:28.344631  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:55:28.344995  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:55:28.345322  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:55:28.455991  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.196:34171
I20260620 13:55:28.456049  6611 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.196:34171 every 8 connection(s)
I20260620 13:55:28.461764  4719 auto_leader_rebalancer-test.cc:439] add a tserver: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:28.485695  6612 heartbeater.cc:344] Connected to a master server at 127.4.155.254:37547
I20260620 13:55:28.486990  6612 heartbeater.cc:461] Registering TS with master...
I20260620 13:55:28.487914  6612 heartbeater.cc:507] Master 127.4.155.254:37547 requested a full tablet report, sending...
I20260620 13:55:28.490284  5780 ts_manager.cc:194] Registered new tserver with Master: b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:55:28.492033  5780 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47386
I20260620 13:55:28.803472  5884 consensus_queue.cc:237] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:28.811925  5952 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:28.813620  6394 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:28.815214  6027 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:28.821753  6394 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:28.829166  6376 raft_consensus.cc:2955] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:28.830940  5952 raft_consensus.cc:2955] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:28.835564  6027 raft_consensus.cc:2955] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
W20260620 13:55:28.836865  5849 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ee15f74e3e4771a050c854530121f3. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:28.853261  5780 catalog_manager.cc:5696] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:28.865330  6028 consensus_queue.cc:237] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:28.891646  5952 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:28.896612  6451 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260620 13:55:28.915843  5884 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:28.917573  6630 raft_consensus.cc:2955] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:28.918864  6451 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260620 13:55:28.922957  5958 raft_consensus.cc:2955] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
W20260620 13:55:28.926877  5998 consensus_peers.cc:597] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81b2378deea24954b2003dda61c1b2c1. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:28.930125  5884 raft_consensus.cc:2955] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:28.934598  5879 consensus_queue.cc:237] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
W20260620 13:55:28.952420  5849 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8a351afb91f46e2b6e724165bc600c1. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:28.955271  6028 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:28.956812  6376 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:29.130360  5781 catalog_manager.cc:5696] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:29.150446  6639 raft_consensus.cc:2955] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:29.159790  5953 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:29.176123  6641 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:29.183235  6031 raft_consensus.cc:2955] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:29.196566  5779 catalog_manager.cc:5696] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:29.225558  5953 raft_consensus.cc:2955] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:29.227036  5959 consensus_queue.cc:237] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:29.235798  6030 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:29.238725  5880 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:29.241729  6644 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:29.247383  6640 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:29.255537  6640 raft_consensus.cc:2955] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:29.259281  5878 raft_consensus.cc:2955] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
W20260620 13:55:29.271482  5924 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a7540e02ee04cdb9365701b0b6a9077. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:29.284297  5779 catalog_manager.cc:5696] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:29.288321  6029 raft_consensus.cc:2955] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:29.312872  6651 ts_tablet_manager.cc:933] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:55:29.328011  6651 tablet_copy_client.cc:323] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.193:46177
I20260620 13:55:29.357870  5894 tablet_copy_service.cc:140] P 2e82c0c231624695ac5a813230bf5038: Received BeginTabletCopySession request for tablet c3ee15f74e3e4771a050c854530121f3 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42748)
I20260620 13:55:29.358579  5894 tablet_copy_service.cc:161] P 2e82c0c231624695ac5a813230bf5038: Beginning new tablet copy session on tablet c3ee15f74e3e4771a050c854530121f3 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42748: session id = b0ce39342d8c4a64904b30b98de02b9f-c3ee15f74e3e4771a050c854530121f3
I20260620 13:55:29.367365  5894 tablet_copy_source_session.cc:215] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:29.371888  6651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ee15f74e3e4771a050c854530121f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:29.391328  6651 tablet_copy_client.cc:806] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:29.392159  6651 tablet_copy_client.cc:670] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:29.403018  6651 tablet_copy_client.cc:538] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:29.421072  6651 tablet_bootstrap.cc:492] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:29.440153  6651 tablet_bootstrap.cc:492] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:29.440949  6651 tablet_bootstrap.cc:492] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:29.441516  6651 ts_tablet_manager.cc:1403] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260620 13:55:29.444293  6651 raft_consensus.cc:359] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:29.444941  6651 raft_consensus.cc:740] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:29.445462  6651 consensus_queue.cc:260] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:29.447494  6612 heartbeater.cc:499] Master 127.4.155.254:37547 was elected leader, sending a full tablet report...
I20260620 13:55:29.448007  6651 ts_tablet_manager.cc:1434] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260620 13:55:29.450017  5894 tablet_copy_service.cc:342] P 2e82c0c231624695ac5a813230bf5038: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-c3ee15f74e3e4771a050c854530121f3 received from {username='slave'} at 127.0.0.1:42748
I20260620 13:55:29.450512  5894 tablet_copy_service.cc:434] P 2e82c0c231624695ac5a813230bf5038: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-c3ee15f74e3e4771a050c854530121f3 on tablet c3ee15f74e3e4771a050c854530121f3 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:29.457460  6651 ts_tablet_manager.cc:933] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:55:29.459023  6651 tablet_copy_client.cc:323] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.193:46177
I20260620 13:55:29.460862  5894 tablet_copy_service.cc:140] P 2e82c0c231624695ac5a813230bf5038: Received BeginTabletCopySession request for tablet b8a351afb91f46e2b6e724165bc600c1 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42748)
I20260620 13:55:29.461392  5894 tablet_copy_service.cc:161] P 2e82c0c231624695ac5a813230bf5038: Beginning new tablet copy session on tablet b8a351afb91f46e2b6e724165bc600c1 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42748: session id = b0ce39342d8c4a64904b30b98de02b9f-b8a351afb91f46e2b6e724165bc600c1
I20260620 13:55:29.471331  5894 tablet_copy_source_session.cc:215] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:29.473703  6658 ts_tablet_manager.cc:933] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:29.474851  6651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a351afb91f46e2b6e724165bc600c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:29.483775  6658 tablet_copy_client.cc:323] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.195:41493
I20260620 13:55:29.490412  6651 tablet_copy_client.cc:806] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:29.492229  6651 tablet_copy_client.cc:670] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:29.497185  6651 tablet_copy_client.cc:538] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:29.509296  6651 tablet_bootstrap.cc:492] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:29.513947  6043 tablet_copy_service.cc:140] P 663684cf4ae54c929bf8240ca0b63a47: Received BeginTabletCopySession request for tablet 81b2378deea24954b2003dda61c1b2c1 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:46758)
I20260620 13:55:29.514789  6043 tablet_copy_service.cc:161] P 663684cf4ae54c929bf8240ca0b63a47: Beginning new tablet copy session on tablet 81b2378deea24954b2003dda61c1b2c1 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:46758: session id = b0ce39342d8c4a64904b30b98de02b9f-81b2378deea24954b2003dda61c1b2c1
I20260620 13:55:29.525900  6043 tablet_copy_source_session.cc:215] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:29.529501  6658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b2378deea24954b2003dda61c1b2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:29.537088  6651 tablet_bootstrap.cc:492] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:29.538168  6651 tablet_bootstrap.cc:492] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:29.538877  6651 ts_tablet_manager.cc:1403] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.011s
I20260620 13:55:29.541867  6651 raft_consensus.cc:359] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:29.542819  6651 raft_consensus.cc:740] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:29.543561  6651 consensus_queue.cc:260] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:29.545815  6651 ts_tablet_manager.cc:1434] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260620 13:55:29.547658  5894 tablet_copy_service.cc:342] P 2e82c0c231624695ac5a813230bf5038: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-b8a351afb91f46e2b6e724165bc600c1 received from {username='slave'} at 127.0.0.1:42748
I20260620 13:55:29.548110  5894 tablet_copy_service.cc:434] P 2e82c0c231624695ac5a813230bf5038: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-b8a351afb91f46e2b6e724165bc600c1 on tablet b8a351afb91f46e2b6e724165bc600c1 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:29.547183  6658 tablet_copy_client.cc:806] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:29.551510  6658 tablet_copy_client.cc:670] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:29.556165  6658 tablet_copy_client.cc:538] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:29.565420  6658 tablet_bootstrap.cc:492] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:29.581382  6658 tablet_bootstrap.cc:492] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:29.582142  6658 tablet_bootstrap.cc:492] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:29.582708  6658 ts_tablet_manager.cc:1403] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.008s
I20260620 13:55:29.585227  6658 raft_consensus.cc:359] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:29.586052  6658 raft_consensus.cc:740] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:29.586728  6658 consensus_queue.cc:260] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:29.588579  6658 ts_tablet_manager.cc:1434] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260620 13:55:29.590372  6043 tablet_copy_service.cc:342] P 663684cf4ae54c929bf8240ca0b63a47: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-81b2378deea24954b2003dda61c1b2c1 received from {username='slave'} at 127.0.0.1:46758
I20260620 13:55:29.590831  6043 tablet_copy_service.cc:434] P 663684cf4ae54c929bf8240ca0b63a47: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-81b2378deea24954b2003dda61c1b2c1 on tablet 81b2378deea24954b2003dda61c1b2c1 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:29.759982  6587 raft_consensus.cc:1217] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:29.828835  6658 ts_tablet_manager.cc:933] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:29.830431  6658 tablet_copy_client.cc:323] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:55:29.843758  5969 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet 1a7540e02ee04cdb9365701b0b6a9077 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:55:29.844393  5969 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet 1a7540e02ee04cdb9365701b0b6a9077 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-1a7540e02ee04cdb9365701b0b6a9077
I20260620 13:55:29.856743  5969 tablet_copy_source_session.cc:215] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:29.860932  6658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7540e02ee04cdb9365701b0b6a9077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:29.874511  6658 tablet_copy_client.cc:806] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:29.875244  6658 tablet_copy_client.cc:670] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:29.879683  6658 tablet_copy_client.cc:538] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:29.884174  6587 raft_consensus.cc:1217] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:29.897801  6658 tablet_bootstrap.cc:492] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:29.913699  6658 tablet_bootstrap.cc:492] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:29.914521  6658 tablet_bootstrap.cc:492] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:29.915230  6658 ts_tablet_manager.cc:1403] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.004s
I20260620 13:55:29.920234  6658 raft_consensus.cc:359] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:29.921195  6658 raft_consensus.cc:740] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:29.921864  6658 consensus_queue.cc:260] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:29.926769  6658 ts_tablet_manager.cc:1434] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260620 13:55:29.934170  5969 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-1a7540e02ee04cdb9365701b0b6a9077 received from {username='slave'} at 127.0.0.1:42078
I20260620 13:55:29.934695  5969 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-1a7540e02ee04cdb9365701b0b6a9077 on tablet 1a7540e02ee04cdb9365701b0b6a9077 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:30.080695  6587 raft_consensus.cc:1217] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:30.254150  6587 raft_consensus.cc:1217] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:30.288628  6639 raft_consensus.cc:1064] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:30.291421  6639 consensus_queue.cc:237] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:30.300092  6587 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:30.301934  5953 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:30.305799  6030 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:30.305877  6638 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:30.307864  6638 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:30.311808  6668 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260620 13:55:30.337332  6668 raft_consensus.cc:2955] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.338598  6587 raft_consensus.cc:2955] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.341086  6029 raft_consensus.cc:2955] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.361258  5779 catalog_manager.cc:5696] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.364502  5953 raft_consensus.cc:2955] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.399438  6668 raft_consensus.cc:1064] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:30.402334  6668 consensus_queue.cc:237] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:30.419080  6030 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:30.419211  6587 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:30.421762  6638 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:30.424059  6642 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:30.425630  5953 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:30.435806  6642 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:30.453449  5882 consensus_queue.cc:237] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:30.480237  6586 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:30.482954  6031 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:30.485919  6668 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:30.487444  6642 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:30.500217  6642 raft_consensus.cc:2955] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.501729  6638 raft_consensus.cc:2955] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.515252  5953 raft_consensus.cc:2955] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.520992  6451 raft_consensus.cc:1064] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:30.506995  6587 raft_consensus.cc:2955] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.523538  6451 consensus_queue.cc:237] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:30.508564  6029 raft_consensus.cc:2955] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.540901  5778 catalog_manager.cc:5696] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.564023  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet b8a351afb91f46e2b6e724165bc600c1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:30.565378  6586 raft_consensus.cc:2955] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.567708  5778 catalog_manager.cc:5696] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.574321  6587 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:30.574882  5953 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:30.575879  6666 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:30.585577  6451 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:30.588781  5882 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:30.591603  6627 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:30.594810  6030 raft_consensus.cc:2955] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.610503  6451 raft_consensus.cc:2955] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.646818  5958 raft_consensus.cc:2955] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.678548  5949 tablet_service.cc:1558] Processing DeleteTablet for tablet b8a351afb91f46e2b6e724165bc600c1 with delete_type TABLET_DATA_TOMBSTONED (TS 192c750f597c43858e1ad09e8d805685 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35974
I20260620 13:55:30.681577  5882 raft_consensus.cc:2955] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.685320  5878 consensus_queue.cc:237] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:30.690318  6689 tablet_replica.cc:333] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:55:30.691938  6689 raft_consensus.cc:2243] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:30.697104  6587 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:30.699851  6680 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:30.702456  6689 raft_consensus.cc:2272] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:30.702936  6587 raft_consensus.cc:2955] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.713479  5958 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:30.708942  6689 ts_tablet_manager.cc:1916] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:30.726603  6639 raft_consensus.cc:2955] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.727283  5780 catalog_manager.cc:5696] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:30.731686  6683 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:30.748075  6029 consensus_queue.cc:237] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:30.751240  5958 raft_consensus.cc:2955] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.752092  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet c3ee15f74e3e4771a050c854530121f3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:30.754410  6586 raft_consensus.cc:2955] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.768684  5952 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:30.770340  6451 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:30.771874  6689 ts_tablet_manager.cc:1929] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:30.774610  6689 log.cc:1199] T b8a351afb91f46e2b6e724165bc600c1 P 192c750f597c43858e1ad09e8d805685: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/wals/b8a351afb91f46e2b6e724165bc600c1
I20260620 13:55:30.778021  6666 raft_consensus.cc:2955] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.779479  5766 catalog_manager.cc:5027] TS 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): tablet b8a351afb91f46e2b6e724165bc600c1 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:30.780364  6585 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:30.783501  6627 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:30.793694  6585 raft_consensus.cc:2955] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.807979  5958 raft_consensus.cc:2955] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.809877  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 81b2378deea24954b2003dda61c1b2c1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:30.816893  5779 catalog_manager.cc:5696] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.824364  5780 catalog_manager.cc:5696] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:30.830778  6640 raft_consensus.cc:1064] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:30.835726  6640 consensus_queue.cc:237] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:30.837796  6021 tablet_service.cc:1558] Processing DeleteTablet for tablet c3ee15f74e3e4771a050c854530121f3 with delete_type TABLET_DATA_TOMBSTONED (TS 663684cf4ae54c929bf8240ca0b63a47 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43482
I20260620 13:55:30.850267  6586 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:30.853370  6029 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:30.854668  5878 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:30.855954  6688 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:30.863595  6644 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:30.864846  6643 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:30.907685  5867 tablet_service.cc:1558] Processing DeleteTablet for tablet 81b2378deea24954b2003dda61c1b2c1 with delete_type TABLET_DATA_TOMBSTONED (TS 2e82c0c231624695ac5a813230bf5038 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58442
I20260620 13:55:30.919872  6690 tablet_replica.cc:333] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:55:30.921159  6690 raft_consensus.cc:2243] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:30.921818  6690 raft_consensus.cc:2272] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:30.925848  6690 ts_tablet_manager.cc:1916] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:30.938411  6692 raft_consensus.cc:2955] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.944432  6028 raft_consensus.cc:2955] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.942359  6586 raft_consensus.cc:2955] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.962764  6696 tablet_replica.cc:333] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:55:30.963884  6696 raft_consensus.cc:2243] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:30.964476  6696 raft_consensus.cc:2272] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:30.972927  6690 ts_tablet_manager.cc:1929] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:30.973541  6690 log.cc:1199] T c3ee15f74e3e4771a050c854530121f3 P 663684cf4ae54c929bf8240ca0b63a47: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/wals/c3ee15f74e3e4771a050c854530121f3
I20260620 13:55:30.976822  5780 catalog_manager.cc:5696] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.978238  5767 catalog_manager.cc:5027] TS 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): tablet c3ee15f74e3e4771a050c854530121f3 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:30.987902  5882 raft_consensus.cc:2955] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:30.993356  6696 ts_tablet_manager.cc:1916] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:31.009815  5958 consensus_queue.cc:237] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:31.017179  5882 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:31.017356  6586 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:31.019484  6692 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:31.024574  6692 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:31.032459  6643 raft_consensus.cc:2955] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:31.034865  6696 ts_tablet_manager.cc:1929] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:31.035516  6696 log.cc:1199] T 81b2378deea24954b2003dda61c1b2c1 P 2e82c0c231624695ac5a813230bf5038: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/wals/81b2378deea24954b2003dda61c1b2c1
I20260620 13:55:31.037657  5767 catalog_manager.cc:5027] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): tablet 81b2378deea24954b2003dda61c1b2c1 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:31.040750  5882 raft_consensus.cc:2955] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:31.048840  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 1a7540e02ee04cdb9365701b0b6a9077 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:31.051096  6586 raft_consensus.cc:2955] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:31.053431  5781 catalog_manager.cc:5696] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:31.070289  6021 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a7540e02ee04cdb9365701b0b6a9077 with delete_type TABLET_DATA_TOMBSTONED (TS 663684cf4ae54c929bf8240ca0b63a47 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43482
I20260620 13:55:31.073628  6690 tablet_replica.cc:333] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:55:31.097740  6690 raft_consensus.cc:2243] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:31.098829  6690 raft_consensus.cc:2272] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:31.102301  6690 ts_tablet_manager.cc:1916] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:31.114198  6690 ts_tablet_manager.cc:1929] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:31.114567  6690 log.cc:1199] T 1a7540e02ee04cdb9365701b0b6a9077 P 663684cf4ae54c929bf8240ca0b63a47: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/wals/1a7540e02ee04cdb9365701b0b6a9077
I20260620 13:55:31.116040  5767 catalog_manager.cc:5027] TS 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): tablet 1a7540e02ee04cdb9365701b0b6a9077 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:32.165993  6028 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
W20260620 13:55:32.175482  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 50e28625b20048a398049a7734aaeaf8. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:32.176435  5953 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:32.177186  5882 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:32.177881  6666 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:32.179231  6701 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:32.188371  5953 raft_consensus.cc:2955] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:32.188618  5882 raft_consensus.cc:2955] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:32.190902  6700 raft_consensus.cc:2955] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:32.206046  5781 catalog_manager.cc:5696] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:32.219086  6028 consensus_queue.cc:237] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
W20260620 13:55:32.230994  5998 consensus_peers.cc:597] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08f835b507484456a3c708ba0e6fb982. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:32.233004  5953 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:32.233561  5880 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:32.235368  6666 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:32.236220  6700 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:32.250021  6701 raft_consensus.cc:2955] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:32.257038  5882 raft_consensus.cc:2955] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:32.292412  5880 consensus_queue.cc:237] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:32.296588  5953 raft_consensus.cc:2955] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:32.300274  5780 catalog_manager.cc:5696] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:32.309620  6028 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260620 13:55:32.311192  5849 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b870adf0b6e5484ba90ad7b17d35cd52. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:32.311738  5953 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:32.312500  6680 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:32.315013  6680 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:32.336354  6713 raft_consensus.cc:2955] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:32.340528  6029 raft_consensus.cc:2955] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:32.341367  5953 raft_consensus.cc:2955] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:32.352871  5958 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:32.356133  5778 catalog_manager.cc:5696] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:32.373158  5882 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:32.373795  6029 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260620 13:55:32.373900  5924 consensus_peers.cc:597] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bab45d487c864870aba1aee58d01ca95. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:32.375138  6643 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:32.376228  6716 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:32.386237  6688 raft_consensus.cc:2955] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:32.387754  5882 raft_consensus.cc:2955] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:32.388060  6028 raft_consensus.cc:2955] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:32.406098  5781 catalog_manager.cc:5696] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:32.672447  6721 ts_tablet_manager.cc:933] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:32.676090  6721 tablet_copy_client.cc:323] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.195:41493
I20260620 13:55:32.677819  6043 tablet_copy_service.cc:140] P 663684cf4ae54c929bf8240ca0b63a47: Received BeginTabletCopySession request for tablet 08f835b507484456a3c708ba0e6fb982 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:46758)
I20260620 13:55:32.678558  6043 tablet_copy_service.cc:161] P 663684cf4ae54c929bf8240ca0b63a47: Beginning new tablet copy session on tablet 08f835b507484456a3c708ba0e6fb982 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:46758: session id = b0ce39342d8c4a64904b30b98de02b9f-08f835b507484456a3c708ba0e6fb982
I20260620 13:55:32.684434  6043 tablet_copy_source_session.cc:215] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:32.687533  6721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f835b507484456a3c708ba0e6fb982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:32.710662  6721 tablet_copy_client.cc:806] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:32.711354  6721 tablet_copy_client.cc:670] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:32.720934  6721 tablet_copy_client.cc:538] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:32.731884  6721 tablet_bootstrap.cc:492] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:32.739313  6723 ts_tablet_manager.cc:933] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:55:32.751914  6723 tablet_copy_client.cc:323] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.193:46177
I20260620 13:55:32.753782  5894 tablet_copy_service.cc:140] P 2e82c0c231624695ac5a813230bf5038: Received BeginTabletCopySession request for tablet b870adf0b6e5484ba90ad7b17d35cd52 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42748)
I20260620 13:55:32.754383  5894 tablet_copy_service.cc:161] P 2e82c0c231624695ac5a813230bf5038: Beginning new tablet copy session on tablet b870adf0b6e5484ba90ad7b17d35cd52 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42748: session id = b0ce39342d8c4a64904b30b98de02b9f-b870adf0b6e5484ba90ad7b17d35cd52
I20260620 13:55:32.761950  5894 tablet_copy_source_session.cc:215] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:32.765669  6723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b870adf0b6e5484ba90ad7b17d35cd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:32.785113  6721 tablet_bootstrap.cc:492] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:32.786181  6721 tablet_bootstrap.cc:492] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:32.787134  6721 ts_tablet_manager.cc:1403] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.055s	user 0.026s	sys 0.005s
I20260620 13:55:32.795039  6721 raft_consensus.cc:359] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:32.797165  6721 raft_consensus.cc:740] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:32.797912  6721 consensus_queue.cc:260] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:32.828056  6721 ts_tablet_manager.cc:1434] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.036s	user 0.022s	sys 0.011s
I20260620 13:55:32.832274  6723 tablet_copy_client.cc:806] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:32.836459  6723 tablet_copy_client.cc:670] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:32.837795  6043 tablet_copy_service.cc:342] P 663684cf4ae54c929bf8240ca0b63a47: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-08f835b507484456a3c708ba0e6fb982 received from {username='slave'} at 127.0.0.1:46758
I20260620 13:55:32.838258  6043 tablet_copy_service.cc:434] P 663684cf4ae54c929bf8240ca0b63a47: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-08f835b507484456a3c708ba0e6fb982 on tablet 08f835b507484456a3c708ba0e6fb982 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:32.846704  6721 ts_tablet_manager.cc:933] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:32.848739  6723 tablet_copy_client.cc:538] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:32.853430  6727 ts_tablet_manager.cc:933] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:32.857963  6727 tablet_copy_client.cc:323] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.195:41493
I20260620 13:55:32.862455  6043 tablet_copy_service.cc:140] P 663684cf4ae54c929bf8240ca0b63a47: Received BeginTabletCopySession request for tablet 50e28625b20048a398049a7734aaeaf8 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:46758)
I20260620 13:55:32.863269  6043 tablet_copy_service.cc:161] P 663684cf4ae54c929bf8240ca0b63a47: Beginning new tablet copy session on tablet 50e28625b20048a398049a7734aaeaf8 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:46758: session id = b0ce39342d8c4a64904b30b98de02b9f-50e28625b20048a398049a7734aaeaf8
I20260620 13:55:32.864753  6723 tablet_bootstrap.cc:492] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:32.893800  6043 tablet_copy_source_session.cc:215] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:32.896103  6721 tablet_copy_client.cc:323] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:55:32.901080  5969 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet bab45d487c864870aba1aee58d01ca95 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:55:32.901317  6727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e28625b20048a398049a7734aaeaf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:32.901675  5969 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet bab45d487c864870aba1aee58d01ca95 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-bab45d487c864870aba1aee58d01ca95
I20260620 13:55:32.910666  6723 tablet_bootstrap.cc:492] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:32.911648  6723 tablet_bootstrap.cc:492] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:32.912352  6723 ts_tablet_manager.cc:1403] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.048s	user 0.028s	sys 0.007s
I20260620 13:55:32.912801  5969 tablet_copy_source_session.cc:215] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:32.916949  6723 raft_consensus.cc:359] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:32.918126  6727 tablet_copy_client.cc:806] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:32.918648  6723 raft_consensus.cc:740] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:32.918867  6727 tablet_copy_client.cc:670] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:32.919382  6723 consensus_queue.cc:260] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:32.921782  6723 ts_tablet_manager.cc:1434] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260620 13:55:32.926442  5894 tablet_copy_service.cc:342] P 2e82c0c231624695ac5a813230bf5038: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-b870adf0b6e5484ba90ad7b17d35cd52 received from {username='slave'} at 127.0.0.1:42748
I20260620 13:55:32.926908  5894 tablet_copy_service.cc:434] P 2e82c0c231624695ac5a813230bf5038: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-b870adf0b6e5484ba90ad7b17d35cd52 on tablet b870adf0b6e5484ba90ad7b17d35cd52 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:32.931355  6727 tablet_copy_client.cc:538] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:32.934458  6721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bab45d487c864870aba1aee58d01ca95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:32.940601  6727 tablet_bootstrap.cc:492] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:32.950683  6721 tablet_copy_client.cc:806] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:32.951342  6721 tablet_copy_client.cc:670] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:32.955312  6721 tablet_copy_client.cc:538] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:32.964529  6727 tablet_bootstrap.cc:492] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:32.965667  6727 tablet_bootstrap.cc:492] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:32.966333  6721 tablet_bootstrap.cc:492] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:32.966410  6727 ts_tablet_manager.cc:1403] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.003s
I20260620 13:55:32.972705  6727 raft_consensus.cc:359] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:32.973640  6727 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:32.974264  6727 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:32.976881  6727 ts_tablet_manager.cc:1434] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260620 13:55:32.978696  6043 tablet_copy_service.cc:342] P 663684cf4ae54c929bf8240ca0b63a47: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-50e28625b20048a398049a7734aaeaf8 received from {username='slave'} at 127.0.0.1:46758
I20260620 13:55:32.979123  6043 tablet_copy_service.cc:434] P 663684cf4ae54c929bf8240ca0b63a47: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-50e28625b20048a398049a7734aaeaf8 on tablet 50e28625b20048a398049a7734aaeaf8 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:33.029241  6721 tablet_bootstrap.cc:492] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:33.030082  6721 tablet_bootstrap.cc:492] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:33.030738  6721 ts_tablet_manager.cc:1403] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.065s	user 0.023s	sys 0.027s
I20260620 13:55:33.033077  6721 raft_consensus.cc:359] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:33.033702  6721 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:33.034214  6721 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:33.036214  6721 ts_tablet_manager.cc:1434] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260620 13:55:33.038074  5969 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-bab45d487c864870aba1aee58d01ca95 received from {username='slave'} at 127.0.0.1:42078
I20260620 13:55:33.038522  5969 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-bab45d487c864870aba1aee58d01ca95 on tablet bab45d487c864870aba1aee58d01ca95 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:33.187212  6586 raft_consensus.cc:1217] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:33.206290  6586 raft_consensus.cc:1217] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:33.225286  6586 raft_consensus.cc:1217] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:33.339586  6586 raft_consensus.cc:1217] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:33.653442  6700 raft_consensus.cc:1064] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:33.656009  6700 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:33.664945  6586 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:33.666734  5953 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:33.666869  5882 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:33.667006  6700 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:33.668322  6737 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:33.669539  6736 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:33.692533  6700 raft_consensus.cc:1064] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:33.695487  6700 consensus_queue.cc:237] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:33.698391  6701 raft_consensus.cc:2955] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:33.703886  5953 raft_consensus.cc:2955] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:33.706874  6586 raft_consensus.cc:2955] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:33.722103  6585 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:33.724355  5778 catalog_manager.cc:5696] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:33.729012  6737 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:33.736460  5882 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:33.736172  5878 raft_consensus.cc:2955] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:33.742718  5953 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:33.750347  6739 raft_consensus.cc:1064] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:33.751890  6734 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:33.753641  6739 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:33.756472  6736 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:33.761404  6713 raft_consensus.cc:1064] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:33.820742  6713 consensus_queue.cc:237] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:55:33.916761  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 89498.1us
I20260620 13:55:33.929229  5880 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:33.932422  6029 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:33.949601  6585 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:33.953686  6747 raft_consensus.cc:2955] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:33.957414  5952 raft_consensus.cc:2955] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:33.963064  6585 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:33.963755  6029 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:33.968842  6585 raft_consensus.cc:2955] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:33.972409  6757 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:33.976076  6684 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260620 13:55:33.991649  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 45227.9us
I20260620 13:55:34.002386  5958 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:34.009457  5882 raft_consensus.cc:2955] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.022886  6640 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:34.046116  6752 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:34.057286  6640 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:34.056803  6684 raft_consensus.cc:2955] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.066735  6640 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:34.065204  6586 raft_consensus.cc:2955] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.093205  6029 raft_consensus.cc:2955] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.144706  6761 raft_consensus.cc:2955] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.148291  6031 raft_consensus.cc:2955] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.162838  5781 catalog_manager.cc:5696] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.164419  5781 catalog_manager.cc:5696] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.170796  5958 raft_consensus.cc:2955] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.170333  6029 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:34.180131  6586 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:34.180498  5882 raft_consensus.cc:2955] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.182205  6747 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:34.183076  5878 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:34.184698  6700 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:34.188428  6585 raft_consensus.cc:2955] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.224718  6748 raft_consensus.cc:2955] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.235150  5781 catalog_manager.cc:5696] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.239601  6585 raft_consensus.cc:2955] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.243755  5884 consensus_queue.cc:237] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:34.247762  5878 raft_consensus.cc:2955] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.251596  6029 consensus_queue.cc:237] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:34.252831  6586 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:34.254709  6684 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:34.264930  6684 raft_consensus.cc:2955] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.267614  5958 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:34.268841  5952 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:34.269399  6587 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:34.270118  6747 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:34.271298  6586 raft_consensus.cc:2955] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.273777  6747 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:34.278352  6713 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:34.285341  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 50e28625b20048a398049a7734aaeaf8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:34.285496  6700 raft_consensus.cc:2955] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.287887  5953 raft_consensus.cc:2955] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.291311  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet b870adf0b6e5484ba90ad7b17d35cd52 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:34.296502  5952 raft_consensus.cc:2955] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.309229  6587 raft_consensus.cc:2955] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.314388  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 08f835b507484456a3c708ba0e6fb982 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:34.312556  5781 catalog_manager.cc:5696] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.328934  5958 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:34.333014  5779 catalog_manager.cc:5696] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.341169  6587 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:34.343190  6716 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:34.343694  5949 tablet_service.cc:1558] Processing DeleteTablet for tablet 50e28625b20048a398049a7734aaeaf8 with delete_type TABLET_DATA_TOMBSTONED (TS 192c750f597c43858e1ad09e8d805685 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35974
I20260620 13:55:34.344272  6029 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:34.346729  5780 catalog_manager.cc:5696] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:34.351343  6769 tablet_replica.cc:333] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:55:34.351708  5867 tablet_service.cc:1558] Processing DeleteTablet for tablet 08f835b507484456a3c708ba0e6fb982 with delete_type TABLET_DATA_TOMBSTONED (TS 2e82c0c231624695ac5a813230bf5038 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58442
I20260620 13:55:34.352505  6769 raft_consensus.cc:2243] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:34.353295  6769 raft_consensus.cc:2272] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:34.353456  6753 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:34.366441  6753 raft_consensus.cc:2955] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.368767  6769 ts_tablet_manager.cc:1916] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:34.373353  6029 raft_consensus.cc:2955] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.377172  6587 raft_consensus.cc:2955] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.380262  6770 tablet_replica.cc:333] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:55:34.381851  6770 raft_consensus.cc:2243] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:34.382730  6770 raft_consensus.cc:2272] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:34.394331  6770 ts_tablet_manager.cc:1916] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:34.400537  5781 catalog_manager.cc:5696] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:34.406416  6769 ts_tablet_manager.cc:1929] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:34.406472  6021 tablet_service.cc:1558] Processing DeleteTablet for tablet b870adf0b6e5484ba90ad7b17d35cd52 with delete_type TABLET_DATA_TOMBSTONED (TS 663684cf4ae54c929bf8240ca0b63a47 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43482
I20260620 13:55:34.413246  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet bab45d487c864870aba1aee58d01ca95 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:34.418980  6769 log.cc:1199] T 50e28625b20048a398049a7734aaeaf8 P 192c750f597c43858e1ad09e8d805685: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/wals/50e28625b20048a398049a7734aaeaf8
I20260620 13:55:34.426486  5867 tablet_service.cc:1558] Processing DeleteTablet for tablet bab45d487c864870aba1aee58d01ca95 with delete_type TABLET_DATA_TOMBSTONED (TS 2e82c0c231624695ac5a813230bf5038 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58442
I20260620 13:55:34.426396  6771 tablet_replica.cc:333] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:55:34.432662  6771 raft_consensus.cc:2243] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:34.432767  5766 catalog_manager.cc:5027] TS 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): tablet 50e28625b20048a398049a7734aaeaf8 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:34.433355  6771 raft_consensus.cc:2272] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:34.433907  6770 ts_tablet_manager.cc:1929] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:34.436643  6770 log.cc:1199] T 08f835b507484456a3c708ba0e6fb982 P 2e82c0c231624695ac5a813230bf5038: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/wals/08f835b507484456a3c708ba0e6fb982
I20260620 13:55:34.438544  5767 catalog_manager.cc:5027] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): tablet 08f835b507484456a3c708ba0e6fb982 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:34.441828  6770 tablet_replica.cc:333] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:55:34.443380  6770 raft_consensus.cc:2243] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:34.443552  6771 ts_tablet_manager.cc:1916] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:34.444255  6770 raft_consensus.cc:2272] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:34.451583  6770 ts_tablet_manager.cc:1916] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:34.462074  6771 ts_tablet_manager.cc:1929] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:34.462677  6771 log.cc:1199] T b870adf0b6e5484ba90ad7b17d35cd52 P 663684cf4ae54c929bf8240ca0b63a47: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/wals/b870adf0b6e5484ba90ad7b17d35cd52
I20260620 13:55:34.464393  5767 catalog_manager.cc:5027] TS 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): tablet b870adf0b6e5484ba90ad7b17d35cd52 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:34.466334  6770 ts_tablet_manager.cc:1929] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:34.466881  6770 log.cc:1199] T bab45d487c864870aba1aee58d01ca95 P 2e82c0c231624695ac5a813230bf5038: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/wals/bab45d487c864870aba1aee58d01ca95
I20260620 13:55:34.468341  5767 catalog_manager.cc:5027] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): tablet bab45d487c864870aba1aee58d01ca95 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:35.515189  6029 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
W20260620 13:55:35.525650  5998 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed1d1d20a2be4ceeb9389e7e3dbd2b5b. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:35.526156  5958 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:35.525897  5878 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:35.527767  6774 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:35.528590  6772 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:35.539306  6774 raft_consensus.cc:2955] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:35.540990  5958 raft_consensus.cc:2955] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:35.541756  5878 raft_consensus.cc:2955] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:35.558461  5780 catalog_manager.cc:5696] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:35.563463  5958 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:35.572178  5878 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260620 13:55:35.572698  5924 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49ee9750110f428fa454f96aaeb360ef. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:35.573225  6029 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:35.575651  6758 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:35.577350  6753 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:35.595743  6758 raft_consensus.cc:2955] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:35.597299  6029 raft_consensus.cc:2955] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:35.597566  5882 raft_consensus.cc:2955] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:35.612634  6031 consensus_queue.cc:237] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:35.623776  5777 catalog_manager.cc:5696] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:35.633765  5958 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260620 13:55:35.636050  5998 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6da14809d5f043db80b3e1639afd8e25. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:35.636242  6772 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:35.640331  5882 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:35.644550  6772 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:35.650650  6774 raft_consensus.cc:2955] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:35.654551  5953 raft_consensus.cc:2955] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:35.659996  5882 raft_consensus.cc:2955] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:35.673763  5958 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:35.691627  5777 catalog_manager.cc:5696] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
W20260620 13:55:35.700215  5924 consensus_peers.cc:597] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6d4fcf1f6a541c6ae1a7724f27750eb. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:35.708676  5882 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:35.708680  6031 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:35.711009  6758 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:35.713666  6758 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:35.723663  6753 raft_consensus.cc:2955] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:35.786434  5878 raft_consensus.cc:2955] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:35.798254  6031 raft_consensus.cc:2955] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:35.857551  5777 catalog_manager.cc:5696] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:35.985435  6799 ts_tablet_manager.cc:933] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:35.985474  6800 ts_tablet_manager.cc:933] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:35.995000  6800 tablet_copy_client.cc:323] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:55:35.995180  6799 tablet_copy_client.cc:323] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.195:41493
I20260620 13:55:35.997797  5969 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet 49ee9750110f428fa454f96aaeb360ef from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:55:35.998459  5969 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet 49ee9750110f428fa454f96aaeb360ef from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-49ee9750110f428fa454f96aaeb360ef
I20260620 13:55:35.998721  6043 tablet_copy_service.cc:140] P 663684cf4ae54c929bf8240ca0b63a47: Received BeginTabletCopySession request for tablet ed1d1d20a2be4ceeb9389e7e3dbd2b5b from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:46758)
I20260620 13:55:35.999382  6043 tablet_copy_service.cc:161] P 663684cf4ae54c929bf8240ca0b63a47: Beginning new tablet copy session on tablet ed1d1d20a2be4ceeb9389e7e3dbd2b5b from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:46758: session id = b0ce39342d8c4a64904b30b98de02b9f-ed1d1d20a2be4ceeb9389e7e3dbd2b5b
I20260620 13:55:36.004614  5969 tablet_copy_source_session.cc:215] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:36.011427  6800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ee9750110f428fa454f96aaeb360ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:36.012732  6043 tablet_copy_source_session.cc:215] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:36.025853  6799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed1d1d20a2be4ceeb9389e7e3dbd2b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:36.034833  6800 tablet_copy_client.cc:806] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:36.035620  6800 tablet_copy_client.cc:670] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:36.042400  6800 tablet_copy_client.cc:538] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:36.048695  6799 tablet_copy_client.cc:806] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:36.049324  6799 tablet_copy_client.cc:670] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:36.050026  6800 tablet_bootstrap.cc:492] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:36.055050  6799 tablet_copy_client.cc:538] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:36.073487  6799 tablet_bootstrap.cc:492] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:36.085999  6800 tablet_bootstrap.cc:492] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:36.087178  6800 tablet_bootstrap.cc:492] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:36.088117  6800 ts_tablet_manager.cc:1403] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.007s
I20260620 13:55:36.093586  6800 raft_consensus.cc:359] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:36.094656  6800 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:36.095685  6800 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:36.119374  6799 tablet_bootstrap.cc:492] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:36.121282  6799 tablet_bootstrap.cc:492] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:36.124372  6806 ts_tablet_manager.cc:933] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:36.123059  6799 ts_tablet_manager.cc:1403] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.050s	user 0.025s	sys 0.008s
I20260620 13:55:36.127183  6800 ts_tablet_manager.cc:1434] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.039s	user 0.015s	sys 0.018s
I20260620 13:55:36.129134  5969 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-49ee9750110f428fa454f96aaeb360ef received from {username='slave'} at 127.0.0.1:42078
I20260620 13:55:36.129617  5969 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-49ee9750110f428fa454f96aaeb360ef on tablet 49ee9750110f428fa454f96aaeb360ef with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:36.130219  6799 raft_consensus.cc:359] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:36.131239  6799 raft_consensus.cc:740] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:36.131991  6799 consensus_queue.cc:260] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:36.136338  6799 ts_tablet_manager.cc:1434] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260620 13:55:36.139317  6043 tablet_copy_service.cc:342] P 663684cf4ae54c929bf8240ca0b63a47: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-ed1d1d20a2be4ceeb9389e7e3dbd2b5b received from {username='slave'} at 127.0.0.1:46758
I20260620 13:55:36.140209  6043 tablet_copy_service.cc:434] P 663684cf4ae54c929bf8240ca0b63a47: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-ed1d1d20a2be4ceeb9389e7e3dbd2b5b on tablet ed1d1d20a2be4ceeb9389e7e3dbd2b5b with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:36.139621  6806 tablet_copy_client.cc:323] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.195:41493
I20260620 13:55:36.142757  6043 tablet_copy_service.cc:140] P 663684cf4ae54c929bf8240ca0b63a47: Received BeginTabletCopySession request for tablet 6da14809d5f043db80b3e1639afd8e25 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:46758)
I20260620 13:55:36.143393  6043 tablet_copy_service.cc:161] P 663684cf4ae54c929bf8240ca0b63a47: Beginning new tablet copy session on tablet 6da14809d5f043db80b3e1639afd8e25 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:46758: session id = b0ce39342d8c4a64904b30b98de02b9f-6da14809d5f043db80b3e1639afd8e25
I20260620 13:55:36.150826  6043 tablet_copy_source_session.cc:215] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:36.154093  6806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da14809d5f043db80b3e1639afd8e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:36.171308  6806 tablet_copy_client.cc:806] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:36.171978  6806 tablet_copy_client.cc:670] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:36.176009  6806 tablet_copy_client.cc:538] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:36.183468  6806 tablet_bootstrap.cc:492] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:36.208796  6806 tablet_bootstrap.cc:492] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:36.209946  6806 tablet_bootstrap.cc:492] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:36.210767  6806 ts_tablet_manager.cc:1403] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.006s
I20260620 13:55:36.215667  6806 raft_consensus.cc:359] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:36.217041  6806 raft_consensus.cc:740] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:36.218227  6806 consensus_queue.cc:260] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:36.221036  6806 ts_tablet_manager.cc:1434] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260620 13:55:36.222783  6043 tablet_copy_service.cc:342] P 663684cf4ae54c929bf8240ca0b63a47: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-6da14809d5f043db80b3e1639afd8e25 received from {username='slave'} at 127.0.0.1:46758
I20260620 13:55:36.223238  6043 tablet_copy_service.cc:434] P 663684cf4ae54c929bf8240ca0b63a47: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-6da14809d5f043db80b3e1639afd8e25 on tablet 6da14809d5f043db80b3e1639afd8e25 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:36.290010  6806 ts_tablet_manager.cc:933] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:36.292343  6806 tablet_copy_client.cc:323] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:55:36.293771  5969 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet f6d4fcf1f6a541c6ae1a7724f27750eb from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:55:36.294298  5969 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet f6d4fcf1f6a541c6ae1a7724f27750eb from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-f6d4fcf1f6a541c6ae1a7724f27750eb
I20260620 13:55:36.300056  5969 tablet_copy_source_session.cc:215] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:36.303718  6806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6d4fcf1f6a541c6ae1a7724f27750eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:36.321412  6806 tablet_copy_client.cc:806] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:36.322083  6806 tablet_copy_client.cc:670] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:36.326109  6806 tablet_copy_client.cc:538] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:36.335776  6806 tablet_bootstrap.cc:492] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:36.356273  6806 tablet_bootstrap.cc:492] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:36.357293  6806 tablet_bootstrap.cc:492] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:36.358022  6806 ts_tablet_manager.cc:1403] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.005s
I20260620 13:55:36.360991  6806 raft_consensus.cc:359] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:36.361990  6806 raft_consensus.cc:740] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:36.362677  6806 consensus_queue.cc:260] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:36.365178  6806 ts_tablet_manager.cc:1434] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260620 13:55:36.367496  5969 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-f6d4fcf1f6a541c6ae1a7724f27750eb received from {username='slave'} at 127.0.0.1:42078
I20260620 13:55:36.367991  5969 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-f6d4fcf1f6a541c6ae1a7724f27750eb on tablet f6d4fcf1f6a541c6ae1a7724f27750eb with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:36.537015  6586 raft_consensus.cc:1217] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:36.545346  6586 raft_consensus.cc:1217] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:36.596755  6586 raft_consensus.cc:1217] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:36.848001  6586 raft_consensus.cc:1217] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:36.993429  6758 raft_consensus.cc:1064] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:36.997066  6758 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:37.008152  5878 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:37.008215  6029 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:37.008284  6586 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:37.009825  6758 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:37.010743  6812 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:37.011651  6775 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:37.098488  6774 raft_consensus.cc:1064] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:37.101524  6774 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:37.146253  6586 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:37.150167  6772 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260620 13:55:37.219767  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 48945.3us
I20260620 13:55:37.227451  5958 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:37.229573  6811 raft_consensus.cc:1064] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:37.238232  6812 raft_consensus.cc:2955] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.251127  6811 consensus_queue.cc:237] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:37.250934  6031 raft_consensus.cc:2955] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.258977  6819 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:37.271694  5882 raft_consensus.cc:2955] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.279547  5777 catalog_manager.cc:5696] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:37.284945  6586 raft_consensus.cc:2955] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:55:37.307582  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 49353.5us
W20260620 13:55:37.323454  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 151541us
I20260620 13:55:37.326236  6586 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:37.326014  6821 raft_consensus.cc:2955] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.329560  6774 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:37.335798  5882 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:37.337582  5952 raft_consensus.cc:2955] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.349824  6772 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:37.350744  5880 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:37.353437  6772 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:37.359434  5880 raft_consensus.cc:2955] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.362818  5953 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:37.364789  6827 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:37.371121  6587 raft_consensus.cc:2955] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.393683  6775 raft_consensus.cc:1064] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:37.396888  6775 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:37.405634  6585 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:37.407375  6031 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:37.409891  5880 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:37.412362  6758 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:37.413960  6812 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:37.413846  6833 raft_consensus.cc:2955] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.417949  6585 raft_consensus.cc:2955] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.423003  5882 raft_consensus.cc:2955] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.427759  6775 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:37.436805  5953 raft_consensus.cc:2955] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.463894  6775 raft_consensus.cc:2955] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.470203  6586 raft_consensus.cc:2955] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.478307  5952 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:37.481349  6031 raft_consensus.cc:2955] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.488883  5780 catalog_manager.cc:5696] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.491616  5780 catalog_manager.cc:5696] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.493527  5880 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:37.492640  6586 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:37.500093  6775 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:37.501847  6797 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:37.520371  6028 consensus_queue.cc:237] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:37.526966  5882 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:37.526156  5781 catalog_manager.cc:5696] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.527859  6586 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:37.529148  6811 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:37.530922  6811 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:37.542825  6833 raft_consensus.cc:2955] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.549549  5882 raft_consensus.cc:2955] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.562202  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 6da14809d5f043db80b3e1639afd8e25 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:37.564004  6814 raft_consensus.cc:2955] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.555711  6586 raft_consensus.cc:2955] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.556202  5878 raft_consensus.cc:2955] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.573297  5958 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:37.576112  5882 raft_consensus.cc:2955] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.579955  6585 raft_consensus.cc:2955] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.585043  6587 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:37.587369  6028 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:37.588501  5777 catalog_manager.cc:5696] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.606591  6775 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:37.611016  5949 tablet_service.cc:1558] Processing DeleteTablet for tablet 6da14809d5f043db80b3e1639afd8e25 with delete_type TABLET_DATA_TOMBSTONED (TS 192c750f597c43858e1ad09e8d805685 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35974
I20260620 13:55:37.612993  6758 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:37.613847  5781 catalog_manager.cc:5696] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:37.616088  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 49ee9750110f428fa454f96aaeb360ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:37.617566  6775 raft_consensus.cc:2955] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.632990  6021 tablet_service.cc:1558] Processing DeleteTablet for tablet 49ee9750110f428fa454f96aaeb360ef with delete_type TABLET_DATA_TOMBSTONED (TS 663684cf4ae54c929bf8240ca0b63a47 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43482
I20260620 13:55:37.637601  6585 raft_consensus.cc:2955] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.667878  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet f6d4fcf1f6a541c6ae1a7724f27750eb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:37.669744  6845 tablet_replica.cc:333] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:55:37.672791  6028 raft_consensus.cc:2955] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.675937  6845 raft_consensus.cc:2243] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:37.675726  5777 catalog_manager.cc:5696] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:37.677670  6846 tablet_replica.cc:333] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:55:37.683660  6846 raft_consensus.cc:2243] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:37.684499  6846 raft_consensus.cc:2272] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:37.681401  6845 raft_consensus.cc:2272] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:37.689419  6845 ts_tablet_manager.cc:1916] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:37.692201  6846 ts_tablet_manager.cc:1916] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:37.711126  5867 tablet_service.cc:1558] Processing DeleteTablet for tablet f6d4fcf1f6a541c6ae1a7724f27750eb with delete_type TABLET_DATA_TOMBSTONED (TS 2e82c0c231624695ac5a813230bf5038 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58442
I20260620 13:55:37.713662  6845 ts_tablet_manager.cc:1929] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:37.714393  6845 log.cc:1199] T 6da14809d5f043db80b3e1639afd8e25 P 192c750f597c43858e1ad09e8d805685: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/wals/6da14809d5f043db80b3e1639afd8e25
I20260620 13:55:37.716133  6846 ts_tablet_manager.cc:1929] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:37.716689  6846 log.cc:1199] T 49ee9750110f428fa454f96aaeb360ef P 663684cf4ae54c929bf8240ca0b63a47: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/wals/49ee9750110f428fa454f96aaeb360ef
I20260620 13:55:37.730188  6847 tablet_replica.cc:333] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:55:37.731390  6847 raft_consensus.cc:2243] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:37.732218  6847 raft_consensus.cc:2272] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:37.732872  5767 catalog_manager.cc:5027] TS 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): tablet 49ee9750110f428fa454f96aaeb360ef (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:37.735828  6847 ts_tablet_manager.cc:1916] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:37.751683  5766 catalog_manager.cc:5027] TS 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): tablet 6da14809d5f043db80b3e1639afd8e25 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:37.754400  6847 ts_tablet_manager.cc:1929] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:37.754879  6847 log.cc:1199] T f6d4fcf1f6a541c6ae1a7724f27750eb P 2e82c0c231624695ac5a813230bf5038: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/wals/f6d4fcf1f6a541c6ae1a7724f27750eb
I20260620 13:55:37.756698  5767 catalog_manager.cc:5027] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): tablet f6d4fcf1f6a541c6ae1a7724f27750eb (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:37.807662  6029 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:37.813723  6585 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:37.814963  5878 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:37.815338  6811 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:37.816788  6833 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:37.826138  6774 raft_consensus.cc:2955] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.832767  6585 raft_consensus.cc:2955] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.833999  5882 raft_consensus.cc:2955] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:37.840157  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet ed1d1d20a2be4ceeb9389e7e3dbd2b5b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:37.853574  5778 catalog_manager.cc:5696] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:37.865988  5949 tablet_service.cc:1558] Processing DeleteTablet for tablet ed1d1d20a2be4ceeb9389e7e3dbd2b5b with delete_type TABLET_DATA_TOMBSTONED (TS 192c750f597c43858e1ad09e8d805685 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35974
I20260620 13:55:37.867012  6845 tablet_replica.cc:333] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:55:37.868221  6845 raft_consensus.cc:2243] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:37.869194  6845 raft_consensus.cc:2272] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:37.876372  6845 ts_tablet_manager.cc:1916] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:37.891387  6845 ts_tablet_manager.cc:1929] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:37.891809  6845 log.cc:1199] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 192c750f597c43858e1ad09e8d805685: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/wals/ed1d1d20a2be4ceeb9389e7e3dbd2b5b
I20260620 13:55:37.893364  5766 catalog_manager.cc:5027] TS 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): tablet ed1d1d20a2be4ceeb9389e7e3dbd2b5b (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:38.949041  5958 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:38.956404  5882 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260620 13:55:38.956804  5924 consensus_peers.cc:597] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc919ad08d5e4a9d9870a33b6fc425e5. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:38.957005  6029 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:38.957906  6850 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:38.959005  6848 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:38.966989  6814 raft_consensus.cc:2955] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:38.970403  5882 raft_consensus.cc:2955] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:38.977808  6029 raft_consensus.cc:2955] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:38.980758  5878 consensus_queue.cc:237] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:38.984709  5780 catalog_manager.cc:5696] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260620 13:55:39.009316  5849 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c5eb52b96b44f7cb3569bfff54e9b1c. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:39.010314  6029 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:39.011955  6825 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:39.013156  5958 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:39.016002  6826 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:39.043246  6826 raft_consensus.cc:2955] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:39.059653  6030 raft_consensus.cc:2955] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:39.063341  5952 raft_consensus.cc:2955] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:39.071767  5953 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:39.084554  6030 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:39.088263  5777 catalog_manager.cc:5696] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:39.087623  5878 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260620 13:55:39.088027  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd6ebbc0e9aa474f80952cef69b0ac25. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:39.091863  6848 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:39.093576  6850 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:39.118775  6848 raft_consensus.cc:2955] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:39.122404  5878 raft_consensus.cc:2955] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:39.123042  6030 raft_consensus.cc:2955] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:39.133846  5882 consensus_queue.cc:237] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:39.144388  5778 catalog_manager.cc:5696] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
W20260620 13:55:39.195994  5849 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99f357751cae4b6b87b5972ef2a1fda4. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:39.197049  6028 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:39.197486  5952 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:39.198693  6862 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:39.199724  6864 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:39.218550  6864 raft_consensus.cc:2955] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:39.220049  6029 raft_consensus.cc:2955] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:39.221467  5952 raft_consensus.cc:2955] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:39.238349  5778 catalog_manager.cc:5696] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:39.400727  6872 ts_tablet_manager.cc:933] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:39.402983  6872 tablet_copy_client.cc:323] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:55:39.404796  5969 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet dc919ad08d5e4a9d9870a33b6fc425e5 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:55:39.405471  5969 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet dc919ad08d5e4a9d9870a33b6fc425e5 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-dc919ad08d5e4a9d9870a33b6fc425e5
I20260620 13:55:39.412868  5969 tablet_copy_source_session.cc:215] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:39.416349  6872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc919ad08d5e4a9d9870a33b6fc425e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:39.429044  6872 tablet_copy_client.cc:806] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:39.429694  6872 tablet_copy_client.cc:670] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:39.434175  6872 tablet_copy_client.cc:538] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:39.442322  6872 tablet_bootstrap.cc:492] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:39.463126  6872 tablet_bootstrap.cc:492] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:39.464017  6872 tablet_bootstrap.cc:492] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:39.464632  6872 ts_tablet_manager.cc:1403] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.022s	user 0.022s	sys 0.000s
I20260620 13:55:39.467356  6872 raft_consensus.cc:359] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:39.467993  6872 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:39.468498  6872 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:39.471781  6872 ts_tablet_manager.cc:1434] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 13:55:39.473519  5969 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-dc919ad08d5e4a9d9870a33b6fc425e5 received from {username='slave'} at 127.0.0.1:42078
I20260620 13:55:39.473938  5969 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-dc919ad08d5e4a9d9870a33b6fc425e5 on tablet dc919ad08d5e4a9d9870a33b6fc425e5 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:39.545348  6872 ts_tablet_manager.cc:933] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:55:39.555037  6872 tablet_copy_client.cc:323] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.193:46177
I20260620 13:55:39.557895  5894 tablet_copy_service.cc:140] P 2e82c0c231624695ac5a813230bf5038: Received BeginTabletCopySession request for tablet 8c5eb52b96b44f7cb3569bfff54e9b1c from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42748)
I20260620 13:55:39.558475  5894 tablet_copy_service.cc:161] P 2e82c0c231624695ac5a813230bf5038: Beginning new tablet copy session on tablet 8c5eb52b96b44f7cb3569bfff54e9b1c from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42748: session id = b0ce39342d8c4a64904b30b98de02b9f-8c5eb52b96b44f7cb3569bfff54e9b1c
I20260620 13:55:39.567989  5894 tablet_copy_source_session.cc:215] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:39.572635  6872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c5eb52b96b44f7cb3569bfff54e9b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:39.591022  6872 tablet_copy_client.cc:806] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:39.591713  6872 tablet_copy_client.cc:670] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:39.595322  6872 tablet_copy_client.cc:538] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:39.604552  6872 tablet_bootstrap.cc:492] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:39.628558  6872 tablet_bootstrap.cc:492] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:39.629578  6872 tablet_bootstrap.cc:492] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:39.630321  6872 ts_tablet_manager.cc:1403] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.007s
I20260620 13:55:39.632735  6877 ts_tablet_manager.cc:933] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:39.633320  6872 raft_consensus.cc:359] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:39.634442  6872 raft_consensus.cc:740] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:39.635360  6872 consensus_queue.cc:260] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:39.638132  6872 ts_tablet_manager.cc:1434] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 13:55:39.642349  6877 tablet_copy_client.cc:323] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:55:39.643291  5894 tablet_copy_service.cc:342] P 2e82c0c231624695ac5a813230bf5038: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-8c5eb52b96b44f7cb3569bfff54e9b1c received from {username='slave'} at 127.0.0.1:42748
I20260620 13:55:39.643748  5894 tablet_copy_service.cc:434] P 2e82c0c231624695ac5a813230bf5038: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-8c5eb52b96b44f7cb3569bfff54e9b1c on tablet 8c5eb52b96b44f7cb3569bfff54e9b1c with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:39.644369  5969 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet fd6ebbc0e9aa474f80952cef69b0ac25 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:55:39.645136  5969 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet fd6ebbc0e9aa474f80952cef69b0ac25 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-fd6ebbc0e9aa474f80952cef69b0ac25
I20260620 13:55:39.653123  5969 tablet_copy_source_session.cc:215] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:39.656463  6877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6ebbc0e9aa474f80952cef69b0ac25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:39.672993  6877 tablet_copy_client.cc:806] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:39.673796  6877 tablet_copy_client.cc:670] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:39.680729  6877 tablet_copy_client.cc:538] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:39.690174  6877 tablet_bootstrap.cc:492] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:39.707273  6877 tablet_bootstrap.cc:492] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:39.708341  6877 tablet_bootstrap.cc:492] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:39.709079  6877 ts_tablet_manager.cc:1403] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.019s	user 0.021s	sys 0.000s
I20260620 13:55:39.712386  6877 raft_consensus.cc:359] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:39.713471  6877 raft_consensus.cc:740] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:39.714254  6877 consensus_queue.cc:260] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:39.717396  6877 ts_tablet_manager.cc:1434] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260620 13:55:39.719221  5969 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-fd6ebbc0e9aa474f80952cef69b0ac25 received from {username='slave'} at 127.0.0.1:42078
I20260620 13:55:39.719663  5969 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-fd6ebbc0e9aa474f80952cef69b0ac25 on tablet fd6ebbc0e9aa474f80952cef69b0ac25 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:39.787403  6877 ts_tablet_manager.cc:933] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:55:39.797729  6877 tablet_copy_client.cc:323] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.193:46177
I20260620 13:55:39.799641  5894 tablet_copy_service.cc:140] P 2e82c0c231624695ac5a813230bf5038: Received BeginTabletCopySession request for tablet 99f357751cae4b6b87b5972ef2a1fda4 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42748)
I20260620 13:55:39.800213  5894 tablet_copy_service.cc:161] P 2e82c0c231624695ac5a813230bf5038: Beginning new tablet copy session on tablet 99f357751cae4b6b87b5972ef2a1fda4 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42748: session id = b0ce39342d8c4a64904b30b98de02b9f-99f357751cae4b6b87b5972ef2a1fda4
I20260620 13:55:39.808137  5894 tablet_copy_source_session.cc:215] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:39.811834  6877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f357751cae4b6b87b5972ef2a1fda4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:39.827477  6877 tablet_copy_client.cc:806] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:39.828166  6877 tablet_copy_client.cc:670] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:39.832676  6877 tablet_copy_client.cc:538] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:39.843207  6877 tablet_bootstrap.cc:492] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:39.863933  6877 tablet_bootstrap.cc:492] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:39.864916  6877 tablet_bootstrap.cc:492] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:39.865623  6877 ts_tablet_manager.cc:1403] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.012s
I20260620 13:55:39.868553  6877 raft_consensus.cc:359] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:39.869282  6877 raft_consensus.cc:740] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:39.870091  6877 consensus_queue.cc:260] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:39.874017  6877 ts_tablet_manager.cc:1434] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260620 13:55:39.877194  5894 tablet_copy_service.cc:342] P 2e82c0c231624695ac5a813230bf5038: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-99f357751cae4b6b87b5972ef2a1fda4 received from {username='slave'} at 127.0.0.1:42748
I20260620 13:55:39.877656  5894 tablet_copy_service.cc:434] P 2e82c0c231624695ac5a813230bf5038: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-99f357751cae4b6b87b5972ef2a1fda4 on tablet 99f357751cae4b6b87b5972ef2a1fda4 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:39.960868  6585 raft_consensus.cc:1217] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:40.031167  6585 raft_consensus.cc:1217] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:40.201545  6586 raft_consensus.cc:1217] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:40.257973  6586 raft_consensus.cc:1217] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:40.446365  6814 raft_consensus.cc:1064] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:40.451874  6814 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:40.458711  6586 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:40.460371  6028 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:40.460758  5878 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:40.461627  6887 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:40.462582  6814 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:40.463376  6881 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:40.506417  6881 raft_consensus.cc:2955] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.509943  5878 raft_consensus.cc:2955] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.513160  6031 raft_consensus.cc:2955] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.516652  6864 raft_consensus.cc:1064] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:40.518852  6864 consensus_queue.cc:237] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:40.525501  5777 catalog_manager.cc:5696] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.544906  6586 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:40.548081  6885 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:40.550683  6586 raft_consensus.cc:2955] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.557668  6028 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:40.560576  6864 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:40.565225  5952 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:40.568660  6884 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:40.603310  6885 raft_consensus.cc:2955] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.612543  6587 raft_consensus.cc:2955] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.617210  5952 raft_consensus.cc:2955] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.620682  6028 raft_consensus.cc:2955] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.633266  5781 catalog_manager.cc:5696] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:40.666723  5953 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:40.686093  6886 raft_consensus.cc:1064] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:40.689599  6031 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:40.689800  6886 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:40.691443  6881 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:40.709715  6028 raft_consensus.cc:2955] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.715953  5878 consensus_queue.cc:237] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:40.700961  6881 raft_consensus.cc:2955] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.719209  6587 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:40.720822  6814 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:40.726344  6587 raft_consensus.cc:2955] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.732160  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet dc919ad08d5e4a9d9870a33b6fc425e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:40.739054  6586 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:40.739519  6028 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:40.740911  6881 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:40.743954  6586 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:40.744529  5878 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:40.745817  6881 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260620 13:55:40.750620  6881 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:40.754511  5781 catalog_manager.cc:5696] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:40.767128  6028 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:40.771875  6864 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:40.773902  6864 raft_consensus.cc:1064] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:40.775956  6905 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:40.780069  6864 consensus_queue.cc:237] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:40.801210  6584 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:40.803304  6825 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:40.810333  5867 tablet_service.cc:1558] Processing DeleteTablet for tablet dc919ad08d5e4a9d9870a33b6fc425e5 with delete_type TABLET_DATA_TOMBSTONED (TS 2e82c0c231624695ac5a813230bf5038 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58442
I20260620 13:55:40.813750  6907 tablet_replica.cc:333] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:55:40.815147  6907 raft_consensus.cc:2243] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:40.814126  6885 raft_consensus.cc:2955] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.817992  6907 raft_consensus.cc:2272] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:40.821398  6031 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:40.822201  6886 raft_consensus.cc:2955] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.824111  6030 raft_consensus.cc:2955] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.825873  5953 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:40.828279  6907 ts_tablet_manager.cc:1916] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:40.831892  5882 raft_consensus.cc:2955] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.833324  6864 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:40.839543  6584 raft_consensus.cc:2955] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.841965  6905 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:40.855129  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 8c5eb52b96b44f7cb3569bfff54e9b1c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260620 13:55:40.935710  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 50054.9us
I20260620 13:55:40.948992  5780 catalog_manager.cc:5696] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.952167  5778 catalog_manager.cc:5696] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:40.948312  6028 raft_consensus.cc:2955] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.968859  6905 raft_consensus.cc:2955] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.986308  6907 ts_tablet_manager.cc:1929] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:40.987025  6907 log.cc:1199] T dc919ad08d5e4a9d9870a33b6fc425e5 P 2e82c0c231624695ac5a813230bf5038: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/wals/dc919ad08d5e4a9d9870a33b6fc425e5
I20260620 13:55:40.987270  6587 raft_consensus.cc:2955] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:40.989838  5767 catalog_manager.cc:5027] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): tablet dc919ad08d5e4a9d9870a33b6fc425e5 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:41.004361  5952 raft_consensus.cc:2955] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:41.004920  6028 raft_consensus.cc:2955] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:41.007328  5949 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c5eb52b96b44f7cb3569bfff54e9b1c with delete_type TABLET_DATA_TOMBSTONED (TS 192c750f597c43858e1ad09e8d805685 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35974
I20260620 13:55:41.013795  6911 tablet_replica.cc:333] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:55:41.020089  6911 raft_consensus.cc:2243] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:41.022353  6911 raft_consensus.cc:2272] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:41.029474  6911 ts_tablet_manager.cc:1916] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:41.026685  6587 raft_consensus.cc:2955] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:41.042631  5776 catalog_manager.cc:5696] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:41.062583  5953 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:41.076555  6911 ts_tablet_manager.cc:1929] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:41.077100  6911 log.cc:1199] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 192c750f597c43858e1ad09e8d805685: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/wals/8c5eb52b96b44f7cb3569bfff54e9b1c
I20260620 13:55:41.081248  5882 consensus_queue.cc:237] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:41.088353  6587 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:41.089519  6586 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:41.091060  6885 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:41.093102  5766 catalog_manager.cc:5027] TS 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): tablet 8c5eb52b96b44f7cb3569bfff54e9b1c (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:41.094218  6886 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:41.098616  5884 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:41.102010  6028 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:41.106848  6881 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:41.109122  6885 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:41.109107  6887 raft_consensus.cc:2955] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:41.109153  6587 raft_consensus.cc:2955] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:41.118897  6864 raft_consensus.cc:2955] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:41.129398  6030 raft_consensus.cc:2955] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:41.133813  5778 catalog_manager.cc:5696] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:41.138360  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 99f357751cae4b6b87b5972ef2a1fda4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:41.139339  6587 raft_consensus.cc:2955] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:41.145054  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet fd6ebbc0e9aa474f80952cef69b0ac25 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:41.148746  5780 catalog_manager.cc:5696] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:41.150769  5882 raft_consensus.cc:2955] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:41.170094  6021 tablet_service.cc:1558] Processing DeleteTablet for tablet fd6ebbc0e9aa474f80952cef69b0ac25 with delete_type TABLET_DATA_TOMBSTONED (TS 663684cf4ae54c929bf8240ca0b63a47 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43482
I20260620 13:55:41.177066  5949 tablet_service.cc:1558] Processing DeleteTablet for tablet 99f357751cae4b6b87b5972ef2a1fda4 with delete_type TABLET_DATA_TOMBSTONED (TS 192c750f597c43858e1ad09e8d805685 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35974
I20260620 13:55:41.178196  6911 tablet_replica.cc:333] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:55:41.179260  6911 raft_consensus.cc:2243] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:41.179901  6911 raft_consensus.cc:2272] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:41.183211  6911 ts_tablet_manager.cc:1916] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:41.185035  6913 tablet_replica.cc:333] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:55:41.187585  6913 raft_consensus.cc:2243] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:41.188377  6913 raft_consensus.cc:2272] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:41.192648  6913 ts_tablet_manager.cc:1916] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:41.203477  6911 ts_tablet_manager.cc:1929] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:41.204152  6911 log.cc:1199] T 99f357751cae4b6b87b5972ef2a1fda4 P 192c750f597c43858e1ad09e8d805685: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/wals/99f357751cae4b6b87b5972ef2a1fda4
I20260620 13:55:41.211051  6913 ts_tablet_manager.cc:1929] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:41.211578  6913 log.cc:1199] T fd6ebbc0e9aa474f80952cef69b0ac25 P 663684cf4ae54c929bf8240ca0b63a47: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/wals/fd6ebbc0e9aa474f80952cef69b0ac25
I20260620 13:55:41.214461  5767 catalog_manager.cc:5027] TS 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): tablet fd6ebbc0e9aa474f80952cef69b0ac25 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:41.223049  5766 catalog_manager.cc:5027] TS 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): tablet 99f357751cae4b6b87b5972ef2a1fda4 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:42.249850  5882 consensus_queue.cc:237] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:42.256379  5958 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:42.256379  6028 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260620 13:55:42.256762  5849 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fb8edcc5cb024ebebdb3cac403f19bc4. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:42.258342  6825 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:42.259572  6905 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:42.274607  6864 raft_consensus.cc:2955] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:42.281579  6031 raft_consensus.cc:2955] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:42.289124  5958 raft_consensus.cc:2955] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:42.297482  5953 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:42.301271  5777 catalog_manager.cc:5696] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:42.337626  6031 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:42.338148  5884 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260620 13:55:42.339035  5924 consensus_peers.cc:597] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b00b548648e441dbb777699ee0ef3f60. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:42.340494  6887 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:42.342242  6901 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:42.357648  6901 raft_consensus.cc:2955] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:42.361783  6031 raft_consensus.cc:2955] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:42.369115  5882 raft_consensus.cc:2955] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:42.374713  6030 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:42.378242  5778 catalog_manager.cc:5696] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260620 13:55:42.397439  5998 consensus_peers.cc:597] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d483a507ec73494da65730a6444e1fd6. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:42.398164  5958 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260620 13:55:42.399995  5882 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260620 13:55:42.400269  6869 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:42.402359  6914 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:42.416184  6914 raft_consensus.cc:2955] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:42.418352  5958 raft_consensus.cc:2955] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:42.432314  5953 consensus_queue.cc:237] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:42.443249  5884 raft_consensus.cc:2955] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:42.445459  5778 catalog_manager.cc:5696] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:42.458266  6031 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:42.462240  6881 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:42.463488  5882 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260620 13:55:42.466805  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14bccd20cc3f44b69eeefefc4f8b72f9. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:42.472757  6887 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:42.479355  6887 raft_consensus.cc:2955] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:42.497133  6030 raft_consensus.cc:2955] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:42.503880  5777 catalog_manager.cc:5696] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:42.508234  5882 raft_consensus.cc:2955] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:42.758595  6935 ts_tablet_manager.cc:933] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:42.761574  6935 tablet_copy_client.cc:323] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:55:42.764115  5969 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet b00b548648e441dbb777699ee0ef3f60 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:55:42.765164  5969 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet b00b548648e441dbb777699ee0ef3f60 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-b00b548648e441dbb777699ee0ef3f60
I20260620 13:55:42.775446  5969 tablet_copy_source_session.cc:215] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:42.778720  6935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b00b548648e441dbb777699ee0ef3f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:42.786350  6937 ts_tablet_manager.cc:933] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:55:42.790537  6937 tablet_copy_client.cc:323] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.193:46177
I20260620 13:55:42.792335  5894 tablet_copy_service.cc:140] P 2e82c0c231624695ac5a813230bf5038: Received BeginTabletCopySession request for tablet fb8edcc5cb024ebebdb3cac403f19bc4 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42748)
I20260620 13:55:42.792888  5894 tablet_copy_service.cc:161] P 2e82c0c231624695ac5a813230bf5038: Beginning new tablet copy session on tablet fb8edcc5cb024ebebdb3cac403f19bc4 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42748: session id = b0ce39342d8c4a64904b30b98de02b9f-fb8edcc5cb024ebebdb3cac403f19bc4
I20260620 13:55:42.801661  5894 tablet_copy_source_session.cc:215] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:42.801786  6935 tablet_copy_client.cc:806] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:42.803959  6935 tablet_copy_client.cc:670] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:42.807156  6937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8edcc5cb024ebebdb3cac403f19bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:42.815266  6935 tablet_copy_client.cc:538] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:42.841871  6937 tablet_copy_client.cc:806] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:42.841984  6935 tablet_bootstrap.cc:492] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:42.855417  6937 tablet_copy_client.cc:670] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:42.861610  6937 tablet_copy_client.cc:538] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:42.881419  6937 tablet_bootstrap.cc:492] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:42.935631  6937 tablet_bootstrap.cc:492] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:42.936692  6937 tablet_bootstrap.cc:492] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:42.937474  6937 ts_tablet_manager.cc:1403] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.056s	user 0.027s	sys 0.017s
I20260620 13:55:42.940506  6937 raft_consensus.cc:359] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:42.941506  6937 raft_consensus.cc:740] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:42.942199  6937 consensus_queue.cc:260] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:42.953696  6937 ts_tablet_manager.cc:1434] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.004s
I20260620 13:55:42.957969  5894 tablet_copy_service.cc:342] P 2e82c0c231624695ac5a813230bf5038: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-fb8edcc5cb024ebebdb3cac403f19bc4 received from {username='slave'} at 127.0.0.1:42748
I20260620 13:55:42.965036  5894 tablet_copy_service.cc:434] P 2e82c0c231624695ac5a813230bf5038: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-fb8edcc5cb024ebebdb3cac403f19bc4 on tablet fb8edcc5cb024ebebdb3cac403f19bc4 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:42.961153  6939 ts_tablet_manager.cc:933] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:42.981197  6939 tablet_copy_client.cc:323] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.195:41493
I20260620 13:55:42.985610  6043 tablet_copy_service.cc:140] P 663684cf4ae54c929bf8240ca0b63a47: Received BeginTabletCopySession request for tablet d483a507ec73494da65730a6444e1fd6 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:46758)
I20260620 13:55:42.986259  6043 tablet_copy_service.cc:161] P 663684cf4ae54c929bf8240ca0b63a47: Beginning new tablet copy session on tablet d483a507ec73494da65730a6444e1fd6 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:46758: session id = b0ce39342d8c4a64904b30b98de02b9f-d483a507ec73494da65730a6444e1fd6
I20260620 13:55:42.995983  6043 tablet_copy_source_session.cc:215] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:42.996999  6935 tablet_bootstrap.cc:492] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:42.998746  6935 tablet_bootstrap.cc:492] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:42.999687  6935 ts_tablet_manager.cc:1403] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.158s	user 0.060s	sys 0.019s
I20260620 13:55:43.003402  6937 ts_tablet_manager.cc:933] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:43.003190  6935 raft_consensus.cc:359] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:43.004119  6935 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:43.004889  6935 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:43.008441  6935 ts_tablet_manager.cc:1434] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260620 13:55:43.018965  5969 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-b00b548648e441dbb777699ee0ef3f60 received from {username='slave'} at 127.0.0.1:42078
I20260620 13:55:43.019589  5969 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-b00b548648e441dbb777699ee0ef3f60 on tablet b00b548648e441dbb777699ee0ef3f60 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:43.026269  6939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d483a507ec73494da65730a6444e1fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:43.027314  6937 tablet_copy_client.cc:323] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:55:43.029031  5969 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet 14bccd20cc3f44b69eeefefc4f8b72f9 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:55:43.029539  5969 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet 14bccd20cc3f44b69eeefefc4f8b72f9 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-14bccd20cc3f44b69eeefefc4f8b72f9
I20260620 13:55:43.043964  5969 tablet_copy_source_session.cc:215] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:43.048797  6937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14bccd20cc3f44b69eeefefc4f8b72f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:43.056079  6939 tablet_copy_client.cc:806] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:43.056869  6939 tablet_copy_client.cc:670] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:43.061249  6939 tablet_copy_client.cc:538] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:43.069998  6937 tablet_copy_client.cc:806] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:43.070905  6937 tablet_copy_client.cc:670] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:43.072335  6939 tablet_bootstrap.cc:492] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:43.075017  6937 tablet_copy_client.cc:538] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:43.094223  6937 tablet_bootstrap.cc:492] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:43.230039  6939 tablet_bootstrap.cc:492] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:43.231022  6939 tablet_bootstrap.cc:492] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:43.231751  6939 ts_tablet_manager.cc:1403] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.160s	user 0.082s	sys 0.073s
I20260620 13:55:43.234651  6586 raft_consensus.cc:1217] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:43.239048  6939 raft_consensus.cc:359] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:43.240043  6939 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:43.240777  6939 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:43.243330  6939 ts_tablet_manager.cc:1434] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260620 13:55:43.245157  6043 tablet_copy_service.cc:342] P 663684cf4ae54c929bf8240ca0b63a47: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-d483a507ec73494da65730a6444e1fd6 received from {username='slave'} at 127.0.0.1:46758
I20260620 13:55:43.245584  6043 tablet_copy_service.cc:434] P 663684cf4ae54c929bf8240ca0b63a47: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-d483a507ec73494da65730a6444e1fd6 on tablet d483a507ec73494da65730a6444e1fd6 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:43.250905  6937 tablet_bootstrap.cc:492] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:43.264031  6937 tablet_bootstrap.cc:492] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:43.265889  6937 ts_tablet_manager.cc:1403] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.172s	user 0.077s	sys 0.049s
I20260620 13:55:43.269676  6937 raft_consensus.cc:359] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:43.270768  6937 raft_consensus.cc:740] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:43.271575  6937 consensus_queue.cc:260] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:43.273697  6937 ts_tablet_manager.cc:1434] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 13:55:43.276678  5969 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-14bccd20cc3f44b69eeefefc4f8b72f9 received from {username='slave'} at 127.0.0.1:42078
I20260620 13:55:43.277150  5969 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-14bccd20cc3f44b69eeefefc4f8b72f9 on tablet 14bccd20cc3f44b69eeefefc4f8b72f9 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:43.307224  6587 raft_consensus.cc:1217] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260620 13:55:43.383352  6587 raft_consensus.cc:1217] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:43.404274  6587 raft_consensus.cc:1217] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:43.624097  6881 raft_consensus.cc:1064] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:43.625777  6881 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:43.631573  6587 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:43.631997  6031 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:43.632591  5884 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:43.633675  6881 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:43.634517  6945 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:43.635324  6944 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:43.647814  6945 raft_consensus.cc:2955] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.652071  6587 raft_consensus.cc:2955] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.671414  5884 raft_consensus.cc:2955] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.673499  5778 catalog_manager.cc:5696] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:43.697165  6030 raft_consensus.cc:2955] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.720538  6929 raft_consensus.cc:1064] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:43.723278  6929 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:43.731796  6587 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260620 13:55:43.733556  6914 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:43.737429  5959 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260620 13:55:43.747207  6914 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:43.755146  5953 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:43.761504  6586 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:43.761897  6030 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:43.763181  6945 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:43.764420  6944 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:43.775961  5884 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260620 13:55:43.778694  6929 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:43.779430  6931 raft_consensus.cc:2955] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.781551  6031 raft_consensus.cc:2955] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.781580  6584 raft_consensus.cc:2955] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.792824  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet b00b548648e441dbb777699ee0ef3f60 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:43.821215  5780 catalog_manager.cc:5696] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.822806  6914 raft_consensus.cc:2955] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.837183  6931 raft_consensus.cc:1064] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:43.836612  5882 raft_consensus.cc:2955] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.840029  6931 consensus_queue.cc:237] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:43.850769  6587 raft_consensus.cc:2955] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.860157  5959 raft_consensus.cc:2955] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.872547  5778 catalog_manager.cc:5696] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.894590  5867 tablet_service.cc:1558] Processing DeleteTablet for tablet b00b548648e441dbb777699ee0ef3f60 with delete_type TABLET_DATA_TOMBSTONED (TS 2e82c0c231624695ac5a813230bf5038 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58442
I20260620 13:55:43.910436  6587 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:43.911741  6031 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:43.915414  5882 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:43.919461  6964 tablet_replica.cc:333] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:55:43.919332  6881 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:43.920655  6964 raft_consensus.cc:2243] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:43.921671  6964 raft_consensus.cc:2272] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:43.926651  6964 ts_tablet_manager.cc:1916] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:43.936618  6944 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260620 13:55:43.940559  6949 raft_consensus.cc:1064] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:43.943059  6887 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:43.945868  6949 consensus_queue.cc:237] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:43.947906  6031 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:43.953750  6964 ts_tablet_manager.cc:1929] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:43.954346  6964 log.cc:1199] T b00b548648e441dbb777699ee0ef3f60 P 2e82c0c231624695ac5a813230bf5038: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/wals/b00b548648e441dbb777699ee0ef3f60
I20260620 13:55:43.956183  5767 catalog_manager.cc:5027] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): tablet b00b548648e441dbb777699ee0ef3f60 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:43.961066  6584 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:43.963143  5953 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:43.965737  6914 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:43.968235  6914 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:55:43.978683  6929 raft_consensus.cc:2955] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.992483  6887 raft_consensus.cc:2955] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.993144  5958 raft_consensus.cc:2955] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.996346  6586 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:43.997009  6031 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:43.997088  6030 raft_consensus.cc:2955] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:43.998483  5953 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:43.998988  6950 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260620 13:55:44.006392  6949 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:44.007438  6905 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:44.008388  5882 raft_consensus.cc:2955] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:44.026630  5777 catalog_manager.cc:5696] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:44.007493  6587 raft_consensus.cc:2955] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:44.039376  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet d483a507ec73494da65730a6444e1fd6 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:44.041862  6966 raft_consensus.cc:2955] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:44.050221  5953 raft_consensus.cc:2955] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:44.072012  5777 catalog_manager.cc:5696] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 4 to 5, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:44.090379  5867 tablet_service.cc:1558] Processing DeleteTablet for tablet d483a507ec73494da65730a6444e1fd6 with delete_type TABLET_DATA_TOMBSTONED (TS 2e82c0c231624695ac5a813230bf5038 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:58442
I20260620 13:55:44.091600  6964 tablet_replica.cc:333] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:55:44.100337  6030 raft_consensus.cc:2955] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:44.107860  6586 raft_consensus.cc:2955] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:44.109575  5780 catalog_manager.cc:5696] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:44.124529  6964 raft_consensus.cc:2243] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:44.125626  6964 raft_consensus.cc:2272] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:44.127071  6584 raft_consensus.cc:2955] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:44.174284  6964 ts_tablet_manager.cc:1916] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:44.196324  6964 ts_tablet_manager.cc:1929] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260620 13:55:44.198038  6964 log.cc:1199] T d483a507ec73494da65730a6444e1fd6 P 2e82c0c231624695ac5a813230bf5038: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/wals/d483a507ec73494da65730a6444e1fd6
I20260620 13:55:44.200732  5767 catalog_manager.cc:5027] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): tablet d483a507ec73494da65730a6444e1fd6 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:44.206434  5884 consensus_queue.cc:237] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:44.208906  5958 consensus_queue.cc:237] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:44.213538  6584 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:44.214461  6586 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:44.215050  6905 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:44.216078  5884 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:44.216373  6887 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:44.217376  6944 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:44.217602  5957 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:44.222736  6949 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:44.225847  6949 raft_consensus.cc:2955] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:44.229065  6931 raft_consensus.cc:2955] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:44.236644  6584 raft_consensus.cc:2955] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:44.239151  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet fb8edcc5cb024ebebdb3cac403f19bc4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:44.244616  5884 raft_consensus.cc:2955] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:44.246577  5778 catalog_manager.cc:5696] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:44.260041  5776 catalog_manager.cc:5696] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:44.265733  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 14bccd20cc3f44b69eeefefc4f8b72f9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:44.274946  5958 raft_consensus.cc:2955] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:44.269304  6584 raft_consensus.cc:2955] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:44.286945  6016 tablet_service.cc:1558] Processing DeleteTablet for tablet 14bccd20cc3f44b69eeefefc4f8b72f9 with delete_type TABLET_DATA_TOMBSTONED (TS 663684cf4ae54c929bf8240ca0b63a47 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43482
I20260620 13:55:44.287673  6021 tablet_service.cc:1558] Processing DeleteTablet for tablet fb8edcc5cb024ebebdb3cac403f19bc4 with delete_type TABLET_DATA_TOMBSTONED (TS 663684cf4ae54c929bf8240ca0b63a47 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43482
I20260620 13:55:44.315230  6974 tablet_replica.cc:333] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:55:44.322311  6974 raft_consensus.cc:2243] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:44.323304  6974 raft_consensus.cc:2272] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:44.327394  6974 ts_tablet_manager.cc:1916] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:44.340379  6974 ts_tablet_manager.cc:1929] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:44.340698  6974 log.cc:1199] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 663684cf4ae54c929bf8240ca0b63a47: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/wals/14bccd20cc3f44b69eeefefc4f8b72f9
I20260620 13:55:44.342573  5767 catalog_manager.cc:5027] TS 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): tablet 14bccd20cc3f44b69eeefefc4f8b72f9 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:44.342731  6974 tablet_replica.cc:333] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:55:44.343796  6974 raft_consensus.cc:2243] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:44.344450  6974 raft_consensus.cc:2272] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:44.347577  6974 ts_tablet_manager.cc:1916] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:44.364482  6974 ts_tablet_manager.cc:1929] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:44.364892  6974 log.cc:1199] T fb8edcc5cb024ebebdb3cac403f19bc4 P 663684cf4ae54c929bf8240ca0b63a47: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/wals/fb8edcc5cb024ebebdb3cac403f19bc4
I20260620 13:55:44.366401  5767 catalog_manager.cc:5027] TS 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): tablet fb8edcc5cb024ebebdb3cac403f19bc4 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
W20260620 13:55:45.419034  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 68871.1us
I20260620 13:55:45.463904  5884 consensus_queue.cc:237] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:45.475788  6029 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:45.477082  5957 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:45.479085  6981 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:45.481462  6905 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260620 13:55:45.489910  5849 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52b97878e9ad465684082e7bf1c482ad. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:45.494558  5957 raft_consensus.cc:2955] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:45.493058  6981 raft_consensus.cc:2955] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:45.523818  5884 consensus_queue.cc:237] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:45.525552  6029 raft_consensus.cc:2955] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:45.526724  5778 catalog_manager.cc:5696] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:45.535774  6030 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260620 13:55:45.537434  5849 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 735685c84e834b9cbaf7533d6fdf16e6. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:45.537621  5957 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:45.537993  6985 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:45.540401  6985 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:45.549793  6981 raft_consensus.cc:2955] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:45.553100  6029 raft_consensus.cc:2955] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:45.570750  5959 consensus_queue.cc:237] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:45.576366  5957 raft_consensus.cc:2955] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:45.582671  6030 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260620 13:55:45.582192  5924 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90f87066e519439ab8be15dccf1d2493. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:45.585350  6983 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:45.596287  5776 catalog_manager.cc:5696] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:45.598484  6979 raft_consensus.cc:2955] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:45.602372  6029 raft_consensus.cc:2955] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:45.610963  5884 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:45.616071  6983 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:45.626044  5884 raft_consensus.cc:2955] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:45.628584  5957 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:45.643247  6029 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:45.644603  6881 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260620 13:55:45.645673  5924 consensus_peers.cc:597] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18f8f8a1b370453aade5f48cd3bedcbd. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:45.644433  5884 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:45.645133  5776 catalog_manager.cc:5696] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:45.647459  6881 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:45.654745  6979 raft_consensus.cc:2955] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:45.658638  6029 raft_consensus.cc:2955] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:45.657857  5884 raft_consensus.cc:2955] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:45.678086  5780 catalog_manager.cc:5696] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:45.996026  7005 ts_tablet_manager.cc:933] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:55:46.073236  7006 ts_tablet_manager.cc:933] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
W20260620 13:55:46.087303  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 43710.4us
I20260620 13:55:46.093111  7006 tablet_copy_client.cc:323] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.193:46177
I20260620 13:55:46.096556  5894 tablet_copy_service.cc:140] P 2e82c0c231624695ac5a813230bf5038: Received BeginTabletCopySession request for tablet 735685c84e834b9cbaf7533d6fdf16e6 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42748)
I20260620 13:55:46.097945  5894 tablet_copy_service.cc:161] P 2e82c0c231624695ac5a813230bf5038: Beginning new tablet copy session on tablet 735685c84e834b9cbaf7533d6fdf16e6 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42748: session id = b0ce39342d8c4a64904b30b98de02b9f-735685c84e834b9cbaf7533d6fdf16e6
I20260620 13:55:46.110829  7005 tablet_copy_client.cc:323] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.193:46177
I20260620 13:55:46.123342  5893 tablet_copy_service.cc:140] P 2e82c0c231624695ac5a813230bf5038: Received BeginTabletCopySession request for tablet 52b97878e9ad465684082e7bf1c482ad from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42748)
I20260620 13:55:46.124042  5893 tablet_copy_service.cc:161] P 2e82c0c231624695ac5a813230bf5038: Beginning new tablet copy session on tablet 52b97878e9ad465684082e7bf1c482ad from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42748: session id = b0ce39342d8c4a64904b30b98de02b9f-52b97878e9ad465684082e7bf1c482ad
I20260620 13:55:46.133976  5894 tablet_copy_source_session.cc:215] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:46.136765  5893 tablet_copy_source_session.cc:215] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:46.139220  7006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 735685c84e834b9cbaf7533d6fdf16e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:46.152874  7005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b97878e9ad465684082e7bf1c482ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:46.174826  7013 ts_tablet_manager.cc:933] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:46.188536  7013 tablet_copy_client.cc:323] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:55:46.190709  5969 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet 90f87066e519439ab8be15dccf1d2493 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:55:46.191367  5969 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet 90f87066e519439ab8be15dccf1d2493 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-90f87066e519439ab8be15dccf1d2493
I20260620 13:55:46.199219  7005 tablet_copy_client.cc:806] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:46.200068  7006 tablet_copy_client.cc:806] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:46.200119  7005 tablet_copy_client.cc:670] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:46.200803  7006 tablet_copy_client.cc:670] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:46.205746  7005 tablet_copy_client.cc:538] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:46.207028  5969 tablet_copy_source_session.cc:215] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:46.213052  7013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f87066e519439ab8be15dccf1d2493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:46.207702  7006 tablet_copy_client.cc:538] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:46.227919  7005 tablet_bootstrap.cc:492] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:46.244997  7015 ts_tablet_manager.cc:933] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:46.245446  7013 tablet_copy_client.cc:806] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:46.251654  7013 tablet_copy_client.cc:670] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:46.256204  7013 tablet_copy_client.cc:538] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:46.271790  7013 tablet_bootstrap.cc:492] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:46.283049  7006 tablet_bootstrap.cc:492] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:46.289721  7005 tablet_bootstrap.cc:492] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:46.296245  7005 tablet_bootstrap.cc:492] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:46.297323  7005 ts_tablet_manager.cc:1403] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.011s
I20260620 13:55:46.302251  7005 raft_consensus.cc:359] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:46.320267  7005 raft_consensus.cc:740] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:46.321302  7005 consensus_queue.cc:260] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
W20260620 13:55:46.328989  6608 debug-util.cc:398] Leaking SignalData structure 0x7b08002da100 after lost signal to thread 4722
W20260620 13:55:46.330435  6608 debug-util.cc:398] Leaking SignalData structure 0x7b08002da7e0 after lost signal to thread 5815
W20260620 13:55:46.332162  6608 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3240 after lost signal to thread 5908
W20260620 13:55:46.335240  6608 debug-util.cc:398] Leaking SignalData structure 0x7b08002b5100 after lost signal to thread 5983
W20260620 13:55:46.337216  6608 debug-util.cc:398] Leaking SignalData structure 0x7b080020b1a0 after lost signal to thread 6057
W20260620 13:55:46.339185  6608 debug-util.cc:398] Leaking SignalData structure 0x7b0800102de0 after lost signal to thread 6611
I20260620 13:55:46.339605  7015 tablet_copy_client.cc:323] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:55:46.342880  5969 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet 18f8f8a1b370453aade5f48cd3bedcbd from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:55:46.343483  5969 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet 18f8f8a1b370453aade5f48cd3bedcbd from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-18f8f8a1b370453aade5f48cd3bedcbd
I20260620 13:55:46.350121  7005 ts_tablet_manager.cc:1434] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.052s	user 0.014s	sys 0.003s
I20260620 13:55:46.357216  5894 tablet_copy_service.cc:342] P 2e82c0c231624695ac5a813230bf5038: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-52b97878e9ad465684082e7bf1c482ad received from {username='slave'} at 127.0.0.1:42748
I20260620 13:55:46.358032  5894 tablet_copy_service.cc:434] P 2e82c0c231624695ac5a813230bf5038: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-52b97878e9ad465684082e7bf1c482ad on tablet 52b97878e9ad465684082e7bf1c482ad with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:46.372496  5969 tablet_copy_source_session.cc:215] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:46.377575  7013 tablet_bootstrap.cc:492] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:46.379722  7013 tablet_bootstrap.cc:492] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:46.380522  7013 ts_tablet_manager.cc:1403] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.109s	user 0.014s	sys 0.020s
I20260620 13:55:46.387740  7015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f8f8a1b370453aade5f48cd3bedcbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:46.397419  6587 raft_consensus.cc:1217] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:46.415908  7013 raft_consensus.cc:359] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:46.417011  7013 raft_consensus.cc:740] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:46.417840  7013 consensus_queue.cc:260] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:46.429100  7013 ts_tablet_manager.cc:1434] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.002s
I20260620 13:55:46.439651  5969 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-90f87066e519439ab8be15dccf1d2493 received from {username='slave'} at 127.0.0.1:42078
I20260620 13:55:46.440116  5969 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-90f87066e519439ab8be15dccf1d2493 on tablet 90f87066e519439ab8be15dccf1d2493 with peer b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:55:46.457304  7006 log.cc:927] Time spent T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260620 13:55:46.469450  7006 tablet_bootstrap.cc:492] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:46.470654  7006 tablet_bootstrap.cc:492] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:46.471601  7006 ts_tablet_manager.cc:1403] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.216s	user 0.026s	sys 0.010s
I20260620 13:55:46.476008  7006 raft_consensus.cc:359] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:46.477217  7006 raft_consensus.cc:740] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:46.493736  7006 consensus_queue.cc:260] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:46.503180  7006 ts_tablet_manager.cc:1434] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.001s
I20260620 13:55:46.505767  7015 tablet_copy_client.cc:806] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:46.506592  7015 tablet_copy_client.cc:670] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:46.524570  5894 tablet_copy_service.cc:342] P 2e82c0c231624695ac5a813230bf5038: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-735685c84e834b9cbaf7533d6fdf16e6 received from {username='slave'} at 127.0.0.1:42748
I20260620 13:55:46.528569  7015 tablet_copy_client.cc:538] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:46.530179  5894 tablet_copy_service.cc:434] P 2e82c0c231624695ac5a813230bf5038: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-735685c84e834b9cbaf7533d6fdf16e6 on tablet 735685c84e834b9cbaf7533d6fdf16e6 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:46.563457  7015 tablet_bootstrap.cc:492] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:46.576570  6587 raft_consensus.cc:1217] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:46.625339  7015 tablet_bootstrap.cc:492] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:46.626556  7015 tablet_bootstrap.cc:492] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:46.627465  7015 ts_tablet_manager.cc:1403] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.064s	user 0.025s	sys 0.006s
I20260620 13:55:46.634162  7015 raft_consensus.cc:359] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:46.635293  7015 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:46.636736  7015 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:46.643039  7015 ts_tablet_manager.cc:1434] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260620 13:55:46.652844  5969 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-18f8f8a1b370453aade5f48cd3bedcbd received from {username='slave'} at 127.0.0.1:42078
I20260620 13:55:46.653352  5969 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-18f8f8a1b370453aade5f48cd3bedcbd on tablet 18f8f8a1b370453aade5f48cd3bedcbd with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:46.817942  6587 raft_consensus.cc:1217] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:46.867925  7008 raft_consensus.cc:1064] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:46.871239  7008 consensus_queue.cc:237] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:46.887821  6587 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:46.887912  5959 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:46.889885  6949 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:46.891780  6985 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:46.901485  6029 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:46.904436  6905 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:46.908630  6584 raft_consensus.cc:1217] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:46.970818  6905 raft_consensus.cc:2955] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:46.974499  6031 raft_consensus.cc:2955] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:46.984756  6584 raft_consensus.cc:2955] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:46.992127  5959 raft_consensus.cc:2955] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.030856  5778 catalog_manager.cc:5696] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.083802  5880 consensus_queue.cc:237] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:47.095074  6584 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:47.096663  6905 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:47.103521  6031 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:47.106056  6905 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:47.108060  6949 raft_consensus.cc:2955] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.125710  6587 raft_consensus.cc:2955] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.139817  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 52b97878e9ad465684082e7bf1c482ad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:47.141875  6031 raft_consensus.cc:2955] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.148345  5777 catalog_manager.cc:5696] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:47.166455  5949 tablet_service.cc:1558] Processing DeleteTablet for tablet 52b97878e9ad465684082e7bf1c482ad with delete_type TABLET_DATA_TOMBSTONED (TS 192c750f597c43858e1ad09e8d805685 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35974
I20260620 13:55:47.167418  7004 raft_consensus.cc:1064] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:47.170178  7004 consensus_queue.cc:237] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:47.194514  7032 tablet_replica.cc:333] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:55:47.195995  7032 raft_consensus.cc:2243] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:47.197049  7032 raft_consensus.cc:2272] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:47.202605  7032 ts_tablet_manager.cc:1916] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:47.206095  6587 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:47.209162  6982 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:47.213425  6031 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:47.219641  7009 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:47.223031  7009 raft_consensus.cc:1064] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:47.258288  7009 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:47.277633  5880 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:47.293167  7034 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:47.334565  7032 ts_tablet_manager.cc:1929] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:47.337430  7032 log.cc:1199] T 52b97878e9ad465684082e7bf1c482ad P 192c750f597c43858e1ad09e8d805685: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/wals/52b97878e9ad465684082e7bf1c482ad
I20260620 13:55:47.340085  5766 catalog_manager.cc:5027] TS 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): tablet 52b97878e9ad465684082e7bf1c482ad (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:47.344170  7035 raft_consensus.cc:2955] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.387348  5777 catalog_manager.cc:5696] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:47.409487  6905 raft_consensus.cc:1064] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:47.413867  6905 consensus_queue.cc:237] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:55:47.420975  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 79813.2us
I20260620 13:55:47.424120  6587 raft_consensus.cc:2955] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.432426  5883 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:47.438522  6031 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:47.438901  6030 raft_consensus.cc:2955] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.440435  6584 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:47.456432  5880 raft_consensus.cc:2955] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.461434  6584 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:47.463461  6949 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:47.467758  6031 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:47.467907  5959 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:47.469502  7040 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:47.474627  6949 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:47.489048  7023 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:47.501734  7040 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:47.500226  5959 consensus_queue.cc:237] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:47.509541  7040 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:47.521200  7023 raft_consensus.cc:2955] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.523990  6584 raft_consensus.cc:2955] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.545825  5780 catalog_manager.cc:5696] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.547051  6029 raft_consensus.cc:2955] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.551853  5880 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:47.561352  6584 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:47.574534  5879 consensus_queue.cc:237] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:47.583179  7040 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:47.584967  6584 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:47.588034  6985 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:47.587633  7043 raft_consensus.cc:2955] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.599418  7040 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:47.600628  7008 raft_consensus.cc:2955] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.602754  6584 raft_consensus.cc:2955] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.620631  6030 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:47.623759  5777 catalog_manager.cc:5696] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:47.627562  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 735685c84e834b9cbaf7533d6fdf16e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:47.628711  5780 catalog_manager.cc:5696] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:47.636312  6985 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:47.637316  6587 raft_consensus.cc:2955] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.642629  6030 raft_consensus.cc:2955] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.648729  5879 raft_consensus.cc:2955] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.652681  6027 raft_consensus.cc:2955] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.718592  5949 tablet_service.cc:1558] Processing DeleteTablet for tablet 735685c84e834b9cbaf7533d6fdf16e6 with delete_type TABLET_DATA_TOMBSTONED (TS 192c750f597c43858e1ad09e8d805685 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35974
I20260620 13:55:47.719651  7032 tablet_replica.cc:333] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:55:47.732321  5957 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:47.734784  7009 raft_consensus.cc:2955] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.749137  7032 raft_consensus.cc:2243] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:47.749933  7032 pending_rounds.cc:70] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685: Trying to abort 1 pending ops.
I20260620 13:55:47.760514  5879 raft_consensus.cc:2955] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.750301  7032 pending_rounds.cc:77] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7298923509393895424 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } } }
I20260620 13:55:47.766076  7032 raft_consensus.cc:2917] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260620 13:55:47.766721  7032 raft_consensus.cc:2889] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260620 13:55:47.767500  7032 raft_consensus.cc:2272] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:47.767838  5778 catalog_manager.cc:5696] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:47.780200  6030 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:47.779635  6584 raft_consensus.cc:2955] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.782472  6587 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:47.783313  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 90f87066e519439ab8be15dccf1d2493 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:47.791671  7032 ts_tablet_manager.cc:1916] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:47.793310  6016 tablet_service.cc:1558] Processing DeleteTablet for tablet 90f87066e519439ab8be15dccf1d2493 with delete_type TABLET_DATA_TOMBSTONED (TS 663684cf4ae54c929bf8240ca0b63a47 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43482
I20260620 13:55:47.792475  7009 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:47.797966  7004 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260620 13:55:47.834954  7052 tablet_replica.cc:333] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:55:47.835273  7041 raft_consensus.cc:2955] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.836936  7052 raft_consensus.cc:2243] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:47.838285  7052 raft_consensus.cc:2272] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:47.843632  7052 ts_tablet_manager.cc:1916] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:47.846779  7032 ts_tablet_manager.cc:1929] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:47.851559  7032 log.cc:1199] T 735685c84e834b9cbaf7533d6fdf16e6 P 192c750f597c43858e1ad09e8d805685: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/wals/735685c84e834b9cbaf7533d6fdf16e6
I20260620 13:55:47.865242  6584 raft_consensus.cc:2955] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.879801  5778 catalog_manager.cc:5696] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:47.890978  5766 catalog_manager.cc:5027] TS 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): tablet 735685c84e834b9cbaf7533d6fdf16e6 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:47.891820  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 18f8f8a1b370453aade5f48cd3bedcbd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:47.892413  6031 raft_consensus.cc:2955] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:47.899284  5867 tablet_service.cc:1558] Processing DeleteTablet for tablet 18f8f8a1b370453aade5f48cd3bedcbd with delete_type TABLET_DATA_TOMBSTONED (TS 2e82c0c231624695ac5a813230bf5038 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58442
I20260620 13:55:47.914672  7053 tablet_replica.cc:333] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:55:47.915999  7053 raft_consensus.cc:2243] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:47.916862  7053 raft_consensus.cc:2272] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:47.919545  7052 ts_tablet_manager.cc:1929] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:47.922010  7052 log.cc:1199] T 90f87066e519439ab8be15dccf1d2493 P 663684cf4ae54c929bf8240ca0b63a47: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/wals/90f87066e519439ab8be15dccf1d2493
I20260620 13:55:47.922480  7053 ts_tablet_manager.cc:1916] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:47.959210  5767 catalog_manager.cc:5027] TS 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): tablet 90f87066e519439ab8be15dccf1d2493 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:47.970924  7053 ts_tablet_manager.cc:1929] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:47.971467  7053 log.cc:1199] T 18f8f8a1b370453aade5f48cd3bedcbd P 2e82c0c231624695ac5a813230bf5038: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/wals/18f8f8a1b370453aade5f48cd3bedcbd
I20260620 13:55:47.972968  5767 catalog_manager.cc:5027] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): tablet 18f8f8a1b370453aade5f48cd3bedcbd (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:48.720925  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:48.797397  5952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:48.798204  5952 raft_consensus.cc:606] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:48.801616  5952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:48.802325  5952 raft_consensus.cc:606] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:48.805377  5952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:48.805872  5952 raft_consensus.cc:606] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:48.824757  5879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:55:48.825467  5879 raft_consensus.cc:606] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:48.828716  5952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:48.829283  5952 raft_consensus.cc:606] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:48.834388  5952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:48.835075  5952 raft_consensus.cc:606] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:48.836416  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260620 13:55:48.837815  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:48.838922  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:48.873929  7040 raft_consensus.cc:993] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: : Instructing follower 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:48.874540  7054 raft_consensus.cc:1081] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:48.879062  6029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:43488
I20260620 13:55:48.879703  6029 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:48.880077  6029 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:48.891499  6029 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:48.895134  6029 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:48.896051  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:48.896477  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:48.896803  5879 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:48.896970  5957 raft_consensus.cc:3055] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:48.897378  5957 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:48.898144  5957 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:48.899324  5957 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:48.905109  5879 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:48.906137  5957 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:48.906982  5998 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:48.908141  6984 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:48.911396  6984 raft_consensus.cc:697] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:48.913687  6984 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:48.931457  5777 catalog_manager.cc:5696] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:48.971429  6949 raft_consensus.cc:993] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: : Instructing follower b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:48.971886  6985 raft_consensus.cc:1081] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Signalling peer b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:48.973572  6587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:46852
I20260620 13:55:48.974133  6587 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:48.974472  6587 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:48.989995  6587 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:48.994994  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:48.995685  5879 raft_consensus.cc:3055] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:48.996023  5879 raft_consensus.cc:740] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:48.996075  6587 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:48.996934  5879 consensus_queue.cc:260] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:48.999248  5879 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:49.000644  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:49.001247  6029 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:49.012543  5879 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:49.013909  6029 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:49.013720  5957 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:49.016808  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:55:49.091889  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 56052.9us
W20260620 13:55:49.145067  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 128446us
I20260620 13:55:49.145356  7066 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:49.150910  7066 raft_consensus.cc:697] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:55:49.152807  7066 consensus_queue.cc:237] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:49.163792  6031 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:49.165990  5879 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:49.168041  7041 raft_consensus.cc:993] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: : Instructing follower b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:49.168509  7041 raft_consensus.cc:1081] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:49.171000  7054 raft_consensus.cc:993] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685: : Instructing follower b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:49.171494  7071 raft_consensus.cc:1081] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:49.173840  7071 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:49.175218  6585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:46864
I20260620 13:55:49.175817  6585 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
W20260620 13:55:49.176011  5924 consensus_peers.cc:597] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 59b6ab17fde545f5b655c12383d08351. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:49.176179  6585 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:49.182188  6584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:46864
I20260620 13:55:49.182765  6584 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:49.183140  6584 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:49.184700  7070 raft_consensus.cc:993] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: : Instructing follower 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:49.185433  7070 raft_consensus.cc:1081] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:49.186789  7069 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:49.192898  6031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:43488
I20260620 13:55:49.193511  6031 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:49.193845  6031 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:49.197799  6584 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:49.198371  6585 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:49.202608  6031 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:49.204903  6584 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:49.206099  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:49.206825  5882 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:49.208630  5777 catalog_manager.cc:5696] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 2, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 2 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:49.211377  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:49.211983  5957 raft_consensus.cc:3055] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:49.212272  5957 raft_consensus.cc:740] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:49.212998  5957 consensus_queue.cc:260] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:49.214902  5957 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:49.215266  7071 raft_consensus.cc:2955] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:49.218741  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:49.218750  5879 raft_consensus.cc:2955] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:49.219898  5952 raft_consensus.cc:3055] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:49.220255  5952 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:49.221748  5882 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:49.223242  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:49.228571  6030 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:49.235095  6030 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:49.222378  5952 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:49.236129  5952 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:49.241497  5776 catalog_manager.cc:5696] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:49.246120  5952 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:49.246658  6552 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:55:49.248181  7066 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:49.248631  6552 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:55:49.249462  7072 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:49.251204  7072 raft_consensus.cc:697] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:55:49.251438  6585 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:49.252153  7072 consensus_queue.cc:237] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:49.255996  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:49.257191  5879 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:49.254254  5957 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:49.262184  7040 raft_consensus.cc:993] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685: : Instructing follower 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:49.267328  7054 raft_consensus.cc:1081] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:49.268213  6030 raft_consensus.cc:2955] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:49.272739  5952 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:49.276540  6027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:43488
I20260620 13:55:49.248677  7066 raft_consensus.cc:697] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:55:49.297379  6027 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:49.297775  6027 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:49.297827  7066 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:49.283051  6031 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:49.286774  5879 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:49.295697  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:49.303596  5957 raft_consensus.cc:3055] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:49.303676  5998 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:49.304688  7058 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:49.303954  5957 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:49.305249  6027 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:49.306098  5957 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:49.307174  5957 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:49.310316  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:49.310948  5882 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:49.312148  6027 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:49.317708  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:49.318397  5953 raft_consensus.cc:3055] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:49.318758  5953 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:49.319656  5953 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:49.321050  5953 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:49.318768  5957 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:49.329110  5882 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:49.329453  7058 raft_consensus.cc:697] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:49.330451  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:49.330713  7058 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:49.333947  7079 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:49.333966  5953 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:49.334717  7079 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:49.338578  7079 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:49.342016  6030 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:49.344501  5882 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:49.351359  7069 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:49.350262  5778 catalog_manager.cc:5696] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 2 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:55:49.361701  5924 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba377ed0ce364307bbe22e24ddafa62e. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:49.363224  7040 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260620 13:55:49.511266  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 163876us
I20260620 13:55:49.550884  5778 catalog_manager.cc:5696] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 2 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:55:49.574958  7085 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260620 13:55:49.597225  5882 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:49.596652  5780 catalog_manager.cc:5696] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:49.639647  7086 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260620 13:55:49.638396  7070 raft_consensus.cc:2955] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:49.647430  5957 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:49.659093  7058 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260620 13:55:49.683605  7081 log.cc:927] Time spent T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260620 13:55:49.710119  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 63940.7us
I20260620 13:55:49.764668  5879 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:49.768869  7072 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260620 13:55:49.800879  5879 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:49.835501  6031 raft_consensus.cc:2955] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:49.808669  7066 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260620 13:55:49.908330  6031 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:49.911859  6031 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:49.911942  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:49.921561  5778 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
W20260620 13:55:49.936674  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 211195us
I20260620 13:55:49.937170  7114 ts_tablet_manager.cc:933] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:49.920564  7066 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260620 13:55:50.007311  7072 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260620 13:55:50.061861  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 104353us
W20260620 13:55:50.081378  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 58446.8us
I20260620 13:55:50.100091  5881 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:50.104079  5952 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:50.106336  5953 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260620 13:55:50.167215  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 46726.6us
I20260620 13:55:50.098095  5957 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:50.174026  5957 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:50.176327  7066 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:55:50.178243  7098 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:50.180241  7098 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:50.191835  5881 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:50.191511  7066 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260620 13:55:50.225383  5776 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:50.253925  5876 raft_consensus.cc:2955] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:50.281348  7070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42074 (request call id 11) took 1006 ms. Trace:
I20260620 13:55:50.304924  7114 tablet_copy_client.cc:323] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:55:50.287384  7070 rpcz_store.cc:276] 0620 13:55:49.268558 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:55:49.270163 (+  1605us) service_pool.cc:224] Handling call
0620 13:55:49.311458 (+ 41295us) log.cc:844] Serialized 506 byte log entry
0620 13:55:50.273686 (+962228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":289,"raft.run_cpu_time_us":1511,"raft.run_wall_time_us":1582,"thread_start_us":8821,"threads_started":1,"wal-append.queue_time_us":8925}
I20260620 13:55:50.311651  5959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:50.312409  5959 raft_consensus.cc:606] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:50.314932  7115 ts_tablet_manager.cc:933] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:50.315683  5969 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet 59b6ab17fde545f5b655c12383d08351 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:55:50.332152  5969 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet 59b6ab17fde545f5b655c12383d08351 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-59b6ab17fde545f5b655c12383d08351
W20260620 13:55:50.393405  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 154781us
I20260620 13:55:50.375814  7082 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.165s
W20260620 13:55:50.512712  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 246646us
W20260620 13:55:50.526122  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 234480us
I20260620 13:55:50.531364  7115 tablet_copy_client.cc:323] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:55:50.535647  5968 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet ba377ed0ce364307bbe22e24ddafa62e from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:55:50.536258  5968 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet ba377ed0ce364307bbe22e24ddafa62e from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-ba377ed0ce364307bbe22e24ddafa62e
I20260620 13:55:50.544960  5879 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
W20260620 13:55:50.571048  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 240314us
W20260620 13:55:50.598040  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 52001.6us
I20260620 13:55:50.565940  5968 tablet_copy_source_session.cc:215] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:50.629352  5969 tablet_copy_source_session.cc:215] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:50.636407  7115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba377ed0ce364307bbe22e24ddafa62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:50.648211  7114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b6ab17fde545f5b655c12383d08351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:50.616314  7079 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:50.738945  7100 raft_consensus.cc:993] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685: : Instructing follower 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:50.739547  7100 raft_consensus.cc:1081] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:50.798272  7115 tablet_copy_client.cc:806] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:50.799026  7115 tablet_copy_client.cc:670] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:50.813014  5957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:50.814100  5957 raft_consensus.cc:606] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:50.827857  6031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:43488
I20260620 13:55:50.828502  6031 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:50.828915  6031 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:55:50.828579  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 100271us
I20260620 13:55:50.838285  7115 tablet_copy_client.cc:538] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:50.841225  6031 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:50.844421  6031 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:50.846900  7115 tablet_bootstrap.cc:492] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
W20260620 13:55:50.859966  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 151391us
I20260620 13:55:50.849107  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:50.868041  5959 raft_consensus.cc:3055] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:50.868528  5959 raft_consensus.cc:740] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:50.879626  5959 consensus_queue.cc:260] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:50.882323  5959 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:50.906410  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:50.911077  5884 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:50.910957  5959 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:50.975515  7071 raft_consensus.cc:993] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: : Instructing follower 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:50.976048  7071 raft_consensus.cc:1081] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:50.986104  6033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:43488
I20260620 13:55:50.987392  6033 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:50.987965  6033 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:50.991617  5959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:50.992275  5959 raft_consensus.cc:606] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:50.994750  5884 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
W20260620 13:55:51.014457  5849 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8078a89b618482f8e4978c463747569. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:55:51.015033  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 138528us
I20260620 13:55:51.023260  5997 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:51.033456  7114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46864 (request call id 272) took 1104 ms. Trace:
I20260620 13:55:51.033926  7114 rpcz_store.cc:276] 0620 13:55:49.929167 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:55:49.929807 (+   640us) service_pool.cc:224] Handling call
0620 13:55:49.937472 (+  7665us) ts_tablet_manager.cc:934] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
0620 13:55:50.646839 (+709367us) tablet_copy_client.cc:368] Tablet copy session begun
0620 13:55:50.792892 (+146053us) tablet_metadata.cc:665] Metadata flushed
0620 13:55:50.793012 (+   120us) tablet_copy_client.cc:497] Wrote new tablet metadata
0620 13:55:51.032735 (+239723us) tablet_copy_client.cc:418] Wrote new consensus metadata
0620 13:55:51.033025 (+   290us) tablet_replica.cc:206] Creating consensus instance
0620 13:55:51.033297 (+   272us) ts_tablet_manager.cc:989] Replica registered.
0620 13:55:51.033369 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":29671,"tablet-copy.queue_time_us":6643,"thread_start_us":250284,"threads_started":2}
I20260620 13:55:51.035807  7114 tablet_copy_client.cc:806] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:51.036389  7114 tablet_copy_client.cc:670] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:51.045742  5879 raft_consensus.cc:1240] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
I20260620 13:55:51.078028  6033 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:51.089080  6033 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:51.066630  7094 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:51.101831  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:51.145995  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:51.147202  5883 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:51.148391  5959 raft_consensus.cc:3055] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:51.148713  5959 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:51.149451  5959 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:51.151765  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51401us
W20260620 13:55:51.153332  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51856.1us
W20260620 13:55:51.162998  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 63067.9us
I20260620 13:55:51.163522  5959 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:51.146087  7111 raft_consensus.cc:993] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685: : Instructing follower 663684cf4ae54c929bf8240ca0b63a47 to start an election
W20260620 13:55:51.169842  7141 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260620 13:55:51.174649  5959 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:51.152173  7094 raft_consensus.cc:697] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:51.179198  5876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 1627) took 1036 ms. Trace:
I20260620 13:55:51.171237  6026 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:51.193297  7091 raft_consensus.cc:1081] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:51.203557  5883 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:51.196182  7094 consensus_queue.cc:237] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:51.203171  7111 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:55:51.179661  5876 rpcz_store.cc:276] 0620 13:55:50.139465 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:55:50.139677 (+   212us) service_pool.cc:224] Handling call
0620 13:55:50.140043 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:55:50.170015 (+ 29972us) raft_consensus.cc:1534] Early marking committed up to index 2
0620 13:55:50.642279 (+472264us) log.cc:844] Serialized 14 byte log entry
0620 13:55:51.125646 (+483367us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:55:51.151663 (+ 26017us) raft_consensus.cc:1645] Marking committed up to 2
0620 13:55:51.157362 (+  5699us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:55:51.162895 (+  5533us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:55:51.172855 (+  9960us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42132,"raft.queue_time_us":60726,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":1356,"spinlock_wait_cycles":87712512,"thread_start_us":406622,"threads_started":2,"wal-append.queue_time_us":251157}
I20260620 13:55:51.228634  7111 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:51.231523  5998 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:51.232563  7124 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:51.233047  7124 raft_consensus.cc:697] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:51.233959  7124 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:51.230958  7111 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:51.300779  5959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:51.301436  5959 raft_consensus.cc:606] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:51.304616  6026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:43488
I20260620 13:55:51.305240  6026 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:51.305605  6026 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:51.323210  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:51.327775  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:55:51.345607  6026 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:51.356041  7114 tablet_copy_client.cc:538] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:51.357771  6026 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:51.361845  5959 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:51.375910  5877 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:55:51.376565  5877 raft_consensus.cc:606] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:51.383244  7096 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260620 13:55:51.391441  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 46320.8us
I20260620 13:55:51.400560  7107 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:51.395157  7114 tablet_bootstrap.cc:492] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:51.412693  5924 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:51.414552  7119 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:55:51.432021  6033 raft_consensus.cc:1240] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
I20260620 13:55:51.439970  5952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:51.440776  5952 raft_consensus.cc:606] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:51.449247  7111 consensus_queue.cc:1059] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:51.450819  7069 raft_consensus.cc:3055] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:51.451206  7157 raft_consensus.cc:993] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685: : Instructing follower 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:51.451221  7069 raft_consensus.cc:740] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:51.452337  7069 consensus_queue.cc:260] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:51.452745  7157 raft_consensus.cc:1081] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:51.472690  7069 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:51.481921  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260620 13:55:51.484107  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:51.483726  5776 catalog_manager.cc:5696] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:51.485034  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:51.484614  7117 raft_consensus.cc:2955] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:51.503535  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:51.508430  5884 consensus_queue.cc:237] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:51.515594  6025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:43488
I20260620 13:55:51.516260  6025 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:51.516603  6025 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:51.520112  7163 ts_tablet_manager.cc:933] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:55:51.541548  7115 tablet_bootstrap.cc:492] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:51.543148  5959 raft_consensus.cc:2955] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:51.553174  5780 catalog_manager.cc:5696] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:51.554679  7115 tablet_bootstrap.cc:492] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:51.559070  7115 ts_tablet_manager.cc:1403] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.712s	user 0.099s	sys 0.094s
I20260620 13:55:51.570927  5776 catalog_manager.cc:5696] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:51.586884  5952 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:51.594266  5997 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:51.599049  7098 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:51.599606  7098 raft_consensus.cc:697] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:51.600455  7098 consensus_queue.cc:237] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:51.562711  7115 raft_consensus.cc:359] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:51.568486  6025 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:51.605808  7115 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:51.607244  7115 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:51.609284  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:51.616528  7163 tablet_copy_client.cc:323] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.193:46177
I20260620 13:55:51.618999  5881 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:51.624274  5959 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:51.631332  7117 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:51.633401  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:51.634003  6025 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:51.634493  5959 raft_consensus.cc:3055] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:51.634912  5959 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:51.636068  5959 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:51.637149  5959 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:51.650434  5894 tablet_copy_service.cc:140] P 2e82c0c231624695ac5a813230bf5038: Received BeginTabletCopySession request for tablet e8078a89b618482f8e4978c463747569 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42748)
I20260620 13:55:51.652694  5894 tablet_copy_service.cc:161] P 2e82c0c231624695ac5a813230bf5038: Beginning new tablet copy session on tablet e8078a89b618482f8e4978c463747569 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42748: session id = b0ce39342d8c4a64904b30b98de02b9f-e8078a89b618482f8e4978c463747569
I20260620 13:55:51.663475  7115 ts_tablet_manager.cc:1434] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.104s	user 0.005s	sys 0.008s
I20260620 13:55:51.664332  5877 raft_consensus.cc:1275] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:51.666203  5959 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:51.667409  5997 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:51.668201  7098 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:51.668694  7098 raft_consensus.cc:697] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:51.669543  7098 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:51.670181  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:51.673437  5877 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:51.701283  5881 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:51.705370  5894 tablet_copy_source_session.cc:215] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Tablet Copy: opened 0 blocks and 1 log segments
W20260620 13:55:51.707305  5849 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c812d18f2bb4da29c562646eb81deb1. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:51.708438  7096 raft_consensus.cc:993] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: : Instructing follower b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:51.709511  7163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8078a89b618482f8e4978c463747569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:51.723070  7152 raft_consensus.cc:1081] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Signalling peer b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:51.761721  6585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:46852
I20260620 13:55:51.762490  6585 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:51.763319  6585 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:51.760339  6033 raft_consensus.cc:2955] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:51.742084  5969 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-ba377ed0ce364307bbe22e24ddafa62e received from {username='slave'} at 127.0.0.1:42078
I20260620 13:55:51.743537  6025 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260620 13:55:51.780604  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 85324.6us
I20260620 13:55:51.791399  6585 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:51.779991  5969 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-ba377ed0ce364307bbe22e24ddafa62e on tablet ba377ed0ce364307bbe22e24ddafa62e with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:51.800519  6585 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:51.808255  7096 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:51.799669  7079 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
W20260620 13:55:51.829558  7169 log.cc:927] Time spent T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260620 13:55:51.854215  7117 raft_consensus.cc:2955] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:51.857823  7114 tablet_bootstrap.cc:492] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:51.858271  7163 tablet_copy_client.cc:806] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:51.858855  7163 tablet_copy_client.cc:670] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:51.858798  7114 tablet_bootstrap.cc:492] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:51.883550  5877 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:51.895277  5952 raft_consensus.cc:1275] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:51.897892  7114 ts_tablet_manager.cc:1403] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.503s	user 0.031s	sys 0.013s
I20260620 13:55:51.906652  5959 raft_consensus.cc:2955] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
W20260620 13:55:51.912724  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 64399.7us
I20260620 13:55:51.915637  5883 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:51.900707  7130 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260620 13:55:51.930872  7179 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260620 13:55:51.930655  6032 raft_consensus.cc:2955] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:51.961354  7114 raft_consensus.cc:359] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:51.962538  7114 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:51.963433  7114 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:51.972772  7069 raft_consensus.cc:993] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: : Instructing follower b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:52.017186  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:52.018164  6032 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:52.017474  7097 raft_consensus.cc:1081] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:52.023070  5959 raft_consensus.cc:1275] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:52.024288  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:52.024953  5884 raft_consensus.cc:3055] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:52.025274  5884 raft_consensus.cc:740] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:52.026070  5884 consensus_queue.cc:260] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:52.028545  6585 raft_consensus.cc:1217] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:52.028971  5884 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:52.030100  7180 consensus_queue.cc:1048] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260620 13:55:52.043164  6582 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
I20260620 13:55:52.049355  6584 raft_consensus.cc:1217] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:52.050377  5884 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:52.057430  7115 ts_tablet_manager.cc:933] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:55:52.060288  7114 ts_tablet_manager.cc:1434] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.146s	user 0.007s	sys 0.000s
W20260620 13:55:52.096637  7184 log.cc:927] Time spent T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260620 13:55:52.100860  5969 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-59b6ab17fde545f5b655c12383d08351 received from {username='slave'} at 127.0.0.1:42078
I20260620 13:55:52.101342  5969 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-59b6ab17fde545f5b655c12383d08351 on tablet 59b6ab17fde545f5b655c12383d08351 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:52.101620  5952 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:52.105299  6032 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
W20260620 13:55:52.112107  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 73002.9us
I20260620 13:55:52.114843  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:55:52.130355  7163 tablet_copy_client.cc:538] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:52.137811  7146 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:52.143517  7115 tablet_copy_client.cc:323] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.193:46177
I20260620 13:55:52.139436  7146 raft_consensus.cc:697] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:55:52.119222  7098 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260620 13:55:52.131522  6582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:46864
I20260620 13:55:52.162518  5778 catalog_manager.cc:5696] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:52.187150  5957 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:52.190418  7098 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:52.191396  5876 raft_consensus.cc:1275] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:52.185493  7163 tablet_bootstrap.cc:492] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:52.181326  6582 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:52.193164  6582 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:52.145159  7146 consensus_queue.cc:237] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:52.206984  5876 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:52.198249  7098 consensus_queue.cc:1048] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260620 13:55:52.209882  7079 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260620 13:55:52.279203  5780 catalog_manager.cc:5696] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:52.287081  5780 catalog_manager.cc:5696] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:52.317667  6582 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:52.320595  6582 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:52.365319  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:52.366488  5956 raft_consensus.cc:3055] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:52.366813  5956 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:55:52.367715  7187 log.cc:927] Time spent T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.283s	user 0.005s	sys 0.000s
W20260620 13:55:52.415117  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 294561us
I20260620 13:55:52.367657  5956 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:52.423277  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:52.426496  6032 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:52.426640  5956 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:52.424553  5894 tablet_copy_service.cc:140] P 2e82c0c231624695ac5a813230bf5038: Received BeginTabletCopySession request for tablet 6c812d18f2bb4da29c562646eb81deb1 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42748)
I20260620 13:55:52.428110  5894 tablet_copy_service.cc:161] P 2e82c0c231624695ac5a813230bf5038: Beginning new tablet copy session on tablet 6c812d18f2bb4da29c562646eb81deb1 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42748: session id = b0ce39342d8c4a64904b30b98de02b9f-6c812d18f2bb4da29c562646eb81deb1
I20260620 13:55:52.453044  6032 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:52.457949  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:55:52.464028  5778 catalog_manager.cc:5696] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 2, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 2 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:52.481808  6583 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
I20260620 13:55:52.487167  5894 tablet_copy_source_session.cc:215] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:52.461022  5956 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:52.500932  7197 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:52.501497  7197 raft_consensus.cc:697] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:55:52.502410  7197 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:52.504675  7119 raft_consensus.cc:1064] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:52.519070  7115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c812d18f2bb4da29c562646eb81deb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:52.520679  7119 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:55:52.524631  7199 log.cc:927] Time spent T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260620 13:55:52.535646  7069 raft_consensus.cc:1064] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:52.542670  7069 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:52.546277  7115 tablet_copy_client.cc:806] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:52.554162  7115 tablet_copy_client.cc:670] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:52.608594  7115 tablet_copy_client.cc:538] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:52.628896  5776 catalog_manager.cc:5696] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 2 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:52.639664  6032 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:52.653012  7069 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260620 13:55:52.672943  6581 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:52.694422  6032 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:52.696621  7115 tablet_bootstrap.cc:492] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:52.661810  7163 tablet_bootstrap.cc:492] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:52.700316  7097 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:52.697523  7186 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:52.704113  5880 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:52.703863  5881 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:52.705546  7163 tablet_bootstrap.cc:492] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:52.710668  7206 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:52.713073  7201 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:52.712291  7163 ts_tablet_manager.cc:1403] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.525s	user 0.027s	sys 0.020s
I20260620 13:55:52.723348  6584 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:52.727934  6026 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:52.731841  7201 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:52.745537  7119 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:52.796905  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:52.786286  7163 raft_consensus.cc:359] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:52.837874  5880 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:52.831719  7163 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:52.860189  7163 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:52.862697  7163 ts_tablet_manager.cc:1434] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.146s	user 0.004s	sys 0.003s
I20260620 13:55:52.842834  7197 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260620 13:55:52.920547  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 70620.7us
I20260620 13:55:52.976965  7214 raft_consensus.cc:2955] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:53.011618  7119 raft_consensus.cc:2955] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:55:53.022972  7210 log.cc:927] Time spent T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260620 13:55:53.037283  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 86011.8us
I20260620 13:55:53.052042  5880 raft_consensus.cc:2955] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:55:53.063136  7211 log.cc:927] Time spent T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260620 13:55:53.087248  5894 tablet_copy_service.cc:342] P 2e82c0c231624695ac5a813230bf5038: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-e8078a89b618482f8e4978c463747569 received from {username='slave'} at 127.0.0.1:42748
I20260620 13:55:53.087728  5894 tablet_copy_service.cc:434] P 2e82c0c231624695ac5a813230bf5038: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-e8078a89b618482f8e4978c463747569 on tablet e8078a89b618482f8e4978c463747569 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:53.186915  6026 raft_consensus.cc:2955] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:55:53.189556  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 90199us
W20260620 13:55:53.191417  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 154482us
I20260620 13:55:53.209067  5880 raft_consensus.cc:2955] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:53.224705  5959 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:53.229586  5959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:53.230099  5959 raft_consensus.cc:606] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:53.235340  7146 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:55:53.240283  6033 raft_consensus.cc:2955] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:53.245743  5959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:53.195451  6581 raft_consensus.cc:2955] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:53.302696  6031 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260620 13:55:53.372453  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 180368us
I20260620 13:55:53.403571  7175 raft_consensus.cc:993] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: : Instructing follower 663684cf4ae54c929bf8240ca0b63a47 to start an election
W20260620 13:55:53.401557  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 190935us
I20260620 13:55:53.408227  6584 raft_consensus.cc:2955] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:53.404129  7175 raft_consensus.cc:1081] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:53.425235  6031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:43488
I20260620 13:55:53.425828  6031 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:53.426189  6031 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:53.436033  6586 raft_consensus.cc:1217] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:53.458182  7197 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:53.461910  5780 catalog_manager.cc:5696] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:53.463608  7115 tablet_bootstrap.cc:492] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:53.468714  5959 raft_consensus.cc:606] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:53.486878  6031 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:55:53.508908  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 103718us
I20260620 13:55:53.518077  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:53.519232  5880 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:53.530501  6031 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:53.538617  7103 raft_consensus.cc:1064] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:53.538924  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:53.539503  5957 raft_consensus.cc:3055] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:53.539814  5957 raft_consensus.cc:740] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:53.540341  5880 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:53.540493  5957 consensus_queue.cc:260] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:53.541600  5957 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:53.541283  7103 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:53.550508  5998 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:53.559597  5957 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
W20260620 13:55:53.568635  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 119980us
I20260620 13:55:53.581521  7115 tablet_bootstrap.cc:492] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:53.589010  7115 ts_tablet_manager.cc:1403] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.893s	user 0.044s	sys 0.046s
I20260620 13:55:53.587085  7079 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:53.607523  7079 raft_consensus.cc:697] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:53.639581  7079 consensus_queue.cc:237] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:53.693871  7115 raft_consensus.cc:359] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:53.729135  7115 raft_consensus.cc:740] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:53.752530  5880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:55:53.753183  5880 raft_consensus.cc:606] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:55:53.836982  6581 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:53.795203  7115 consensus_queue.cc:260] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:53.860189  5776 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:53.906132  7240 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:53.936692  7115 ts_tablet_manager.cc:1434] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.347s	user 0.005s	sys 0.005s
I20260620 13:55:53.969866  5894 tablet_copy_service.cc:342] P 2e82c0c231624695ac5a813230bf5038: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-6c812d18f2bb4da29c562646eb81deb1 received from {username='slave'} at 127.0.0.1:42748
I20260620 13:55:53.970549  5894 tablet_copy_service.cc:434] P 2e82c0c231624695ac5a813230bf5038: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-6c812d18f2bb4da29c562646eb81deb1 on tablet 6c812d18f2bb4da29c562646eb81deb1 with peer b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:55:54.007411  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 110896us
W20260620 13:55:54.011464  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 119746us
I20260620 13:55:54.042831  5954 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:54.054975  7219 raft_consensus.cc:993] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: : Instructing follower b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:54.056599  7219 raft_consensus.cc:1081] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer b0ce39342d8c4a64904b30b98de02b9f to start an election
W20260620 13:55:54.063310  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 45934.8us
I20260620 13:55:54.078847  5780 catalog_manager.cc:5696] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:54.086628  6581 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:54.090883  5876 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:54.092284  6581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:46864
I20260620 13:55:54.092929  6581 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:54.093359  6581 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:54.102586  6580 raft_consensus.cc:1217] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:54.116108  6026 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:54.124495  5954 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:54.124423  6581 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:54.146575  6581 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:54.150238  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:54.151141  5954 raft_consensus.cc:3055] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:54.151525  5954 raft_consensus.cc:740] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:54.152863  5954 consensus_queue.cc:260] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:54.153859  5954 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:54.155915  6026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:55:54.156589  6026 raft_consensus.cc:606] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:55:54.160394  5884 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:54.166744  7094 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:54.170732  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:54.171358  5958 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:54.171868  5876 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:54.182135  6580 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:54.183867  7218 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:54.185040  6030 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260620 13:55:54.186038  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:55:54.190186  6985 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:54.198762  5952 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:54.189800  5958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:54.199638  5958 raft_consensus.cc:606] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:54.200593  7225 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:54.201457  5954 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:54.203001  6551 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:55:54.203269  5876 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:54.204155  7234 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:54.204223  7214 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:54.204738  7234 raft_consensus.cc:697] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:55:54.205667  7234 consensus_queue.cc:237] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:54.221355  7258 raft_consensus.cc:993] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038: : Instructing follower 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:55:54.223543  7255 raft_consensus.cc:1081] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Signalling peer 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:55:54.228328  7219 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:54.234457  7219 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:54.240643  7257 raft_consensus.cc:2955] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:54.245056  6030 raft_consensus.cc:2955] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:54.283039  5780 catalog_manager.cc:5696] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:54.292326  5776 catalog_manager.cc:5696] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 2 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:54.323371  5958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:36000
I20260620 13:55:54.324024  5958 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:54.324378  5958 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:54.349123  5958 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:54.357890  5958 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:54.367614  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:54.368235  5884 raft_consensus.cc:3055] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:54.368551  5884 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:54.368844  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:54.369369  6030 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:54.369227  5884 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:54.370323  5884 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:54.375892  7222 raft_consensus.cc:2955] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:54.382421  5958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:54.385275  5958 raft_consensus.cc:606] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:54.360406  7214 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260620 13:55:54.394409  6030 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:55:54.377516  6580 raft_consensus.cc:2955] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:54.445564  5884 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
W20260620 13:55:54.451895  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 79221.9us
I20260620 13:55:54.460779  5876 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:54.475641  7214 raft_consensus.cc:993] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: : Instructing follower 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:55:54.476109  7214 raft_consensus.cc:1081] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:55:54.480741  5778 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:54.482132  6030 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:54.482271  6582 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:54.483211  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260620 13:55:54.483307  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet ba377ed0ce364307bbe22e24ddafa62e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:54.484876  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:54.485620  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:54.488322  7240 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:54.489933  7240 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:54.494696  7215 raft_consensus.cc:993] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47: : Instructing follower 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:55:54.495398  7215 raft_consensus.cc:1081] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Signalling peer 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:55:54.499599  5876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:58452
I20260620 13:55:54.500183  5959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:35986
I20260620 13:55:54.502203  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:54.501313  5959 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:54.504758  5959 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:54.505877  6016 tablet_service.cc:1558] Processing DeleteTablet for tablet ba377ed0ce364307bbe22e24ddafa62e with delete_type TABLET_DATA_TOMBSTONED (TS 663684cf4ae54c929bf8240ca0b63a47 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43482
I20260620 13:55:54.500226  5876 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:54.508351  5876 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:54.503882  6580 raft_consensus.cc:2955] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:54.511495  7240 raft_consensus.cc:2955] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:54.504222  7214 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:54.516606  7214 raft_consensus.cc:697] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:54.517637  7214 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:54.521939  7219 raft_consensus.cc:2955] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:54.531519  7071 raft_consensus.cc:993] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: : Instructing follower b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:54.525336  6581 raft_consensus.cc:2955] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:54.547739  7071 raft_consensus.cc:1081] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:54.557482  6582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:46864
I20260620 13:55:54.565483  6582 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:54.529932  6584 raft_consensus.cc:2955] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:54.536123  6026 raft_consensus.cc:2955] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:54.567917  6582 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:54.604229  6028 raft_consensus.cc:2955] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:54.614699  5959 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:54.625732  5884 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:54.635991  5959 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:54.637156  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:54.637897  6028 raft_consensus.cc:3055] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:55:54.654413  6028 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:54.643266  5876 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:54.637929  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:54.661206  5884 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:54.643411  5778 catalog_manager.cc:5696] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:54.649626  7234 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:54.651803  6582 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:54.659759  5780 catalog_manager.cc:5696] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:54.655198  6028 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:54.675012  6028 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:54.688582  7268 tablet_replica.cc:333] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:55:54.690164  5876 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:55:54.690598  5881 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
I20260620 13:55:54.692324  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet e8078a89b618482f8e4978c463747569 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:54.645677  5776 catalog_manager.cc:5696] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 1 to 2, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 2 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:54.694340  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 59b6ab17fde545f5b655c12383d08351 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:54.696024  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:55:54.708137  6584 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:54.708062  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:54.709023  5959 raft_consensus.cc:3055] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:54.709299  5959 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:54.710131  5959 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:54.711490  5959 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:54.714480  5884 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:55:54.718106  6028 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:55:54.721077  6584 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:55:54.721863  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:54.711508  7239 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:55:54.724879  7239 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:54.727226  7268 raft_consensus.cc:2243] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:54.746031  7218 raft_consensus.cc:1064] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:54.748600  7218 consensus_queue.cc:237] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:54.741421  7219 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:55:54.751539  7219 raft_consensus.cc:697] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:54.753643  5849 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:55:54.758186  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:54.758754  5952 raft_consensus.cc:3055] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:54.759094  5952 raft_consensus.cc:740] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:54.760306  5959 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:55:54.743196  7268 raft_consensus.cc:2272] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:54.765815  5952 consensus_queue.cc:260] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:54.766669  5952 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:54.752395  7219 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:54.788869  5952 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:54.790926  6551 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:55:54.798000  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:54.800830  6028 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:54.817128  6028 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:54.793159  7217 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:54.796677  6582 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:54.824222  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:55:54.803683  7146 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:54.844818  5954 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:54.839301  7217 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:54.883363  7217 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:54.884673  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:55:54.918152  5998 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:55:54.929911  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 112875us
I20260620 13:55:54.931439  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:55:54.932201  5959 raft_consensus.cc:1813] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Handling vote request from an unknown peer 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:54.932796  5959 raft_consensus.cc:2393] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 2: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:55:54.893884  7146 raft_consensus.cc:697] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:55:54.944161  5867 tablet_service.cc:1558] Processing DeleteTablet for tablet 59b6ab17fde545f5b655c12383d08351 with delete_type TABLET_DATA_TOMBSTONED (TS 2e82c0c231624695ac5a813230bf5038 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58442
I20260620 13:55:54.889892  7239 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:55:54.950536  5998 raft_consensus.cc:2686] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 13:55:54.946641  7234 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260620 13:55:54.987942  7146 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:55.040107  7286 tablet_replica.cc:333] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:55:55.046985  7268 ts_tablet_manager.cc:1916] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:55.065408  6580 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:55.070436  6033 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:55.074923  6985 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:55.080919  5877 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:55.084438  5949 tablet_service.cc:1558] Processing DeleteTablet for tablet e8078a89b618482f8e4978c463747569 with delete_type TABLET_DATA_TOMBSTONED (TS 192c750f597c43858e1ad09e8d805685 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35974
I20260620 13:55:55.087206  5952 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:55.098769  7105 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:55.143174  5778 catalog_manager.cc:5696] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 3, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:55.136477  5780 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index 4 to 3, term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193), VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) added, now has a pending config: VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193), VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194), VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 2 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:55.121217  7222 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260620 13:55:55.162160  7286 raft_consensus.cc:2243] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:55.196584  7292 tablet_replica.cc:333] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:55:55.198158  7292 raft_consensus.cc:2243] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:55.200312  7292 pending_rounds.cc:70] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685: Trying to abort 1 pending ops.
I20260620 13:55:55.200675  7292 pending_rounds.cc:77] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7298923534499037184 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "e8078a89b618482f8e4978c463747569" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } } }
I20260620 13:55:55.202514  7292 raft_consensus.cc:2917] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260620 13:55:55.155793  7277 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260620 13:55:55.207140  7292 raft_consensus.cc:2889] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260620 13:55:55.229874  7292 raft_consensus.cc:2272] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:55.282526  7286 raft_consensus.cc:2272] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:55.293706  7286 ts_tablet_manager.cc:1916] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:55.307267  7292 ts_tablet_manager.cc:1916] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:55.317900  5776 catalog_manager.cc:5696] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 2 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:55.321420  7268 ts_tablet_manager.cc:1929] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:55.321878  7268 log.cc:1199] T ba377ed0ce364307bbe22e24ddafa62e P 663684cf4ae54c929bf8240ca0b63a47: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/wals/ba377ed0ce364307bbe22e24ddafa62e
I20260620 13:55:55.342254  5767 catalog_manager.cc:5027] TS 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): tablet ba377ed0ce364307bbe22e24ddafa62e (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:55.345033  6030 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:55.395866  7222 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:55.423136  6580 raft_consensus.cc:2955] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:55.409691  7217 raft_consensus.cc:2955] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:55.432660  6025 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:55.436395  7279 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:55.446521  5959 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:55.449558  6582 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:55.474009  5956 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:55.477192  7153 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:55:55.480082  7279 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:55:55.508147  7292 ts_tablet_manager.cc:1929] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:55.507074  5776 catalog_manager.cc:5696] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:55.513826  6026 raft_consensus.cc:2955] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:55.532290  6033 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:55:55.511297  7292 log.cc:1199] T e8078a89b618482f8e4978c463747569 P 192c750f597c43858e1ad09e8d805685: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/wals/e8078a89b618482f8e4978c463747569
I20260620 13:55:55.535964  7105 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260620 13:55:55.548784  5876 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:55:55.596544  5766 catalog_manager.cc:5027] TS 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): tablet e8078a89b618482f8e4978c463747569 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:55.588384  5877 consensus_queue.cc:237] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:55.597232  7071 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260620 13:55:55.607396  7298 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:55.598273  5776 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted, no longer has a pending config: VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193), VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194), VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 2 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:55.622684  6016 tablet_service.cc:1558] Processing DeleteTablet for tablet ba377ed0ce364307bbe22e24ddafa62e with delete_type TABLET_DATA_TOMBSTONED (TS 663684cf4ae54c929bf8240ca0b63a47 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43482
I20260620 13:55:55.625124  5767 catalog_manager.cc:5027] TS 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): tablet ba377ed0ce364307bbe22e24ddafa62e (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:55.627135  7153 raft_consensus.cc:2955] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:55.663739  5956 raft_consensus.cc:2955] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:55.675719  7286 ts_tablet_manager.cc:1929] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:55.706571  7286 log.cc:1199] T 59b6ab17fde545f5b655c12383d08351 P 2e82c0c231624695ac5a813230bf5038: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/wals/59b6ab17fde545f5b655c12383d08351
W20260620 13:55:55.798173  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 115432us
W20260620 13:55:55.849617  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 149566us
I20260620 13:55:55.867848  5767 catalog_manager.cc:5027] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): tablet 59b6ab17fde545f5b655c12383d08351 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
W20260620 13:55:55.891238  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 206954us
W20260620 13:55:55.893414  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 58608.9us
I20260620 13:55:55.894014  6033 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:55.913690  6581 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:55.920156  7117 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260620 13:55:55.993134  7105 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:56.034114  7314 raft_consensus.cc:2955] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:56.104537  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 6c812d18f2bb4da29c562646eb81deb1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:56.106591  6033 raft_consensus.cc:2955] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:56.128353  5780 catalog_manager.cc:5696] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:56.158046  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:56.182250  6582 raft_consensus.cc:2955] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:56.367858  5949 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c812d18f2bb4da29c562646eb81deb1 with delete_type TABLET_DATA_TOMBSTONED (TS 192c750f597c43858e1ad09e8d805685 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35974
I20260620 13:55:56.372478  7320 tablet_replica.cc:333] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:55:56.403004  5956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:56.404266  5956 raft_consensus.cc:606] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:56.413533  5956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4cd17345f80464287c5952767849dbb"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:56.414237  5956 raft_consensus.cc:606] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:56.419555  5881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:55:56.420279  5881 raft_consensus.cc:606] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:56.420323  7320 raft_consensus.cc:2243] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:56.422879  7298 raft_consensus.cc:993] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: : Instructing follower 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:56.423758  7298 raft_consensus.cc:1081] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:56.424692  5881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:55:56.425283  5881 raft_consensus.cc:606] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:55:56.425309  6033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4cd17345f80464287c5952767849dbb"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:43488
I20260620 13:55:56.425990  6033 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:56.426433  6033 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.426355  7320 raft_consensus.cc:2272] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:56.428623  5881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec20d216461d4414813627ca62e330e4"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:55:56.429133  5881 raft_consensus.cc:606] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:55:56.432983  6025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:55:56.433662  6025 raft_consensus.cc:606] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:56.435603  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260620 13:55:56.437561  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:56.439283  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:56.446496  6033 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:56.452276  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:56.453150  5877 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.453619  7320 ts_tablet_manager.cc:1916] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:56.470494  6033 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:56.471858  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:56.472186  5877 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:56.472476  5956 raft_consensus.cc:3055] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:56.472875  5956 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:56.473806  5998 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:56.475327  7280 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:56.475876  7280 raft_consensus.cc:697] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:56.476890  7280 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:56.473747  5956 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:56.484673  5956 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.490128  7257 raft_consensus.cc:993] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038: : Instructing follower 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:55:56.491568  7257 raft_consensus.cc:1081] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Signalling peer 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:55:56.494944  5958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:36000
I20260620 13:55:56.495517  5958 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:56.495826  5958 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.507539  5958 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:56.511549  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:56.512282  5877 raft_consensus.cc:3055] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:56.512686  5877 raft_consensus.cc:740] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:56.517216  5877 consensus_queue.cc:260] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:56.517352  5776 catalog_manager.cc:5696] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:56.522457  5877 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.529287  7320 ts_tablet_manager.cc:1929] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:56.534494  7320 log.cc:1199] T 6c812d18f2bb4da29c562646eb81deb1 P 192c750f597c43858e1ad09e8d805685: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/wals/6c812d18f2bb4da29c562646eb81deb1
I20260620 13:55:56.539031  5958 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:56.540630  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:56.541410  6025 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.545203  5877 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:55:56.538654  5766 catalog_manager.cc:5027] TS 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): tablet 6c812d18f2bb4da29c562646eb81deb1 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:56.549436  7314 raft_consensus.cc:993] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: : Instructing follower b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:56.549949  7314 raft_consensus.cc:1081] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Signalling peer b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:56.551723  6582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:46852
I20260620 13:55:56.552300  6582 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:56.552667  6582 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.555606  6025 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:55:56.518131  5956 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:56.557472  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:56.559566  7206 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:56.560057  7206 raft_consensus.cc:697] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:56.561169  7206 consensus_queue.cc:237] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:56.570088  6582 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:56.572602  6582 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:56.575201  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:56.575768  5881 raft_consensus.cc:3055] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:56.576056  5881 raft_consensus.cc:740] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:56.576793  5881 consensus_queue.cc:260] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:56.578114  5881 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.580981  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:56.581700  6025 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.585579  5881 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:56.586793  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:55:56.588029  7276 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:56.588670  7276 raft_consensus.cc:697] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:55:56.589574  6025 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:56.589850  7276 consensus_queue.cc:237] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:56.618947  5776 catalog_manager.cc:5696] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 2, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 2 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:56.633036  5778 catalog_manager.cc:5696] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 1 to 2, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 2 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:56.634842  7214 raft_consensus.cc:993] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: : Instructing follower b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:56.635519  7206 raft_consensus.cc:1081] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:56.641832  6582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:46864
I20260620 13:55:56.642464  6582 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:56.642856  6582 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.651688  6582 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:56.654691  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:56.654914  6582 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:56.655313  5881 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.658293  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:56.658871  5958 raft_consensus.cc:3055] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:56.659195  5958 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:56.659996  5958 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:56.661218  5958 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.666419  5881 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:56.667635  6552 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:55:56.668762  7323 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:56.669204  7323 raft_consensus.cc:697] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:55:56.671078  7278 raft_consensus.cc:993] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038: : Instructing follower 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:55:56.671634  7278 raft_consensus.cc:1081] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Signalling peer 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:55:56.670644  7323 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:56.680032  5956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec20d216461d4414813627ca62e330e4"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:36000
I20260620 13:55:56.686839  5956 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:56.687460  5956 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.696399  5958 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:56.702414  5956 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:56.704620  5956 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:56.707942  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:56.708638  5881 raft_consensus.cc:3055] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:56.708498  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:56.709343  6025 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.709056  5881 raft_consensus.cc:740] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:56.710500  5881 consensus_queue.cc:260] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:56.711773  5881 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.717787  6025 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:55:56.720362  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:56.719775  5881 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:55:56.712921  5778 catalog_manager.cc:5696] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 2 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:56.721101  7206 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:56.721612  7206 raft_consensus.cc:697] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:56.722537  7206 consensus_queue.cc:237] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:56.745046  5778 catalog_manager.cc:5696] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 1 to 2, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 2 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:56.865274  7273 raft_consensus.cc:993] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47: : Instructing follower 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:55:56.865798  7273 raft_consensus.cc:1081] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Signalling peer 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:55:56.869854  5958 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:56.871822  7280 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:56.877915  5881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:58456
I20260620 13:55:56.878705  5881 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:56.879290  5881 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.889053  5877 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:56.891566  7272 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:56.908977  5881 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:56.916175  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:56.917068  6030 raft_consensus.cc:3055] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:56.917369  6030 raft_consensus.cc:740] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:56.918216  6030 consensus_queue.cc:260] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:56.919553  6030 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.930338  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:55:56.931283  6582 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:56.936025  6030 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:55:56.915669  5881 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:55:56.950178  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:56.952113  7314 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:56.952841  7314 raft_consensus.cc:697] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:56.954326  7314 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:57.002648  6582 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:55:57.022996  6033 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:57.024626  7323 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:57.031404  5877 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:57.035974  7206 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:57.054870  5776 catalog_manager.cc:5696] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 1 to 2, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:57.075414  6033 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:57.082648  7206 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:57.089777  5881 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:57.091490  7146 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:55:57.141301  5881 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:57.147297  7206 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:57.162194  6030 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:57.167232  7214 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:57.200872  5881 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:57.202379  7323 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:57.223393  5958 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:57.225329  7146 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:57.463171  5958 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:57.473812  6030 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:57.474342  5877 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260620 13:55:57.474753  5924 consensus_peers.cc:597] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f67b5ea416143c1a0a6729eaaa909c2. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:57.476205  7206 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:57.477267  7214 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:57.498041  7298 raft_consensus.cc:2955] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:57.501545  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:57.500950  6025 raft_consensus.cc:2955] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:57.515911  5877 raft_consensus.cc:2955] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:57.532142  5956 consensus_queue.cc:237] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:57.563159  5776 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:57.593039  5878 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260620 13:55:57.594350  5924 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4fd646f84cb04514aa9889ea5f67db81. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:57.605856  5957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:57.606679  5957 raft_consensus.cc:606] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:57.608628  7298 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:57.613050  6029 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:55:57.619611  5957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:57.620389  5957 raft_consensus.cc:606] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:57.637779  6581 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:57.650753  6029 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:57.662813  7298 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:55:57.665196  6029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5757f55132b747db98400dba7b8056df"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:55:57.666138  6029 raft_consensus.cc:606] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:57.693686  7314 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:57.694654  7347 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:55:57.731765  7206 raft_consensus.cc:2955] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:57.771301  5776 catalog_manager.cc:5696] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:57.772743  5881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:55:57.776520  5881 raft_consensus.cc:606] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Received request to transfer leadership to TS 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:57.773201  7350 raft_consensus.cc:993] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: : Instructing follower b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:57.775383  6030 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:57.782663  5881 raft_consensus.cc:2955] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:57.817365  6031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:55:57.818002  6031 raft_consensus.cc:606] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:55:57.819506  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260620 13:55:57.821081  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:57.821818  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:57.828601  7350 raft_consensus.cc:1081] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:55:57.847302  6582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:46864
I20260620 13:55:57.848147  6582 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:57.848564  6582 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:57.858493  6025 raft_consensus.cc:2955] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
W20260620 13:55:57.874905  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a1bc98eaf2354afeb378f85e462f31ab. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:57.886345  6582 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:57.896346  5881 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260620 13:55:57.901247  5958 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260620 13:55:57.906510  6582 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:57.911867  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:57.912607  6025 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:57.932220  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:57.932891  5952 raft_consensus.cc:3055] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:57.933168  5952 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:57.933871  5952 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:57.935067  5952 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:57.935434  6025 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:57.937747  6552 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:55:57.938505  7117 raft_consensus.cc:993] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038: : Instructing follower 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:57.938856  7323 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:57.938980  7117 raft_consensus.cc:1081] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Signalling peer 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:57.939450  7323 raft_consensus.cc:697] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:55:57.940428  7323 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:57.943758  5952 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:55:57.947575  7273 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:57.960175  7362 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:57.960855  7364 ts_tablet_manager.cc:933] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:57.958365  6025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:43502
I20260620 13:55:57.963831  6025 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:57.971277  6025 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:57.990885  6025 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:57.995138  5956 raft_consensus.cc:2955] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:57.982951  7288 raft_consensus.cc:2955] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:58.011157  6025 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:55:58.009970  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:58.014653  5878 raft_consensus.cc:3055] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:58.015057  5878 raft_consensus.cc:740] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:58.017936  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:55:58.018566  6581 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:58.025110  7362 raft_consensus.cc:993] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: : Instructing follower 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:55:58.025617  7273 raft_consensus.cc:1081] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Signalling peer 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:55:58.023924  5878 consensus_queue.cc:260] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:58.033603  7364 tablet_copy_client.cc:323] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:55:58.036689  5878 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:58.038157  5956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:35986
I20260620 13:55:58.038687  5956 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:58.039039  5956 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:58.043915  5778 catalog_manager.cc:5696] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 2 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:58.047227  6581 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:58.049253  5969 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet 2f67b5ea416143c1a0a6729eaaa909c2 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:55:58.049957  5969 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet 2f67b5ea416143c1a0a6729eaaa909c2 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-2f67b5ea416143c1a0a6729eaaa909c2
I20260620 13:55:58.052202  5881 raft_consensus.cc:2955] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:58.053740  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:55:58.054451  7288 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:58.055089  7288 raft_consensus.cc:697] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:58.056362  7288 consensus_queue.cc:237] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:58.063331  5878 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:58.066004  6025 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:58.069602  5969 tablet_copy_source_session.cc:215] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:58.044584  5776 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:58.046029  7351 raft_consensus.cc:993] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: : Instructing follower 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:55:58.077965  7370 ts_tablet_manager.cc:933] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:58.078624  7351 raft_consensus.cc:1081] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:55:58.080868  5881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:58452
I20260620 13:55:58.081669  5881 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:58.082116  5881 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:58.084954  5956 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:58.086539  7370 tablet_copy_client.cc:323] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:55:58.080804  7364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f67b5ea416143c1a0a6729eaaa909c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:58.088511  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:58.089164  6029 raft_consensus.cc:3055] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:55:58.089478  6029 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:58.090644  5881 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:58.091535  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:55:58.092252  6581 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:58.092698  5881 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:58.096127  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:58.096374  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:58.096737  6030 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:58.096920  5958 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:58.097304  5958 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:58.098096  5958 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:58.099575  5958 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:58.090387  6029 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:58.103449  6029 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:58.103365  5969 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet 4fd646f84cb04514aa9889ea5f67db81 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:55:58.109642  5969 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet 4fd646f84cb04514aa9889ea5f67db81 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-4fd646f84cb04514aa9889ea5f67db81
I20260620 13:55:58.109539  5776 catalog_manager.cc:5696] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 2, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:58.112865  6029 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:55:58.115814  5924 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:58.116703  7351 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:55:58.117208  7351 raft_consensus.cc:697] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:58.115893  5958 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:55:58.118095  7351 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:58.086917  5956 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:55:58.122819  6581 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:55:58.124861  5848 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:58.125788  7348 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:58.126251  7348 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:58.126950  5881 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260620 13:55:58.127206  7348 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:58.128368  7273 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:55:58.129114  5952 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260620 13:55:58.131439  7273 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:58.136977  5969 tablet_copy_source_session.cc:215] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
W20260620 13:55:58.139417  5998 consensus_peers.cc:597] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 649259d8acc1429d8dddd2677f87f911. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:55:58.146989  7364 tablet_copy_client.cc:806] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:58.147855  7364 tablet_copy_client.cc:670] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:58.129146  6030 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:55:58.152393  7370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd646f84cb04514aa9889ea5f67db81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:58.146409  5776 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:58.164959  7364 tablet_copy_client.cc:538] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:58.184993  7288 raft_consensus.cc:2955] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:58.189539  5881 raft_consensus.cc:2955] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:58.192492  7364 tablet_bootstrap.cc:492] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:58.223074  7370 tablet_copy_client.cc:806] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:58.223719  7370 tablet_copy_client.cc:670] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:58.240969  5776 catalog_manager.cc:5696] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:58.247737  5881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58442
I20260620 13:55:58.248449  5881 raft_consensus.cc:606] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Received request to transfer leadership
I20260620 13:55:58.262127  7363 raft_consensus.cc:993] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47: : Instructing follower 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:55:58.262799  7363 raft_consensus.cc:1081] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Signalling peer 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:55:58.263831  7364 tablet_bootstrap.cc:492] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:58.264930  7364 tablet_bootstrap.cc:492] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:58.265818  7364 ts_tablet_manager.cc:1403] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.011s
I20260620 13:55:58.269517  5881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58442
I20260620 13:55:58.270234  5881 raft_consensus.cc:606] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Received request to transfer leadership
I20260620 13:55:58.269678  7364 raft_consensus.cc:359] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:58.270956  7364 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
W20260620 13:55:58.271827  5767 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 2f67b5ea416143c1a0a6729eaaa909c2 already in progress [suppressed 6 similar messages]
I20260620 13:55:58.271829  7364 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:58.275933  5878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5757f55132b747db98400dba7b8056df"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:58456
I20260620 13:55:58.276779  5878 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:58.277321  5878 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:58.278976  5876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58442
I20260620 13:55:58.279415  7364 ts_tablet_manager.cc:1434] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260620 13:55:58.279699  5876 raft_consensus.cc:606] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Received request to transfer leadership
I20260620 13:55:58.293015  5776 catalog_manager.cc:5696] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 3, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:55:58.299027  5829 auto_rebalancer.cc:855] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260620 13:55:58.299618  5829 auto_rebalancer.cc:863] Could not move replica: Remote error: Service unavailable: leadership transfer for 2f67b5ea416143c1a0a6729eaaa909c2 already in progress
W20260620 13:55:58.300002  5829 auto_rebalancer.cc:301] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 2f67b5ea416143c1a0a6729eaaa909c2 already in progress
I20260620 13:55:58.303725  5969 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-2f67b5ea416143c1a0a6729eaaa909c2 received from {username='slave'} at 127.0.0.1:42078
I20260620 13:55:58.304100  7370 tablet_copy_client.cc:538] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:58.304381  5969 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-2f67b5ea416143c1a0a6729eaaa909c2 on tablet 2f67b5ea416143c1a0a6729eaaa909c2 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:58.310477  5878 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:58.312647  5878 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:58.313446  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:58.314047  5959 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:58.315419  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:58.316046  6030 raft_consensus.cc:3055] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:58.316419  6030 raft_consensus.cc:740] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:58.316632  7370 tablet_bootstrap.cc:492] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:58.317293  6030 consensus_queue.cc:260] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:58.318452  6030 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:58.321148  5959 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:55:58.322700  5848 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:58.324882  7348 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:58.327423  7348 raft_consensus.cc:697] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:58.328841  7348 consensus_queue.cc:237] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:58.333006  6030 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:55:58.341638  5959 raft_consensus.cc:2955] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:55:58.348448  5777 catalog_manager.cc:5696] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 1 to 2, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:58.376782  7370 tablet_bootstrap.cc:492] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:58.377763  7370 tablet_bootstrap.cc:492] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:58.378453  7370 ts_tablet_manager.cc:1403] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.022s
I20260620 13:55:58.381136  7370 raft_consensus.cc:359] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:58.381809  7370 raft_consensus.cc:740] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:58.382548  7370 consensus_queue.cc:260] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:58.385466  7370 ts_tablet_manager.cc:1434] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260620 13:55:58.388656  5969 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-4fd646f84cb04514aa9889ea5f67db81 received from {username='slave'} at 127.0.0.1:42078
I20260620 13:55:58.389081  5969 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-4fd646f84cb04514aa9889ea5f67db81 on tablet 4fd646f84cb04514aa9889ea5f67db81 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:58.409735  7370 ts_tablet_manager.cc:933] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:58.411330  7370 tablet_copy_client.cc:323] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.195:41493
I20260620 13:55:58.412312  5959 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:58.412894  6043 tablet_copy_service.cc:140] P 663684cf4ae54c929bf8240ca0b63a47: Received BeginTabletCopySession request for tablet a1bc98eaf2354afeb378f85e462f31ab from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:46758)
I20260620 13:55:58.413460  6043 tablet_copy_service.cc:161] P 663684cf4ae54c929bf8240ca0b63a47: Beginning new tablet copy session on tablet a1bc98eaf2354afeb378f85e462f31ab from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:46758: session id = b0ce39342d8c4a64904b30b98de02b9f-a1bc98eaf2354afeb378f85e462f31ab
I20260620 13:55:58.413812  7146 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:58.422552  6043 tablet_copy_source_session.cc:215] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:58.426218  7370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1bc98eaf2354afeb378f85e462f31ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:58.451081  6030 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:58.461844  7146 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:58.464105  7370 tablet_copy_client.cc:806] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:58.464745  7370 tablet_copy_client.cc:670] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:58.478642  7370 tablet_copy_client.cc:538] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:58.489460  7370 tablet_bootstrap.cc:492] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:58.504168  7364 ts_tablet_manager.cc:933] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:58.511426  7364 tablet_copy_client.cc:323] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.195:41493
I20260620 13:55:58.512511  5881 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:58.513186  6043 tablet_copy_service.cc:140] P 663684cf4ae54c929bf8240ca0b63a47: Received BeginTabletCopySession request for tablet 649259d8acc1429d8dddd2677f87f911 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:46758)
I20260620 13:55:58.513731  6043 tablet_copy_service.cc:161] P 663684cf4ae54c929bf8240ca0b63a47: Beginning new tablet copy session on tablet 649259d8acc1429d8dddd2677f87f911 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:46758: session id = b0ce39342d8c4a64904b30b98de02b9f-649259d8acc1429d8dddd2677f87f911
I20260620 13:55:58.514065  7272 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:58.523905  6043 tablet_copy_source_session.cc:215] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:55:58.528182  7364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649259d8acc1429d8dddd2677f87f911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:55:58.540644  6581 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:58.546452  7273 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:58.606946  6585 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Advancing to term 2
I20260620 13:55:58.610438  6582 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:55:58.612387  7298 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260620 13:55:58.624806  6030 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:55:58.626240  6585 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260620 13:55:58.630057  7351 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:55:58.648788  7347 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:58.652009  7364 tablet_copy_client.cc:806] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:55:58.655193  7364 tablet_copy_client.cc:670] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:55:58.668282  7364 tablet_copy_client.cc:538] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:55:58.673703  7370 tablet_bootstrap.cc:492] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:58.674800  7370 tablet_bootstrap.cc:492] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:58.675612  7370 ts_tablet_manager.cc:1403] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.186s	user 0.045s	sys 0.087s
I20260620 13:55:58.678885  7370 raft_consensus.cc:359] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:58.679488  7347 raft_consensus.cc:1064] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
W20260620 13:55:58.680019  7347 raft_consensus.cc:1068] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038: Unable to promote non-voter b0ce39342d8c4a64904b30b98de02b9f: Service unavailable: leader transfer in progress
I20260620 13:55:58.680598  7370 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:58.681368  7370 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:58.684130  7370 ts_tablet_manager.cc:1434] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260620 13:55:58.685593  6582 raft_consensus.cc:1217] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:55:58.686528  6043 tablet_copy_service.cc:342] P 663684cf4ae54c929bf8240ca0b63a47: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-a1bc98eaf2354afeb378f85e462f31ab received from {username='slave'} at 127.0.0.1:46758
I20260620 13:55:58.687384  6043 tablet_copy_service.cc:434] P 663684cf4ae54c929bf8240ca0b63a47: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-a1bc98eaf2354afeb378f85e462f31ab on tablet a1bc98eaf2354afeb378f85e462f31ab with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:58.712999  5956 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260620 13:55:58.714605  7117 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:58.726665  7364 tablet_bootstrap.cc:492] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:55:58.734066  6030 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260620 13:55:58.735896  7347 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:58.764420  7117 raft_consensus.cc:993] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038: : Instructing follower 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:55:58.768229  7348 raft_consensus.cc:1081] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Signalling peer 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:55:58.780810  5956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:36000
I20260620 13:55:58.781455  5956 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:58.782274  7347 raft_consensus.cc:1064] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
W20260620 13:55:58.782713  7347 raft_consensus.cc:1068] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038: Unable to promote non-voter b0ce39342d8c4a64904b30b98de02b9f: Service unavailable: leader transfer in progress
I20260620 13:55:58.794435  5956 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:58.823333  6582 raft_consensus.cc:1217] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260620 13:55:58.827456  5956 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:58.839130  5956 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:58.844074  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:58.844676  5881 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:55:58.844961  5881 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:58.845696  5881 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:58.865422  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:58.866091  6030 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:58.867149  5881 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:58.867326  6025 raft_consensus.cc:1275] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:58.868826  7117 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:58.885843  6030 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:55:58.886941  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:58.891042  5956 raft_consensus.cc:1275] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:58.891352  7298 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:55:58.891888  7298 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:58.892629  7298 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:58.893716  7348 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:58.933425  5780 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 3, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:58.929368  5881 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:55:58.945161  7364 tablet_bootstrap.cc:492] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:55:58.948786  7364 tablet_bootstrap.cc:492] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:55:58.949553  7364 ts_tablet_manager.cc:1403] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.223s	user 0.017s	sys 0.027s
I20260620 13:55:58.952858  7364 raft_consensus.cc:359] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:58.953697  7364 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:55:58.954331  7364 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:55:58.966670  7364 ts_tablet_manager.cc:1434] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260620 13:55:58.969651  6043 tablet_copy_service.cc:342] P 663684cf4ae54c929bf8240ca0b63a47: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-649259d8acc1429d8dddd2677f87f911 received from {username='slave'} at 127.0.0.1:46758
I20260620 13:55:58.970111  6043 tablet_copy_service.cc:434] P 663684cf4ae54c929bf8240ca0b63a47: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-649259d8acc1429d8dddd2677f87f911 on tablet 649259d8acc1429d8dddd2677f87f911 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:55:59.001121  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:59.095176  6025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:55:59.095703  6025 raft_consensus.cc:606] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:59.098963  5956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab83097997ba42219f9a63aad224f786"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:59.099543  5956 raft_consensus.cc:606] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:55:59.103077  5881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:55:59.103751  5881 raft_consensus.cc:606] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:55:59.107213  5956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:55:59.107760  5956 raft_consensus.cc:606] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:55:59.110445  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260620 13:55:59.111992  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:55:59.112682  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:55:59.229398  7273 raft_consensus.cc:993] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47: : Instructing follower 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:55:59.231540  7280 raft_consensus.cc:1081] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Signalling peer 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:55:59.233209  5881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:58456
I20260620 13:55:59.233853  5881 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:59.234236  5881 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:59.244083  5881 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:59.245960  5881 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:55:59.246752  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:59.247411  5956 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:59.247541  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:55:59.248217  6025 raft_consensus.cc:3055] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:55:59.248510  6025 raft_consensus.cc:740] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:59.249516  6025 consensus_queue.cc:260] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:59.250718  6025 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:59.256313  5956 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:55:59.257479  5848 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:55:59.259155  7347 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:55:59.259636  7347 raft_consensus.cc:697] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:59.260551  7347 consensus_queue.cc:237] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:59.267758  7206 raft_consensus.cc:993] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685: : Instructing follower 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:59.268324  7206 raft_consensus.cc:1081] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:55:59.269590  6025 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:55:59.272104  6029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab83097997ba42219f9a63aad224f786"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:43488
I20260620 13:55:59.273219  7298 raft_consensus.cc:1064] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:59.277040  6029 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:59.277442  6029 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:59.279430  7298 consensus_queue.cc:237] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:59.286499  5780 catalog_manager.cc:5696] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 2 to 3, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 3 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:59.292407  6029 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:59.296793  6031 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:59.298173  6582 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:59.299616  7206 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:59.300459  7351 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:59.306931  5881 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:55:59.310909  6025 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260620 13:55:59.312932  6029 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:55:59.314442  6581 raft_consensus.cc:1217] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260620 13:55:59.315841  7298 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:59.316182  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:59.316727  5958 raft_consensus.cc:3055] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:59.317022  5958 raft_consensus.cc:740] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:59.317179  7298 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:59.317673  5958 consensus_queue.cc:260] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:59.318842  5958 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:59.325525  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:59.326390  5876 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:59.338254  5958 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:59.339449  5997 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:55:59.339814  5876 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:55:59.341449  7280 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:59.343967  7280 raft_consensus.cc:697] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:55:59.345019  7280 consensus_queue.cc:237] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:55:59.363713  6585 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Advancing to term 3
I20260620 13:55:59.366293  5876 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260620 13:55:59.372618  6585 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260620 13:55:59.373576  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 48133.2us
I20260620 13:55:59.379004  7206 raft_consensus.cc:993] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: : Instructing follower 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:55:59.378710  7409 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:59.387952  7206 raft_consensus.cc:1081] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:55:59.391582  7410 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:59.385649  5780 catalog_manager.cc:5696] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:55:59.409806  5881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:58452
I20260620 13:55:59.410413  5881 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:59.410748  5881 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:59.416203  7298 raft_consensus.cc:2955] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.419803  5881 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:59.424613  7362 raft_consensus.cc:1064] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:59.427546  7362 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:59.427261  5876 raft_consensus.cc:2955] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.430552  5881 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:55:59.433070  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:55:59.433665  5956 raft_consensus.cc:3055] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:55:59.433954  5956 raft_consensus.cc:740] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:59.434636  5956 consensus_queue.cc:260] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:59.438511  5956 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:59.444733  5776 catalog_manager.cc:5696] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:59.447305  6031 raft_consensus.cc:2955] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.463151  7407 raft_consensus.cc:993] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038: : Instructing follower 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:55:59.463711  7407 raft_consensus.cc:1081] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Signalling peer 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:55:59.467172  5958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:36000
I20260620 13:55:59.467715  5958 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:55:59.468060  5958 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:59.472144  5952 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260620 13:55:59.473702  7280 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:59.476862  6580 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260620 13:55:59.479626  7415 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:59.488548  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:55:59.489121  6585 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:55:59.496356  6581 raft_consensus.cc:2955] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.503684  5957 consensus_queue.cc:237] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:59.515551  5876 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:59.517382  7410 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:59.521317  5956 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:55:59.526176  5958 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:59.528543  5958 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:55:59.537014  6585 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:55:59.539413  5881 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260620 13:55:59.540688  5849 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:55:59.541442  7407 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:55:59.541507  7280 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:59.542021  7407 raft_consensus.cc:697] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:59.542951  7407 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:59.548558  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:55:59.550117  6585 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:59.552062  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:55:59.559999  7351 raft_consensus.cc:2955] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.571419  5881 raft_consensus.cc:3055] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:55:59.571779  5881 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:55:59.572502  5881 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:59.575745  5881 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:55:59.579972  5876 raft_consensus.cc:2955] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.589071  7362 raft_consensus.cc:2955] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.591820  6585 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:55:59.594205  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:55:59.594914  7410 raft_consensus.cc:1064] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:59.595094  7298 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:55:59.595731  7298 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:55:59.595999  6580 raft_consensus.cc:2955] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.596817  7298 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:59.602305  5881 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:55:59.599714  7410 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:59.613201  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 4fd646f84cb04514aa9889ea5f67db81 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:59.622845  6584 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:55:59.628355  5776 catalog_manager.cc:5696] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:59.641456  6584 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:55:59.644429  5956 raft_consensus.cc:2955] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.657027  6031 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:55:59.662390  5878 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:55:59.661700  5777 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:55:59.662494  5778 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 3, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:55:59.666746  7411 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:59.669158  7409 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:59.671043  5881 raft_consensus.cc:2955] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.685611  7410 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:59.688398  7298 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:59.689356  6584 raft_consensus.cc:2955] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.706533  5956 raft_consensus.cc:1275] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:55:59.711848  7407 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:59.716852  7410 raft_consensus.cc:2955] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.719779  5776 catalog_manager.cc:5696] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.726143  6580 raft_consensus.cc:2955] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.742048  6025 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:59.748137  6029 raft_consensus.cc:1275] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:55:59.747567  6031 raft_consensus.cc:2955] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.750488  7407 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:55:59.753140  5881 raft_consensus.cc:1275] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:59.754388  7414 consensus_queue.cc:1048] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:59.758963  5878 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:59.760543  7280 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:59.762542  6580 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:59.764163  6016 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fd646f84cb04514aa9889ea5f67db81 with delete_type TABLET_DATA_TOMBSTONED (TS 663684cf4ae54c929bf8240ca0b63a47 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43482
I20260620 13:55:59.777604  5778 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 2 to 5, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.782141  7362 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:59.788787  5878 raft_consensus.cc:2955] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.813126  7414 raft_consensus.cc:2955] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.824282  5958 raft_consensus.cc:1275] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:55:59.824476  6584 raft_consensus.cc:2955] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.826565  7273 consensus_queue.cc:1048] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:55:59.828547  5878 raft_consensus.cc:2955] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.830852  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet a1bc98eaf2354afeb378f85e462f31ab with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:59.831494  7425 tablet_replica.cc:333] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:55:59.832835  7425 raft_consensus.cc:2243] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:55:59.833611  7425 raft_consensus.cc:2272] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:55:59.855362  7425 ts_tablet_manager.cc:1916] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:55:59.859828  5777 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 4 to 5, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.857715  5956 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:59.886643  6584 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:55:59.887905  7425 ts_tablet_manager.cc:1929] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:55:59.889019  7425 log.cc:1199] T 4fd646f84cb04514aa9889ea5f67db81 P 663684cf4ae54c929bf8240ca0b63a47: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/wals/4fd646f84cb04514aa9889ea5f67db81
I20260620 13:55:59.889732  6025 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:55:59.891196  5767 catalog_manager.cc:5027] TS 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): tablet 4fd646f84cb04514aa9889ea5f67db81 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:55:59.892364  7298 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:55:59.894037  7298 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:55:59.905134  7410 raft_consensus.cc:2955] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.918779  6584 raft_consensus.cc:2955] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.929858  6025 raft_consensus.cc:2955] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:55:59.941865  7362 raft_consensus.cc:1064] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:55:59.945333  7362 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:55:59.952318  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 2f67b5ea416143c1a0a6729eaaa909c2 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:55:59.952378  5949 tablet_service.cc:1558] Processing DeleteTablet for tablet a1bc98eaf2354afeb378f85e462f31ab with delete_type TABLET_DATA_TOMBSTONED (TS 192c750f597c43858e1ad09e8d805685 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:35974
I20260620 13:55:59.960414  5957 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:55:59.963092  7407 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:55:59.970981  6580 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260620 13:55:59.972621  5878 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260620 13:55:59.978679  7362 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:55:59.979872  7273 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:55:59.995911  5959 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260620 13:55:59.997584  7273 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:56:00.033416  5777 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 5 to 6, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:00.043449  6584 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:00.047009  7348 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:00.051410  5867 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f67b5ea416143c1a0a6729eaaa909c2 with delete_type TABLET_DATA_TOMBSTONED (TS 2e82c0c231624695ac5a813230bf5038 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58442
I20260620 13:56:00.053436  7433 tablet_replica.cc:333] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:56:00.055847  7433 raft_consensus.cc:2243] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:56:00.073508  7433 raft_consensus.cc:2272] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260620 13:56:00.131224  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51688.6us
W20260620 13:56:00.139322  7431 log.cc:927] Time spent T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260620 13:56:00.146507  7428 tablet_replica.cc:333] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:56:00.156598  7362 raft_consensus.cc:2955] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:00.158865  5878 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:00.159034  7428 raft_consensus.cc:2243] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:56:00.161103  7428 raft_consensus.cc:2272] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:56:00.160645  6581 raft_consensus.cc:2955] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:00.165942  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:00.172680  7433 ts_tablet_manager.cc:1916] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:56:00.173139  5956 raft_consensus.cc:2955] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:00.175943  7409 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:56:00.177340  7428 ts_tablet_manager.cc:1916] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:56:00.208756  5881 raft_consensus.cc:2955] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:00.215158  7433 ts_tablet_manager.cc:1929] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260620 13:56:00.215852  7433 log.cc:1199] T 2f67b5ea416143c1a0a6729eaaa909c2 P 2e82c0c231624695ac5a813230bf5038: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/wals/2f67b5ea416143c1a0a6729eaaa909c2
I20260620 13:56:00.219998  7428 ts_tablet_manager.cc:1929] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260620 13:56:00.220652  7428 log.cc:1199] T a1bc98eaf2354afeb378f85e462f31ab P 192c750f597c43858e1ad09e8d805685: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/wals/a1bc98eaf2354afeb378f85e462f31ab
I20260620 13:56:00.230120  5767 catalog_manager.cc:5027] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): tablet 2f67b5ea416143c1a0a6729eaaa909c2 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:56:00.234380  5776 catalog_manager.cc:5696] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:56:00.248128  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 61106.2us
I20260620 13:56:00.267225  6584 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:00.273976  6031 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:00.279739  7351 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:00.274412  5766 catalog_manager.cc:5027] TS 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): tablet a1bc98eaf2354afeb378f85e462f31ab (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:56:00.297834  6584 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:00.298089  5956 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:00.299455  7415 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:00.300340  7362 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:00.308151  6031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:56:00.309048  6031 raft_consensus.cc:606] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:00.312763  7414 raft_consensus.cc:2955] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:00.314522  5876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8078a89b618482f8e4978c463747569"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:56:00.315217  5876 raft_consensus.cc:606] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:00.315758  6584 raft_consensus.cc:2955] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:00.333734  5959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec20d216461d4414813627ca62e330e4"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:56:00.334465  5959 raft_consensus.cc:606] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Received request to transfer leadership to TS 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:00.349176  5959 raft_consensus.cc:2955] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:00.350440  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 649259d8acc1429d8dddd2677f87f911 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:56:00.358410  5881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:56:00.358973  5881 raft_consensus.cc:606] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:56:00.360370  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260620 13:56:00.362426  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:56:00.363575  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:00.373237  7415 raft_consensus.cc:993] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47: : Instructing follower 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:56:00.373880  7415 raft_consensus.cc:1081] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Signalling peer 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:56:00.375861  5881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:58456
I20260620 13:56:00.376525  5881 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:00.376942  5881 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:00.386231  5881 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:00.389571  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:00.390198  6031 raft_consensus.cc:3055] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:00.390507  6031 raft_consensus.cc:740] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:00.391637  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:00.392187  5959 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:00.396545  6031 consensus_queue.cc:260] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:00.397696  6031 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:00.374763  5777 catalog_manager.cc:5696] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 4 to 5, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:00.404281  7407 raft_consensus.cc:993] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038: : Instructing follower 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:56:00.404690  5881 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:00.404843  7407 raft_consensus.cc:1081] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Signalling peer 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:56:00.406824  5959 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:00.411943  5956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:36000
I20260620 13:56:00.412509  5956 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:00.412828  5956 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:00.413507  6031 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:00.414644  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:00.415477  7407 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:00.416103  7407 raft_consensus.cc:697] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:00.417572  7407 consensus_queue.cc:237] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:00.426688  5867 tablet_service.cc:1558] Processing DeleteTablet for tablet 649259d8acc1429d8dddd2677f87f911 with delete_type TABLET_DATA_TOMBSTONED (TS 2e82c0c231624695ac5a813230bf5038 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:58442
I20260620 13:56:00.427961  7433 tablet_replica.cc:333] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:56:00.428423  5956 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:00.430285  7433 raft_consensus.cc:2243] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:56:00.431663  5956 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:00.432258  7433 raft_consensus.cc:2272] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:56:00.436152  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:00.436728  5881 raft_consensus.cc:3055] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:00.437016  5881 raft_consensus.cc:740] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:00.437067  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:00.437811  5881 consensus_queue.cc:260] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:00.438064  6580 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:00.438907  5881 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:00.446002  5881 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:00.447963  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:00.451237  7409 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:00.451769  7409 raft_consensus.cc:697] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:00.452593  7409 consensus_queue.cc:237] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:00.457674  7433 ts_tablet_manager.cc:1916] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:56:00.453789  6580 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:00.471834  5777 catalog_manager.cc:5696] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 1 to 2, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:00.485829  7433 ts_tablet_manager.cc:1929] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260620 13:56:00.486270  7433 log.cc:1199] T 649259d8acc1429d8dddd2677f87f911 P 2e82c0c231624695ac5a813230bf5038: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/wals/649259d8acc1429d8dddd2677f87f911
I20260620 13:56:00.485510  5778 catalog_manager.cc:5696] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 1 to 2, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 2 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:00.488021  5767 catalog_manager.cc:5027] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): tablet 649259d8acc1429d8dddd2677f87f911 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:56:00.615309  7351 raft_consensus.cc:993] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: : Instructing follower 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:56:00.615909  7409 raft_consensus.cc:1081] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Signalling peer 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:56:00.617967  6031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec20d216461d4414813627ca62e330e4"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:43488
I20260620 13:56:00.618503  6031 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:00.618744  6031 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:00.626067  6031 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:00.628209  6031 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:00.629513  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:00.630028  5956 raft_consensus.cc:3055] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:00.630311  5956 raft_consensus.cc:740] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:00.631004  5956 consensus_queue.cc:260] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:00.631677  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:00.632041  5956 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:00.632222  5881 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:00.638911  5956 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:00.639954  5997 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:00.639951  5881 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:00.640854  7414 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:00.641438  7414 raft_consensus.cc:697] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:00.642681  7414 consensus_queue.cc:237] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:00.653394  5778 catalog_manager.cc:5696] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 3, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:56:00.747831  7347 raft_consensus.cc:993] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: : Instructing follower b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:56:00.748387  7407 raft_consensus.cc:1081] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Signalling peer b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:56:00.750007  6580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8078a89b618482f8e4978c463747569"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:46852
I20260620 13:56:00.750510  6580 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:00.751252  6580 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:00.758291  6580 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:00.761088  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:00.761700  6580 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:00.761907  5876 raft_consensus.cc:3055] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:00.762212  5876 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:00.762957  5876 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:00.764274  5876 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:00.764741  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:00.765704  6031 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:00.772496  6031 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:00.773121  5876 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:00.773814  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:00.774645  7146 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:00.775138  7146 raft_consensus.cc:697] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:00.775887  7146 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:00.784442  5778 catalog_manager.cc:5696] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 2, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 2 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:00.854467  5956 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:56:00.855785  7407 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:56:00.868170  6031 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:56:00.869745  7407 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:56:00.874590  6581 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:00.877785  7409 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:00.893909  5876 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:00.896147  7351 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:01.092597  5881 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:01.094713  7414 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:01.106710  5956 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:01.109328  7415 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:01.275471  5881 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:01.276602  7146 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:01.281728  6025 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:01.283411  7146 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:01.473477  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:01.509815  5958 consensus_queue.cc:237] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:01.543473  6025 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:56:01.566752  5876 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:56:01.568477  5956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:56:01.569108  5956 raft_consensus.cc:606] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Received request to transfer leadership to TS 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:01.570787  5924 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b06407c45954213adfef7604a8c4f21. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:56:01.571008  7455 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:56:01.574057  7411 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:56:01.575358  6029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4cd17345f80464287c5952767849dbb"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:56:01.575920  6029 raft_consensus.cc:606] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:01.579752  5876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:56:01.580368  5876 raft_consensus.cc:606] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:56:01.582281  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260620 13:56:01.583984  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:56:01.584707  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:01.595377  7455 raft_consensus.cc:2955] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:01.597189  5881 raft_consensus.cc:2955] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:01.600605  6025 raft_consensus.cc:2955] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:01.614786  7351 raft_consensus.cc:993] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: : Instructing follower 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:56:01.615399  7351 raft_consensus.cc:1081] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Signalling peer 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:56:01.621747  5776 catalog_manager.cc:5696] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:01.629098  6025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:43488
I20260620 13:56:01.629956  6025 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:01.631078  6025 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:01.629663  5956 consensus_queue.cc:237] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:01.643226  6025 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:01.646483  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:01.647068  5876 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:01.649298  6029 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:56:01.651852  7456 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:56:01.651398  5881 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:56:01.653793  6025 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:01.654742  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:56:01.659330  5924 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f1025714d0b439cb56cc08764cb5fce. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:56:01.660279  5958 raft_consensus.cc:3055] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:01.665793  5958 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:01.667078  5958 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:01.668439  5958 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:01.678474  7455 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:56:01.694094  5958 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:01.695797  5997 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:01.696293  5876 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:01.696707  7449 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:01.697445  7449 raft_consensus.cc:697] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:01.699467  7449 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:01.707876  7455 raft_consensus.cc:2955] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:01.713310  6025 raft_consensus.cc:2955] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:01.729120  5958 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:01.736647  5880 raft_consensus.cc:2955] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:01.751765  5777 catalog_manager.cc:5696] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260620 13:56:01.759362  5924 consensus_peers.cc:597] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86bd36dee6d64396bfbb86cd90a7bedd. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:56:01.762224  6025 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260620 13:56:01.761878  5778 catalog_manager.cc:5696] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 3, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:56:01.767313  7455 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:01.773510  5880 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260620 13:56:01.775255  7455 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:56:01.777776  7410 raft_consensus.cc:2955] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:01.782768  6025 raft_consensus.cc:2955] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:01.802134  5876 raft_consensus.cc:2955] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:01.806932  5880 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:01.806537  5776 catalog_manager.cc:5696] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 4, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260620 13:56:01.835008  5849 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fc24d0691404d29bfa069498ec57dd0. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:56:01.849704  6025 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:56:01.849769  5958 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:56:01.851250  7470 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:56:01.856119  7407 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260620 13:56:01.883494  6031 raft_consensus.cc:2955] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:01.882433  7407 raft_consensus.cc:2955] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:01.887981  5958 raft_consensus.cc:2955] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:01.999951  5776 catalog_manager.cc:5696] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:02.008406  7415 raft_consensus.cc:993] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: : Instructing follower 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:56:02.009701  7415 raft_consensus.cc:1081] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Signalling peer 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:56:02.012570  5880 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4cd17345f80464287c5952767849dbb"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:58456
I20260620 13:56:02.013257  5880 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:02.013705  5880 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:02.022554  5880 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:02.030990  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:02.031651  5956 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:02.032111  5880 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:02.037534  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:02.038342  6025 raft_consensus.cc:3055] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:02.038676  6025 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:02.040529  6025 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:02.042011  5956 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:02.042604  6025 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:02.049386  5848 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:02.050310  7470 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:02.050976  7470 raft_consensus.cc:697] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:02.051851  7470 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:02.053850  5956 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:02.067209  6025 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:02.109789  7347 raft_consensus.cc:993] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038: : Instructing follower 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:56:02.110917  7478 raft_consensus.cc:1081] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Signalling peer 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:56:02.115913  5959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:36000
I20260620 13:56:02.116524  5959 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:02.116931  5959 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:02.120226  5776 catalog_manager.cc:5696] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 2 to 3, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 3 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:02.123744  5880 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:02.134245  7449 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:56:02.139760  5959 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:02.142081  5959 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:02.143443  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:02.144299  5876 raft_consensus.cc:3055] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:02.144587  5876 raft_consensus.cc:740] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:02.144893  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:02.145550  6585 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:02.145540  5876 consensus_queue.cc:260] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:02.146999  5876 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:02.144564  7480 ts_tablet_manager.cc:933] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:02.156100  5876 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:02.157960  5924 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:02.158860  7455 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:02.159576  7455 raft_consensus.cc:697] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:02.161290  6585 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:02.160874  7455 consensus_queue.cc:237] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:02.194139  5959 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:02.196601  7475 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:02.216526  7481 ts_tablet_manager.cc:933] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:02.217269  7480 tablet_copy_client.cc:323] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:56:02.219244  7481 tablet_copy_client.cc:323] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:56:02.219408  5969 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet 8b06407c45954213adfef7604a8c4f21 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:56:02.220010  5969 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet 8b06407c45954213adfef7604a8c4f21 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-8b06407c45954213adfef7604a8c4f21
I20260620 13:56:02.221697  7486 ts_tablet_manager.cc:933] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:02.221557  5968 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet 86bd36dee6d64396bfbb86cd90a7bedd from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:56:02.222282  5968 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet 86bd36dee6d64396bfbb86cd90a7bedd from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-86bd36dee6d64396bfbb86cd90a7bedd
I20260620 13:56:02.228780  5969 tablet_copy_source_session.cc:215] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:56:02.234185  7486 tablet_copy_client.cc:323] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.194:38517
I20260620 13:56:02.236095  7480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b06407c45954213adfef7604a8c4f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:56:02.241402  5969 tablet_copy_service.cc:140] P 192c750f597c43858e1ad09e8d805685: Received BeginTabletCopySession request for tablet 1f1025714d0b439cb56cc08764cb5fce from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42078)
I20260620 13:56:02.242079  5969 tablet_copy_service.cc:161] P 192c750f597c43858e1ad09e8d805685: Beginning new tablet copy session on tablet 1f1025714d0b439cb56cc08764cb5fce from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42078: session id = b0ce39342d8c4a64904b30b98de02b9f-1f1025714d0b439cb56cc08764cb5fce
I20260620 13:56:02.250599  5969 tablet_copy_source_session.cc:215] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:56:02.252650  5776 catalog_manager.cc:5696] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 1 to 2, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 2 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:02.254894  7486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1025714d0b439cb56cc08764cb5fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:56:02.255143  5968 tablet_copy_source_session.cc:215] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:56:02.262653  7481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86bd36dee6d64396bfbb86cd90a7bedd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:56:02.287242  7486 tablet_copy_client.cc:806] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:56:02.288033  7486 tablet_copy_client.cc:670] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:56:02.294344  7486 tablet_copy_client.cc:538] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:56:02.297168  7480 tablet_copy_client.cc:806] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:56:02.297780  7480 tablet_copy_client.cc:670] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:56:02.313696  7480 tablet_copy_client.cc:538] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:56:02.316431  7486 tablet_bootstrap.cc:492] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:56:02.322904  7481 tablet_copy_client.cc:806] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:56:02.323589  7481 tablet_copy_client.cc:670] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:56:02.327255  7481 tablet_copy_client.cc:538] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:56:02.339833  7480 tablet_bootstrap.cc:492] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:56:02.341537  7481 tablet_bootstrap.cc:492] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:56:02.361449  7486 tablet_bootstrap.cc:492] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:56:02.362504  7486 tablet_bootstrap.cc:492] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:56:02.363281  7486 ts_tablet_manager.cc:1403] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.008s
I20260620 13:56:02.367424  7486 raft_consensus.cc:359] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:02.368417  7486 raft_consensus.cc:740] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:56:02.369205  7486 consensus_queue.cc:260] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:02.372179  7486 ts_tablet_manager.cc:1434] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260620 13:56:02.376519  5968 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-1f1025714d0b439cb56cc08764cb5fce received from {username='slave'} at 127.0.0.1:42078
I20260620 13:56:02.377012  5968 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-1f1025714d0b439cb56cc08764cb5fce on tablet 1f1025714d0b439cb56cc08764cb5fce with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:02.381306  7480 tablet_bootstrap.cc:492] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:56:02.382355  7480 tablet_bootstrap.cc:492] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:56:02.383221  7480 ts_tablet_manager.cc:1403] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.012s
I20260620 13:56:02.389379  7480 raft_consensus.cc:359] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:02.390367  7480 raft_consensus.cc:740] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:56:02.391089  7480 consensus_queue.cc:260] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:02.393834  7480 ts_tablet_manager.cc:1434] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260620 13:56:02.395776  5968 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-8b06407c45954213adfef7604a8c4f21 received from {username='slave'} at 127.0.0.1:42078
I20260620 13:56:02.396279  5968 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-8b06407c45954213adfef7604a8c4f21 on tablet 8b06407c45954213adfef7604a8c4f21 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:02.413146  7480 ts_tablet_manager.cc:933] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:56:02.424742  7481 tablet_bootstrap.cc:492] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:56:02.428478  7481 tablet_bootstrap.cc:492] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:56:02.429245  7481 ts_tablet_manager.cc:1403] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.020s
I20260620 13:56:02.433178  7481 raft_consensus.cc:359] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:02.434058  7481 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:56:02.434716  7481 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:02.437451  7481 ts_tablet_manager.cc:1434] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 13:56:02.438305  7480 tablet_copy_client.cc:323] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.193:46177
I20260620 13:56:02.440920  5968 tablet_copy_service.cc:342] P 192c750f597c43858e1ad09e8d805685: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-86bd36dee6d64396bfbb86cd90a7bedd received from {username='slave'} at 127.0.0.1:42078
I20260620 13:56:02.441386  5968 tablet_copy_service.cc:434] P 192c750f597c43858e1ad09e8d805685: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-86bd36dee6d64396bfbb86cd90a7bedd on tablet 86bd36dee6d64396bfbb86cd90a7bedd with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:02.447065  5894 tablet_copy_service.cc:140] P 2e82c0c231624695ac5a813230bf5038: Received BeginTabletCopySession request for tablet 0fc24d0691404d29bfa069498ec57dd0 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42748)
I20260620 13:56:02.447896  5894 tablet_copy_service.cc:161] P 2e82c0c231624695ac5a813230bf5038: Beginning new tablet copy session on tablet 0fc24d0691404d29bfa069498ec57dd0 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42748: session id = b0ce39342d8c4a64904b30b98de02b9f-0fc24d0691404d29bfa069498ec57dd0
I20260620 13:56:02.455991  6025 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:02.457499  7478 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:56:02.463434  5894 tablet_copy_source_session.cc:215] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:56:02.471943  7480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc24d0691404d29bfa069498ec57dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:56:02.476375  5956 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:02.501919  7480 tablet_copy_client.cc:806] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:56:02.502921  7480 tablet_copy_client.cc:670] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:56:02.503728  7478 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:02.513697  7480 tablet_copy_client.cc:538] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:56:02.524827  7480 tablet_bootstrap.cc:492] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:56:02.554909  7480 tablet_bootstrap.cc:492] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:56:02.555959  7480 tablet_bootstrap.cc:492] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:56:02.556851  7480 ts_tablet_manager.cc:1403] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.032s	user 0.027s	sys 0.003s
I20260620 13:56:02.560214  7480 raft_consensus.cc:359] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:02.561434  7480 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:56:02.562322  7480 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:02.565594  7480 ts_tablet_manager.cc:1434] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260620 13:56:02.568193  5894 tablet_copy_service.cc:342] P 2e82c0c231624695ac5a813230bf5038: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-0fc24d0691404d29bfa069498ec57dd0 received from {username='slave'} at 127.0.0.1:42748
I20260620 13:56:02.568730  5894 tablet_copy_service.cc:434] P 2e82c0c231624695ac5a813230bf5038: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-0fc24d0691404d29bfa069498ec57dd0 on tablet 0fc24d0691404d29bfa069498ec57dd0 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:02.673673  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:02.676403  6584 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:02.679674  7410 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:02.697449  6584 raft_consensus.cc:1217] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:56:02.700570  5876 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:02.708242  7456 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:02.725095  6581 raft_consensus.cc:1217] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260620 13:56:02.804131  6584 raft_consensus.cc:1217] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:56:02.814291  5876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4cd17345f80464287c5952767849dbb"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:56:02.814956  5876 raft_consensus.cc:606] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:56:02.816831  6584 raft_consensus.cc:1217] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:56:02.818859  5958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:56:02.819563  5958 raft_consensus.cc:606] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:02.824137  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260620 13:56:02.825961  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:56:02.827080  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:02.986132  7456 raft_consensus.cc:993] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: : Instructing follower 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:56:02.986660  7456 raft_consensus.cc:1081] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Signalling peer 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:56:02.989142  5876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:58452
I20260620 13:56:02.989686  5876 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:02.990026  5876 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:02.997078  5876 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:03.006685  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:03.007372  5958 raft_consensus.cc:3055] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:03.007690  5958 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:03.008631  5958 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:03.009794  5958 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:03.010844  5876 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:03.010731  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:03.015403  6581 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:03.023527  6581 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:03.034637  5849 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:03.035404  7477 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:03.034919  5958 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:03.037480  7477 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:03.038371  7477 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:03.051510  5776 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 3 to 4, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 4 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:03.093129  7470 raft_consensus.cc:993] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038: : Instructing follower 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:56:03.093665  7470 raft_consensus.cc:1081] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Signalling peer 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:56:03.105809  5958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4cd17345f80464287c5952767849dbb"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:36000
I20260620 13:56:03.106515  5958 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:03.106926  5958 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:03.119277  5958 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:03.124250  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:03.124830  5881 raft_consensus.cc:3055] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:03.124990  5958 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:03.125101  5881 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:03.128564  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:03.129148  6025 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:03.129074  5881 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:03.130332  5881 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:03.139928  6025 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:03.143627  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:03.145401  7456 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:03.146147  7456 raft_consensus.cc:697] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:03.148452  7456 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:03.145102  5881 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:03.159631  5776 catalog_manager.cc:5696] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 3 to 4, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 4 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:03.196743  7455 raft_consensus.cc:1064] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:56:03.199813  7455 consensus_queue.cc:237] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:03.212328  6584 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:56:03.213927  7455 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:03.215457  6025 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:56:03.218277  5881 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:56:03.222643  7508 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:03.226570  7455 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:56:03.239928  7508 raft_consensus.cc:2955] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.242588  5881 raft_consensus.cc:2955] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.242390  6025 raft_consensus.cc:2955] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.247277  7410 raft_consensus.cc:1064] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:56:03.249914  7410 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:03.286755  5776 catalog_manager.cc:5696] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.312801  6025 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:56:03.314447  6581 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:56:03.316116  6584 raft_consensus.cc:2955] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.325783  5881 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:56:03.330650  7508 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:03.331813  7516 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:03.332208  7515 raft_consensus.cc:1064] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:56:03.334996  7515 consensus_queue.cc:237] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:03.352689  7516 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:03.355540  5958 consensus_queue.cc:237] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:03.399995  7470 raft_consensus.cc:1064] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:56:03.402705  7470 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:03.418416  6581 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:56:03.423817  6025 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:56:03.426043  7477 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:03.433391  5876 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260620 13:56:03.434291  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 48945.6us
I20260620 13:56:03.441751  6584 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:56:03.446686  7477 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:03.452517  7516 raft_consensus.cc:2955] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.454921  5876 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:56:03.462785  6031 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:56:03.472563  7455 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:56:03.476429  5956 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:56:03.476830  7410 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:56:03.478777  7456 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:03.487272  7523 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:03.492362  6029 raft_consensus.cc:2955] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.505410  6581 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:56:03.510221  6581 raft_consensus.cc:2955] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.523666  7456 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260620 13:56:03.525085  7525 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260620 13:56:03.538589  5777 catalog_manager.cc:5696] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 4 to 5, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:03.541462  5959 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260620 13:56:03.542623  5876 raft_consensus.cc:2955] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.557753  7410 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:03.560535  6580 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260620 13:56:03.562384  7515 raft_consensus.cc:2955] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.565191  7524 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:03.569316  5881 raft_consensus.cc:2955] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.570319  7523 raft_consensus.cc:2955] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.582605  6581 raft_consensus.cc:2955] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.614045  5956 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:03.624137  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 8b06407c45954213adfef7604a8c4f21 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:56:03.631927  5958 raft_consensus.cc:2955] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.638756  7410 raft_consensus.cc:2955] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.648690  6031 raft_consensus.cc:2955] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.650485  5778 catalog_manager.cc:5696] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.666347  5876 raft_consensus.cc:2955] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.695667  5881 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:56:03.698199  7508 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:56:03.698913  6030 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:56:03.701901  6581 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:03.707825  7508 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:56:03.709560  7455 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:03.725124  5779 catalog_manager.cc:5696] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.730691  6031 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:03.739640  6016 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b06407c45954213adfef7604a8c4f21 with delete_type TABLET_DATA_TOMBSTONED (TS 663684cf4ae54c929bf8240ca0b63a47 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43482
I20260620 13:56:03.748988  7539 tablet_replica.cc:333] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:56:03.750100  7539 raft_consensus.cc:2243] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:56:03.751000  7539 raft_consensus.cc:2272] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:56:03.751945  7410 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:03.772917  6581 raft_consensus.cc:2955] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.770539  7455 raft_consensus.cc:2955] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.804272  7539 ts_tablet_manager.cc:1916] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:56:03.822261  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 86bd36dee6d64396bfbb86cd90a7bedd with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:56:03.819371  6581 raft_consensus.cc:2955] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.830370  6031 raft_consensus.cc:2955] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.862346  7523 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:56:03.871296  5778 catalog_manager.cc:5696] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 5 to 6, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.880071  6030 raft_consensus.cc:2955] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.895470  7539 ts_tablet_manager.cc:1929] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:56:03.903846  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:03.901989  7539 log.cc:1199] T 8b06407c45954213adfef7604a8c4f21 P 663684cf4ae54c929bf8240ca0b63a47: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/wals/8b06407c45954213adfef7604a8c4f21
I20260620 13:56:03.922330  5777 catalog_manager.cc:5696] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.928164  5867 tablet_service.cc:1558] Processing DeleteTablet for tablet 86bd36dee6d64396bfbb86cd90a7bedd with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:58442
I20260620 13:56:03.950810  6584 raft_consensus.cc:2955] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:03.984920  5767 catalog_manager.cc:5027] TS 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): tablet 8b06407c45954213adfef7604a8c4f21 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
W20260620 13:56:03.998049  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 45416.2us
I20260620 13:56:04.007035  7548 tablet_replica.cc:333] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:56:04.012599  7548 raft_consensus.cc:2243] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:56:04.013455  7548 raft_consensus.cc:2272] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:56:04.020869  7548 ts_tablet_manager.cc:1916] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:56:04.025966  5958 consensus_queue.cc:237] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:04.031435  5881 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:04.037556  6584 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:56:04.038174  6585 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:56:04.038926  7455 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:04.040571  6030 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:56:04.047703  7536 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:56:04.048259  7542 raft_consensus.cc:2955] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:04.051494  6585 raft_consensus.cc:2955] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:04.058411  5881 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:56:04.060104  7523 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:04.067070  7548 ts_tablet_manager.cc:1929] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260620 13:56:04.067240  5766 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 1f1025714d0b439cb56cc08764cb5fce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:56:04.080714  7548 log.cc:1199] T 86bd36dee6d64396bfbb86cd90a7bedd P 2e82c0c231624695ac5a813230bf5038: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/wals/86bd36dee6d64396bfbb86cd90a7bedd
I20260620 13:56:04.078593  6030 raft_consensus.cc:2955] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:04.070288  7516 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260620 13:56:04.085821  5767 catalog_manager.cc:5027] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): tablet 86bd36dee6d64396bfbb86cd90a7bedd (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:56:04.070780  6584 raft_consensus.cc:2955] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:04.092983  5778 catalog_manager.cc:5696] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New cstate: current_term: 1 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:04.069535  7524 raft_consensus.cc:2955] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:04.105208  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 0fc24d0691404d29bfa069498ec57dd0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:56:04.107829  5881 raft_consensus.cc:2955] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:04.116210  5779 catalog_manager.cc:5696] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index 3 to 4, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:04.121479  6016 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f1025714d0b439cb56cc08764cb5fce with delete_type TABLET_DATA_TOMBSTONED (TS 663684cf4ae54c929bf8240ca0b63a47 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43482
I20260620 13:56:04.125141  7539 tablet_replica.cc:333] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:56:04.126211  7539 raft_consensus.cc:2243] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:56:04.127077  7539 raft_consensus.cc:2272] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:56:04.136122  5949 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fc24d0691404d29bfa069498ec57dd0 with delete_type TABLET_DATA_TOMBSTONED (TS 192c750f597c43858e1ad09e8d805685 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35974
I20260620 13:56:04.137599  7539 ts_tablet_manager.cc:1916] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:56:04.151906  7550 tablet_replica.cc:333] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:56:04.153524  7550 raft_consensus.cc:2243] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:56:04.155930  7550 raft_consensus.cc:2272] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:56:04.166277  7539 ts_tablet_manager.cc:1929] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:56:04.167012  7539 log.cc:1199] T 1f1025714d0b439cb56cc08764cb5fce P 663684cf4ae54c929bf8240ca0b63a47: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/wals/1f1025714d0b439cb56cc08764cb5fce
I20260620 13:56:04.169962  5767 catalog_manager.cc:5027] TS 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): tablet 1f1025714d0b439cb56cc08764cb5fce (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:56:04.169972  7550 ts_tablet_manager.cc:1916] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:56:04.184129  6030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:56:04.184758  6030 raft_consensus.cc:606] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:04.187620  5881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5757f55132b747db98400dba7b8056df"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:56:04.188300  5881 raft_consensus.cc:606] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:56:04.191254  5958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:56:04.191740  5958 raft_consensus.cc:606] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:04.192829  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260620 13:56:04.193913  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:56:04.194517  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:04.197875  7550 ts_tablet_manager.cc:1929] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:56:04.198398  7550 log.cc:1199] T 0fc24d0691404d29bfa069498ec57dd0 P 192c750f597c43858e1ad09e8d805685: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/wals/0fc24d0691404d29bfa069498ec57dd0
I20260620 13:56:04.200181  5766 catalog_manager.cc:5027] TS 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): tablet 0fc24d0691404d29bfa069498ec57dd0 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:56:04.354689  7536 raft_consensus.cc:993] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: : Instructing follower 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:56:04.355237  7523 raft_consensus.cc:1081] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Signalling peer 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:56:04.356997  5958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5757f55132b747db98400dba7b8056df"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:36000
I20260620 13:56:04.357950  5958 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:04.358340  5958 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:04.366732  5958 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:04.368736  5958 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:04.370827  7549 raft_consensus.cc:993] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47: : Instructing follower 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:56:04.371932  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:04.372108  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:04.372462  5881 raft_consensus.cc:3055] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:04.372722  5881 raft_consensus.cc:740] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:04.372740  6030 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:04.373298  5881 consensus_queue.cc:260] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:04.376013  5881 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:04.379421  7503 raft_consensus.cc:1081] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Signalling peer 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:56:04.384261  5881 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:04.387427  5880 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:58456
I20260620 13:56:04.387989  5880 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:04.388320  5880 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:04.381675  6030 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:04.396332  5880 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:04.398051  5880 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:04.400909  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:04.401209  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:04.401489  5952 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:04.401764  6030 raft_consensus.cc:3055] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:04.402508  6030 raft_consensus.cc:740] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:04.401916  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:04.403782  7542 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:04.404874  7542 raft_consensus.cc:697] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:04.405748  7542 consensus_queue.cc:237] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:04.410065  6030 consensus_queue.cc:260] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:04.413476  6030 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:04.414844  5952 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:04.416316  5848 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:04.417161  7524 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:04.417665  7524 raft_consensus.cc:697] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:04.418514  7524 consensus_queue.cc:237] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:04.431383  6030 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:04.437517  5778 catalog_manager.cc:5696] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 3, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:04.442955  5777 catalog_manager.cc:5696] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 2 to 3, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 3 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:04.522996  7542 raft_consensus.cc:993] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: : Instructing follower b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:56:04.523547  7516 raft_consensus.cc:1081] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:56:04.524991  6584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:46864
I20260620 13:56:04.525581  6584 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:04.526039  6584 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:04.532119  6584 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:04.534597  6584 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:04.536597  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:04.536826  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:04.537618  5881 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:04.537176  5952 raft_consensus.cc:3055] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:04.538290  5952 raft_consensus.cc:740] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:04.543666  5881 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:04.543458  5952 consensus_queue.cc:260] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:04.544709  5952 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:04.544934  6552 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:04.545686  7521 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:04.546069  7521 raft_consensus.cc:697] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:04.546833  7521 consensus_queue.cc:237] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:04.549928  5952 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:04.561748  5777 catalog_manager.cc:5696] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 2 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:04.795524  6031 raft_consensus.cc:1275] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:04.797320  7516 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:56:04.816334  5881 raft_consensus.cc:1275] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:04.817878  7455 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:56:04.859632  5958 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:04.861671  7536 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:56:04.872548  6031 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:04.874055  7535 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:56:04.996959  5958 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:04.998545  7521 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:05.034473  5880 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:05.041767  7531 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:05.207494  5880 consensus_queue.cc:237] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
W20260620 13:56:05.214586  5849 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 020dbb4b944d4deeba944d1a7c6d5c76. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:56:05.216969  6030 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:56:05.217530  5958 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:56:05.218091  7524 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:56:05.218922  7535 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:56:05.228229  7524 raft_consensus.cc:2955] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:05.229736  6030 raft_consensus.cc:2955] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:05.236115  5958 raft_consensus.cc:2955] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:05.246536  5778 catalog_manager.cc:5696] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:05.247671  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:05.263543  6030 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:05.274922  5958 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260620 13:56:05.275638  5998 consensus_peers.cc:597] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 24c27735bbb449a98fab7edad2ba9837. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:56:05.275957  5880 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260620 13:56:05.276693  7503 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:05.277657  7553 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:05.295557  7545 raft_consensus.cc:2955] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:05.307610  5881 raft_consensus.cc:2955] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:05.312469  5958 raft_consensus.cc:2955] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:05.317517  5876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:56:05.318156  5876 raft_consensus.cc:606] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:56:05.328236  5952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:56:05.328892  5952 raft_consensus.cc:606] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Received request to transfer leadership to TS 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:05.332080  6030 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:05.332803  5777 catalog_manager.cc:5696] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index -1 to 4, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 3 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:05.343367  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260620 13:56:05.345049  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:56:05.345870  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260620 13:56:05.358530  5998 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 923bfc4f20d94a57b0d84d45e40b12ae. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:56:05.360373  5958 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260620 13:56:05.362421  7549 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:56:05.380244  7503 raft_consensus.cc:2955] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:05.388567  5880 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260620 13:56:05.390069  7549 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:05.401733  6031 consensus_queue.cc:237] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:05.402171  5880 raft_consensus.cc:2955] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:05.404371  5952 raft_consensus.cc:2955] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
W20260620 13:56:05.419842  5998 consensus_peers.cc:597] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 29e2284e793941b4aa9829a72313998c. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:56:05.423794  5958 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:56:05.425206  7545 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:56:05.426312  5880 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 13:56:05.427628  5777 catalog_manager.cc:5696] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 reported cstate change: config changed from index -1 to 3, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:05.429332  7545 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:56:05.439703  7545 raft_consensus.cc:2955] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:05.441545  5958 raft_consensus.cc:2955] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:05.461601  5881 raft_consensus.cc:2955] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:56:05.494042  7542 raft_consensus.cc:993] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: : Instructing follower 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:56:05.494702  7455 raft_consensus.cc:1081] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Signalling peer 663684cf4ae54c929bf8240ca0b63a47 to start an election
I20260620 13:56:05.482918  5778 catalog_manager.cc:5696] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index -1 to 2, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:05.496908  6031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:43488
I20260620 13:56:05.497406  6031 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:05.497771  6031 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:05.508949  6031 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:05.511978  6031 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:05.512359  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:05.513087  5958 raft_consensus.cc:3055] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:05.513236  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:05.513432  5958 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:05.513666  6584 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:05.514222  5958 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:05.515337  5958 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:05.518651  6584 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:05.519748  5998 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:05.521040  7578 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:05.521899  7578 raft_consensus.cc:697] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:05.522910  7578 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:05.525313  5958 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:05.546422  5777 catalog_manager.cc:5696] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:05.626796  7582 ts_tablet_manager.cc:933] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:56:05.636691  7582 tablet_copy_client.cc:323] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.193:46177
I20260620 13:56:05.638779  5894 tablet_copy_service.cc:140] P 2e82c0c231624695ac5a813230bf5038: Received BeginTabletCopySession request for tablet 020dbb4b944d4deeba944d1a7c6d5c76 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:42748)
I20260620 13:56:05.639478  5894 tablet_copy_service.cc:161] P 2e82c0c231624695ac5a813230bf5038: Beginning new tablet copy session on tablet 020dbb4b944d4deeba944d1a7c6d5c76 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:42748: session id = b0ce39342d8c4a64904b30b98de02b9f-020dbb4b944d4deeba944d1a7c6d5c76
I20260620 13:56:05.649194  5894 tablet_copy_source_session.cc:215] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:56:05.652833  7582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 020dbb4b944d4deeba944d1a7c6d5c76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:56:05.667637  7582 tablet_copy_client.cc:806] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:56:05.668228  7582 tablet_copy_client.cc:670] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:56:05.672478  7582 tablet_copy_client.cc:538] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:56:05.681885  7582 tablet_bootstrap.cc:492] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:56:05.724849  7582 tablet_bootstrap.cc:492] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:56:05.725831  7582 tablet_bootstrap.cc:492] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:56:05.726581  7582 ts_tablet_manager.cc:1403] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.045s	user 0.037s	sys 0.004s
I20260620 13:56:05.729799  7582 raft_consensus.cc:359] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:05.731503  7582 raft_consensus.cc:740] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:56:05.732164  7582 consensus_queue.cc:260] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:05.753834  7582 ts_tablet_manager.cc:1434] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.004s
I20260620 13:56:05.760404  7585 ts_tablet_manager.cc:933] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:05.763469  5894 tablet_copy_service.cc:342] P 2e82c0c231624695ac5a813230bf5038: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-020dbb4b944d4deeba944d1a7c6d5c76 received from {username='slave'} at 127.0.0.1:42748
I20260620 13:56:05.764139  5894 tablet_copy_service.cc:434] P 2e82c0c231624695ac5a813230bf5038: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-020dbb4b944d4deeba944d1a7c6d5c76 on tablet 020dbb4b944d4deeba944d1a7c6d5c76 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:05.764577  7585 tablet_copy_client.cc:323] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.195:41493
I20260620 13:56:05.766844  6043 tablet_copy_service.cc:140] P 663684cf4ae54c929bf8240ca0b63a47: Received BeginTabletCopySession request for tablet 24c27735bbb449a98fab7edad2ba9837 from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:46758)
I20260620 13:56:05.767405  6043 tablet_copy_service.cc:161] P 663684cf4ae54c929bf8240ca0b63a47: Beginning new tablet copy session on tablet 24c27735bbb449a98fab7edad2ba9837 from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:46758: session id = b0ce39342d8c4a64904b30b98de02b9f-24c27735bbb449a98fab7edad2ba9837
I20260620 13:56:05.784401  7535 raft_consensus.cc:993] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: : Instructing follower 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:56:05.784960  7535 raft_consensus.cc:1081] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Signalling peer 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:56:05.787181  5958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:36000
I20260620 13:56:05.787704  5958 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:05.788043  5958 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:05.797658  5958 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:05.797773  6043 tablet_copy_source_session.cc:215] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:56:05.799633  5958 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:05.801072  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:05.801141  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:05.801885  6030 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:05.801913  5880 raft_consensus.cc:3055] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:05.802424  7585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c27735bbb449a98fab7edad2ba9837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:56:05.802378  5880 raft_consensus.cc:740] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:05.803278  5880 consensus_queue.cc:260] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:05.804486  5880 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:05.812031  6030 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:05.812345  5880 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:05.814039  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:05.814729  7455 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:05.815243  7455 raft_consensus.cc:697] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:05.816123  7455 consensus_queue.cc:237] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:05.822566  7582 ts_tablet_manager.cc:933] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:05.832885  7585 tablet_copy_client.cc:806] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:56:05.833590  7585 tablet_copy_client.cc:670] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:56:05.837963  7585 tablet_copy_client.cc:538] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:56:05.839586  5777 catalog_manager.cc:5696] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 3, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:05.848985  7582 tablet_copy_client.cc:323] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.195:41493
I20260620 13:56:05.849538  7585 tablet_bootstrap.cc:492] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:56:05.850682  6043 tablet_copy_service.cc:140] P 663684cf4ae54c929bf8240ca0b63a47: Received BeginTabletCopySession request for tablet 923bfc4f20d94a57b0d84d45e40b12ae from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:46758)
I20260620 13:56:05.851349  6043 tablet_copy_service.cc:161] P 663684cf4ae54c929bf8240ca0b63a47: Beginning new tablet copy session on tablet 923bfc4f20d94a57b0d84d45e40b12ae from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:46758: session id = b0ce39342d8c4a64904b30b98de02b9f-923bfc4f20d94a57b0d84d45e40b12ae
I20260620 13:56:05.863092  6043 tablet_copy_source_session.cc:215] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:56:05.866281  7582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923bfc4f20d94a57b0d84d45e40b12ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:56:05.887066  7582 tablet_copy_client.cc:806] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:56:05.887676  7582 tablet_copy_client.cc:670] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:56:05.892940  7585 tablet_bootstrap.cc:492] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:56:05.893985  7585 tablet_bootstrap.cc:492] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:56:05.894724  7582 tablet_copy_client.cc:538] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:56:05.895869  7585 ts_tablet_manager.cc:1403] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.047s	user 0.034s	sys 0.000s
I20260620 13:56:05.899674  7585 raft_consensus.cc:359] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:05.900621  7585 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:56:05.901342  7585 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:05.905385  7585 ts_tablet_manager.cc:1434] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260620 13:56:05.907361  6043 tablet_copy_service.cc:342] P 663684cf4ae54c929bf8240ca0b63a47: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-24c27735bbb449a98fab7edad2ba9837 received from {username='slave'} at 127.0.0.1:46758
I20260620 13:56:05.907843  6043 tablet_copy_service.cc:434] P 663684cf4ae54c929bf8240ca0b63a47: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-24c27735bbb449a98fab7edad2ba9837 on tablet 24c27735bbb449a98fab7edad2ba9837 with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:05.917233  7582 tablet_bootstrap.cc:492] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:56:05.936081  5952 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:05.937626  7578 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:05.942790  7582 tablet_bootstrap.cc:492] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:56:05.943871  7582 tablet_bootstrap.cc:492] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:56:05.944809  7582 ts_tablet_manager.cc:1403] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.001s
I20260620 13:56:05.949329  7582 raft_consensus.cc:359] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:05.950788  7582 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:56:05.952244  7582 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:05.954767  7582 ts_tablet_manager.cc:1434] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260620 13:56:05.960038  6043 tablet_copy_service.cc:342] P 663684cf4ae54c929bf8240ca0b63a47: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-923bfc4f20d94a57b0d84d45e40b12ae received from {username='slave'} at 127.0.0.1:46758
I20260620 13:56:05.960556  6043 tablet_copy_service.cc:434] P 663684cf4ae54c929bf8240ca0b63a47: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-923bfc4f20d94a57b0d84d45e40b12ae on tablet 923bfc4f20d94a57b0d84d45e40b12ae with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:05.968273  6585 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:05.971766  7553 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:06.117267  7582 ts_tablet_manager.cc:933] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:06.134485  7582 tablet_copy_client.cc:323] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.195:41493
I20260620 13:56:06.145833  6043 tablet_copy_service.cc:140] P 663684cf4ae54c929bf8240ca0b63a47: Received BeginTabletCopySession request for tablet 29e2284e793941b4aa9829a72313998c from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:46758)
I20260620 13:56:06.146420  6043 tablet_copy_service.cc:161] P 663684cf4ae54c929bf8240ca0b63a47: Beginning new tablet copy session on tablet 29e2284e793941b4aa9829a72313998c from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:46758: session id = b0ce39342d8c4a64904b30b98de02b9f-29e2284e793941b4aa9829a72313998c
I20260620 13:56:06.160106  6043 tablet_copy_source_session.cc:215] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:56:06.170219  6585 raft_consensus.cc:1217] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:56:06.186560  7582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e2284e793941b4aa9829a72313998c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:56:06.199244  6585 raft_consensus.cc:1217] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260620 13:56:06.214964  7582 tablet_copy_client.cc:806] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:56:06.215607  7582 tablet_copy_client.cc:670] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:56:06.284343  7582 tablet_copy_client.cc:538] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:56:06.317222  7582 tablet_bootstrap.cc:492] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:56:06.347695  6584 raft_consensus.cc:1217] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260620 13:56:06.379251  7582 tablet_bootstrap.cc:492] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:56:06.380321  7582 tablet_bootstrap.cc:492] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:56:06.381065  7582 ts_tablet_manager.cc:1403] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 0.064s	user 0.026s	sys 0.027s
I20260620 13:56:06.384451  7582 raft_consensus.cc:359] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:06.385820  7582 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:56:06.387522  7582 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:06.392040  7582 ts_tablet_manager.cc:1434] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.004s
I20260620 13:56:06.393997  6043 tablet_copy_service.cc:342] P 663684cf4ae54c929bf8240ca0b63a47: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-29e2284e793941b4aa9829a72313998c received from {username='slave'} at 127.0.0.1:46758
I20260620 13:56:06.394604  6043 tablet_copy_service.cc:434] P 663684cf4ae54c929bf8240ca0b63a47: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-29e2284e793941b4aa9829a72313998c on tablet 29e2284e793941b4aa9829a72313998c with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:06.421046  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:06.421936  6029 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:06.433779  5881 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:06.437009  7596 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:06.445586  7605 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260620 13:56:06.561050  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 73879.6us
W20260620 13:56:06.661540  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 141805us
I20260620 13:56:06.664850  6585 raft_consensus.cc:1217] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260620 13:56:06.666014  7603 raft_consensus.cc:1064] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:56:06.674487  7603 consensus_queue.cc:237] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:06.729108  6028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:56:06.729907  6028 raft_consensus.cc:606] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:56:06.764487  5952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:56:06.765177  5952 raft_consensus.cc:606] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:06.795189  6029 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:56:06.801994  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260620 13:56:06.805794  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:56:06.807842  6581 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:56:06.807789  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:06.818753  7609 raft_consensus.cc:1064] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
W20260620 13:56:06.819665  7609 raft_consensus.cc:1068] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: Unable to promote non-voter b0ce39342d8c4a64904b30b98de02b9f: Service unavailable: leader transfer in progress
I20260620 13:56:06.834532  7601 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:06.835687  7603 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:07.773690  7618 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:07.774518  7618 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:07.777904  7618 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:07.785104  7618 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:07.785996  7618 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:07.789767  7618 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:07.877233  5812 debug-util.cc:398] Leaking SignalData structure 0x7b08000349a0 after lost signal to thread 4722
I20260620 13:56:08.015230  7618 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.015861  7618 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.018028  7618 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.020915  7618 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.023517  7618 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.025678  7618 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.038873  7621 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.039822  7621 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.040872  7622 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.041471  7622 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.042639  7621 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.046064  7624 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.046511  7625 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.046742  7621 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.047189  7625 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.047688  7621 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.049368  7622 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.049531  7625 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.050179  7621 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.050871  7622 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.051438  7622 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.046761  7624 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.053604  7626 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.053781  7622 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.054265  7624 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.063438  7626 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:08.067374  7626 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.071416  7620 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.072324  7626 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.072116  7620 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.073350  7623 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.073040  7626 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:08.073997  7623 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.083225  7626 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.084208  7626 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.084903  7621 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.074654  7620 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.084782  7626 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.083177  7629 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.088071  7503 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.088516  7629 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.088814  7503 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.085475  7621 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.094074  7629 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.096565  7621 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.100904  7621 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.101763  7621 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.103713  7625 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.103955  7621 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.087602  7626 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.105224  7626 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.076300  7623 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.105353  7633 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.108376  7503 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.110167  7521 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.105192  7625 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.110828  7521 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.113344  7625 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.113440  7521 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.105875  7626 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.085996  7620 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.114521  7620 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:08.115664  7626 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.104418  7627 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.116587  7627 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.108876  7633 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.117117  7620 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.119057  7627 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.123271  7601 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.128924  7601 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.129650  5952 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:56:08.124228  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.130370  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.130916  6025 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:56:08.124967  7610 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.125196  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.131719  7601 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.126057  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.127858  7626 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.132861  7626 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.135221  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.135299  7626 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.136706  7610 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.138954  7610 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.140565  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.141674  5849 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:08.142627  7603 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.148960  7605 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.153337  7521 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.153654  7605 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.140846  7633 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.153916  7521 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.155191  7601 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:08.155640  7601 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.153388  7603 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.156041  7601 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:08.156805  7605 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.149535  7611 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.150285  7553 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.157624  7611 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.157795  7603 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.158916  7521 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.161916  7611 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.163738  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.165539  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.160399  5778 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56594 (request call id 324) took 1346 ms. Trace:
I20260620 13:56:08.169463  5778 rpcz_store.cc:276] 0620 13:56:06.813740 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:06.830313 (+ 16573us) service_pool.cc:224] Handling call
0620 13:56:08.160194 (+1329881us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166774,"reported_tablets":1}
I20260620 13:56:08.160197  7553 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.172694  7553 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.165534  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.160157  7625 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.174767  7625 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.177090  7625 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.162788  7616 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.177855  7616 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.180644  7616 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.180882  7622 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.184878  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.222275  7608 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.190719  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.191473  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.222842  7608 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.223426  6031 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:08.227242  7608 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.229969  7622 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.234130  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.193187  7603 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.235661  7603 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.238339  7603 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.238832  7603 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.194242  7597 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.260802  7597 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.194746  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.263406  5880 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:08.263684  7605 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.264418  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.264320  7605 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.265771  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.266535  7605 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.196736  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.267021  7644 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.198173  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:08.198539  5812 debug-util.cc:398] Leaking SignalData structure 0x7b0800035080 after lost signal to thread 5815
I20260620 13:56:08.199290  7637 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.205575  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.205818  5779 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56624 (request call id 335) took 1425 ms. Trace:
I20260620 13:56:08.206240  7521 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.207158  7619 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.207588  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.208350  7598 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.208458  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.208880  7618 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.212510  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.214092  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.219393  7524 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.219841  7634 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.168377  7623 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.220196  7553 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.220878  7631 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.221405  7610 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.231810  6030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 1683) took 1392 ms. Trace:
I20260620 13:56:08.289376  6030 rpcz_store.cc:276] 0620 13:56:06.838840 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:06.838962 (+   122us) service_pool.cc:224] Handling call
0620 13:56:06.840788 (+  1826us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:06.841267 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:06.841300 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:08.060889 (+1219589us) log.cc:844] Serialized 564 byte log entry
0620 13:56:08.152494 (+ 91605us) raft_consensus.cc:1645] Marking committed up to 2
0620 13:56:08.152536 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:08.152609 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:08.231380 (+ 78771us) raft_consensus.cc:1685] finished
0620 13:56:08.231409 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:08.231596 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":91273,"threads_started":1,"wal-append.queue_time_us":90566}
I20260620 13:56:08.290426  7455 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.290585  7645 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.271153  7597 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.291044  7455 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.231704  7620 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.273047  7626 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.278864  7619 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.193691  7616 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.242769  7578 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.243716  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.245254  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.243381  7641 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.303658  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.304363  7623 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.304826  7608 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.305425  7608 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.308068  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.308972  7608 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.309351  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.287792  7618 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.310555  7578 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.311641  7618 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.250156  7516 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.312342  7516 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:08.312865  7578 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.313391  7616 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.314461  7516 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:08.250634  5848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.411s	user 0.014s	sys 0.003s
I20260620 13:56:08.253209  7640 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.253904  7599 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.255029  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.317420  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.256472  7627 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.257077  7596 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.296629  7610 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.257562  7633 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.191668  7601 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.272995  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.277523  7636 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.278263  7643 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.268424  7605 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.272502  5779 rpcz_store.cc:276] 0620 13:56:06.780832 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:06.781045 (+   213us) service_pool.cc:224] Handling call
0620 13:56:08.205583 (+1424538us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":204431,"reported_tablets":1}
I20260620 13:56:08.268640  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:08.271955  5812 debug-util.cc:398] Leaking SignalData structure 0x7b080023d300 after lost signal to thread 5908
I20260620 13:56:08.268827  7622 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.295604  7626 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.272255  7642 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.320294  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.306795  7623 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.269582  7638 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:08.322932  5848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.484s	user 0.015s	sys 0.004s
I20260620 13:56:08.318616  7627 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.295521  7620 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.327803  7455 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.291356  7553 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.332029  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:08.334756  5812 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc100 after lost signal to thread 5909
I20260620 13:56:08.272089  7603 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.315615  7616 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.331079  6585 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:08.276473  7521 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.339375  5881 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 2: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:08.267702  7644 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.291922  7524 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.315765  7599 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.315694  7640 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.348706  7642 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.318739  7596 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.335821  7516 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.366623  7622 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.320104  7645 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.338658  7629 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.403131  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.368609  7503 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.404114  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.339654  7618 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.303485  7641 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.382670  7455 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.381096  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.405898  6581 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:56:08.334699  7605 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.310057  7631 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.334272  7633 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.389364  5877 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:08.402107  5876 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:08.402261  5883 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 1.
I20260620 13:56:08.405766  7455 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.279844  7598 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.403126  7516 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.408985  7535 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.408978  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.410151  7610 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.296401  7634 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.430871  7455 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:08.404623  5812 debug-util.cc:398] Leaking SignalData structure 0x7b080031e140 after lost signal to thread 5983
I20260620 13:56:08.415871  7635 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.389954  5875 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:08.416401  7628 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.271287  7637 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.410197  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.411903  7597 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.429450  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.421427  7618 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.430354  7516 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.425623  6026 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:56:08.406772  7622 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.432876  7535 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.444674  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.449704  5879 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:56:08.443750  6581 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
W20260620 13:56:08.436489  5812 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6600 after lost signal to thread 5984
I20260620 13:56:08.418164  7629 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.411446  7503 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.457718  5884 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:08.432176  7619 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.345386  7643 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.467648  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.470345  7627 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.476228  7618 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.476711  7535 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.339749  7636 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:08.485834  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 44071.6us
I20260620 13:56:08.471846  7605 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.386101  7638 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.462677  7516 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.496526  7633 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.496703  7642 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.498406  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.501307  7645 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.501399  7640 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.471886  7641 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.510041  5849 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:08.500382  6552 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:08.440436  7635 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.518245  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:08.523403  6031 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:08.520645  7636 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.525480  7553 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.440554  7628 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.500195  7601 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.527222  7622 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.516670  7642 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:08.465200  7597 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.533267  5998 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:08.497718  7627 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.526464  7599 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:08.504462  5812 debug-util.cc:398] Leaking SignalData structure 0x7b08001ed620 after lost signal to thread 6057
I20260620 13:56:08.546299  7651 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.549700  7629 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.550573  7603 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.522662  7626 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.523821  7640 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:08.552044  6552 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:08.522169  7516 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:08.556397  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 113919us
I20260620 13:56:08.542300  7521 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:56:08.558943  7622 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:08.571406  7628 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.552907  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:08.551865  7642 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.569432  7644 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.561503  7524 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.561156  7638 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.576205  7646 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:08.588721  5998 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:08.589433  7608 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:08.587826  6552 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:08.589838  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:08.600119  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:08.602159  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:08.574241  7640 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.608641  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.607079  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.585353  7642 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:08.584455  7622 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.595268  7608 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.609849  7644 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:08.589872  7597 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.591629  7628 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:08.564774  7627 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.612982  5998 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:08.608604  5812 debug-util.cc:398] Leaking SignalData structure 0x7b08002e1cc0 after lost signal to thread 6611
I20260620 13:56:08.628264  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.610548  7640 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:08.575371  7651 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.609961  7636 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:08.610411  7645 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:08.613973  7633 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:08.617658  7622 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:08.617136  7624 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:08.624827  7644 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.747012  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.747282  7624 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.731226  7631 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.732345  7637 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.598598  7596 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.624835  7608 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:08.612746  7643 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.607038  7646 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.748829  7646 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:08.703753  7611 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:08.747766  7624 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:08.747362  7644 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:08.745115  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.751190  6031 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:08.706209  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.757877  6033 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:08.745617  7598 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.756395  6582 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:56:08.767354  5878 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
W20260620 13:56:08.768743  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 160514us
I20260620 13:56:08.744648  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.754350  7611 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.776604  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:08.767177  5812 debug-util.cc:398] Leaking SignalData structure 0x7b0800323460 after lost signal to thread 7604
I20260620 13:56:08.780534  7651 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.706480  7628 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.787000  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.787952  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.789074  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.789153  7516 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.785775  7611 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:08.789913  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.799319  5882 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 1.
I20260620 13:56:08.781221  7627 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.791158  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.796738  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.798041  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.800212  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:08.839386  5958 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 1.
I20260620 13:56:08.801482  7651 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.803758  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.804382  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.810216  7640 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.811456  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.846094  7651 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.821547  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:08.823477  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:08.859398  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.824258  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.863592  6580 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:08.864255  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.865101  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.866318  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.824961  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.828104  7628 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.777350  7601 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260620 13:56:08.829341  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.831579  7503 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.832686  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:08.833142  7620 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.833711  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:08.879424  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.834580  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.826835  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.835780  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.818908  7624 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.853101  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.869438  5957 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:08.873287  7627 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:08.883510  7627 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.883716  7635 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.884765  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.873404  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.873420  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.879920  5953 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:08.882961  7651 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.887895  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.903748  5849 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:08.880170  6029 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:56:08.886042  7634 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.888908  7627 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.906708  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.902905  5998 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:08.889150  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.900348  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.908243  6582 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:56:08.904619  5881 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:08.904282  6033 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:08.901185  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.909446  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.913990  6581 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:56:08.914392  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.915652  6032 raft_consensus.cc:2393] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:08.910235  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.917182  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:08.917873  5958 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:08.802935  7608 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.909183  7628 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.907871  7616 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:08.919775  7628 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.922307  7628 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:08.922439  7646 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.923408  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.932801  7646 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.918807  7553 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:08.933576  7553 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:08.933650  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.934015  7553 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:08.942344  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.942822  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:08.942975  6587 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:08.943567  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.944116  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:08.944725  5955 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:08.942209  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.950678  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.950680  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.951421  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.918787  7635 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.963567  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.967499  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.970168  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.968271  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.931555  7616 raft_consensus.cc:697] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:08.974391  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:08.975154  5950 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:08.976086  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.976105  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.980216  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.980688  7640 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:08.981982  7624 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.982878  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.983381  7624 raft_consensus.cc:1064] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:56:08.983568  7611 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.984745  6031 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:08.985776  7622 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.985673  7624 consensus_queue.cc:237] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:08.988178  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:08.989321  6026 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:08.971374  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:08.946738  7628 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:08.993510  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.999847  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:08.996917  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:08.979005  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:09.006722  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.007772  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.005903  7608 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:09.002318  7628 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:08.977319  7642 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:09.011409  7628 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:09.006453  5998 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:08.992271  7616 consensus_queue.cc:237] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:09.019441  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.019795  7608 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:08.992822  7611 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:08.997238  7635 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:09.036746  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:09.037966  7635 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:09.022588  7642 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:09.036545  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.024667  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.020275  7608 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:09.028373  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.029132  7622 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:09.030141  7578 raft_consensus.cc:1064] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:56:09.030418  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:09.052767  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.030712  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:09.030812  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:09.034379  6031 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:09.035365  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:09.012665  7625 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:09.041270  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.042946  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:09.044337  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:09.043557  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.049345  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:09.051795  7657 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.062726  7578 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:09.065347  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.066219  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.055593  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:09.056787  6552 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:09.067219  7623 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:09.067667  7623 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:09.068094  7623 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:09.068429  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.050402  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.055528  7625 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:09.060004  6026 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 2: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:09.050293  7608 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:09.071574  5998 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:09.073544  5849 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:09.075599  7603 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:09.076218  7603 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:09.078709  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.076802  7603 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:09.073751  7610 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:09.072263  7643 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:09.083504  7610 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:09.083714  7643 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:09.085250  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.091553  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.072321  7625 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:09.084009  7610 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:09.087276  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.051301  7553 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:09.087293  7643 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:09.104436  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.108904  5849 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:09.084427  7644 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:09.105022  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.153529  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.282601  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:09.233942  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.196045  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.171257  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:09.295630  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.198982  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:09.201529  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.300951  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.301620  7627 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:09.302080  7627 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:09.227485  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.302573  7627 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:09.206092  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.097220  7611 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:09.184945  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.201838  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.303390  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.217202  6028 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:09.128778  5849 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:09.239411  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.214397  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.113544  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.218436  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.183866  7622 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.307335  7634 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:09.309803  7634 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:09.310072  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.311393  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.156754  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.141156  6026 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:09.239954  7553 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:09.110260  7620 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.318156  7625 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:09.322187  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.322081  7623 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:09.317979  7616 raft_consensus.cc:2955] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:09.324493  7623 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:09.326046  6580 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:09.327224  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:09.305877  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 177192us
I20260620 13:56:09.314291  7516 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.315315  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:09.323727  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.310266  7634 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:09.334378  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 249181us
I20260620 13:56:09.329072  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.279223  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.330797  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.307277  7611 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:09.339293  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.341964  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.337575  7620 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.343952  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.340667  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.332267  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:09.335434  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.196557  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.344046  7646 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.260739  7608 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:09.337368  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.286437  7603 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:09.333739  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:09.143592  7637 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:09.349676  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.357797  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:09.359067  6583 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 1 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:56:09.359876  6581 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:56:09.368041  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.342856  7611 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:09.372649  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.373596  6026 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:09.379732  7638 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.392198  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.386226  7627 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:09.365381  7503 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.341305  7648 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:09.394610  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:09.362301  7635 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:09.405722  7635 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:09.406240  7635 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:09.387799  5778 catalog_manager.cc:5696] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:09.349797  7598 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:09.413167  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:09.397715  5998 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.401755  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:09.393662  7624 raft_consensus.cc:1064] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:56:09.371745  7637 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:09.419773  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:09.392824  7651 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:09.412460  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.424705  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.399071  7646 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 13:56:09.464255  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 107450us
I20260620 13:56:09.414392  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:09.424041  7603 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:09.420739  7622 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:09.420650  7637 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:09.421446  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.497920  7628 consensus_queue.cc:1059] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:56:09.502557  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:09.503716  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.505615  7644 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:09.507220  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.507745  7610 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:09.508410  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.510030  7610 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:09.510063  6031 raft_consensus.cc:1240] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:09.509521  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:09.505089  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:09.521399  5955 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:56:09.522809  7625 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:09.537634  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 61905.4us
I20260620 13:56:09.537760  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:09.542021  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:09.526387  6025 raft_consensus.cc:2955] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:09.553704  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:09.554129  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 57307.4us
I20260620 13:56:09.514061  7643 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:09.556818  5883 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 2: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:09.557171  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:09.557880  5997 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:09.559125  5881 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260620 13:56:09.566231  5997 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:09.564343  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:09.568205  7643 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:09.549523  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:09.562819  7608 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:09.570266  7624 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:09.571007  7608 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:09.571482  7608 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:09.571866  7608 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:09.572939  7635 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:09.561617  5848 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.577176  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:09.577329  7627 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:09.560420  7610 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.579873  7635 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:09.582211  5997 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.584151  5848 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.575639  7625 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:09.580543  7673 consensus_queue.cc:1059] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260620 13:56:09.595427  7625 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:09.595916  7625 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:09.586333  7503 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.596216  7673 raft_consensus.cc:3055] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:09.586064  7670 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.596695  7673 raft_consensus.cc:740] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:09.606190  7611 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:09.608721  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:09.608843  7611 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:09.593549  7631 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:09.612633  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:09.613440  5997 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.615468  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:09.610198  7673 consensus_queue.cc:260] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:09.637485  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 50406.6us
I20260620 13:56:09.640130  5997 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:09.640336  5848 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.644295  7631 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.641474  5997 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:09.645835  7610 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:09.646047  5848 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.647240  7631 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:09.646991  7637 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:09.653913  5997 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:09.656023  7666 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:09.656358  7659 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:09.632767  7611 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:09.670969  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:09.672912  7637 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:09.683416  5848 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.689579  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:09.698629  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 49656us
I20260620 13:56:09.698520  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:09.702509  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:09.684680  7634 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:09.705826  7625 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:09.716632  5848 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.721403  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.721978  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:09.714018  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:09.723599  5848 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.724617  7681 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:09.724803  7679 log.cc:927] Time spent T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.095s	user 0.001s	sys 0.002s
I20260620 13:56:09.725703  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:09.727593  7637 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:09.731477  7634 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:09.704247  7680 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:09.712391  7608 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:09.738114  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.722138  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.733038  5848 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.735598  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:09.735085  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:09.714612  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 159562us
I20260620 13:56:09.751579  5848 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.752483  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.752933  5848 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.696146  5997 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:09.713081  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:09.738229  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.746951  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:09.754997  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 99213.5us
W20260620 13:56:09.757694  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 167481us
I20260620 13:56:09.759683  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:09.762650  5848 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.763446  7683 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.770593  7611 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:56:09.772554  7680 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.764183  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.776604  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:09.778112  7673 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:09.754124  7672 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.783800  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:09.785255  7625 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:09.785787  7628 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:09.786526  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:09.787176  7608 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:09.764562  7637 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:56:09.787889  7631 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.788668  7685 consensus_queue.cc:1059] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:56:09.789129  7681 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:09.783262  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.755771  7667 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:09.791242  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:09.791616  6026 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:09.792006  6581 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:09.761081  7634 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.793506  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:09.796376  6026 raft_consensus.cc:1240] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:09.800266  7674 raft_consensus.cc:3055] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:09.800858  7674 raft_consensus.cc:740] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:09.801707  7674 consensus_queue.cc:260] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:09.807312  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:09.769907  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:09.812786  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:09.814091  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:09.814972  6026 raft_consensus.cc:2393] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:09.818823  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:09.768909  5848 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.824378  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:09.824900  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 56085.6us
I20260620 13:56:09.825186  5998 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:09.826409  5998 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:09.786530  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:09.827775  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:09.829192  7685 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:09.829789  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:09.831226  7553 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:09.838613  7686 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:09.827888  7683 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:09.839749  6581 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260620 13:56:09.840600  7503 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:56:09.802949  7674 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:09.785151  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:09.842131  5998 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:56:09.843078  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 125367us
I20260620 13:56:09.845086  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.846799  5924 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.847977  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.848373  5998 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:09.835057  7611 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:09.852708  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.849867  7503 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.849537  7516 consensus_queue.cc:1059] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260620 13:56:09.858595  7678 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.854419  7608 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:09.858121  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.851949  7635 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.854177  7676 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.855075  7685 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:09.869231  5876 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:09.861013  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:09.867343  5884 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260620 13:56:09.869894  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:09.868950  5883 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:56:09.864421  7688 consensus_queue.cc:1059] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260620 13:56:09.868162  7651 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:09.854933  7670 consensus_queue.cc:1059] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260620 13:56:09.863502  7631 consensus_queue.cc:1059] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260620 13:56:09.868939  7678 consensus_queue.cc:1059] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260620 13:56:09.845903  7683 consensus_queue.cc:1059] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260620 13:56:09.873947  7608 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.874980  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:09.933719  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:09.874620  7669 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260620 13:56:09.938185  7683 raft_consensus.cc:3055] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:09.941277  6551 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:09.948873  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 104998us
I20260620 13:56:09.949682  6551 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:09.951344  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.919866  7553 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
W20260620 13:56:09.953442  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 79328.9us
I20260620 13:56:09.953837  7644 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:09.956811  6551 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:09.957931  5998 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:09.931399  7667 consensus_queue.cc:1059] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260620 13:56:09.944335  7683 raft_consensus.cc:740] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:09.955402  7688 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:09.959136  7648 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:09.983275  7625 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:09.983593  7665 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.109s
I20260620 13:56:09.962071  7644 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:09.986544  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 131881us
I20260620 13:56:09.988291  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.990020  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.991928  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:10.015390  5924 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:10.019748  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 63034.5us
I20260620 13:56:10.020686  6551 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:10.022053  6551 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:10.023216  6551 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:09.986433  7648 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:09.973505  7624 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260620 13:56:10.014384  7644 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:10.016606  7676 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:10.036280  7692 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:09.981877  7688 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:10.030871  7648 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:10.028402  7685 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 13:56:10.050032  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 75502.5us
I20260620 13:56:10.051159  7688 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:10.053589  7646 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260620 13:56:10.066141  7682 log.cc:927] Time spent T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.307s	user 0.003s	sys 0.004s
I20260620 13:56:10.023340  7683 consensus_queue.cc:260] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:10.066056  7693 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:10.092408  7697 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:10.080363  7696 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:10.083649  7683 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:10.111918  5877 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:10.088285  7691 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:10.136309  7642 raft_consensus.cc:3055] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:10.136570  5955 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:56:10.136783  7642 raft_consensus.cc:740] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:10.125658  7696 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:10.152642  7635 raft_consensus.cc:3055] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:10.153142  7635 raft_consensus.cc:740] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:10.153954  7635 consensus_queue.cc:260] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:10.154647  7611 raft_consensus.cc:3055] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Stepping down as leader of term 1
W20260620 13:56:10.155267  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:10.160741  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 145534us
I20260620 13:56:10.155041  7611 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:10.165202  7611 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.170979  5956 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260620 13:56:10.155030  7635 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:10.156675  7696 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:10.166550  7611 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:10.172257  7628 raft_consensus.cc:3055] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:10.185346  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:10.192009  7693 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:10.187036  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:10.200719  5997 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:56:10.202252  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 179154us
I20260620 13:56:10.182324  7628 raft_consensus.cc:740] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:10.203173  6551 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:10.179550  7516 consensus_queue.cc:1059] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260620 13:56:10.205034  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:10.207759  6551 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:10.206502  7691 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:56:10.213577  7648 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.202570  7688 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.219641  7628 consensus_queue.cc:260] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:10.221227  7628 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:10.221804  7644 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.222715  7681 raft_consensus.cc:3055] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:10.223138  7681 raft_consensus.cc:740] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:10.205886  7693 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:10.209162  7503 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260620 13:56:10.231066  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:10.234768  6030 raft_consensus.cc:1240] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:10.236505  6028 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:56:10.242368  6551 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:10.181483  7642 consensus_queue.cc:260] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.238250  7688 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:10.244832  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:10.246728  6025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:56:10.250528  6025 raft_consensus.cc:606] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:10.250929  6025 raft_consensus.cc:614] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:56:10.252280  7516 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:10.244983  7598 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:10.245527  7693 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:10.259789  7644 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:10.256237  7648 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:10.263209  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:10.264932  5924 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:10.266070  7553 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:56:10.267370  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:10.268285  7611 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:10.269202  7624 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:10.270890  6030 raft_consensus.cc:1240] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:10.265105  7693 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:10.270262  7503 raft_consensus.cc:2955] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:10.272123  7637 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:56:10.273273  7674 raft_consensus.cc:3055] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:10.273675  7674 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:10.273057  7681 consensus_queue.cc:260] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:10.274660  7681 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:10.274492  7637 consensus_queue.cc:1059] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:10.278789  7675 raft_consensus.cc:3055] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:10.279239  7675 raft_consensus.cc:740] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:10.280223  7675 consensus_queue.cc:260] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.281375  7675 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:10.274497  7674 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:10.293496  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:10.297582  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:10.299749  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:10.305763  5884 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:10.282289  7642 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:10.315719  5876 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:10.314313  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:10.315660  6029 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
W20260620 13:56:10.316215  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 73974.1us
I20260620 13:56:10.319191  6551 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:10.353770  5881 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
W20260620 13:56:10.354096  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:10.325039  5879 raft_consensus.cc:1240] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:10.354794  6028 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:10.355854  6032 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:10.286654  7611 raft_consensus.cc:697] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:10.356652  6582 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:10.357290  6551 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:10.359709  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:10.360167  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:10.361058  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:10.360863  7611 consensus_queue.cc:237] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.362231  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:10.364071  5958 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:56:10.364771  7696 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.303998  7678 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:10.358588  6551 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:10.367350  5952 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:10.367934  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:10.370186  7648 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:56:10.371670  6551 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:10.317711  7635 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:10.375252  5956 raft_consensus.cc:1240] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:10.320549  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:10.380074  6582 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:10.352473  7688 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 13:56:10.354450  7643 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:10.377696  5953 raft_consensus.cc:2955] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:10.404192  7623 raft_consensus.cc:3055] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:10.404692  7623 raft_consensus.cc:740] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:10.406421  7623 consensus_queue.cc:260] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:10.407639  5951 raft_consensus.cc:2955] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:10.409165  7623 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:10.366369  7644 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:10.415920  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:10.417124  5876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:56:10.403474  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:10.417833  5876 raft_consensus.cc:606] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:56:10.418905  6028 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:10.419335  6583 raft_consensus.cc:1240] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
W20260620 13:56:10.424203  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:10.426402  5882 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:10.371408  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:10.428591  6578 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 3: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:10.382359  7648 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:10.430421  6579 raft_consensus.cc:2955] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:10.437368  7696 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:10.449729  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:10.452303  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:10.452860  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:10.454531  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:10.456185  5998 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:10.457019  7625 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:56:10.448735  7678 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:10.458762  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260620 13:56:10.458207  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:10.463167  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:10.458640  7702 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:10.459288  7624 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:10.471935  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:56:10.473034  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:10.471189  5779 catalog_manager.cc:5696] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:10.477967  5778 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56594 (request call id 325) took 1097 ms. Trace:
I20260620 13:56:10.480741  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:10.439049  7635 consensus_queue.cc:1059] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260620 13:56:10.486091  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:10.458361  7516 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:10.466401  7685 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:10.500285  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:10.500285  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:10.512012  5998 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:10.517241  7503 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:10.518329  7702 consensus_queue.cc:1059] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:10.519575  7702 raft_consensus.cc:3055] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:10.519961  7702 raft_consensus.cc:740] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:10.521081  7553 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:56:10.521121  7702 consensus_queue.cc:260] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.522959  7702 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:10.531080  5848 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:10.480119  5778 rpcz_store.cc:276] 0620 13:56:09.380448 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:09.380648 (+   200us) service_pool.cc:224] Handling call
0620 13:56:10.477901 (+1097253us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:56:09.486328 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:56:09.487258 (+   930us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:56:09.487349 (+    91us) write_op.cc:435] Acquired schema lock
0620 13:56:09.487401 (+    52us) tablet.cc:662] Decoding operations
0620 13:56:09.487947 (+   546us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:56:09.488089 (+   142us) write_op.cc:641] Partition lock acquired for write op
0620 13:56:09.488130 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0620 13:56:09.488503 (+   373us) tablet.cc:701] Row locks acquired
0620 13:56:09.488552 (+    49us) write_op.cc:260] PREPARE: finished
0620 13:56:09.488842 (+   290us) write_op.cc:270] Start()
0620 13:56:09.489060 (+   218us) write_op.cc:276] Timestamp: P: 1781963769488756 usec, L: 0
0620 13:56:09.489117 (+    57us) op_driver.cc:348] REPLICATION: starting
0620 13:56:09.530747 (+ 41630us) log.cc:844] Serialized 541 byte log entry
0620 13:56:09.815137 (+284390us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b1800330e80. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc70abf3 00007f0fdc70cfc1 00007f0fdc70cf79 00007f0fdc70cf09 00007f0fdc70ced1 00007f0fdc70c1cd 0000000000389354 0000000000389199 00007f0fdc6ee03a
0620 13:56:09.815477 (+   340us) op_driver.cc:464] REPLICATION: finished
0620 13:56:09.939269 (+123792us) write_op.cc:301] APPLY: starting
0620 13:56:09.939413 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0620 13:56:09.939584 (+   171us) tablet.cc:1370] finished BulkCheckPresence
0620 13:56:09.939635 (+    51us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:56:09.940078 (+   443us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:56:09.940411 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 13:56:09.940530 (+   119us) write_op.cc:312] APPLY: finished
0620 13:56:09.959642 (+ 19112us) log.cc:844] Serialized 23 byte log entry
0620 13:56:09.981369 (+ 21727us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:09.986955 (+  5586us) write_op.cc:454] Released schema lock
0620 13:56:10.004351 (+ 17396us) write_op.cc:341] FINISH: Updating metrics
0620 13:56:10.047342 (+ 42991us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:10.047398 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6581,"reported_tablets":3,"spinlock_wait_cycles":30720,"child_traces":[["op",{"apply.queue_time_us":115696,"apply.run_cpu_time_us":3960,"apply.run_wall_time_us":104948,"num_ops":1,"prepare.queue_time_us":74863,"prepare.run_cpu_time_us":32259,"prepare.run_wall_time_us":109100,"raft.queue_time_us":152586,"raft.run_cpu_time_us":17612,"raft.run_wall_time_us":47361,"replication_time_us":326206,"spinlock_wait_cycles":51386752,"thread_start_us":274259,"threads_started":4,"wal-append.queue_time_us":74958}]]}
I20260620 13:56:10.548424  6586 raft_consensus.cc:1240] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:10.555554  6551 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:10.561900  6551 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:10.565840  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:10.588831  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:10.591976  6551 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:10.465780  5875 raft_consensus.cc:2955] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:10.560294  7637 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:56:10.529184  7635 consensus_queue.cc:1059] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260620 13:56:10.561183  7690 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:10.586220  7648 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:56:10.587677  7643 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 13:56:10.587234  7644 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 13:56:10.604535  7674 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:10.619601  7627 consensus_queue.cc:1059] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:56:10.600217  7698 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:10.605616  7681 consensus_queue.cc:1059] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260620 13:56:10.627444  7628 consensus_queue.cc:1059] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260620 13:56:10.645864  7628 raft_consensus.cc:3055] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:10.646317  7628 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:10.598173  7640 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260620 13:56:10.623080  7603 consensus_queue.cc:1059] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260620 13:56:10.653299  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:10.662977  7603 raft_consensus.cc:3055] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:10.663486  7603 raft_consensus.cc:740] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:10.664333  7603 consensus_queue.cc:260] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.666015  7603 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:10.667320  7627 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 13:56:10.637226  7690 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.668426  7628 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.669838  7690 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:10.671969  7673 consensus_queue.cc:1059] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260620 13:56:10.685062  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51702us
I20260620 13:56:10.669875  7628 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:10.689674  6584 raft_consensus.cc:2955] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:10.693717  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:10.695734  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 46574.3us
I20260620 13:56:10.696871  7690 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:10.704475  7702 consensus_queue.cc:1059] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:10.706816  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:10.715667  7721 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:56:10.712460  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:10.716711  7683 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:10.720052  7683 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:10.721175  5849 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:10.724520  7640 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:56:10.725574  6578 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:10.728976  7635 consensus_queue.cc:1059] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260620 13:56:10.731360  7627 raft_consensus.cc:3055] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:10.731956  7627 raft_consensus.cc:740] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:10.732939  7627 consensus_queue.cc:260] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.734283  7627 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:10.735934  7637 raft_consensus.cc:3055] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:10.736454  7637 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:10.736599  7683 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.738075  7683 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:10.706725  7718 consensus_queue.cc:1059] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260620 13:56:10.749061  7718 raft_consensus.cc:3055] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
W20260620 13:56:10.749287  7717 log.cc:927] Time spent T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260620 13:56:10.749536  7718 raft_consensus.cc:740] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:10.751080  7718 consensus_queue.cc:260] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:10.752408  7718 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:10.760164  5959 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
W20260620 13:56:10.763960  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:10.761608  6582 raft_consensus.cc:2955] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:10.774792  5882 raft_consensus.cc:2955] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:10.819722  5954 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:10.839900  7705 raft_consensus.cc:2955] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:10.829942  7620 consensus_queue.cc:1059] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260620 13:56:10.759594  7608 raft_consensus.cc:2955] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:10.869118  7692 raft_consensus.cc:3055] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:10.869685  7692 raft_consensus.cc:740] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:10.871719  7692 consensus_queue.cc:260] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.874173  7692 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:10.881201  5954 raft_consensus.cc:2955] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:10.884688  6581 raft_consensus.cc:1240] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:10.846649  5848 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:10.889310  7637 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.890743  7637 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:10.891357  7672 raft_consensus.cc:993] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: : Instructing follower 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:56:10.891861  7672 raft_consensus.cc:1081] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Signalling peer 192c750f597c43858e1ad09e8d805685 to start an election
W20260620 13:56:10.894263  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 47732.9us
I20260620 13:56:10.895560  7675 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:10.896077  7675 raft_consensus.cc:697] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:10.896373  5955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:36000
I20260620 13:56:10.897166  5955 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:10.896935  7675 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:10.897612  5955 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:10.906059  6580 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:10.929958  6579 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:10.918525  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:10.945128  5877 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:10.949970  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:10.937526  5952 raft_consensus.cc:2955] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:10.974756  6580 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:10.961263  7718 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:10.955680  7667 consensus_queue.cc:1059] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260620 13:56:10.985296  6580 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:10.989904  7667 raft_consensus.cc:3055] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:10.990489  7667 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:10.989797  7625 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:10.991413  7667 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:10.993275  7667 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:11.001998  7644 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:11.002609  7644 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.007527  7644 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
W20260620 13:56:11.007920  5951 consensus_meta.cc:287] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.003s
I20260620 13:56:10.978613  5955 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.011153  7624 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:11.012457  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:11.023727  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:11.058434  5880 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:11.027209  5876 raft_consensus.cc:2955] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:11.066483  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:11.082048  5955 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:11.064944  7625 consensus_queue.cc:1059] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260620 13:56:11.088162  7726 log.cc:927] Time spent T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260620 13:56:11.078329  7704 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:11.099210  7704 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:11.099697  7704 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:11.100303  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:11.100934  5880 raft_consensus.cc:3055] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:11.101255  5880 raft_consensus.cc:740] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:11.099395  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:11.101838  6025 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:11.092716  7624 raft_consensus.cc:3055] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:11.114358  5880 consensus_queue.cc:260] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.133524  5776 catalog_manager.cc:5696] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 4 to 5, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:11.115726  7624 raft_consensus.cc:740] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:11.135476  5776 catalog_manager.cc:5696] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 3 to 4, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:11.133572  5880 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:11.143929  5777 catalog_manager.cc:5696] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:11.135680  7624 consensus_queue.cc:260] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.156117  6025 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:11.159893  7624 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:11.161391  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:11.178467  7704 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.186345  6583 raft_consensus.cc:1240] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260620 13:56:11.188207  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:11.191187  5880 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:11.196671  7704 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:56:11.200953  6579 raft_consensus.cc:2955] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:11.210438  7665 consensus_queue.cc:1059] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:11.211414  7665 raft_consensus.cc:3055] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:11.211753  7665 raft_consensus.cc:740] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:11.212646  7665 consensus_queue.cc:260] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.213884  7665 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:11.230139  7692 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:11.242889  7692 raft_consensus.cc:697] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:11.243953  7692 consensus_queue.cc:237] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.257583  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:11.259518  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:11.263104  7696 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260620 13:56:11.311869  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 44988.1us
I20260620 13:56:11.347361  7620 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:11.347992  7620 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.350333  7620 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:11.359443  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:11.360581  6025 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:11.362119  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:11.363358  7721 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:11.364221  7721 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:11.364544  7721 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:11.374657  7721 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.378902  7688 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:11.380375  5951 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260620 13:56:11.380939  7688 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.381680  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:11.382684  5954 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:11.384202  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:11.384968  5880 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 2: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:11.385304  7637 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:11.387944  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:11.388634  6026 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:11.387084  7688 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:11.389693  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:11.391160  7688 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:11.391639  7688 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:11.391553  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:11.392334  7688 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:11.405067  7637 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:11.405731  7637 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.406034  7721 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:11.408000  7637 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:11.411819  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:11.412621  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:11.413276  6026 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:11.413338  7688 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.414535  5849 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:11.418094  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:11.418776  7721 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:11.419204  5875 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 2: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:11.419266  7721 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:11.419806  7721 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:11.423202  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:11.423810  6025 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:11.427937  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:11.429091  7637 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:11.443552  7637 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.444445  7721 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.442685  6025 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:11.446359  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:11.428787  5779 catalog_manager.cc:5696] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 2, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:11.449800  7620 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:11.450340  7637 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:11.450407  7620 raft_consensus.cc:697] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:11.447031  7688 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:11.451622  7620 consensus_queue.cc:237] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.452790  6026 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:11.429803  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:11.455821  5955 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:11.456751  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:11.457454  6579 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:11.460045  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:11.460475  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:11.461077  7603 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:11.461536  7603 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:11.461961  7603 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:11.463696  7688 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:11.464725  7688 raft_consensus.cc:697] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:11.468732  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:11.469693  6025 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:11.478142  7688 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.495666  7637 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:11.496255  7637 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.498852  7637 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:11.432379  5875 consensus_queue.cc:237] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.501523  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:11.502627  6025 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:11.504830  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:11.507450  7692 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:11.511375  7623 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:11.512022  7623 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:11.511883  7692 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.512498  7623 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:11.514129  7692 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:11.516757  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:11.517398  5876 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:11.518411  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:11.519021  6026 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:11.521966  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:11.520020  5954 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:11.520080  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:11.525568  7516 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:11.526523  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:11.539849  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:11.558780  6025 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:11.538228  7516 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:11.559799  7516 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:11.561470  5776 catalog_manager.cc:5696] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 4 to 5, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 5 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:11.544523  5955 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:11.535748  7603 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.538357  7721 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:11.573053  6026 consensus_queue.cc:237] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.584268  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:11.585500  6030 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:11.594376  6032 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260620 13:56:11.591595  7611 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:11.600963  7611 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.603204  7611 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:11.603809  7620 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:11.606424  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:11.606992  5880 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:11.609489  7623 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.611883  7623 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:11.614022  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:11.614583  7603 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:11.614802  6030 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:11.623270  5998 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:11.623847  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:11.632107  6028 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.645237  5778 catalog_manager.cc:5696] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 2, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 2 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:11.653785  6580 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:11.655452  6025 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:11.655336  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:11.638067  5954 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:56:11.638640  7611 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:11.662465  5779 catalog_manager.cc:5696] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 1 to 2, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 2 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:11.667574  5849 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:11.674979  7637 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:11.675215  7611 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:11.691860  6030 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:11.661574  5955 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:11.686358  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:11.698380  7611 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:11.691884  7620 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:11.703202  6579 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:56:11.716671  7634 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260620 13:56:11.706635  7624 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:11.738765  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 71282.2us
I20260620 13:56:11.748927  7516 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.751286  7516 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:11.757436  6030 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:56:11.757778  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:11.758430  5875 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:11.734772  7624 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.762284  7624 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:11.769105  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:11.769758  5876 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:56:11.773306  7611 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.775779  7611 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:11.778126  7516 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:56:11.783605  7747 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:11.784227  7747 raft_consensus.cc:697] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:11.785156  7747 consensus_queue.cc:237] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.788546  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:11.789363  6032 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:11.789469  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:11.745579  7620 raft_consensus.cc:697] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:11.793004  7620 consensus_queue.cc:237] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.796366  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:11.801448  6032 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:11.802616  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:11.794589  5776 catalog_manager.cc:5696] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 3 to 5, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 5 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:11.810464  6580 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:11.812994  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:11.813479  7749 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:11.813573  6581 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:56:11.816444  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:11.815443  7603 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260620 13:56:11.818951  6579 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:11.807075  7516 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260620 13:56:11.825354  7635 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:11.826144  7635 raft_consensus.cc:697] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:11.827381  7635 consensus_queue.cc:237] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.831849  5875 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:11.837731  5952 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260620 13:56:11.839413  7669 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:11.839897  7669 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:11.840282  7669 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:11.851773  7669 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.814059  7749 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.858644  7669 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:11.858803  7749 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:11.859668  7749 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:11.861706  7749 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.867058  7637 raft_consensus.cc:697] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:11.870460  7748 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:56:11.870537  7637 consensus_queue.cc:237] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.867445  7683 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:11.864549  6032 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.877281  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:11.878260  5956 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:11.882174  7516 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:11.884382  5952 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:11.890671  5848 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
W20260620 13:56:11.899235  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 95896.8us
I20260620 13:56:11.885010  7683 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.903688  7683 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:11.904089  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:11.904757  5880 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:11.905181  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:11.906906  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:11.908891  5875 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:11.893306  7705 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260620 13:56:11.910938  7692 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:11.911387  7692 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:11.911747  7692 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:11.911995  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:11.912845  5875 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:11.907949  7749 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:11.883040  7516 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:11.924229  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:11.925220  6030 raft_consensus.cc:2393] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:11.925496  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:11.937259  7750 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:11.938639  7747 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:11.939253  7747 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:11.941771  7747 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:11.943917  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:11.947690  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:11.948167  6580 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:11.948271  6581 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:11.946789  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:11.949923  5880 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:11.950758  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:11.916378  7752 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:11.951378  6028 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:11.933084  7635 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:11.963826  7752 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:11.976801  7683 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:11.996896  7730 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:11.996593  7719 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260620 13:56:11.997485  7730 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:11.999248  7677 log.cc:927] Time spent T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260620 13:56:11.999753  7758 log.cc:927] Time spent T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260620 13:56:12.000902  7752 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:56:12.002084  7755 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260620 13:56:11.985335  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:12.022589  5849 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:11.980829  7696 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260620 13:56:12.026285  6581 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:11.980836  7669 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260620 13:56:12.030658  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:12.050118  6580 raft_consensus.cc:2393] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:12.029378  6025 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260620 13:56:12.047205  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:11.976740  7750 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260620 13:56:11.989535  7635 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.048502  7637 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:12.086891  7667 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:12.087291  7704 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:12.087576  7667 raft_consensus.cc:697] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:12.087898  7704 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.088560  7667 consensus_queue.cc:237] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.015803  7683 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.097538  5956 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:12.082562  6579 raft_consensus.cc:2393] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 2: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:12.090461  7704 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:12.124742  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 108361us
I20260620 13:56:12.126451  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:12.129400  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:12.130340  6032 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:12.081773  7637 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:12.116899  7648 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:12.139328  7763 log.cc:927] Time spent T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260620 13:56:12.138665  7637 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:12.139662  7719 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.114573  7634 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260620 13:56:12.256701  7770 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.257442  7770 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:12.258643  7760 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260620 13:56:12.246074  7516 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:12.267959  7759 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260620 13:56:12.268553  7770 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:12.299965  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:12.154263  7648 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:12.281301  7677 log.cc:927] Time spent T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260620 13:56:12.252076  7719 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:12.328339  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 275577us
I20260620 13:56:12.334295  6025 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260620 13:56:12.336139  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 323317us
I20260620 13:56:12.337848  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:12.340620  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:12.340544  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:12.341521  6580 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:12.341488  5882 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:12.346325  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:12.346258  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:12.346591  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:12.347012  6032 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:12.347420  6028 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:12.347579  6025 raft_consensus.cc:2368] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5.
I20260620 13:56:12.355723  6026 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:12.389056  6580 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 3
I20260620 13:56:12.390134  7770 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.391577  7719 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:12.359644  7516 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.392925  7778 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.393334  7516 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.393486  7778 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.394966  7770 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.396000  7778 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:12.397346  7770 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:12.395529  7516 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:12.397223  5950 raft_consensus.cc:2955] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:12.399894  6580 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:56:12.362855  7635 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:12.401886  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:12.371856  7704 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.410903  5924 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:12.375310  7683 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:12.416033  7764 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
W20260620 13:56:12.417903  7692 consensus_meta.cc:287] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.000s
I20260620 13:56:12.417625  7704 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:12.418654  5875 consensus_meta.cc:287] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.505s	user 0.004s	sys 0.006s
I20260620 13:56:12.429603  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:12.434466  5924 leader_election.cc:400] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5.
I20260620 13:56:12.444698  5924 leader_election.cc:403] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:56:12.421628  7770 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:12.430830  7692 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:12.425805  7635 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:12.449638  7692 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:12.449792  7635 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:12.429607  7774 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:12.449151  7719 raft_consensus.cc:2955] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:12.450322  5955 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:12.450606  7774 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.436316  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:12.452555  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 49343.9us
I20260620 13:56:12.447026  7770 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:12.458036  5958 raft_consensus.cc:2955] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:12.450311  7635 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:12.468518  6026 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260620 13:56:12.461017  7770 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:12.472013  6026 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:12.470777  7704 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:12.474781  7774 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:12.460088  7692 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 5
I20260620 13:56:12.476588  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:12.455351  5875 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:12.470783  7768 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260620 13:56:12.481460  7620 raft_consensus.cc:2955] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:12.487192  7767 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.487895  7767 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.488709  7779 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:12.489504  7779 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:12.489840  7779 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:12.490353  7767 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:12.491736  7752 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.494422  7752 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:12.440774  7637 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:12.497735  7637 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:12.504900  7665 raft_consensus.cc:2955] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:12.506062  7637 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.512758  7627 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:12.513798  7627 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.515748  7669 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.516088  7627 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:12.516301  7669 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.519174  7669 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:12.506855  7637 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.530019  7637 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:12.533620  7753 log.cc:927] Time spent T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.609s	user 0.005s	sys 0.018s
I20260620 13:56:12.535869  7611 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:12.536497  7611 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:12.538197  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:12.538904  5951 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:12.540124  7553 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.540818  7553 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.542332  5997 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:12.543206  7667 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:12.543587  7667 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:12.544384  7667 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:12.544566  7553 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:12.545317  7611 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:12.546813  7770 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.549533  7730 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:12.551494  7635 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.552620  5953 raft_consensus.cc:2368] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5.
I20260620 13:56:12.553897  5959 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 5: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:12.543216  7772 raft_consensus.cc:2955] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:12.514817  7692 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5.
I20260620 13:56:12.558386  5998 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:56:12.562577  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 86065.3us
I20260620 13:56:12.565528  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:12.568943  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 29e2284e793941b4aa9829a72313998c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:56:12.568542  7620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:58442 (request call id 85) took 1139 ms. Trace:
I20260620 13:56:12.571973  7635 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:12.579520  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:12.584024  7696 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.599162  7784 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.584199  7728 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.599525  7696 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.589124  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:12.609989  6030 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:12.585777  7623 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.590248  7750 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:12.596427  7775 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:12.600003  7667 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.598882  5951 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
W20260620 13:56:12.558080  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 185109us
I20260620 13:56:12.603266  5882 raft_consensus.cc:2955] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:12.604617  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:12.612291  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:12.616408  5876 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
W20260620 13:56:12.619637  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 250925us
I20260620 13:56:12.634160  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:12.618466  7623 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:12.638337  7623 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:12.599735  7784 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:12.639520  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:12.630273  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:12.643373  5877 raft_consensus.cc:2393] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 2: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:12.643754  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:12.644652  6580 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:12.645474  6028 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260620 13:56:12.647686  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:12.648277  6582 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:12.635236  5880 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:12.652006  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:12.653796  5883 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260620 13:56:12.627009  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:12.660111  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:12.658353  5876 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:12.661759  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:12.662640  5881 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:12.657554  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:12.664529  5880 raft_consensus.cc:2368] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5.
I20260620 13:56:12.669548  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:12.660754  6025 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:12.670244  5959 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:12.672202  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:12.672950  6028 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:56:12.613507  7770 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:12.676299  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:12.677987  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:12.678411  6580 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:12.679641  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:12.680546  6580 raft_consensus.cc:2393] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 2: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:12.681707  6580 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:12.684015  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:12.693449  7765 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.694249  7765 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.594103  7620 rpcz_store.cc:276] 0620 13:56:11.429377 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:11.429881 (+   504us) service_pool.cc:224] Handling call
0620 13:56:11.535514 (+105633us) log.cc:844] Serialized 501 byte log entry
0620 13:56:11.826905 (+291391us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b54001a6ba0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf77219e 00007f0fdf77cd10 00007f0fdf77ccb8 00007f0fdf77cc38 00007f0fdf77cbf3 00007f0fdf77be7c 00007f0fe56671f6 00007f0fe56619a8 00007f0fdf7b8bab 00007f0fdf7bb6a0
0620 13:56:12.564402 (+737497us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54001a6ba0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf772e8a 00007f0fdf7721b9 00007f0fdf77cd10 00007f0fdf77ccb8 00007f0fdf77cc38 00007f0fdf77cbf3 00007f0fdf77be7c 00007f0fe56671f6 00007f0fe56619a8 00007f0fdf7b8bab
0620 13:56:12.568424 (+  4022us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7456,"raft.queue_time_us":8885,"raft.run_cpu_time_us":1658,"raft.run_wall_time_us":1658,"spinlock_wait_cycles":361257216,"thread_start_us":42471,"threads_started":1,"wal-append.queue_time_us":89664}
I20260620 13:56:12.685878  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:12.683804  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:12.699676  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 020dbb4b944d4deeba944d1a7c6d5c76 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:56:12.646982  7750 raft_consensus.cc:697] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:12.700057  6587 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:12.697037  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:12.710206  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:12.684652  6586 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:12.651525  7623 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:12.696815  7765 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:12.719846  5924 leader_election.cc:400] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5.
I20260620 13:56:12.720180  5924 leader_election.cc:403] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260620 13:56:12.721388  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:12.651000  5954 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:12.642302  7637 consensus_queue.cc:1059] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260620 13:56:12.725759  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 64165.2us
I20260620 13:56:12.727236  6587 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:12.677883  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:12.730679  6030 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:12.599841  7728 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.726254  7623 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.741698  7777 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:12.742926  7683 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:56:12.743749  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:12.744731  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:12.749305  6586 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 3: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:12.641997  7775 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.723094  7516 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:12.756592  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:12.752080  7637 consensus_queue.cc:1243] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 663684cf4ae54c929bf8240ca0b63a47 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260620 13:56:12.752816  5950 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 1.
I20260620 13:56:12.760295  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:12.760483  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:12.760939  6587 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:12.730078  7770 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:12.659857  7754 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.120s
I20260620 13:56:12.781126  7750 consensus_queue.cc:237] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:12.758126  6552 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:12.747457  7766 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260620 13:56:12.783481  7784 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:12.770174  5883 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:12.797495  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:12.800410  6585 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:12.791147  6582 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:12.729441  7781 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:12.739382  7748 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:56:12.794847  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 67058.1us
W20260620 13:56:12.805449  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 47447.9us
I20260620 13:56:12.805799  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:12.806171  6552 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:12.806691  6581 raft_consensus.cc:2393] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 2: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:12.805444  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:12.808264  6586 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 5
I20260620 13:56:12.763141  7516 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:12.814481  7728 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:12.817826  6551 leader_election.cc:400] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5.
I20260620 13:56:12.818320  6551 leader_election.cc:403] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:56:12.815330  7516 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:12.796111  7779 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.831562  7767 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:12.832018  7767 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:12.832552  7767 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:12.833264  5953 raft_consensus.cc:2393] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 4: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:12.803278  7696 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:12.919497  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 194252us
I20260620 13:56:12.818071  7748 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:12.817160  7688 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:12.819486  7781 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:13.125108  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:13.118754  7733 log.cc:927] Time spent T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.214s	user 0.000s	sys 0.011s
I20260620 13:56:13.120085  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 24c27735bbb449a98fab7edad2ba9837 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:56:13.007097  6580 raft_consensus.cc:2955] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:12.808300  5848 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:13.125921  6030 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:13.126160  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:13.127854  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:13.134516  6029 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:13.137800  7787 log.cc:927] Time spent T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.325s	user 0.009s	sys 0.000s
I20260620 13:56:13.141027  7767 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.146562  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:13.147294  6033 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
W20260620 13:56:13.148679  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 340430us
I20260620 13:56:13.151645  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:13.151741  7667 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.151837  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:13.152153  7775 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.152472  6028 raft_consensus.cc:2368] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5.
I20260620 13:56:13.152804  7779 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.152882  6024 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:13.153203  7648 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:13.126899  7781 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:13.124027  7688 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:13.161280  5957 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:13.161947  6587 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:13.164850  7516 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.161355  6586 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:13.127000  7692 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:13.126777  7719 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:13.127734  7772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43482 (request call id 81) took 1550 ms. Trace:
I20260620 13:56:13.173079  7752 raft_consensus.cc:3055] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:13.185904  7516 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.176030  5952 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260620 13:56:13.195442  7786 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5.
I20260620 13:56:13.196580  7692 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.170903  7688 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:13.183399  7752 raft_consensus.cc:740] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:13.263144  6029 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:13.197027  7719 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.215385  7794 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:13.215227  7770 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5.
I20260620 13:56:13.271965  7794 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:13.266355  7623 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.269169  7627 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:13.287918  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 478617us
I20260620 13:56:13.291785  7767 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:13.289253  7761 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:13.287369  7719 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:13.302736  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 179754us
I20260620 13:56:13.332983  7516 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:56:13.337322  7794 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:13.339632  7788 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260620 13:56:13.285753  7752 consensus_queue.cc:260] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:13.367442  6552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.016s	sys 0.034s
I20260620 13:56:13.179527  7772 rpcz_store.cc:276] 0620 13:56:11.571094 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:11.571302 (+   208us) service_pool.cc:224] Handling call
0620 13:56:11.610824 (+ 39522us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b540015caa0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf779900 00007f0fdf802f22 00007f0fdf801be0 00007f0fdf7fadda 00007f0fe47c2bc9 00007f0fddd3cdb4 00007f0fddd3cd42 00007f0fddd3cc71 00007f0fddd3cbec 00007f0fddd3bea2
0620 13:56:11.640350 (+ 29526us) log.cc:844] Serialized 501 byte log entry
0620 13:56:12.833315 (+1192965us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6503,"raft.queue_time_us":99018,"raft.run_cpu_time_us":1647,"raft.run_wall_time_us":63855,"spinlock_wait_cycles":85187200,"thread_start_us":55625,"threads_started":1}
I20260620 13:56:13.295168  7627 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.338529  7761 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:56:13.375968  6552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.016s	sys 0.034s
I20260620 13:56:13.377727  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:13.378599  6586 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:56:13.377774  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 557488us
I20260620 13:56:13.394207  5952 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260620 13:56:13.395175  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:13.398064  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:13.503377  5959 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:13.398898  5956 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:13.504997  7752 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:13.505630  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 122556us
I20260620 13:56:13.507972  7644 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:13.508487  7644 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.510624  7794 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:13.514113  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:13.515846  7516 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:13.526098  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:13.527410  5924 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:13.379763  7761 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:13.583776  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:13.584573  6552 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:13.584568  6586 raft_consensus.cc:2393] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:13.585366  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:13.511236  7794 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.542718  7774 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:13.545516  7770 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election won for term 5
W20260620 13:56:13.582564  7795 log.cc:927] Time spent T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260620 13:56:13.551169  7748 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:13.612046  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 84713.3us
I20260620 13:56:13.604072  7692 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.590562  7648 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:13.615901  7516 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:13.617698  7516 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:13.618414  7516 raft_consensus.cc:697] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:13.622306  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:13.619571  7516 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.605540  7627 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.618711  7648 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:13.625211  7797 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:13.600520  7774 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.643692  7648 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:13.643092  7692 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:13.694135  6580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 561) took 1019 ms. Trace:
I20260620 13:56:13.644301  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:13.694988  6580 rpcz_store.cc:276] 0620 13:56:12.674771 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:12.682392 (+  7621us) service_pool.cc:224] Handling call
0620 13:56:12.682964 (+   572us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:12.684311 (+  1347us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:12.684351 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:12.707601 (+ 23250us) log.cc:844] Serialized 501 byte log entry
0620 13:56:13.003404 (+295803us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:56:13.169974 (+166570us) log.cc:844] Serialized 14 byte log entry
0620 13:56:13.176665 (+  6691us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:13.176743 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:13.693913 (+517170us) raft_consensus.cc:1685] finished
0620 13:56:13.693938 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:13.694073 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4961,"raft.queue_time_us":5114,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":295474,"threads_started":1,"wal-append.queue_time_us":515030}
I20260620 13:56:13.643435  7770 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:13.716171  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:13.696564  7808 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:13.653255  7797 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.715976  7719 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:13.698171  7692 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:13.736081  7761 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.743906  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:13.751705  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:13.752784  7692 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:13.754631  7797 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:56:13.723487  7808 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.743795  7748 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:13.756860  7748 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:13.757985  7808 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.738984  7770 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.738840  7648 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:13.762194  6024 consensus_meta.cc:287] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.609s	user 0.008s	sys 0.004s
I20260620 13:56:13.762564  6024 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:13.730495  7719 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:13.744544  7688 consensus_meta.cc:287] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.001s
I20260620 13:56:13.744385  7794 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.745167  7750 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:13.738902  7774 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.790951  7750 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:13.794112  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:13.762404  7648 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:13.796011  6032 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
W20260620 13:56:13.821683  7781 consensus_meta.cc:287] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260620 13:56:13.822256  7781 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.789582  7761 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.857908  7772 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:13.865415  7772 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.867165  7719 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.867753  5950 raft_consensus.cc:2393] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:13.868019  7719 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:13.868633  7750 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:13.792280  7688 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.868798  7719 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.876847  7750 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:13.877740  7719 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.877451  7750 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:13.862872  7748 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:13.878881  7688 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:13.886754  7781 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.888293  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:13.889429  6580 raft_consensus.cc:2393] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:56:13.890334  7789 log.cc:927] Time spent T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.986s	user 0.014s	sys 0.006s
I20260620 13:56:13.891773  7750 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:13.893146  6584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 541) took 1239 ms. Trace:
I20260620 13:56:13.893537  6584 rpcz_store.cc:276] 0620 13:56:12.653373 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:12.655885 (+  2512us) service_pool.cc:224] Handling call
0620 13:56:12.656550 (+   665us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:12.656993 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:12.657043 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:12.660280 (+  3237us) log.cc:844] Serialized 501 byte log entry
0620 13:56:12.726648 (+ 66368us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:12.729276 (+  2628us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:12.729405 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:13.890024 (+1160619us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b24000d4858. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc591614 00007f0fdc58f71b 00007f0fdc74a619 00007f0fdc74a2a5 00007f0fdc7498ed 00007f0fdf37f4ae 00007f0fdf396c2c 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1
0620 13:56:13.892821 (+  2797us) raft_consensus.cc:1685] finished
0620 13:56:13.892844 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:13.893067 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8022784,"thread_start_us":66059,"threads_started":1,"wal-append.queue_time_us":124410}
I20260620 13:56:13.898399  7770 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:13.899027  7770 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.901784  7770 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.902860  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:13.910897  6582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 650) took 1261 ms. Trace:
I20260620 13:56:13.911373  6582 rpcz_store.cc:276] 0620 13:56:12.649414 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:12.651798 (+  2384us) service_pool.cc:224] Handling call
0620 13:56:13.910644 (+1258846us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54006c5f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:13.910786 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272565632}
I20260620 13:56:13.917946  7805 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:13.968510  7516 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:14.036310  7516 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.014644  5779 catalog_manager.cc:5696] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 4, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 4 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:56:13.957121  5877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1184) took 1354 ms (client timeout 1694 ms). Trace:
W20260620 13:56:14.041669  5877 rpcz_store.cc:269] 0620 13:56:12.602575 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:12.604403 (+  1828us) service_pool.cc:224] Handling call
0620 13:56:13.956766 (+1352363us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b54000c58d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:13.956990 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62735104}
I20260620 13:56:13.969345  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:14.043668  7516 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:14.044030  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:14.045120  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:14.045222  5958 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:14.045795  5952 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:14.046303  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:13.928867  7808 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:14.047171  7808 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:14.047447  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:14.047811  5883 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42748 (request call id 314) took 1291 ms (client timeout 1690 ms). Trace:
I20260620 13:56:14.048372  6578 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:14.048719  5883 rpcz_store.cc:269] 0620 13:56:12.756228 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:12.756352 (+   124us) service_pool.cc:224] Handling call
0620 13:56:14.047635 (+1291283us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5400169ed4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:14.047754 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29627136}
I20260620 13:56:13.933547  7627 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:14.012173  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 317) took 1390 ms. Trace:
I20260620 13:56:14.050848  7627 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:14.051052  5953 rpcz_store.cc:276] 0620 13:56:12.622086 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:12.622197 (+   111us) service_pool.cc:224] Handling call
0620 13:56:14.011796 (+1389599us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400170f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:14.012010 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443582848}
I20260620 13:56:14.017860  7683 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:14.052968  7627 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:14.052830  7683 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.054385  7627 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:13.933606  7804 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:13.978844  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 1746) took 1300 ms. Trace:
W20260620 13:56:13.931242  5959 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 1745) took 1253 ms (client timeout 1539 ms). Trace:
I20260620 13:56:14.056173  7804 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:14.056819  5959 rpcz_store.cc:269] 0620 13:56:12.677952 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:12.722558 (+ 44606us) service_pool.cc:224] Handling call
0620 13:56:13.930952 (+1208394us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54002611d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:13.931150 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1260834048}
I20260620 13:56:14.046967  5957 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:13.978792  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:14.058630  7804 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.997707  6029 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260620 13:56:13.925724  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:14.084622  6583 raft_consensus.cc:2368] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4.
I20260620 13:56:14.043706  6030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:56:13.923033  5849 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:14.085304  6030 raft_consensus.cc:606] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
W20260620 13:56:14.085574  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 162661us
I20260620 13:56:14.043907  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:56:13.923787  5954 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1159) took 1361 ms (client timeout 1694 ms). Trace:
I20260620 13:56:14.060556  7669 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:14.086993  5955 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:14.087167  7669 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.089862  7669 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:13.929208  7692 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:13.922819  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:14.048261  5956 raft_consensus.cc:2393] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:14.101831  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:14.065312  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:56:14.066566  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:14.104028  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:14.104722  5848 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:14.067741  7637 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:14.068665  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:14.106418  6586 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:14.068989  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:14.069820  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:14.071832  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:13.967022  6580 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:14.073197  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:14.106740  6584 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:13.918862  7770 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:14.105997  7746 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:14.074460  7553 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:14.110061  7728 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:14.076393  5997 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:14.080696  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 923bfc4f20d94a57b0d84d45e40b12ae with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260620 13:56:14.075986  7804 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:14.049360  7808 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:14.091199  5954 rpcz_store.cc:269] 0620 13:56:12.562176 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:12.565203 (+  3027us) service_pool.cc:224] Handling call
0620 13:56:13.923490 (+1358287us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b5400305f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:13.923682 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116214144}
I20260620 13:56:13.951241  7800 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:14.093221  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:14.093394  7749 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:14.090884  7692 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.095980  5955 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
W20260620 13:56:14.098079  5847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.009s	sys 0.023s
I20260620 13:56:14.140187  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:14.097954  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:13.918938  7805 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:14.114590  6024 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:14.100211  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:14.055150  7683 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:14.108071  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:13.974159  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:14.109436  6032 raft_consensus.cc:2410] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260620 13:56:14.111408  5998 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:14.114675  7770 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:14.054840  7627 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:14.105281  6551 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:14.125855  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:14.115072  5951 raft_consensus.cc:2393] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 4: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:14.155215  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:14.127434  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 51134.2us
I20260620 13:56:14.117220  7728 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:13.919466  7781 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:56:14.144629  5847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.010s	sys 0.024s
I20260620 13:56:14.056169  5950 rpcz_store.cc:276] 0620 13:56:12.678274 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:12.760237 (+ 81963us) service_pool.cc:224] Handling call
0620 13:56:13.978504 (+1218267us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002607d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:13.978761 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2534921984}
I20260620 13:56:14.150295  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:14.171464  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:14.116604  7768 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:14.152226  6030 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
W20260620 13:56:14.152163  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 46961.1us
I20260620 13:56:14.156666  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:14.180924  5959 raft_consensus.cc:2393] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:14.157400  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:14.138599  6026 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
W20260620 13:56:14.157644  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 46342.6us
I20260620 13:56:14.160988  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:14.163594  5997 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:14.143258  7749 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:14.166146  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:14.171885  6552 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:14.162145  7774 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:14.115759  7746 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.161165  7696 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:14.161425  7750 raft_consensus.cc:2764] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260620 13:56:14.176316  5924 leader_election.cc:400] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5.
I20260620 13:56:14.189630  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:14.176769  7516 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:14.140772  7800 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.190554  7516 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:14.191385  7692 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:14.151312  5955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1163) took 1310 ms (client timeout 1709 ms). Trace:
I20260620 13:56:14.115862  7553 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.196015  7516 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:14.177945  7805 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:14.151309  7784 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:14.179270  5956 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:14.137212  7808 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:14.167589  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:14.114729  7637 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.186919  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:14.136929  7773 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:14.209997  5959 raft_consensus.cc:2368] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4.
I20260620 13:56:14.177362  6578 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:14.139041  7804 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.161768  7683 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:14.196568  7516 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:14.174377  7635 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:14.218086  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:14.174764  7770 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:14.173048  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 66813.6us
I20260620 13:56:14.232540  7817 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:14.184322  7781 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:14.204782  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 118440us
I20260620 13:56:14.173825  7644 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:14.183485  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:14.208042  6585 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:14.239637  5954 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:56:14.189906  7783 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:14.240113  7785 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:14.240425  7783 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:14.240767  7785 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.240943  7783 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:14.188740  7696 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:14.212630  7516 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:14.213261  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:14.186558  7749 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:14.242992  7696 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:14.243088  7516 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:14.243458  6025 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:56:14.215221  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:14.244549  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:14.245185  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:14.245711  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:14.246515  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:14.215482  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:14.216272  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:14.192720  7811 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:14.219686  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:14.197729  7798 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:14.214193  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:14.209403  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:14.192653  7774 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:14.253557  7516 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.212344  7765 raft_consensus.cc:2764] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260620 13:56:14.239379  5849 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:14.248303  6032 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:14.213351  7808 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:14.193759  5955 rpcz_store.cc:269] 0620 13:56:12.834896 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.043611 (+1208715us) service_pool.cc:224] Handling call
0620 13:56:14.145647 (+102036us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:14.208961  7784 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:14.251076  7811 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:14.223271  7683 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:14.229490  7635 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.224308  7773 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:14.300215  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 74740us
I20260620 13:56:14.271498  7764 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:14.274013  7770 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:14.247942  7820 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.125s
I20260620 13:56:14.338013  7516 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:14.439690  5850 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.314s	user 0.023s	sys 0.013s
I20260620 13:56:14.272552  7768 raft_consensus.cc:697] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:14.286437  5951 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:14.287483  7627 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:14.443167  5848 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
W20260620 13:56:14.448657  5850 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.323s	user 0.024s	sys 0.014s
W20260620 13:56:14.436308  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 204762us
I20260620 13:56:14.380491  7785 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:14.353170  7818 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:14.446065  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 206763us
I20260620 13:56:14.261453  7798 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.382349  7811 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:14.435722  7688 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:14.445415  5950 raft_consensus.cc:2955] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:56:14.460361  7821 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260620 13:56:14.461323  7635 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:14.462527  7637 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:14.463155  7637 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:14.463569  7781 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:14.463961  7798 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:14.464586  7637 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:14.465164  7637 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.467973  7808 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:14.468256  7784 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:14.469796  7683 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:14.470696  7792 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:14.471375  7823 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:14.471290  7792 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.472121  7823 raft_consensus.cc:697] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:14.449795  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:14.484495  5924 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:14.489092  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 305167us
I20260620 13:56:14.485984  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:14.455472  7824 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:14.512759  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 58397us
I20260620 13:56:14.440028  7770 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:14.519022  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 75953.4us
I20260620 13:56:14.475662  7553 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:14.525957  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:14.440122  7764 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.528632  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:14.532250  7749 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:14.533094  7805 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:14.535033  7830 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:14.482558  7688 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.507849  7683 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:14.512691  7637 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:14.537617  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 47653.6us
I20260620 13:56:14.523902  7804 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:14.508049  7781 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:14.512950  7746 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:14.514494  7829 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:14.513254  7792 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:14.515245  7820 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:14.538656  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:14.544013  5848 leader_election.cc:400] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4.
I20260620 13:56:14.546882  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:14.537853  7808 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:14.528896  7824 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:14.546001  5883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:56:14.599516  5883 raft_consensus.cc:606] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:14.546593  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:14.536270  7696 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.600540  5877 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
W20260620 13:56:14.600683  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 62130.7us
I20260620 13:56:14.473912  7818 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.541318  7805 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:14.611315  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:14.612929  5879 raft_consensus.cc:2410] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260620 13:56:14.544472  7831 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:14.597564  5848 leader_election.cc:403] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260620 13:56:14.616215  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 72503.9us
I20260620 13:56:14.537755  7827 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:14.606920  7696 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:14.541092  6024 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:16.910512  7608 raft_consensus.cc:2764] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260620 13:56:16.910698  6024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 325) took 2837 ms (client timeout 2451 ms). Trace:
I20260620 13:56:16.911971  7861 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:16.911451  6024 rpcz_store.cc:269] 0620 13:56:14.072767 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.072924 (+   157us) service_pool.cc:224] Handling call
0620 13:56:16.910407 (+2837483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:14.674929  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260620 13:56:16.913031  7861 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:15.790843  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:14.674984  6552 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:16.916694  7861 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:16.918259  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:14.641355  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 98566us
W20260620 13:56:16.263540  5850 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.624s	user 0.004s	sys 0.007s
I20260620 13:56:14.659789  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:16.924578  5850 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.285s	user 0.005s	sys 0.008s
I20260620 13:56:16.924853  5877 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:14.621477  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:14.646066  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:14.646539  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:16.945204  5881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42748 (request call id 330) took 2300 ms (client timeout 2210 ms). Trace:
W20260620 13:56:16.945521  5876 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42748 (request call id 331) took 2299 ms (client timeout 1839 ms). Trace:
I20260620 13:56:14.629326  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:14.646768  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:14.557359  5997 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.709s (SENT)
I20260620 13:56:14.612162  7804 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:14.612300  7805 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:17.084960  7804 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:17.085633  7804 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:14.662153  7764 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.089569  7764 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:14.627156  7749 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:15.757619  7811 consensus_meta.cc:287] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 1.269s	user 0.011s	sys 0.000s
I20260620 13:56:14.600502  7820 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.094327  7811 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.097478  7811 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:14.542573  7768 consensus_queue.cc:237] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.488478  7823 consensus_queue.cc:237] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:14.557205  7781 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:14.657240  7824 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:15.146248  7828 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:17.110773  7828 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.113520  7828 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:14.597432  7829 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:14.653381  7637 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:17.115453  7781 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:14.622691  7831 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:16.334198  7800 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:15.681348  7833 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:17.121068  7833 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.569406  7835 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:17.123719  7835 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.126041  7835 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:14.658476  7832 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:56:15.791700  7838 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.003s	sys 0.006s
I20260620 13:56:14.619902  7773 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:14.555058  7830 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:14.633108  7688 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.156029  7830 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.156970  7831 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.157809  7832 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.161093  7832 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.162138  7833 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:16.249688  7836 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.598s	user 0.004s	sys 0.014s
W20260620 13:56:17.163498  7836 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.515s	user 0.004s	sys 0.015s
I20260620 13:56:16.251216  7818 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:16.292461  7806 log.cc:927] Time spent T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 2.578s	user 0.000s	sys 0.018s
W20260620 13:56:16.379956  5880 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42748 (request call id 319) took 1823 ms (client timeout 1583 ms). Trace:
I20260620 13:56:16.382992  5777 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47386 (request call id 230) took 2264 ms. Trace:
I20260620 13:56:17.167357  5777 rpcz_store.cc:276] 0620 13:56:14.118286 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:16.377611 (+2259325us) service_pool.cc:224] Handling call
0620 13:56:16.382688 (+  5077us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":0}
I20260620 13:56:14.716056  7770 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:16.447708  6584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 671) took 2287 ms (client timeout 1671 ms). Trace:
W20260620 13:56:17.170518  6584 rpcz_store.cc:269] 0620 13:56:14.159729 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:16.447224 (+2287495us) service_pool.cc:211] Skipping call since client already timed out
0620 13:56:16.447428 (+   204us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260620 13:56:16.570703  5848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.949s	user 0.016s	sys 0.012s
I20260620 13:56:16.600289  7852 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:17.172216  5848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.550s	user 0.016s	sys 0.013s
I20260620 13:56:16.614275  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 329) took 2546 ms. Trace:
I20260620 13:56:16.619841  7853 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:17.172364  7852 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.172817  5958 rpcz_store.cc:276] 0620 13:56:14.067285 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.067413 (+   128us) service_pool.cc:224] Handling call
0620 13:56:14.067761 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:14.157316 (+ 89555us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:14.157344 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:14.157387 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:14.157417 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:16.613545 (+2456128us) spinlock_profiling.cc:243] Waited 89.4 ms on lock 0x7b5400078fd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:16.613636 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:16.613971 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205524736}
I20260620 13:56:17.173209  7853 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:17.166510  5880 rpcz_store.cc:269] 0620 13:56:14.555820 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:16.379039 (+1823219us) service_pool.cc:211] Skipping call since client already timed out
0620 13:56:16.379505 (+   466us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260620 13:56:16.621925  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1167) took 2551 ms. Trace:
I20260620 13:56:17.176147  5954 rpcz_store.cc:276] 0620 13:56:14.070293 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.240611 (+170318us) service_pool.cc:224] Handling call
0620 13:56:14.240954 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:14.351656 (+110702us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:14.370113 (+ 18457us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:14.378648 (+  8535us) raft_consensus.cc:1645] Marking committed up to 2
0620 13:56:14.380979 (+  2331us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:16.621314 (+2240335us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b54001964d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:16.621397 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:16.621706 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112529792}
I20260620 13:56:16.626801  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 323) took 2581 ms. Trace:
I20260620 13:56:16.636615  5924 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:16.660638  7854 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:17.177537  5952 rpcz_store.cc:276] 0620 13:56:14.045329 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.046397 (+  1068us) service_pool.cc:224] Handling call
0620 13:56:14.046621 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:14.192687 (+146066us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:14.192719 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:14.192765 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:14.192796 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:16.626088 (+2433292us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54002508d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:16.626172 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:16.626556 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335491328}
W20260620 13:56:17.178346  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 542243us
I20260620 13:56:16.662065  6029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 319) took 2600 ms. Trace:
I20260620 13:56:17.179275  6029 rpcz_store.cc:276] 0620 13:56:14.061621 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.068676 (+  7055us) service_pool.cc:224] Handling call
0620 13:56:14.068964 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:14.094218 (+ 25254us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:14.094249 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:14.094293 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:14.094324 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:16.661244 (+2566920us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b54000d5054. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:16.661336 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:16.661735 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57614080}
I20260620 13:56:17.180076  7853 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:16.678169  5951 consensus_meta.cc:287] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 2.225s	user 0.036s	sys 0.030s
I20260620 13:56:16.678475  7855 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:17.181303  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:17.181201  7855 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.182350  7800 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:17.178020  7854 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.183853  7855 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:16.695729  7856 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:17.184768  7856 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.185912  7854 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:16.696336  7774 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:16.818948  5905 debug-util.cc:398] Leaking SignalData structure 0x7b0800119bc0 after lost signal to thread 4722
W20260620 13:56:17.188239  5905 debug-util.cc:398] Leaking SignalData structure 0x7b08000fa2a0 after lost signal to thread 5815
I20260620 13:56:17.188881  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:17.180998  5951 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
W20260620 13:56:17.189656  5905 debug-util.cc:398] Leaking SignalData structure 0x7b080038fa40 after lost signal to thread 5908
W20260620 13:56:17.189992  5905 debug-util.cc:398] Leaking SignalData structure 0x7b080038f9e0 after lost signal to thread 5909
I20260620 13:56:16.823024  7791 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:17.191453  7791 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:17.192174  5951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 330) took 3124 ms (client timeout 2451 ms). Trace:
W20260620 13:56:17.192728  5951 rpcz_store.cc:269] 0620 13:56:14.067615 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.188738 (+121123us) service_pool.cc:224] Handling call
0620 13:56:17.191880 (+3003142us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b54002521d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:17.192079 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11408128}
I20260620 13:56:17.193821  7791 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:16.827687  7857 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:17.194664  7857 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.196975  7857 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.197866  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:17.198722  6032 raft_consensus.cc:2368] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3.
I20260620 13:56:16.831626  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:16.851886  5998 connection.cc:256] RPC call timeout handler was delayed by -1.2628300679999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260620 13:56:17.203482  5998 connection.cc:256] RPC call timeout handler was delayed by -1.2628300679999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260620 13:56:17.203900  5998 connection.cc:256] RPC call timeout handler was delayed by -1.2259300680000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
W20260620 13:56:17.204216  5998 connection.cc:256] RPC call timeout handler was delayed by -1.1485300680000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
I20260620 13:56:17.203424  5957 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
W20260620 13:56:17.204556  5998 connection.cc:256] RPC call timeout handler was delayed by -1.0072300680000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
W20260620 13:56:17.204900  5998 connection.cc:256] RPC call timeout handler was delayed by -1.0009300680000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
I20260620 13:56:16.852669  7859 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:16.855258  6026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2218) took 2641 ms. Trace:
I20260620 13:56:16.864761  7862 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:16.871142  7822 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 2.434s	user 0.005s	sys 0.015s
I20260620 13:56:16.894045  5779 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56624 (request call id 341) took 4332 ms. Trace:
I20260620 13:56:16.897866  7864 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:17.227387  7792 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:17.228446  7864 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.230301  6032 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260620 13:56:16.925594  5877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42748 (request call id 328) took 2288 ms (client timeout 1674 ms). Trace:
W20260620 13:56:16.946373  5876 rpcz_store.cc:269] 0620 13:56:14.646045 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.646235 (+   190us) service_pool.cc:224] Handling call
0620 13:56:16.945262 (+2299027us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:16.953480  5879 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:17.231952  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:16.945731  5881 rpcz_store.cc:269] 0620 13:56:14.645199 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.645362 (+   163us) service_pool.cc:224] Handling call
0620 13:56:16.944940 (+2299578us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:16.969668  7761 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:16.974738  5884 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42748 (request call id 332) took 2328 ms (client timeout 1766 ms). Trace:
I20260620 13:56:16.995023  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:14.710120  7783 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:17.235464  5884 rpcz_store.cc:269] 0620 13:56:14.646443 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.646556 (+   113us) service_pool.cc:224] Handling call
0620 13:56:16.974503 (+2327947us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:17.001644  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:56:17.008040  7868 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:17.009521  7869 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:17.013686  7865 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:17.014392  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1178) took 2928 ms. Trace:
I20260620 13:56:17.014844  7748 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:16.998751  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 1751) took 2822 ms. Trace:
I20260620 13:56:17.020246  7866 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:56:17.021878  5953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1166) took 2951 ms (client timeout 2204 ms). Trace:
I20260620 13:56:17.028370  7872 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:17.252226  7748 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.040845  7867 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:17.044804  7728 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.029587  7870 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:17.049592  7874 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:17.059731  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:17.060427  7772 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.061719  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:17.063236  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:17.064640  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 2.88257e+06us
I20260620 13:56:17.069660  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:17.072468  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:17.092051  7730 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:56:17.092743  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 2.53507e+06us
I20260620 13:56:17.092845  7767 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:17.097373  5776 catalog_manager.cc:5696] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 2 to 4, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 4 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:17.094327  7749 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:17.107225  7820 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.090525  7764 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.269876  7764 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.114629  7829 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:17.127439  7838 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.468s	user 0.003s	sys 0.008s
I20260620 13:56:17.150075  5882 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:17.174965  7852 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.182725  7800 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:17.279284  7800 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:17.279552  7637 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4.
W20260620 13:56:16.836158  5956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1170) took 2764 ms (client timeout 1873 ms). Trace:
W20260620 13:56:17.190981  5905 debug-util.cc:398] Leaking SignalData structure 0x7b080039faa0 after lost signal to thread 5983
I20260620 13:56:17.227641  7688 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:17.288885  7688 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.227304  7859 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:17.285800  5956 rpcz_store.cc:269] 0620 13:56:14.071138 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.101549 (+ 30411us) service_pool.cc:224] Handling call
0620 13:56:16.835495 (+2733946us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b54002512d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:16.835880 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176496512}
I20260620 13:56:17.228578  7792 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:17.292407  5882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42748 (request call id 327) took 2663 ms (client timeout 1638 ms). Trace:
W20260620 13:56:17.292874  5882 rpcz_store.cc:269] 0620 13:56:14.628682 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.628882 (+   200us) service_pool.cc:224] Handling call
0620 13:56:17.292200 (+2663318us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400325854. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:17.292339 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382414592}
I20260620 13:56:16.919241  5875 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 1.
I20260620 13:56:17.231426  7791 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:17.321532  7791 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.292472  7859 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:17.325613  5997 connection.cc:256] RPC call timeout handler was delayed by -1.7742345870000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
W20260620 13:56:17.325999  5997 connection.cc:256] RPC call timeout handler was delayed by -1.771630324000057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
W20260620 13:56:17.326308  5997 connection.cc:256] RPC call timeout handler was delayed by -1.6897303240000383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
W20260620 13:56:17.326602  5997 connection.cc:256] RPC call timeout handler was delayed by -1.5976166369999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
W20260620 13:56:17.231312  5877 rpcz_store.cc:269] 0620 13:56:14.637013 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.659482 (+ 22469us) service_pool.cc:224] Handling call
0620 13:56:16.925468 (+2265986us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:17.233352  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:17.274593  7767 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:17.209592  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:17.328163  7767 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:17.232841  7862 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.206593  6026 rpcz_store.cc:276] 0620 13:56:14.214164 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.214273 (+   109us) service_pool.cc:224] Handling call
0620 13:56:14.214519 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:14.443129 (+228610us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:14.443161 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:14.443205 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:56:14.443241 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:16.854624 (+2411383us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54001c9654. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:16.854697 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:16.855046 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525266176}
I20260620 13:56:17.239563  7856 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.205344  7853 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:17.239151  7761 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.230876  7864 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.210994  7833 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:17.210201  7818 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:17.209966  7752 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:17.358271  7862 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.240417  7832 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260620 13:56:17.239137  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 272506us
I20260620 13:56:17.241204  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:17.207876  7835 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:17.245576  5959 rpcz_store.cc:276] 0620 13:56:14.075899 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.441797 (+365898us) service_pool.cc:224] Handling call
0620 13:56:14.442105 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:14.444163 (+  2058us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:14.444318 (+   155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:14.444375 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0620 13:56:14.444420 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:17.004140 (+2559720us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b5400262ad4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:17.004227 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:17.004487 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4227840}
I20260620 13:56:17.246946  5955 rpcz_store.cc:276] 0620 13:56:14.175639 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.544316 (+368677us) service_pool.cc:224] Handling call
0620 13:56:14.575971 (+ 31655us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:16.996782 (+2420811us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:16.997048 (+   266us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:16.997198 (+   150us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:56:16.997443 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:16.997639 (+   196us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:16.998258 (+   619us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:17.222838  5779 rpcz_store.cc:276] 0620 13:56:12.558551 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:12.564746 (+  6195us) service_pool.cc:224] Handling call
0620 13:56:16.890961 (+4326215us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:56:14.192135 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:56:14.322213 (+130078us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:56:14.322273 (+    60us) write_op.cc:435] Acquired schema lock
0620 13:56:14.322298 (+    25us) tablet.cc:662] Decoding operations
0620 13:56:14.419066 (+ 96768us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:56:14.427839 (+  8773us) write_op.cc:641] Partition lock acquired for write op
0620 13:56:14.436551 (+  8712us) tablet.cc:685] Acquiring locks for 1 operations
0620 13:56:14.451076 (+ 14525us) tablet.cc:701] Row locks acquired
0620 13:56:14.453781 (+  2705us) write_op.cc:260] PREPARE: finished
0620 13:56:14.459249 (+  5468us) write_op.cc:270] Start()
0620 13:56:14.459371 (+   122us) write_op.cc:276] Timestamp: P: 1781963774459201 usec, L: 0
0620 13:56:14.459393 (+    22us) op_driver.cc:348] REPLICATION: starting
0620 13:56:14.460218 (+   825us) log.cc:844] Serialized 536 byte log entry
0620 13:56:16.254998 (+1794780us) op_driver.cc:464] REPLICATION: finished
0620 13:56:16.276401 (+ 21403us) write_op.cc:301] APPLY: starting
0620 13:56:16.276503 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0620 13:56:16.276603 (+   100us) tablet.cc:1370] finished BulkCheckPresence
0620 13:56:16.276728 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:56:16.276986 (+   258us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:56:16.277146 (+   160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 13:56:16.277181 (+    35us) write_op.cc:312] APPLY: finished
0620 13:56:16.277428 (+   247us) log.cc:844] Serialized 23 byte log entry
0620 13:56:16.277604 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:16.277687 (+    83us) write_op.cc:454] Released schema lock
0620 13:56:16.277721 (+    34us) write_op.cc:341] FINISH: Updating metrics
0620 13:56:16.278063 (+   342us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:16.278093 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":20877,"apply.run_cpu_time_us":1645,"apply.run_wall_time_us":1644,"num_ops":1,"prepare.queue_time_us":103080,"prepare.run_cpu_time_us":21130,"prepare.run_wall_time_us":351897,"raft.queue_time_us":1624213,"raft.run_cpu_time_us":15732,"raft.run_wall_time_us":21868,"replication_time_us":1794360,"spinlock_wait_cycles":348544,"thread_start_us":2652572,"threads_started":4,"wal-append.queue_time_us":143673}]]}
I20260620 13:56:17.372677  7835 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.243762  7868 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:17.033272  5950 consensus_meta.cc:287] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 2.568s	user 0.022s	sys 0.021s
I20260620 13:56:17.252355  7866 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:17.251471  5953 rpcz_store.cc:269] 0620 13:56:14.070015 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:17.021484 (+2951469us) service_pool.cc:211] Skipping call since client already timed out
0620 13:56:17.021667 (+   183us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260620 13:56:17.334790  5776 catalog_manager.cc:5696] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:17.254840  7878 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:17.256048  7783 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:17.259822  6027 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
W20260620 13:56:17.260366  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 2.52831e+06us
I20260620 13:56:17.262696  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:17.263590  7749 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.252889  7872 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.264170  6025 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 1.
I20260620 13:56:17.264765  6031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2208) took 3155 ms. Trace:
I20260620 13:56:17.264783  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.265754  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:17.266274  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.266440  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:17.267127  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.267215  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.278246  7730 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.320703  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.244975  7781 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:17.327005  5997 connection.cc:256] RPC call timeout handler was delayed by -1.5310637380000571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
I20260620 13:56:17.252332  7869 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.258662  7870 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.346196  7761 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.355193  7859 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:17.336766  7865 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.356679  7833 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.357611  7818 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:17.359546  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 96469.5us
I20260620 13:56:17.366819  7832 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:17.258744  7867 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.358610  7752 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:17.369539  5848 connection.cc:256] RPC call timeout handler was delayed by -1.019965276999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260620 13:56:17.248318  5879 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:17.384712  6032 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:56:17.293745  7874 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.284273  7829 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.393643  7866 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:17.399030  7868 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:17.684190  5997 connection.cc:256] RPC call timeout handler was delayed by -1.231122892000144s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
I20260620 13:56:17.688155  5883 raft_consensus.cc:1813] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Handling vote request from an unknown peer 192c750f597c43858e1ad09e8d805685
I20260620 13:56:17.678112  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:17.691563  5879 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42748 (request call id 325) took 3071 ms (client timeout 2294 ms). Trace:
I20260620 13:56:17.682121  6551 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:17.694243  5883 raft_consensus.cc:2410] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260620 13:56:17.692129  5879 rpcz_store.cc:269] 0620 13:56:14.620535 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.620741 (+   206us) service_pool.cc:224] Handling call
0620 13:56:17.687992 (+3067251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:17.696101  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.697345  7791 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:17.513772  7873 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260620 13:56:17.667892  7804 consensus_meta.cc:287] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.005s
W20260620 13:56:17.707870  5905 debug-util.cc:398] Leaking SignalData structure 0x7b08003bdc00 after lost signal to thread 6057
W20260620 13:56:17.708317  5905 debug-util.cc:398] Leaking SignalData structure 0x7b08003bdbc0 after lost signal to thread 6058
I20260620 13:56:17.708056  7804 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:17.709514  5905 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1840 after lost signal to thread 6611
W20260620 13:56:17.709854  5905 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1820 after lost signal to thread 6612
W20260620 13:56:17.710155  5905 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1740 after lost signal to thread 7553
W20260620 13:56:17.710557  5905 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1720 after lost signal to thread 7644
I20260620 13:56:17.710654  7804 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.700831  6029 raft_consensus.cc:2410] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260620 13:56:17.701818  5876 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:17.702075  7781 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.702280  6024 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:17.702576  5878 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:17.702889  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:17.704461  7869 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.706367  7829 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.602825  7878 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.520539  7767 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.514422  7728 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:17.516803  7748 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:17.711598  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.684644  6031 rpcz_store.cc:276] 0620 13:56:14.109195 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.109349 (+   154us) service_pool.cc:224] Handling call
0620 13:56:14.114044 (+  4695us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:14.124617 (+ 10573us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:14.124649 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:14.126687 (+  2038us) log.cc:844] Serialized 26 byte log entry
0620 13:56:14.212169 (+ 85482us) raft_consensus.cc:1645] Marking committed up to 1
0620 13:56:14.212966 (+   797us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:14.213029 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:16.869983 (+2656954us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:56:17.256543 (+386560us) raft_consensus.cc:1685] finished
0620 13:56:17.256562 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:17.264582 (+  8020us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12111,"raft.queue_time_us":13282,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":8910,"spinlock_wait_cycles":9236864,"thread_start_us":51045,"threads_started":1,"wal-append.queue_time_us":145624}
I20260620 13:56:17.699550  5881 raft_consensus.cc:2393] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 3: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:17.715432  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:17.699939  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.421677  7835 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.733752  5882 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:17.689347  7832 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:17.724309  7783 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:17.725303  7688 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:17.731796  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 358669us
I20260620 13:56:17.740972  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:17.676321  7800 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:17.723088  5905 debug-util.cc:398] Leaking SignalData structure 0x7b08003b15e0 after lost signal to thread 7734
I20260620 13:56:17.738922  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.385339  7805 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.745697  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.734879  5876 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:17.741662  6032 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:17.744540  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.748139  5879 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:56:17.749130  5881 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:17.750921  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.731987  5875 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:17.754761  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.751253  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.750748  5884 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:17.753500  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.754575  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.757059  5876 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:17.758384  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.735486  7799 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:17.759155  5881 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:17.761307  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.743139  7792 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.741974  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1175) took 3668 ms. Trace:
I20260620 13:56:17.762740  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:17.751997  7728 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.764233  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:17.758342  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:17.754695  7804 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:17.773821  5953 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260620 13:56:17.778595  5877 raft_consensus.cc:2393] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:17.736269  7859 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.752250  7783 raft_consensus.cc:697] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:17.774084  7767 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:17.779927  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:17.774253  5880 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
W20260620 13:56:17.781700  5924 connection.cc:256] RPC call timeout handler was delayed by -2.3514791019999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260620 13:56:17.781533  7804 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.784683  5957 raft_consensus.cc:2368] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3.
I20260620 13:56:17.781978  7853 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:17.782874  5849 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:17.766131  7870 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:17.789757  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:17.792927  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:17.792840  7853 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.794065  5951 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:17.791105  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:17.778138  7878 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.795374  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:17.798239  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:17.799264  5956 raft_consensus.cc:2376] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4. Re-sending same reply.
I20260620 13:56:17.801002  5955 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:17.772027  7799 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.803856  7852 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:17.808048  7730 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:17.808528  7781 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:17.817817  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:17.809898  7783 consensus_queue.cc:237] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.811862  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:17.812129  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:17.801558  7870 raft_consensus.cc:2764] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260620 13:56:17.797752  7853 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.815882  7852 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.816964  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:17.817085  7804 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.817914  7781 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:17.810985  6552 connection.cc:256] RPC call timeout handler was delayed by -2.8454990029999863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260620 13:56:17.821388  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 46620.4us
I20260620 13:56:17.822234  5879 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 4: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:17.822897  5959 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:17.823035  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.823352  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:17.823849  5997 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:17.850080  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 47365.9us
I20260620 13:56:17.850235  7867 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:17.850939  7867 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:17.851339  7867 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:17.851719  7867 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:17.822932  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.853049  7874 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.853866  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.855060  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.838433  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:17.819000  5905 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1280 after lost signal to thread 7795
W20260620 13:56:17.856532  6552 connection.cc:256] RPC call timeout handler was delayed by -2.8328990029999659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
I20260620 13:56:17.844200  7859 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:17.844973  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:17.857087  6552 connection.cc:256] RPC call timeout handler was delayed by -2.0597558519999666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
I20260620 13:56:17.849306  6025 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:17.845795  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:17.857534  6552 connection.cc:256] RPC call timeout handler was delayed by -1.9211140510000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260620 13:56:17.857931  6552 connection.cc:256] RPC call timeout handler was delayed by -1.8334134230000245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22940000000000002s for a response
W20260620 13:56:17.858366  6552 connection.cc:256] RPC call timeout handler was delayed by -1.8073326420000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2451s for a response
W20260620 13:56:17.858788  6552 connection.cc:256] RPC call timeout handler was delayed by -1.7959589979999464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260620 13:56:17.861038  6552 connection.cc:256] RPC call timeout handler was delayed by -1.7959589979999464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260620 13:56:17.861510  6552 connection.cc:256] RPC call timeout handler was delayed by -1.7674663809999629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260620 13:56:17.861914  6552 connection.cc:256] RPC call timeout handler was delayed by -1.7579646799999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260620 13:56:17.862287  6552 connection.cc:256] RPC call timeout handler was delayed by -1.6457717580000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
W20260620 13:56:17.862674  6552 connection.cc:256] RPC call timeout handler was delayed by -1.5785750450000933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260620 13:56:17.864974  5883 raft_consensus.cc:2393] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:17.866137  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.867031  5876 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
W20260620 13:56:17.868489  6552 connection.cc:256] RPC call timeout handler was delayed by -1.5569930040001054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260620 13:56:17.868896  6552 connection.cc:256] RPC call timeout handler was delayed by -1.5128750450001007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
W20260620 13:56:17.869333  6552 connection.cc:256] RPC call timeout handler was delayed by -1.2842005940000263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30400000000000005s for a response
W20260620 13:56:17.869735  6552 connection.cc:256] RPC call timeout handler was delayed by -1.271358996999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260620 13:56:17.870076  6552 connection.cc:256] RPC call timeout handler was delayed by -1.271358996999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260620 13:56:17.871876  7749 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.842134  7853 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:17.874395  7853 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.876549  7853 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:17.881049  5924 connection.cc:256] RPC call timeout handler was delayed by -2.1858791020000581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260620 13:56:17.881608  5924 connection.cc:256] RPC call timeout handler was delayed by -2.1086787160000995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260620 13:56:17.881961  5924 connection.cc:256] RPC call timeout handler was delayed by -2.0690787160000355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260620 13:56:17.882290  5924 connection.cc:256] RPC call timeout handler was delayed by -1.9608791020000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260620 13:56:17.882072  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 158045us
W20260620 13:56:17.882639  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6551787560000548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260620 13:56:17.883200  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6083669960000861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
W20260620 13:56:17.883565  5924 connection.cc:256] RPC call timeout handler was delayed by -1.5245521389999794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260620 13:56:17.884081  5924 connection.cc:256] RPC call timeout handler was delayed by -1.5245521389999794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260620 13:56:17.884414  5924 connection.cc:256] RPC call timeout handler was delayed by -1.5209521389999736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260620 13:56:17.884781  5924 connection.cc:256] RPC call timeout handler was delayed by -1.5209521389999736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260620 13:56:17.885140  5924 connection.cc:256] RPC call timeout handler was delayed by -1.3926010810000662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260620 13:56:17.885511  5924 connection.cc:256] RPC call timeout handler was delayed by -1.3883381960000634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260620 13:56:17.885890  5924 connection.cc:256] RPC call timeout handler was delayed by -1.3787521389999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260620 13:56:17.886752  5924 connection.cc:256] RPC call timeout handler was delayed by -1.3548010810000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
W20260620 13:56:17.887334  5924 connection.cc:256] RPC call timeout handler was delayed by -1.3157521389999829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20260620 13:56:17.887786  5924 connection.cc:256] RPC call timeout handler was delayed by -1.2414010810000491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
I20260620 13:56:17.887283  6028 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
W20260620 13:56:17.888250  5924 connection.cc:256] RPC call timeout handler was delayed by -1.1109010810000655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
I20260620 13:56:17.877622  7872 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:17.890055  5924 connection.cc:256] RPC call timeout handler was delayed by -1.1010010810000495s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260620 13:56:17.880782  5905 debug-util.cc:398] Leaking SignalData structure 0x7b08001e9780 after lost signal to thread 7798
W20260620 13:56:17.893479  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0789114420000487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2479s for a response
I20260620 13:56:17.887389  7833 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.886785  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:17.900271  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:17.903467  7862 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:17.904135  7862 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.906740  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:17.909699  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:17.900357  7752 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.913777  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:17.914412  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:17.915027  5957 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:17.915714  5875 raft_consensus.cc:2410] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260620 13:56:17.894404  7800 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.916961  7818 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.917096  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:17.920751  7852 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.922642  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:17.923226  7728 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.923445  5956 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:17.773244  5950 rpcz_store.cc:276] 0620 13:56:14.075037 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:14.307555 (+232518us) service_pool.cc:224] Handling call
0620 13:56:14.436047 (+128492us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:14.441840 (+  5793us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:17.384092 (+2942252us) log.cc:844] Serialized 14 byte log entry
0620 13:56:17.693724 (+309632us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:17.722739 (+ 29015us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:17.731290 (+  8551us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:17.735587 (+  4297us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:17.739677 (+  4090us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3465,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":8053,"thread_start_us":263345,"threads_started":1,"wal-append.queue_time_us":311456}
I20260620 13:56:17.927024  7867 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:17.928158  6032 raft_consensus.cc:1240] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:17.929457  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:17.930212  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:17.931627  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:17.932088  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:17.932443  6578 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:17.932996  6586 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:56:17.893204  7781 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.906857  7862 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.936563  7865 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:17.938441  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:17.939379  5954 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:17.940505  7799 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.942731  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:17.943820  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:17.943982  5954 raft_consensus.cc:2393] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:17.944574  6580 raft_consensus.cc:2393] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 3: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:17.949189  6583 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:17.945240  7805 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.951319  6552 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:17.887565  7832 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.962814  7832 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:17.942531  7867 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:17.965147  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:17.976662  6032 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:17.977715  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 125160us
I20260620 13:56:17.979738  5957 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:17.983176  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:17.984004  5954 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:17.984222  7688 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:17.984866  7783 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:17.985117  7878 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:17.985947  7878 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.984879  7688 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.991356  7730 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:17.992583  5956 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:17.992285  7730 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:17.999192  7688 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:17.979413  7728 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:17.999796  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.001137  7730 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:18.004323  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:18.004904  5951 raft_consensus.cc:1240] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:18.005110  5957 raft_consensus.cc:2393] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:18.006088  5953 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:18.006004  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.006531  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:17.997076  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:18.007215  5955 raft_consensus.cc:1813] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Handling vote request from an unknown peer 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:18.008868  5955 raft_consensus.cc:2410] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260620 13:56:18.009033  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.009630  5959 raft_consensus.cc:1813] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Handling vote request from an unknown peer 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:18.010218  5959 raft_consensus.cc:2410] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260620 13:56:18.003046  7728 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.019125  7866 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:17.994318  7783 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:18.020211  5997 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:18.031754  7728 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:18.031952  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.034799  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.037494  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.037779  7889 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:18.039062  7889 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:18.020809  7866 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:18.038596  6581 raft_consensus.cc:2955] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:18.039541  7889 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:18.039882  7866 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:18.053376  5959 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:18.015714  7867 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260620 13:56:18.067802  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.070891  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.075251  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.076037  5959 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:18.082496  7865 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:56:18.084780  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.085716  6583 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:18.082576  5997 leader_election.cc:400] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3.
I20260620 13:56:18.092545  5997 leader_election.cc:403] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260620 13:56:18.092895  7832 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:18.093552  7832 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.093493  5997 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:18.042044  7783 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.093951  7878 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:18.095672  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.099184  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.104964  7832 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:18.105273  7862 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:18.105852  7862 raft_consensus.cc:697] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:18.106858  7862 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.107787  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.108680  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.109242  6026 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:18.111497  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.114866  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:18.117552  5849 connection.cc:256] RPC call timeout handler was delayed by -2.4902377910000268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
I20260620 13:56:18.118270  7872 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:18.118482  5849 connection.cc:256] RPC call timeout handler was delayed by -2.4722377909999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260620 13:56:18.118786  7872 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.120190  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:18.119377  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 61083.4us
I20260620 13:56:18.119252  5997 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:18.123347  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.123935  7859 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:18.124841  7859 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:18.125228  7859 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:18.126076  7783 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:18.127619  5884 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260620 13:56:18.128001  5884 pending_rounds.cc:85] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 5
I20260620 13:56:18.128271  5884 pending_rounds.cc:107] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260620 13:56:18.128528  5884 raft_consensus.cc:2889] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:18.130882  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.132043  5997 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:18.132596  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.128839  7889 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:18.143075  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.144009  5875 raft_consensus.cc:2410] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260620 13:56:18.144388  7889 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:18.145156  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.145790  5959 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:56:18.145918  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:18.146641  5953 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:18.146888  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.146978  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.147408  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.147961  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.148128  5953 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:18.148234  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.148577  5952 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:18.148895  5951 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:18.129364  7866 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.147570  5958 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:18.149266  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:18.162213  5955 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:18.147465  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.162717  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.162302  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.162976  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.165990  5957 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:18.146647  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.163648  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.167744  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.168099  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.169135  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.169665  5878 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:18.172610  5880 raft_consensus.cc:2368] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3.
I20260620 13:56:18.173018  6026 raft_consensus.cc:1275] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260620 13:56:18.173547  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.174660  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.149655  5953 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:18.175298  5882 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:18.178253  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.179129  5883 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:18.184036  5879 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260620 13:56:18.188891  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.189060  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.196225  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.197017  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.191062  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.202139  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.204362  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.210434  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.211189  6584 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:56:18.211438  5959 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:18.211779  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.212848  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.213459  5880 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:18.211361  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.212719  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.204960  5882 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:18.216596  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:18.217542  5953 raft_consensus.cc:2393] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 2: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:18.217803  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.216477  6026 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:18.216812  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:18.249818  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 66829.8us
I20260620 13:56:18.251354  7799 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:18.251754  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.219726  6583 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:56:18.253206  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.253947  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:18.254057  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.254420  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:18.221814  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:18.221732  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.255448  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:18.226109  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.257753  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.254983  5882 raft_consensus.cc:2410] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260620 13:56:18.226444  6584 raft_consensus.cc:2955] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:18.228332  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.227450  6578 raft_consensus.cc:2955] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:18.229357  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.232996  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.234967  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.235438  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.235971  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.236629  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.235970  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.238375  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.240604  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.255510  7783 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:18.226337  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.255698  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:18.255004  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.195860  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.276309  6032 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:18.405854  5953 raft_consensus.cc:1813] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Handling vote request from an unknown peer 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:18.283501  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.407163  5952 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:18.382145  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:18.415365  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.414101  5958 raft_consensus.cc:2393] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 2: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:18.406733  6582 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:18.414471  5953 raft_consensus.cc:2410] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260620 13:56:18.430699  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.438992  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:18.434432  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 178855us
I20260620 13:56:18.276664  7799 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:18.442083  6552 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:18.445961  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 192142us
I20260620 13:56:18.378051  6579 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:18.413868  7889 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:18.449057  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:18.414088  7865 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3.
I20260620 13:56:18.451817  5997 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:18.421964  7872 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:18.452469  7878 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:18.452903  7892 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:18.458808  7891 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:18.405475  7783 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:18.465994  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.466837  7864 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:18.437532  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:18.447152  7799 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:18.467700  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.469221  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:18.472560  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.475260  7878 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:18.499598  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:18.486121  6032 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:18.485832  7864 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:18.500855  7864 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:18.489318  7833 consensus_queue.cc:1059] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:56:18.477661  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:18.515908  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 62776.3us
I20260620 13:56:18.480736  7891 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:18.486249  7783 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:18.496346  7799 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:18.522888  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.496330  7878 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:56:18.529636  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 112557us
W20260620 13:56:18.532116  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 62966.1us
I20260620 13:56:18.535650  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.534049  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:18.523195  7891 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:18.527685  7730 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260620 13:56:18.541594  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 52447us
I20260620 13:56:18.533516  7866 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:18.519767  7864 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:18.534439  7859 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.562223  6587 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:18.542666  7805 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:18.563514  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:18.577127  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:18.576009  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 128723us
I20260620 13:56:18.590764  5997 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:18.595234  7872 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:56:18.596653  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.597479  6583 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
W20260620 13:56:18.600486  7899 log.cc:927] Time spent T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260620 13:56:18.601912  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.602624  5952 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:18.603966  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.595692  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.607468  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:18.611685  7903 log.cc:927] Time spent T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260620 13:56:18.611891  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.587579  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:18.619457  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.619805  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:18.622654  5952 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:56:18.623186  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:18.578349  7833 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:18.636057  5951 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 1.
W20260620 13:56:18.639835  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 49148.9us
I20260620 13:56:18.643332  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:18.588900  7859 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:18.634544  7872 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:18.628384  6551 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:18.633884  6026 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:18.634912  5953 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 1.
I20260620 13:56:18.573794  7805 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:18.654620  7805 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:18.666143  6551 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:18.645323  7833 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:18.650393  7864 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:18.650048  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:18.671360  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 122199us
I20260620 13:56:18.671835  7914 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:18.667354  7791 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:18.667495  7792 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:18.675872  7889 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:18.645617  6579 raft_consensus.cc:2376] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4. Re-sending same reply.
I20260620 13:56:18.652544  7872 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:18.722714  7872 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:18.721436  7904 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:18.730077  7904 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.679087  7805 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.737100  5952 raft_consensus.cc:1240] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
W20260620 13:56:18.713653  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 136626us
I20260620 13:56:18.679221  7833 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:18.719599  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:18.739557  5849 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:18.721227  7889 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:18.735982  7892 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:18.679589  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:18.680205  7859 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260620 13:56:18.757319  7910 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election won for term 3
W20260620 13:56:18.762053  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 174536us
W20260620 13:56:18.762426  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 96406us
I20260620 13:56:18.767505  7920 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260620 13:56:18.768635  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51095.1us
I20260620 13:56:18.743711  7730 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:18.772629  6551 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:18.758488  7892 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:18.778002  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:18.775687  7730 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:18.781349  7730 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:18.782848  7911 consensus_queue.cc:1059] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:18.784247  7911 raft_consensus.cc:3055] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:18.784647  7911 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:18.785511  7911 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:18.786509  7911 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:18.789124  7730 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.791400  7730 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:18.792524  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:18.793974  7911 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:18.796592  7911 raft_consensus.cc:697] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:18.797713  7911 consensus_queue.cc:237] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.802577  7730 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:18.803257  7730 raft_consensus.cc:697] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:18.804267  7730 consensus_queue.cc:237] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:18.802184  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 122678us
I20260620 13:56:18.806298  7878 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.807371  5998 leader_election.cc:400] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3.
I20260620 13:56:18.818295  7878 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:18.819073  6026 raft_consensus.cc:1240] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260620 13:56:18.775416  7920 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:18.822582  7906 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:18.822769  6032 raft_consensus.cc:1240] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:18.822810  5998 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:18.770198  7805 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:18.806641  7783 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.829190  5998 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:18.830588  7805 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:18.831354  7859 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:18.832157  7904 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:18.834996  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:18.835659  5958 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:56:18.837350  7901 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.284s	user 0.004s	sys 0.000s
I20260620 13:56:18.840071  5997 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:18.834743  7891 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.842636  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:18.852588  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 80030.8us
I20260620 13:56:18.852718  5957 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:18.853641  6551 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:18.854707  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 53174.5us
W20260620 13:56:18.857451  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:18.850625  5958 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:18.830979  7805 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:18.861403  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:18.867620  6581 raft_consensus.cc:2393] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 2: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:18.868932  5998 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:18.869951  6585 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:18.866964  7916 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:18.876459  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:18.868595  7805 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:18.858542  7920 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:18.873822  7878 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:18.893163  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:18.874033  7791 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:18.907366  7799 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.911183  7922 consensus_queue.cc:1059] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260620 13:56:18.911473  7909 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:18.873210  7910 raft_consensus.cc:697] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:18.834744  7833 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.891918  5998 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:56:18.938931  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 47127.9us
I20260620 13:56:18.939971  5998 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:18.889513  7915 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:18.882561  7866 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:18.924434  7891 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:18.874276  7921 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:18.925571  7917 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:18.932267  7892 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.932169  7910 consensus_queue.cc:237] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:18.937264  5956 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:18.892858  7783 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:18.942317  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 164392us
I20260620 13:56:18.913441  7878 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:18.947615  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:18.942956  7791 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:18.899384  7907 consensus_queue.cc:1059] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260620 13:56:18.944413  7864 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:56:18.954571  7872 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:18.948024  7799 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:18.965739  7833 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:18.965592  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:18.952508  7832 raft_consensus.cc:3055] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:18.966526  7783 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:18.968024  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:18.968524  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:19.012840  6032 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:18.948280  7921 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:18.969717  7805 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:18.971220  7889 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:18.972107  7859 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:18.943195  7915 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:18.974498  7892 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:18.975848  5998 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:18.948939  7917 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:18.980430  5778 catalog_manager.cc:5696] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:18.983734  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:18.984479  7907 raft_consensus.cc:3055] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Stepping down as leader of term 5
W20260620 13:56:19.004011  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 113370us
I20260620 13:56:18.959623  7878 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:19.031817  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 56381.5us
I20260620 13:56:19.032563  5997 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:18.993937  7916 raft_consensus.cc:697] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:19.038839  5997 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:19.039461  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 71530.2us
I20260620 13:56:19.031994  7907 raft_consensus.cc:740] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:19.038414  7864 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:19.042830  7907 consensus_queue.cc:260] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:19.044101  7907 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:19.045284  6026 raft_consensus.cc:1240] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:19.032001  7915 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:19.048079  5998 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:19.049300  5998 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:19.049507  7833 consensus_queue.cc:1059] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:56:19.051350  6025 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:19.052603  7889 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:19.053361  7889 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:19.053789  7905 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:19.011605  7920 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.056509  5956 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:19.057898  7920 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:19.058732  7905 raft_consensus.cc:697] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:56:19.059288  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 93804.3us
I20260620 13:56:19.053200  7904 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:19.011636  7832 raft_consensus.cc:740] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:19.061594  5953 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:19.027901  7921 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:19.060485  5778 catalog_manager.cc:5696] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 3 to 4, VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) evicted. New cstate: current_term: 1 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:19.025444  7783 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:19.039556  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 165747us
I20260620 13:56:19.066313  6032 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:19.028654  7914 raft_consensus.cc:697] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:19.074384  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:19.074976  7832 consensus_queue.cc:260] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:19.075172  7914 consensus_queue.cc:237] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.076517  6551 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:19.077378  6551 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:19.077497  6552 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:19.032696  7799 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:19.037166  7917 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:19.078992  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:19.037521  7891 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:19.060425  7866 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:19.089437  5778 catalog_manager.cc:5696] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index 3 to 4, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New cstate: current_term: 1 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:19.090987  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:19.099731  7934 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:19.076107  7783 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:19.093688  5776 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56594 (request call id 329) took 6318 ms. Trace:
I20260620 13:56:19.092835  5778 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:19.085260  7892 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:19.109367  5778 catalog_manager.cc:5696] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:19.108261  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.089238  7832 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:19.081065  7799 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:19.102635  5776 rpcz_store.cc:276] 0620 13:56:12.767377 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:12.767615 (+   238us) service_pool.cc:224] Handling call
0620 13:56:19.085882 (+6318267us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:56:17.828576 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:56:17.829254 (+   678us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:56:17.829301 (+    47us) write_op.cc:435] Acquired schema lock
0620 13:56:17.829320 (+    19us) tablet.cc:662] Decoding operations
0620 13:56:17.829739 (+   419us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:56:17.829846 (+   107us) write_op.cc:641] Partition lock acquired for write op
0620 13:56:17.829875 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0620 13:56:17.855515 (+ 25640us) tablet.cc:701] Row locks acquired
0620 13:56:17.855536 (+    21us) write_op.cc:260] PREPARE: finished
0620 13:56:17.855702 (+   166us) write_op.cc:270] Start()
0620 13:56:17.855857 (+   155us) write_op.cc:276] Timestamp: P: 1781963777855647 usec, L: 0
0620 13:56:17.855877 (+    20us) op_driver.cc:348] REPLICATION: starting
0620 13:56:17.892059 (+ 36182us) log.cc:844] Serialized 924 byte log entry
0620 13:56:18.014528 (+122469us) op_driver.cc:464] REPLICATION: finished
0620 13:56:18.114880 (+100352us) write_op.cc:301] APPLY: starting
0620 13:56:18.114979 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0620 13:56:18.115142 (+   163us) tablet.cc:1370] finished BulkCheckPresence
0620 13:56:18.131226 (+ 16084us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:56:18.167610 (+ 36384us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:56:18.195478 (+ 27868us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0620 13:56:18.202223 (+  6745us) write_op.cc:312] APPLY: finished
0620 13:56:18.404483 (+202260us) log.cc:844] Serialized 29 byte log entry
0620 13:56:18.444011 (+ 39528us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:18.451341 (+  7330us) write_op.cc:454] Released schema lock
0620 13:56:18.461869 (+ 10528us) write_op.cc:341] FINISH: Updating metrics
0620 13:56:18.529768 (+ 67899us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:18.533167 (+  3399us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9363,"reported_tablets":6,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":98244,"apply.run_cpu_time_us":3697,"apply.run_wall_time_us":399280,"num_ops":2,"prepare.queue_time_us":288631,"prepare.run_cpu_time_us":4028,"prepare.run_wall_time_us":89161,"replication_time_us":139185,"thread_start_us":258523,"threads_started":2}]]}
I20260620 13:56:19.089778  7891 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:19.092196  7866 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:19.118357  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.117609  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.117715  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.116916  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:19.117673  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.083076  7927 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:19.094333  7926 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:19.126246  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.124754  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.110047  7892 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:19.131958  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.125941  7752 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:19.113129  7792 consensus_queue.cc:1059] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260620 13:56:19.132654  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.132855  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.135639  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:19.135949  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:19.104521  7728 consensus_queue.cc:1059] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260620 13:56:19.093559  7833 consensus_queue.cc:1059] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260620 13:56:19.116247  7799 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:19.120024  7866 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:19.115738  7928 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:19.118116  7891 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:19.158288  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:19.158849  6586 raft_consensus.cc:1240] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:19.158970  7924 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:19.162561  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:19.105001  7905 consensus_queue.cc:237] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:19.137856  7892 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:19.167904  7752 raft_consensus.cc:697] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:19.113258  7862 consensus_queue.cc:1059] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260620 13:56:19.169215  7872 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:19.169622  7792 raft_consensus.cc:3055] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
W20260620 13:56:19.219570  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 143626us
W20260620 13:56:19.170439  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:19.172247  7730 raft_consensus.cc:3055] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:19.173867  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:19.228236  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:19.157140  6032 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:19.229593  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.175220  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.175781  6585 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:19.177430  7889 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:19.138309  7916 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.123927  7930 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:19.128849  7927 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.184360  7805 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:19.189255  7915 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.196556  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:19.202436  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:19.249699  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:19.209153  6580 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:19.168836  7833 raft_consensus.cc:3055] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Stepping down as leader of term 2
W20260620 13:56:19.217715  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 117425us
I20260620 13:56:19.131733  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.129149  7926 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:19.263818  7926 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:19.264822  6578 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:19.231825  6582 raft_consensus.cc:1240] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:19.232470  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.236788  6584 raft_consensus.cc:2368] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4.
I20260620 13:56:19.238718  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:19.207504  7924 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:19.240324  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.222487  7792 raft_consensus.cc:740] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:19.244988  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:19.179016  7878 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.222597  7928 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:19.227820  7730 raft_consensus.cc:740] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:19.266985  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:19.321102  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 71508us
I20260620 13:56:19.271803  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:19.494357  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 336146us
I20260620 13:56:19.395524  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:19.335686  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:19.383911  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 279356us
I20260620 13:56:19.358852  6032 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:19.548177  7924 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:19.288836  7915 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:19.464653  7904 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:19.405959  7930 raft_consensus.cc:697] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:19.628816  7904 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.629385  7930 consensus_queue.cc:237] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.631467  7904 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:19.586539  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:19.340173  5875 raft_consensus.cc:2410] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260620 13:56:19.341459  7752 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.413256  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:19.651387  7917 consensus_meta.cc:287] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.561s	user 0.000s	sys 0.016s
I20260620 13:56:19.651849  7917 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.624225  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:19.290205  7805 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260620 13:56:19.322180  7931 log.cc:927] Time spent T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260620 13:56:19.572554  7919 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260620 13:56:19.412627  7941 log.cc:927] Time spent T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.148s	user 0.002s	sys 0.000s
W20260620 13:56:19.621984  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 377054us
I20260620 13:56:19.669405  5849 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:19.254405  7833 raft_consensus.cc:740] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:19.673524  7892 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.674005  7919 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:19.673894  7792 consensus_queue.cc:260] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.675065  7792 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:19.639238  5848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.650s (SENT) [suppressed 29 similar messages]
W20260620 13:56:19.639689  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 110535us
I20260620 13:56:19.640659  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:19.640997  7934 raft_consensus.cc:3055] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:19.683795  7934 raft_consensus.cc:740] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:56:19.654464  7783 consensus_meta.cc:287] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.005s
W20260620 13:56:19.685500  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 46294.5us
I20260620 13:56:19.641593  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:19.491051  7921 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:19.408015  7865 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:19.624405  6552 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:19.658565  6586 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:19.659521  7730 consensus_queue.cc:260] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.663820  5953 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:19.340729  7937 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:19.564466  7927 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:19.664873  5957 raft_consensus.cc:1240] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
W20260620 13:56:19.622112  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 90477us
I20260620 13:56:19.244451  7872 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:19.469209  7922 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:19.717224  7922 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.672084  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:19.672617  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 48568.1us
I20260620 13:56:19.673352  7914 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260620 13:56:19.720206  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 48189.6us
I20260620 13:56:19.675640  6578 raft_consensus.cc:1240] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:19.674818  7833 consensus_queue.cc:260] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:19.683938  7917 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:19.711088  7728 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 13:56:19.692596  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 68316.5us
I20260620 13:56:19.700886  7921 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:19.700965  5954 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:56:19.701635  7934 consensus_queue.cc:260] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:19.709059  7799 consensus_meta.cc:287] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.006s
I20260620 13:56:19.710026  7892 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:19.656464  7805 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:19.638547  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.664495  7866 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.289414  7891 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.734048  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:19.712846  7924 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.739871  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:19.767562  5958 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:19.768697  7924 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:19.755501  5950 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:19.769269  7946 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:19.753860  7833 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:19.769634  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:19.733300  7947 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:19.690539  7783 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.742785  7752 consensus_queue.cc:1059] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260620 13:56:19.777549  7922 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:19.777683  7752 raft_consensus.cc:3055] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:19.745538  5849 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:19.778098  7752 raft_consensus.cc:740] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:19.779204  7891 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:19.755823  7928 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.730484  7872 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:19.779680  7910 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:19.780090  7872 consensus_queue.cc:1059] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:19.752998  5998 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:19.780792  7872 consensus_queue.cc:1243] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer b0ce39342d8c4a64904b30b98de02b9f log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260620 13:56:19.757548  7911 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260620 13:56:19.753127  7799 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:19.724524  7914 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:19.759443  6552 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:19.711273  7865 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:19.786188  7911 raft_consensus.cc:3055] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:19.737686  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:19.768584  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:19.713593  7937 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:56:19.772744  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:19.779017  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:19.757963  7730 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:19.848351  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 69402.1us
I20260620 13:56:19.848595  7919 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:19.849416  5849 leader_election.cc:400] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4.
I20260620 13:56:19.850611  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:19.781977  5998 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:19.851679  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 69765us
I20260620 13:56:19.852350  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:19.852558  7922 consensus_queue.cc:1059] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260620 13:56:19.853287  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 93927.4us
I20260620 13:56:19.783325  7878 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:19.783366  7872 raft_consensus.cc:3055] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:19.854413  7872 raft_consensus.cc:740] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:19.759815  7943 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:19.855279  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:19.855567  7943 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.776504  7934 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:19.823426  7946 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260620 13:56:19.828881  7926 consensus_meta.cc:287] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.564s	user 0.013s	sys 0.010s
I20260620 13:56:19.874830  7926 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.811003  7905 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:19.875773  7905 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:19.876155  7905 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:19.876844  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:19.778977  7752 consensus_queue.cc:260] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.787371  7914 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:19.818318  7916 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260620 13:56:19.839480  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 70997.2us
I20260620 13:56:19.847321  5956 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:19.880532  5882 raft_consensus.cc:2393] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 4: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:19.852799  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:19.853442  5998 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:19.761364  7805 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:19.853711  7922 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:19.894582  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:19.860579  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:19.899410  6032 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:19.901484  6032 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:19.901968  7920 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:19.908411  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:19.908732  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:19.909823  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:19.910094  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:19.786636  7911 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:19.865132  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:19.837453  7783 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:19.866066  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:19.874154  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:19.875224  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:19.830278  5951 raft_consensus.cc:1240] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:19.839681  7799 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:19.885185  6025 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
W20260620 13:56:19.893466  7951 log.cc:927] Time spent T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260620 13:56:19.893733  6579 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:19.894053  7926 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:19.894541  6027 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
W20260620 13:56:19.930639  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 77266.9us
I20260620 13:56:19.931402  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:19.894994  6033 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:19.895313  5881 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:19.932463  5998 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:19.895596  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:19.896000  6031 raft_consensus.cc:1240] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:19.896253  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:19.853951  7921 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:19.912562  6028 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:19.912606  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:19.786580  7947 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.871948  7906 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:19.940683  7791 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:19.940793  7906 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:19.852375  7866 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:19.941283  7906 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:19.862579  7878 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:19.862432  7910 raft_consensus.cc:3055] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:19.942102  7910 raft_consensus.cc:740] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:19.942953  7910 consensus_queue.cc:260] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.943701  7904 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:19.944092  7904 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:19.944182  7910 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:19.944523  7904 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:56:19.916481  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:19.855310  7872 consensus_queue.cc:260] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.871680  7937 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:19.872797  7943 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:19.920975  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:19.920887  7911 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:19.921743  7865 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:19.922744  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:19.928579  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:19.929509  6024 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:19.896608  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:19.936177  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:19.975548  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 47081.4us
I20260620 13:56:19.938046  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:19.938210  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:19.940241  7944 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:19.981321  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:19.980422  7946 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:19.886853  7919 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:19.947304  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:19.983011  7911 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:19.985565  6025 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:19.988039  7947 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:19.995034  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:19.984545  7946 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:19.995882  7946 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:19.998986  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:19.948123  6027 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260620 13:56:20.001097  7943 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:20.004294  7921 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:20.005925  7937 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.007740  7783 consensus_queue.cc:1059] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260620 13:56:20.008176  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:20.009479  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 71336.7us
I20260620 13:56:20.014329  6027 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:20.017165  7927 consensus_queue.cc:1059] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:56:20.009057  7926 raft_consensus.cc:3055] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:20.019260  7927 raft_consensus.cc:3055] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:20.019526  7926 raft_consensus.cc:740] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:20.019706  7927 raft_consensus.cc:740] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:20.020556  7926 consensus_queue.cc:260] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.023289  6552 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:19.951508  5956 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:20.029228  6551 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:19.954452  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:19.955725  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:19.956344  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:19.956820  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:20.035000  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:19.956954  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:19.955864  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:19.930274  7924 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260620 13:56:19.961287  5848 leader_election.cc:336] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.880s (SENT)
I20260620 13:56:19.971824  5952 raft_consensus.cc:1275] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260620 13:56:19.974437  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:19.935837  7752 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:19.971031  7907 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:19.999723  5879 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:20.026501  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:19.956877  7872 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:20.040849  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:20.041711  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:20.043349  5878 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:20.021808  7926 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:20.039577  5848 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:20.056313  6552 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:20.059230  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:20.036798  7924 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:20.070861  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:20.047791  7878 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:20.080101  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:20.056137  7730 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:20.062988  7833 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election won for term 3
W20260620 13:56:20.090231  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:20.093981  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:20.080327  7920 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:20.082600  5875 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:20.070719  7928 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260620 13:56:20.095726  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:20.085832  7915 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:20.021433  7927 consensus_queue.cc:260] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:20.082506  7924 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:20.095746  5998 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:20.058116  7907 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.057889  7916 consensus_queue.cc:1059] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260620 13:56:20.116354  5998 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:20.095427  7730 raft_consensus.cc:697] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:20.066929  7919 consensus_queue.cc:1059] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260620 13:56:20.144902  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:20.102053  7928 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:20.163354  5879 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:20.199488  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:20.203650  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:20.110806  7914 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:20.139031  7859 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260620 13:56:20.216732  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 179784us
I20260620 13:56:20.201736  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:20.212414  7730 consensus_queue.cc:237] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.215386  7909 consensus_queue.cc:1059] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:20.105304  7866 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260620 13:56:20.110733  7805 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:20.096573  7930 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
W20260620 13:56:20.226281  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 155685us
I20260620 13:56:20.227236  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:20.227926  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 281178us
I20260620 13:56:20.202965  7928 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:20.226847  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:20.221211  7936 raft_consensus.cc:3055] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:20.221038  7911 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:20.220594  7792 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:20.230062  7859 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 13:56:20.242183  7936 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:20.259565  7936 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.260994  7936 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:20.250519  5954 raft_consensus.cc:1240] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:20.263556  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:20.247808  7967 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:20.264657  7967 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.254668  5959 raft_consensus.cc:1240] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
W20260620 13:56:20.267915  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 66256.8us
I20260620 13:56:20.267035  7967 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:20.273144  7878 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:20.229408  7927 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:20.300782  5879 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:20.255261  7944 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:20.267884  7937 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:20.274017  7859 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:20.274434  7909 consensus_queue.cc:1243] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer 2e82c0c231624695ac5a813230bf5038 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260620 13:56:20.310846  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:20.302735  7911 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:20.267962  7792 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.330842  5877 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:20.308365  7919 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:20.285629  7905 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.241400  7971 consensus_queue.cc:1059] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260620 13:56:20.356694  6026 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:20.332291  7859 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.372284  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1217) took 1113 ms. Trace:
I20260620 13:56:20.372754  5959 rpcz_store.cc:276] 0620 13:56:19.259011 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:19.259823 (+   812us) service_pool.cc:224] Handling call
0620 13:56:19.290575 (+ 30752us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:20.267716 (+977141us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:20.372005 (+104289us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b5400262ad4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:20.372216 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2216801024}
I20260620 13:56:20.338485  7919 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:20.377844  7919 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:20.380738  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 92540us
I20260620 13:56:20.381620  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:20.353981  7956 log.cc:927] Time spent T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260620 13:56:20.388309  7833 raft_consensus.cc:697] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:56:20.389251  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 272997us
I20260620 13:56:20.333285  7911 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:20.395280  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 163812us
W20260620 13:56:20.361241  7965 log.cc:927] Time spent T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260620 13:56:20.359004  7961 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260620 13:56:20.363252  7970 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:20.395831  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:20.411271  7969 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:20.412771  7792 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:20.444291  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:20.417482  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:20.444674  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:20.445336  5880 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:20.444296  7805 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:20.444983  5881 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:20.446048  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:20.446220  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:20.416021  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:20.447413  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:20.447989  5883 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:20.384863  7934 consensus_meta.cc:287] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.513s	user 0.003s	sys 0.008s
I20260620 13:56:20.360212  7859 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:20.424379  5878 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:20.488660  5883 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:20.426712  5884 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
W20260620 13:56:20.489533  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 45230us
I20260620 13:56:20.428730  6587 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:20.437624  6585 raft_consensus.cc:1240] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:20.428089  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:20.417958  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:20.436455  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:20.493518  6581 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:56:20.436638  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:20.431205  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:20.441217  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:20.440646  7914 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:20.420004  7920 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:20.397238  7799 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:20.417197  5882 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260620 13:56:20.417716  7972 consensus_queue.cc:1059] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260620 13:56:20.497614  5882 pending_rounds.cc:85] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 4
I20260620 13:56:20.495657  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:20.487066  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 91306.3us
I20260620 13:56:20.493494  6586 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:20.417346  7833 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.365311  7904 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.429839  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:20.498157  5882 pending_rounds.cc:107] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260620 13:56:20.485247  7907 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:20.398763  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:20.444162  7752 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
W20260620 13:56:20.500741  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 60831.5us
I20260620 13:56:20.389510  7865 consensus_queue.cc:1059] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260620 13:56:20.416625  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:20.415722  7973 consensus_queue.cc:1059] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.185s
I20260620 13:56:20.498966  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:20.444545  7969 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:20.502027  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:20.662977  6552 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:20.512485  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:20.522032  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:20.666653  5882 raft_consensus.cc:2889] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:20.518702  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:20.511862  5848 leader_election.cc:336] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.544s (SENT)
W20260620 13:56:20.552347  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:20.584053  7964 raft_consensus.cc:3055] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:20.584935  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:20.585008  6586 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
W20260620 13:56:20.674011  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 162178us
I20260620 13:56:20.697981  7964 raft_consensus.cc:740] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:20.678714  6029 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:20.415071  7946 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:20.698957  7964 consensus_queue.cc:260] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:20.675186  7924 consensus_meta.cc:287] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.019s
W20260620 13:56:20.550616  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:20.666322  6585 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
W20260620 13:56:20.698586  5848 leader_election.cc:336] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.624s (SENT)
I20260620 13:56:20.701545  5848 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:20.701773  5955 raft_consensus.cc:1813] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Handling vote request from an unknown peer 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:20.679221  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:20.703047  5955 raft_consensus.cc:2393] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 2: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:20.703430  6032 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:20.700222  7964 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:20.704492  7960 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:20.705070  7960 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:20.705538  7960 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:20.705633  5849 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:20.629987  6581 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:20.700091  5956 raft_consensus.cc:1240] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:20.514482  7904 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:20.675226  7891 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 13:56:20.710274  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:20.711031  7971 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:20.700114  7924 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:20.711485  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 212633us
I20260620 13:56:20.711735  7971 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:20.712204  7971 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:20.712635  7971 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:20.713774  7907 consensus_queue.cc:1059] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:56:20.716368  7924 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:20.486352  7970 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:20.728839  7970 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:20.483575  7905 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:20.496091  7805 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:20.730408  7805 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:20.730892  7805 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:20.508136  7979 consensus_queue.cc:1059] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.236s
I20260620 13:56:20.736481  7979 raft_consensus.cc:3055] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:20.736940  7979 raft_consensus.cc:740] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:56:20.612676  7910 consensus_meta.cc:287] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.000s
W20260620 13:56:20.744670  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 66810.5us
I20260620 13:56:20.745594  6552 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:20.738097  7979 consensus_queue.cc:260] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.438910  7906 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.770648  5924 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:20.743094  7969 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:20.777915  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:20.779009  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:20.780435  6029 raft_consensus.cc:2393] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 3: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:56:20.788993  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:20.773823  7878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.012s	sys 0.011s
I20260620 13:56:20.696288  7928 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.749280  7936 consensus_queue.cc:1059] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260620 13:56:20.822527  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:20.769083  7979 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:20.815631  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:20.825517  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:20.794672  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:20.793596  7915 consensus_meta.cc:287] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.686s	user 0.007s	sys 0.002s
I20260620 13:56:20.795006  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:20.831220  6031 raft_consensus.cc:2393] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 2: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:20.773525  7799 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:20.832796  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:20.900565  5879 raft_consensus.cc:1813] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Handling vote request from an unknown peer 192c750f597c43858e1ad09e8d805685
I20260620 13:56:20.901484  5879 raft_consensus.cc:2410] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260620 13:56:20.816655  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:20.799710  7945 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260620 13:56:20.892149  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 91036.2us
I20260620 13:56:20.791697  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:20.884588  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:20.905684  5881 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 4: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:20.767596  7891 consensus_queue.cc:1059] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260620 13:56:20.883822  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:20.906107  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 111200us
I20260620 13:56:20.906999  5880 raft_consensus.cc:2410] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260620 13:56:20.890745  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:20.908869  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:20.824486  7878 raft_consensus.cc:697] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:20.911157  7730 consensus_queue.cc:1059] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:56:20.911671  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:20.912338  7878 consensus_queue.cc:237] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:20.915781  5848 leader_election.cc:336] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.717s (SENT)
I20260620 13:56:20.916388  5848 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:20.909363  7945 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:20.909853  7915 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:20.832361  7977 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.178s
I20260620 13:56:20.920004  7926 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:20.933600  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:20.944633  5924 connection.cc:256] RPC call timeout handler was delayed by -2.2123024349999696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
I20260620 13:56:20.841171  7971 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:20.921459  5955 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:20.926923  7972 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:20.937788  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:20.927175  7946 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:20.947023  5924 connection.cc:256] RPC call timeout handler was delayed by -2.1853024349999259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
I20260620 13:56:20.932379  7945 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:56:20.951253  5924 connection.cc:256] RPC call timeout handler was delayed by -2.1808024349999187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
W20260620 13:56:20.952904  5924 connection.cc:256] RPC call timeout handler was delayed by -2.0674024349999627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260620 13:56:20.953223  5924 connection.cc:256] RPC call timeout handler was delayed by -1.9999024349999672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260620 13:56:20.953534  5924 connection.cc:256] RPC call timeout handler was delayed by -1.850502434999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260620 13:56:20.953778  5924 connection.cc:256] RPC call timeout handler was delayed by -1.801002434999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260620 13:56:20.954115  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6849024349999127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
W20260620 13:56:20.954469  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6300024349999376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
I20260620 13:56:20.955371  5924 leader_election.cc:400] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3.
I20260620 13:56:20.955725  5924 leader_election.cc:403] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260620 13:56:20.956275  7799 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3.
I20260620 13:56:20.940448  7910 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:20.958146  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:20.922029  7805 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.960827  7984 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:20.967384  7910 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.970333  7976 consensus_queue.cc:1059] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260620 13:56:20.971606  5878 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:20.972826  7971 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:20.926235  7960 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.833256  7963 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.150s
I20260620 13:56:20.984684  7911 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:20.957875  7988 log.cc:927] Time spent T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260620 13:56:21.012377  7910 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:21.021071  7973 raft_consensus.cc:3055] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
W20260620 13:56:21.031893  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 73868.5us
I20260620 13:56:21.032287  7948 raft_consensus.cc:3055] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:21.033226  7948 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:20.975303  7924 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260620 13:56:21.037556  5883 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:21.039624  7967 consensus_queue.cc:1059] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:56:21.039667  7974 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:21.041327  7960 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:21.041500  7974 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:20.995194  6029 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:21.029435  7946 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:21.029665  7906 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:21.055212  7974 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:21.065801  7805 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:21.060494  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:21.067469  7981 log.cc:927] Time spent T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260620 13:56:21.052634  7984 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:21.031548  7973 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:21.088265  7946 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:21.088572  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1230) took 1169 ms. Trace:
I20260620 13:56:21.089262  7928 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:21.089054  5954 rpcz_store.cc:276] 0620 13:56:19.918909 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:19.924347 (+  5438us) service_pool.cc:224] Handling call
0620 13:56:19.952585 (+ 28238us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:20.263893 (+311308us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:21.088256 (+824363us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54001815d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:21.088499 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635228544}
I20260620 13:56:21.034171  7948 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.095810  7963 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:21.100652  7973 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:21.101603  5848 leader_election.cc:336] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.859s (SENT)
I20260620 13:56:21.102149  5848 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.103286  7971 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:21.104593  7922 raft_consensus.cc:3055] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:21.104355  7945 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.104975  7922 raft_consensus.cc:740] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:21.106459  7919 raft_consensus.cc:3055] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:21.106112  7922 consensus_queue.cc:260] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.107191  7922 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:21.086701  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:21.106858  7919 raft_consensus.cc:740] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:21.126817  7945 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:21.132236  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:21.133365  6584 raft_consensus.cc:3055] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:21.133853  6584 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:21.123729  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 352) took 1201 ms. Trace:
I20260620 13:56:21.138334  5882 rpcz_store.cc:276] 0620 13:56:19.907656 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:19.927511 (+ 19855us) service_pool.cc:224] Handling call
0620 13:56:19.952448 (+ 24937us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:20.667377 (+714929us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:21.108829 (+441452us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b54000c62d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:21.109066 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1068013952}
I20260620 13:56:21.142395  7984 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:21.148773  5884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42748 (request call id 349) took 1268 ms. Trace:
I20260620 13:56:21.149206  5884 rpcz_store.cc:276] 0620 13:56:19.880202 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:19.880384 (+   182us) service_pool.cc:224] Handling call
0620 13:56:21.148592 (+1268208us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54002b20d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:21.148691 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180870912}
I20260620 13:56:21.151330  7919 consensus_queue.cc:260] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:21.151782  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:21.152701  6031 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:21.152854  7919 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:56:21.154157  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 67583us
I20260620 13:56:21.134796  6584 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.156260  6028 raft_consensus.cc:1240] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260620 13:56:21.157761  6029 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:21.160984  5849 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:21.163672  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:21.176334  6025 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:21.153461  7866 raft_consensus.cc:3055] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:21.165606  7805 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:21.167636  7909 raft_consensus.cc:3055] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:21.168320  7936 raft_consensus.cc:3055] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:21.172152  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:21.222786  5879 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:21.173123  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:21.224013  5884 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:21.173906  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:21.180725  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:21.215258  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 60234.9us
I20260620 13:56:21.219224  6584 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:21.219784  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:21.225746  5882 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:21.220505  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:21.214578  7872 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260620 13:56:21.232012  5876 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:21.222287  7936 raft_consensus.cc:740] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:21.194512  7805 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:21.233475  7805 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:21.233686  7936 consensus_queue.cc:260] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.221661  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:21.224951  5877 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:21.239763  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:21.191999  7866 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:21.245949  5877 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:21.246814  5776 catalog_manager.cc:5696] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 2 to 4, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 4 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:21.213490  7971 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:21.253719  7971 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:21.254338  7971 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:21.258028  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:21.241577  7866 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.264242  6584 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:21.243301  7936 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:21.300042  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 193942us
I20260620 13:56:21.311192  5849 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:21.312112  5884 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:21.314783  5879 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:21.299396  6025 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:21.266281  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:56:21.316742  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 50542.9us
W20260620 13:56:21.316852  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:21.268723  5867 tablet_service.cc:1558] Processing DeleteTablet for tablet 29e2284e793941b4aa9829a72313998c with delete_type TABLET_DATA_TOMBSTONED (TS 2e82c0c231624695ac5a813230bf5038 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58442
I20260620 13:56:21.317867  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.272294  5778 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56610 (request call id 348) took 4137 ms. Trace:
I20260620 13:56:21.317906  5953 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:21.320447  5958 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:56:21.320765  5776 catalog_manager.cc:5696] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 3, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 3 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:56:21.326743  5848 leader_election.cc:336] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.639s (SENT)
I20260620 13:56:21.327159  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:21.327351  5848 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.327966  6584 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:21.328398  5882 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:21.326300  5849 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:21.266021  7917 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260620 13:56:21.269292  7866 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:21.340956  5776 catalog_manager.cc:5696] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 4 to 5, term changed from 2 to 3, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to <none>, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New cstate: current_term: 3 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:21.345156  5776 catalog_manager.cc:5696] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 3, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 3 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:21.253337  7909 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:21.348776  5776 catalog_manager.cc:5696] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 5 to 6, term changed from 3 to 4, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to <none>, VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) evicted. New cstate: current_term: 4 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:21.352025  5849 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:21.321532  7963 raft_consensus.cc:2764] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260620 13:56:21.318885  5778 rpcz_store.cc:276] 0620 13:56:17.119930 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:17.120219 (+   289us) service_pool.cc:224] Handling call
0620 13:56:17.152470 (+ 32251us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b5400002490. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d38b2 00007f0fe5651659 00007f0fe55e98b6 00007f0fe55ba968 00007f0fe56b90ae 00007f0fe3b7e4a4 00007f0fe3b7e432 00007f0fe3b7e361 00007f0fe3b7e2dc
0620 13:56:21.257431 (+4104961us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:56:19.650606 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:56:19.651314 (+   708us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:56:19.651466 (+   152us) write_op.cc:435] Acquired schema lock
0620 13:56:19.651504 (+    38us) tablet.cc:662] Decoding operations
0620 13:56:19.652262 (+   758us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:56:19.652326 (+    64us) write_op.cc:641] Partition lock acquired for write op
0620 13:56:19.652357 (+    31us) tablet.cc:685] Acquiring locks for 5 operations
0620 13:56:19.652928 (+   571us) tablet.cc:701] Row locks acquired
0620 13:56:19.652953 (+    25us) write_op.cc:260] PREPARE: finished
0620 13:56:19.653095 (+   142us) write_op.cc:270] Start()
0620 13:56:19.653211 (+   116us) write_op.cc:276] Timestamp: P: 1781963779653052 usec, L: 0
0620 13:56:19.653238 (+    27us) op_driver.cc:348] REPLICATION: starting
0620 13:56:19.699040 (+ 45802us) log.cc:844] Serialized 2074 byte log entry
0620 13:56:20.062274 (+363234us) op_driver.cc:464] REPLICATION: finished
0620 13:56:20.249725 (+187451us) write_op.cc:301] APPLY: starting
0620 13:56:20.255676 (+  5951us) tablet.cc:1367] starting BulkCheckPresence
0620 13:56:20.301960 (+ 46284us) tablet.cc:1370] finished BulkCheckPresence
0620 13:56:20.325138 (+ 23178us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:56:20.371737 (+ 46599us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:56:20.371933 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0620 13:56:20.371979 (+    46us) write_op.cc:312] APPLY: finished
0620 13:56:20.372213 (+   234us) log.cc:844] Serialized 47 byte log entry
0620 13:56:20.372382 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:20.372487 (+   105us) write_op.cc:454] Released schema lock
0620 13:56:20.372527 (+    40us) write_op.cc:341] FINISH: Updating metrics
0620 13:56:20.372889 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:20.372918 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":173700,"reported_tablets":7,"spinlock_wait_cycles":39296896,"child_traces":[["op",{"apply.queue_time_us":155335,"apply.run_cpu_time_us":3006,"apply.run_wall_time_us":139231,"num_ops":5,"prepare.queue_time_us":411869,"prepare.run_cpu_time_us":20546,"prepare.run_wall_time_us":113858,"raft.queue_time_us":182217,"raft.run_cpu_time_us":12995,"raft.run_wall_time_us":86444,"replication_time_us":408846,"thread_start_us":430050,"threads_started":4,"wal-append.queue_time_us":118287}]]}
I20260620 13:56:21.332437  7919 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:21.343492  7977 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260620 13:56:21.371625  5848 leader_election.cc:336] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.650s (SENT)
I20260620 13:56:21.372164  5848 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:21.281816  7971 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:21.351006  7927 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:21.384719  7927 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:21.385085  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.385855  5959 raft_consensus.cc:2393] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:21.386610  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.361343  7979 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:21.387275  7979 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:21.387655  7979 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:21.356316  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.390852  7974 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:56:21.392452  5959 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:21.393707  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:21.394363  5959 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 7
I20260620 13:56:21.381038  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:21.340703  7859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.052s	sys 0.072s
I20260620 13:56:21.347779  7910 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:21.396361  7917 consensus_queue.cc:1059] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:21.397540  7910 raft_consensus.cc:697] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:21.381750  5957 raft_consensus.cc:1240] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:21.380779  7967 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:21.382835  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:21.359639  7919 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:21.384181  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.355619  5776 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 4 to 6, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 6 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:21.395378  5953 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:21.396647  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.386837  7927 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:21.398321  7917 raft_consensus.cc:3055] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:21.343187  7872 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260620 13:56:21.383766  7752 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260620 13:56:21.414713  5848 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.693s (SENT)
I20260620 13:56:21.428431  5848 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:21.430024  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.415411  5924 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.416296  5958 raft_consensus.cc:2393] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:21.432296  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.433997  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:21.434252  5848 leader_election.cc:336] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.003s (SENT)
I20260620 13:56:21.370453  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.408439  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.398437  7910 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:21.297907  7805 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:21.424510  7917 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:21.454008  7917 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.455454  7917 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:21.456074  7805 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:21.407863  7859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.053s	sys 0.073s
I20260620 13:56:21.432700  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:21.444661  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.401523  7970 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:21.390904  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.412484  5955 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:21.419334  7919 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:21.424916  7946 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:21.441359  7872 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:21.466178  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:21.446879  7799 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:21.467595  7805 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election won for term 2
W20260620 13:56:21.459689  7728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.009s	sys 0.017s
I20260620 13:56:21.469141  5958 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:21.469528  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:21.487828  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:56:21.475080  5848 leader_election.cc:336] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.044s (SENT)
I20260620 13:56:21.488972  5848 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.484071  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:21.452430  7947 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.048s	sys 0.150s
I20260620 13:56:21.418301  7967 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.476532  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.499816  5956 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:21.487937  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.496110  5957 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:21.496312  5954 raft_consensus.cc:2393] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:56:21.496110  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:21.468731  7970 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.505734  5958 raft_consensus.cc:2393] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 2: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:21.498051  7946 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:56:21.506850  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:21.509804  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.503612  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:21.496034  7947 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.048s	sys 0.151s
W20260620 13:56:21.496793  7728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.010s	sys 0.017s
I20260620 13:56:21.512182  5953 raft_consensus.cc:2393] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:21.496874  7963 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:21.515439  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:21.512161  5997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.002s	sys 0.014s
W20260620 13:56:21.519634  6552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.063s	sys 0.052s
I20260620 13:56:21.509545  7805 raft_consensus.cc:697] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:21.523205  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.524181  5953 raft_consensus.cc:2393] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:21.527770  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.528704  5950 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:21.530037  5950 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260620 13:56:21.509202  5882 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:51382
W20260620 13:56:21.532075  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:21.531895  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:21.531948  5882 raft_consensus.cc:606] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:56:21.532750  5882 raft_consensus.cc:614] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260620 13:56:21.522339  6552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.063s	sys 0.052s
W20260620 13:56:21.533526  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 615806us
I20260620 13:56:21.534790  6552 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.536490  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.538355  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:21.541282  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:21.522274  5997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.002s	sys 0.014s
I20260620 13:56:21.453039  7909 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.544478  6552 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.551136  5997 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:21.562420  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.564158  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.530793  7979 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.589502  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.600906  5952 raft_consensus.cc:2393] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:21.521497  7963 raft_consensus.cc:697] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:56:21.602206  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 51234.7us
I20260620 13:56:21.561115  7926 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:21.587867  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.561250  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.559612  7792 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 13:56:21.560099  7892 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:21.618181  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.619035  5953 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:21.608765  5952 raft_consensus.cc:1240] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
W20260620 13:56:21.602443  7920 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.011s	sys 0.019s
I20260620 13:56:21.595310  6552 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.578882  7993 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:21.640158  5959 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
W20260620 13:56:21.640919  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 45672.6us
I20260620 13:56:21.647406  6552 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.588845  7989 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:56:21.610569  7971 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:21.658651  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:21.631422  5952 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:21.589581  7947 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:21.655347  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:21.663162  6587 raft_consensus.cc:1813] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Handling vote request from an unknown peer 192c750f597c43858e1ad09e8d805685
I20260620 13:56:21.663664  6587 raft_consensus.cc:2393] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 3: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:21.656349  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:21.664968  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:21.624289  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.602629  7891 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:21.669526  5877 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:21.669077  5879 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:56:21.647579  7792 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:56:21.669008  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:21.672655  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:21.682215  6586 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:21.682251  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:21.657702  7926 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:21.660308  7892 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:21.643198  7984 consensus_queue.cc:1059] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260620 13:56:21.676890  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:21.620680  7791 consensus_queue.cc:1059] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
W20260620 13:56:21.621060  7920 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.012s	sys 0.019s
I20260620 13:56:21.727773  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.727648  7891 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:21.729159  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.676241  5881 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:21.729292  7891 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:21.729966  7891 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:56:21.731284  6553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.015s	sys 0.003s
I20260620 13:56:21.731300  7995 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election won for term 3
W20260620 13:56:21.731832  6553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.016s	sys 0.003s
I20260620 13:56:21.732066  7995 raft_consensus.cc:697] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:21.731777  7947 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:21.733106  7995 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.730883  7891 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.734613  7911 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:21.735210  7911 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:21.737239  7992 log.cc:927] Time spent T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260620 13:56:21.737845  7911 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:21.738576  7994 log.cc:927] Time spent T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260620 13:56:21.668444  7927 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:21.648139  7993 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:21.750348  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:21.669473  7878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.020s	sys 0.019s
I20260620 13:56:21.681675  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:21.779305  6581 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
W20260620 13:56:21.784704  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:21.749267  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:21.758577  7911 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:21.794330  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:21.783527  7878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.020s	sys 0.019s
I20260620 13:56:21.662869  7805 consensus_queue.cc:237] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:21.678629  7963 consensus_queue.cc:237] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:21.778442  7967 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:21.788326  7970 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:21.817227  6582 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:21.748438  7892 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.796640  5875 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:21.776944  7927 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.839951  7960 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:21.840791  7993 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:21.842473  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.861738  7960 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.864444  7960 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:21.809736  7919 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.851861  7970 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:21.870306  5996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.026s	sys 0.047s
W20260620 13:56:21.873610  6032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.008s	sys 0.042s
I20260620 13:56:21.808576  7911 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:21.875337  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 391010us
W20260620 13:56:21.876302  6032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.008s	sys 0.042s
W20260620 13:56:21.875353  5996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.026s	sys 0.047s
I20260620 13:56:21.860466  7979 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:21.871695  7833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.016s	sys 0.078s
I20260620 13:56:21.878135  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
W20260620 13:56:21.881260  5878 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.025s	sys 0.071s
W20260620 13:56:21.884918  5878 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.025s	sys 0.071s
I20260620 13:56:21.884377  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:21.896081  6029 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:21.880420  7859 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260620 13:56:21.897717  5998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.134s	user 0.019s	sys 0.034s
W20260620 13:56:21.898200  5998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.019s	sys 0.034s
I20260620 13:56:21.879688  7993 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:21.882221  7833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.017s	sys 0.078s
W20260620 13:56:21.882077  7936 consensus_meta.cc:287] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.000s
I20260620 13:56:21.903185  6027 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
W20260620 13:56:21.898811  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 1.22155e+06us
I20260620 13:56:21.893911  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:21.905035  6028 raft_consensus.cc:2393] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 2: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:21.904881  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:21.891131  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:21.906281  7979 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:21.906428  7934 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:21.906535  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:21.906857  7799 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:21.907119  7934 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:21.907938  7934 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:21.908308  7979 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.910665  7979 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:21.901554  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:21.912099  6029 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:21.919365  7892 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:21.919772  8006 tablet_replica.cc:333] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:56:21.921459  5998 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:21.923509  5998 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:21.924116  5876 raft_consensus.cc:1240] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:21.925645  5882 raft_consensus.cc:1240] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:21.884872  7922 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:21.889402  7960 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:21.885426  7984 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:21.925674  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:21.929085  6029 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:21.877333  7970 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.937402  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:21.897531  7924 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
W20260620 13:56:21.938558  5848 leader_election.cc:336] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.166s (SENT)
W20260620 13:56:21.944636  5848 leader_election.cc:336] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.958s (SENT)
I20260620 13:56:21.945851  5848 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.948599  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:21.951076  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:21.919432  8008 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election won for term 4
W20260620 13:56:21.957124  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:21.934623  7979 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:21.945035  7791 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:21.927428  7993 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:21.968664  7799 raft_consensus.cc:697] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:21.945204  8001 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:21.972482  5848 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:21.969842  6587 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:21.959723  6024 raft_consensus.cc:3055] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:21.935214  7922 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.962394  7967 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:21.935788  7984 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:21.961548  7936 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:21.981528  6016 tablet_service.cc:1558] Processing DeleteTablet for tablet 020dbb4b944d4deeba944d1a7c6d5c76 with delete_type TABLET_DATA_TOMBSTONED (TS 663684cf4ae54c929bf8240ca0b63a47 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43482
W20260620 13:56:21.982254  7866 consensus_meta.cc:287] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.003s
I20260620 13:56:21.986066  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:21.974038  8009 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:21.996583  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:21.978255  8001 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:21.996814  5848 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:21.979173  6024 raft_consensus.cc:740] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:22.007750  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:22.004572  6580 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:22.011229  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:21.999500  7919 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:22.016765  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:22.010530  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:21.980556  7996 consensus_queue.cc:1059] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260620 13:56:22.012663  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:21.995456  7927 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:22.012079  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:21.998844  8010 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:22.027315  6031 raft_consensus.cc:2393] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:22.015518  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:22.027374  6587 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:22.018007  6029 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:22.029309  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:22.031396  7960 raft_consensus.cc:697] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:21.968241  7979 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:22.042106  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 45381.5us
I20260620 13:56:22.043498  5848 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:22.059849  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:22.009050  7973 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:22.062717  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 114193us
I20260620 13:56:22.008024  8001 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:22.072623  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:22.069957  6028 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:22.077368  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:22.079054  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:22.079924  5848 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:22.080120  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:22.023496  7872 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:22.025173  7924 raft_consensus.cc:697] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:22.081193  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:22.073251  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 141977us
I20260620 13:56:22.001231  7936 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.078116  8008 raft_consensus.cc:697] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:22.086841  5998 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:22.087468  8008 consensus_queue.cc:237] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:22.088629  7936 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:22.081926  6029 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:22.074723  6587 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260620 13:56:22.084306  5848 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:22.090075  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:22.090122  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:22.091162  5848 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:22.091364  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:22.092252  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:22.093037  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:22.093703  6029 raft_consensus.cc:2410] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260620 13:56:22.095304  5848 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:22.073945  7977 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:22.096457  6029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:56:22.072242  7919 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:22.100713  6029 raft_consensus.cc:606] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:22.129256  5998 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:56:22.092692  8002 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260620 13:56:22.082664  7833 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:22.130074  6029 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260620 13:56:22.139988  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:22.140172  6029 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260620 13:56:22.008157  8009 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } attrs { replace: true } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.135279  7970 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:22.099560  7967 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:22.129132  7919 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.136281  7866 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:22.101174  6587 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260620 13:56:22.126947  7977 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:22.143867  6027 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
W20260620 13:56:22.123420  8004 log.cc:927] Time spent T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260620 13:56:22.144388  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 135126us
I20260620 13:56:22.156363  6587 raft_consensus.cc:1240] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:22.007093  7799 consensus_queue.cc:237] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.171655  5882 raft_consensus.cc:1275] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260620 13:56:22.167320  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:22.162976  6026 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:22.211987  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:22.212092  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:22.212672  6026 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:22.210446  5882 pending_rounds.cc:85] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 3
I20260620 13:56:22.132679  7920 raft_consensus.cc:3055] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:22.215063  5882 pending_rounds.cc:107] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260620 13:56:22.086046  8010 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:22.215742  5882 raft_consensus.cc:2889] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:22.209858  6587 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:56:22.226344  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:22.227439  5882 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
W20260620 13:56:22.232331  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 151213us
I20260620 13:56:22.233279  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:22.233266  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:22.234967  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:22.236868  6587 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260620 13:56:22.236286  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 141086us
I20260620 13:56:22.211206  7977 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:22.238668  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:22.218540  8014 log.cc:927] Time spent T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260620 13:56:22.214697  8022 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:22.085439  7960 consensus_queue.cc:237] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:22.240123  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:22.212888  7970 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:22.157694  8023 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:22.219451  7993 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:22.219568  7920 raft_consensus.cc:740] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:22.252300  5848 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:22.220101  7866 raft_consensus.cc:697] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:22.253870  5882 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 3: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:22.262724  6027 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:22.263525  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:22.270471  5878 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:22.231741  7998 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:22.274693  5882 raft_consensus.cc:1240] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 3. Current term is 4. Ops: []
W20260620 13:56:22.282768  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 55810.5us
I20260620 13:56:22.278635  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:22.280067  6032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 1867) took 1131 ms. Trace:
I20260620 13:56:22.244690  8024 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:22.242311  8010 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:22.283488  6032 rpcz_store.cc:276] 0620 13:56:21.148684 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:21.153729 (+  5045us) service_pool.cc:224] Handling call
0620 13:56:21.154120 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:21.302325 (+148205us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:21.302377 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:21.318132 (+ 15755us) log.cc:844] Serialized 26 byte log entry
0620 13:56:21.367419 (+ 49287us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b1800088d80. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:56:21.876974 (+509555us) raft_consensus.cc:1645] Marking committed up to 1
0620 13:56:21.877028 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:21.877120 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:22.279739 (+402619us) raft_consensus.cc:1685] finished
0620 13:56:22.279762 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:22.280001 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155572,"raft.queue_time_us":148918,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":15271296,"thread_start_us":509330,"threads_started":1,"wal-append.queue_time_us":629063}
I20260620 13:56:22.286288  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:22.259024  7922 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:22.285081  6027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:56:22.291831  6027 raft_consensus.cc:606] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:56:22.292392  6027 raft_consensus.cc:614] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:56:22.237702  7934 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.294516  5878 raft_consensus.cc:2393] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 3: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:22.272352  7805 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:22.276906  8008 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:56:22.281939  7970 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:22.277063  8022 raft_consensus.cc:697] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:22.304596  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:22.281358  8025 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:22.306437  6552 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:22.305727  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 53526.8us
I20260620 13:56:22.274242  8023 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:22.313230  5848 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:22.314280  5849 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:22.310586  6552 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:22.316546  5875 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:22.321359  5881 raft_consensus.cc:1240] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:22.303882  7963 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
W20260620 13:56:22.325671  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 47139.7us
I20260620 13:56:22.325575  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:22.264671  7924 consensus_queue.cc:237] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.303964  7805 raft_consensus.cc:697] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:22.302418  8031 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:22.310680  7979 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:22.350824  6027 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260620 13:56:22.323748  8013 log.cc:927] Time spent T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260620 13:56:22.319752  7922 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:22.328208  8011 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260620 13:56:22.357510  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:22.360332  6032 raft_consensus.cc:2393] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 3: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:22.313525  7995 consensus_queue.cc:1059] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260620 13:56:22.325472  7892 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:22.308908  7970 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.377635  7859 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:22.365911  7892 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:22.378845  7892 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:22.380172  5875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:56:22.378278  7859 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:22.388167  5875 raft_consensus.cc:606] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:56:22.388926  7934 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:22.388700  8022 consensus_queue.cc:237] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:22.358882  7963 raft_consensus.cc:697] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:56:22.394454  8015 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260620 13:56:22.396715  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:22.398387  7995 raft_consensus.cc:3055] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:22.359308  7866 consensus_queue.cc:237] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:22.381275  7936 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260620 13:56:22.355993  8008 consensus_queue.cc:1059] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260620 13:56:22.414656  5882 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:22.328516  8030 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260620 13:56:22.353515  8025 consensus_queue.cc:1059] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260620 13:56:22.356577  8031 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.400494  7919 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:22.378288  8012 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:22.408082  7995 raft_consensus.cc:740] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:22.440121  8040 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:22.440755  8040 raft_consensus.cc:697] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:22.442090  8040 consensus_queue.cc:237] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:22.442734  7995 consensus_queue.cc:260] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.444260  7995 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:22.444967  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:22.445843  6583 raft_consensus.cc:2393] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:22.420637  7791 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:22.426896  7979 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:22.471323  6024 consensus_queue.cc:260] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.473268  6024 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:22.480988  6028 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:22.496723  6578 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
W20260620 13:56:22.498586  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:22.499075  7984 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:22.501677  7970 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:22.516090  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 389) took 1117 ms. Trace:
I20260620 13:56:22.519220  5953 rpcz_store.cc:276] 0620 13:56:21.399055 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:21.619813 (+220758us) service_pool.cc:224] Handling call
0620 13:56:21.652561 (+ 32748us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:21.655603 (+  3042us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:21.655632 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:21.664125 (+  8493us) log.cc:844] Serialized 26 byte log entry
0620 13:56:22.000153 (+336028us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:22.000219 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:22.006887 (+  6668us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:22.515778 (+508891us) raft_consensus.cc:1685] finished
0620 13:56:22.515812 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:22.516011 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3433,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":10227,"thread_start_us":252756,"threads_started":1,"wal-append.queue_time_us":397101}
I20260620 13:56:22.528481  8023 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:22.476276  8009 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:22.432924  7805 consensus_queue.cc:237] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.533661  7859 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:22.542753  7859 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:22.511983  8041 consensus_queue.cc:1059] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.160s
I20260620 13:56:22.518018  7976 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260620 13:56:22.512298  7963 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:22.571398  8038 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260620 13:56:22.554941  7892 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:22.574481  8032 log.cc:927] Time spent T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260620 13:56:22.591356  5883 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
W20260620 13:56:22.595029  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:22.576229  7892 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:22.599849  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:22.606032  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:22.615240  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 473747us
I20260620 13:56:22.617828  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:22.618247  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:22.619408  6586 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:22.620810  6587 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:22.623838  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:22.625008  6586 raft_consensus.cc:2393] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:22.587029  8009 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:22.642590  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:22.643317  6587 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:22.637224  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:22.641387  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:22.648224  6584 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:22.652777  6583 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:22.576207  8031 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:22.655292  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:22.621976  7752 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:22.621745  7859 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 13:56:22.622058  8012 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:22.582111  8001 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:22.635097  7892 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:56:22.668670  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 50920.1us
I20260620 13:56:22.677359  8050 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:22.676936  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 318839us
I20260620 13:56:22.675029  7752 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.686291  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:22.686914  6584 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:22.689464  6026 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:22.683684  8050 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.684657  7892 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.692283  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:22.693835  5998 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:22.694594  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 288762us
I20260620 13:56:22.657765  8009 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:22.695678  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:22.696239  7791 consensus_queue.cc:1059] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:56:22.696549  8006 raft_consensus.cc:2243] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:56:22.696462  7999 raft_consensus.cc:3055] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Stepping down as leader of term 3
W20260620 13:56:22.698112  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 383870us
I20260620 13:56:22.699570  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:22.699710  5959 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:22.692480  6587 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
W20260620 13:56:22.701130  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 388115us
I20260620 13:56:22.702268  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:22.703595  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:22.705612  6552 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:22.706075  6027 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:22.706348  7904 consensus_queue.cc:1059] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:22.709343  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:22.709153  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:22.710289  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:22.712109  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:22.713390  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:22.712199  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:22.713970  6584 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:22.714807  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:22.715761  6587 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 2: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:22.716895  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:22.718184  6027 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:22.719523  5884 raft_consensus.cc:1240] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260620 13:56:22.722703  5879 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:22.723402  7892 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:22.723805  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:22.724049  7892 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:22.724212  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:22.724610  7892 raft_consensus.cc:697] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:22.725162  5884 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:22.726485  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:22.678819  8012 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.722849  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:22.731078  6027 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:22.722781  7752 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:22.728859  5884 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:22.689126  7946 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260620 13:56:22.730211  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:22.709662  8034 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:22.708272  7934 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:22.741391  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:22.711359  7999 raft_consensus.cc:740] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:22.694533  8008 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260620 13:56:22.741595  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:22.700837  7995 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260620 13:56:22.755587  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:22.750540  8034 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:22.725767  7892 consensus_queue.cc:237] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.723423  6024 raft_consensus.cc:1240] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:22.754454  5998 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:22.746793  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:22.756253  6587 raft_consensus.cc:1813] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Handling vote request from an unknown peer 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:22.762506  6587 raft_consensus.cc:2393] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:22.763587  5998 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:22.764055  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:22.764816  6587 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:22.765256  5998 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:22.711241  7970 consensus_queue.cc:1059] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260620 13:56:22.765822  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:22.757902  7904 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:22.785250  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:22.759186  8034 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:22.788086  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:22.791368  6584 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:22.791657  6587 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:22.794095  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:22.796331  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:22.786607  5998 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:22.790768  7859 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260620 13:56:22.766942  7984 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:22.816721  6029 raft_consensus.cc:1240] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:22.821980  7924 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:22.786039  7993 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:22.813810  8006 raft_consensus.cc:2272] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:56:22.764932  7999 consensus_queue.cc:260] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:22.791077  7934 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:22.822795  7924 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.833377  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:22.823145  6578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 690) took 1167 ms. Trace:
I20260620 13:56:22.841472  8029 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:22.841369  6578 rpcz_store.cc:276] 0620 13:56:21.655614 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:21.656963 (+  1349us) service_pool.cc:224] Handling call
0620 13:56:22.379543 (+722580us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b580005fa98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:56:22.379793 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:22.497292 (+117499us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:22.822807 (+325515us) spinlock_profiling.cc:243] Waited 96.8 ms on lock 0x7b5400620554. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:22.823033 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236541056}
I20260620 13:56:22.842160  8029 raft_consensus.cc:697] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:22.827345  7866 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:22.843679  8029 consensus_queue.cc:237] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:22.854980  8000 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:22.855136  8055 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260620 13:56:22.856711  6587 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:22.859509  8051 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:22.823071  8028 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260620 13:56:22.852983  7866 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:22.854516  7999 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:22.897823  8054 log.cc:927] Time spent T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260620 13:56:22.903585  8017 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.884s	user 0.000s	sys 0.004s
I20260620 13:56:22.870173  8001 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:22.911826  8016 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.749s	user 0.004s	sys 0.000s
W20260620 13:56:22.914283  7927 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260620 13:56:22.897249  7866 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:22.944120  8050 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:22.942788  7924 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:22.850612  7920 consensus_queue.cc:260] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:22.976696  8022 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.028s	sys 0.055s
I20260620 13:56:22.905582  7911 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:22.967048  7977 consensus_meta.cc:287] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.000s
I20260620 13:56:22.960032  8009 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:23.005743  7970 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:23.039417  7910 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:23.040596  7948 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:23.017331  8030 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:23.045383  8019 raft_consensus.cc:993] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: : Instructing follower b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:56:22.909183  8051 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.025893  7911 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260620 13:56:23.075443  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:23.080307  7911 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:23.081528  7911 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:23.084456  8006 ts_tablet_manager.cc:1916] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:56:23.080308  7996 raft_consensus.cc:1081] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Signalling peer b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:56:23.065881  7920 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:23.047995  8022 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.028s	sys 0.059s
I20260620 13:56:23.096235  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:23.105979  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:23.079945  8030 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.099494  6585 raft_consensus.cc:2376] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3. Re-sending same reply.
I20260620 13:56:23.021309  7977 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:23.115200  7922 consensus_meta.cc:287] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.753s	user 0.008s	sys 0.005s
I20260620 13:56:23.110651  8008 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:23.115800  7922 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:23.116036  8008 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.118361  8008 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:23.121616  6585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 699) took 1410 ms (client timeout 1671 ms). Trace:
I20260620 13:56:23.088138  8037 consensus_queue.cc:1059] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260620 13:56:23.124505  8037 raft_consensus.cc:3055] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:23.124974  8037 raft_consensus.cc:740] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:56:23.125617  8010 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.829s	user 0.003s	sys 0.009s
I20260620 13:56:23.127174  5879 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:56:23.068322  7910 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:23.122186  6585 rpcz_store.cc:269] 0620 13:56:21.701645 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:21.724828 (+ 23183us) service_pool.cc:224] Handling call
0620 13:56:23.096066 (+1371238us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b580005fa98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:56:23.112115 (+ 16049us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59257728}
I20260620 13:56:23.132386  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 366) took 1247 ms. Trace:
I20260620 13:56:23.130972  8030 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:23.132905  6025 rpcz_store.cc:276] 0620 13:56:21.891486 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:21.891945 (+   459us) service_pool.cc:224] Handling call
0620 13:56:21.892388 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:22.002956 (+110568us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:22.002987 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:22.003037 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:22.003076 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:23.132103 (+1129027us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54001c8254. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:23.132153 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:23.132312 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253768448}
I20260620 13:56:23.110417  7946 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:23.126106  8010 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:23.151186  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:23.149816  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:23.151926  5958 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
W20260620 13:56:23.152204  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:23.154489  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:23.156005  8019 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:23.112836  8012 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:23.158592  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:23.160805  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:23.162791  5957 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:23.164177  8001 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:23.155557  7967 consensus_meta.cc:287] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.943s	user 0.014s	sys 0.000s
I20260620 13:56:23.156281  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:23.165771  5956 raft_consensus.cc:1240] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:23.157513  7946 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.237897  8051 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:23.126080  8037 consensus_queue.cc:260] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.244364  8037 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:23.245611  5997 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:23.247350  7937 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:23.241834  7967 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:23.247884  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:23.246861  5997 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:23.156715  8019 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.259416  7984 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:23.259974  7984 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:23.260428  7984 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:23.261175  8019 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:23.265539  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:23.266374  5950 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:23.242100  5951 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:23.269148  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:23.164742  8001 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.240617  8008 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:23.241616  7946 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:23.247817  7937 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:23.318672  7934 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260620 13:56:23.298472  5849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.003s	sys 0.033s
I20260620 13:56:23.269486  5955 raft_consensus.cc:1240] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:23.241890  7867 consensus_queue.cc:1059] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
W20260620 13:56:23.332304  5849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.003s	sys 0.033s
I20260620 13:56:23.330112  7937 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:23.342146  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 595411us
W20260620 13:56:23.346560  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 560001us
I20260620 13:56:23.348037  5998 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:23.350118  6031 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260620 13:56:23.351774  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:23.353094  6582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 588) took 2937 ms. Trace:
I20260620 13:56:23.353704  8051 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:23.359725  8051 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:23.362380  8051 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:23.353530  6582 rpcz_store.cc:276] 0620 13:56:20.405375 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:20.405486 (+   111us) service_pool.cc:224] Handling call
0620 13:56:20.405795 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:21.817769 (+1411974us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:23.342321 (+1524552us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54005bd954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:23.342526 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3245511936}
W20260620 13:56:23.364734  6027 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.015s	sys 0.052s
W20260620 13:56:23.365125  6027 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.015s	sys 0.052s
I20260620 13:56:23.365789  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:23.366422  5879 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:23.368252  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:23.336794  8036 tablet_replica.cc:333] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:56:23.330583  7934 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:23.376094  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:23.332878  7910 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:23.383524  6028 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:23.385129  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:23.386224  6025 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:23.329527  8008 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.391144  7977 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:23.425848  5951 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:23.430373  5881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2243) took 1518 ms. Trace:
I20260620 13:56:23.430828  5881 rpcz_store.cc:276] 0620 13:56:21.911531 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:21.912345 (+   814us) service_pool.cc:224] Handling call
0620 13:56:22.321191 (+408846us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:22.322178 (+   987us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:23.430154 (+1107976us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54003fb1d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:23.430304 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911011072}
I20260620 13:56:23.431849  7927 raft_consensus.cc:3055] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:23.432454  7927 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:23.433336  5876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1249) took 1263 ms. Trace:
I20260620 13:56:23.434072  7984 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.426542  7910 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260620 13:56:23.435703  8021 raft_consensus.cc:3055] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:23.436101  8021 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:23.436981  8021 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:23.438040  8034 consensus_meta.cc:287] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.000s
I20260620 13:56:23.433764  5876 rpcz_store.cc:276] 0620 13:56:22.170099 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:22.170211 (+   112us) service_pool.cc:224] Handling call
0620 13:56:22.170621 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:22.232013 (+ 61392us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:22.232041 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:22.232084 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:22.232114 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:23.433093 (+1200979us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b54000519d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:23.433141 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:23.433277 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140679552}
I20260620 13:56:23.445658  5879 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:23.447660  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:23.449345  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:23.439630  8020 consensus_queue.cc:1059] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260620 13:56:23.451025  7867 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:23.434893  7799 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:23.452792  6029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2258) took 1315 ms. Trace:
I20260620 13:56:23.343569  7911 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.388969  7934 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:23.446614  7946 consensus_queue.cc:1059] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260620 13:56:23.433367  7927 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.438069  8021 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:23.479743  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:23.467613  6029 rpcz_store.cc:276] 0620 13:56:22.137718 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:22.141971 (+  4253us) service_pool.cc:224] Handling call
0620 13:56:22.142537 (+   566us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:22.817347 (+674810us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:23.452540 (+635193us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b540009c254. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:23.452730 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549930240}
I20260620 13:56:23.517143  6025 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
W20260620 13:56:23.474473  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:23.467803  5997 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:23.518684  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 122366us
I20260620 13:56:23.476436  7867 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:23.479024  5875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51382 (request call id 17) took 1103 ms. Trace:
I20260620 13:56:23.521054  8019 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:23.474442  7799 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:23.534873  8019 raft_consensus.cc:697] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:23.535856  7799 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.537240  7799 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:23.540246  7984 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:23.541385  8037 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:23.540931  7937 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.480095  7833 raft_consensus.cc:3055] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:23.547926  7833 raft_consensus.cc:740] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:23.549369  7911 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:23.518906  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 51237.9us
I20260620 13:56:23.552461  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:23.553212  5951 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 4
I20260620 13:56:23.553681  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:23.536015  8019 consensus_queue.cc:237] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:23.541909  8037 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:23.482201  7924 raft_consensus.cc:3055] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:23.542578  8020 raft_consensus.cc:3055] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:23.523903  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:23.566960  5849 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:23.481465  8001 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:23.485831  7866 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:23.480140  7859 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:23.481804  7909 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:23.517823  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 169895us
W20260620 13:56:23.572044  5883 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42748 (request call id 365) took 1919 ms (client timeout 1560 ms). Trace:
I20260620 13:56:23.573292  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:23.584942  6030 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:23.585074  5998 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:23.574635  6026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2259) took 1360 ms. Trace:
I20260620 13:56:23.586236  6026 rpcz_store.cc:276] 0620 13:56:22.214509 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:22.229531 (+ 15022us) service_pool.cc:224] Handling call
0620 13:56:22.239798 (+ 10267us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:22.689894 (+450096us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:23.574417 (+884523us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b5400059bd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:23.574576 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1033671424}
I20260620 13:56:23.575737  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:23.587656  5959 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:23.584746  5883 rpcz_store.cc:269] 0620 13:56:21.653037 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:21.653197 (+   160us) service_pool.cc:224] Handling call
0620 13:56:23.571860 (+1918663us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b54000c67d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:23.571977 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012495616}
I20260620 13:56:23.588462  5998 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:23.592974  7937 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:23.593729  8008 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:23.449862  8034 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.564935  8037 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:23.580063  7910 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:23.579856  7911 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260620 13:56:23.579732  7999 consensus_meta.cc:287] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.002s
I20260620 13:56:23.562668  8020 raft_consensus.cc:740] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:23.561054  7924 raft_consensus.cc:740] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:56:23.611752  5880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.008s	sys 0.016s
W20260620 13:56:23.612329  5880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.009s	sys 0.016s
I20260620 13:56:23.595254  8001 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260620 13:56:23.616415  6552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.023s	sys 0.040s
W20260620 13:56:23.616940  6552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.023s	sys 0.040s
I20260620 13:56:23.606299  7910 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:23.526193  5875 rpcz_store.cc:276] 0620 13:56:22.375348 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:22.380013 (+  4665us) service_pool.cc:224] Handling call
0620 13:56:23.478748 (+1098735us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4c00117900. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fddac6120 00007f0fddad7129 00007f0fdda9cd44 00007f0fddac462d 00007f0fddac4293 00007f0fdf7f7072 00007f0fdf7f6c2a 00007f0fe47c4d0a 00007f0fddd48934 00007f0fddd488c2 00007f0fddd487f1
0620 13:56:23.478897 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28984704}
I20260620 13:56:23.609432  7911 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:23.549484  7833 consensus_queue.cc:260] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:23.623330  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 902547us
I20260620 13:56:23.634704  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:23.635394  6029 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:23.638551  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:23.639063  5959 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
W20260620 13:56:23.613950  8040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.002s	sys 0.025s
W20260620 13:56:23.615438  7904 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.022s	sys 0.018s
I20260620 13:56:23.649639  6587 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:23.655097  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:23.617595  8001 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:23.633535  7892 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.005s	sys 0.021s
W20260620 13:56:23.697481  7892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.005s	sys 0.021s
W20260620 13:56:23.621222  7979 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.023s	sys 0.043s
I20260620 13:56:23.621917  7910 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:23.698813  5997 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:23.692768  8029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.013s	sys 0.013s
I20260620 13:56:23.641295  7911 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:56:23.692893  6553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.043s	sys 0.074s
W20260620 13:56:23.696391  7904 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.022s	sys 0.018s
I20260620 13:56:23.645416  8030 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:56:23.707481  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 63655.2us
I20260620 13:56:23.677290  6029 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
W20260620 13:56:23.704699  8029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.013s	sys 0.013s
W20260620 13:56:23.696853  8040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.002s	sys 0.025s
W20260620 13:56:23.703557  7979 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.028s	sys 0.052s
W20260620 13:56:23.707191  7891 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.025s	sys 0.014s
W20260620 13:56:23.726261  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:23.951555  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:23.952226  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:23.952445  6029 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:23.952921  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:23.953478  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:23.695953  8008 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:56:23.954761  5924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.032s	sys 0.052s
I20260620 13:56:23.701428  8001 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:23.718079  8048 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.010s	sys 0.015s
W20260620 13:56:23.782464  8049 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.017s	sys 0.051s
I20260620 13:56:23.793380  8072 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:23.720290  7920 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:23.723178  7904 raft_consensus.cc:697] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:56:23.889192  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 71831.3us
W20260620 13:56:23.896552  6551 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.027s	user 0.017s	sys 0.082s
W20260620 13:56:23.900933  5878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.037s	sys 0.053s
W20260620 13:56:23.967056  6551 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.017s	sys 0.082s
W20260620 13:56:23.967778  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 1.10372e+06us
W20260620 13:56:23.968201  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:23.704593  7924 consensus_queue.cc:260] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:23.739745  8030 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.971792  6029 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:23.907698  7947 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:23.974661  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:23.898402  8040 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:23.696411  8020 consensus_queue.cc:260] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.705165  8044 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:23.704362  8045 raft_consensus.cc:3055] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Stepping down as leader of term 2
W20260620 13:56:23.708269  6553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.043s	sys 0.074s
W20260620 13:56:23.956350  5924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.032s	sys 0.052s
W20260620 13:56:23.988981  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 550310us
I20260620 13:56:23.989881  6551 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:23.936623  7866 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:23.992054  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:23.992579  5956 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260620 13:56:23.962714  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 474517us
W20260620 13:56:23.954396  7891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.026s	sys 0.014s
I20260620 13:56:23.895287  7973 raft_consensus.cc:3055] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
W20260620 13:56:23.967324  5878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.037s	sys 0.053s
I20260620 13:56:23.914419  5951 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:23.975463  6587 raft_consensus.cc:1813] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Handling vote request from an unknown peer 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:23.980510  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:23.981643  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 317386us
W20260620 13:56:23.983397  5847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.227s	user 0.015s	sys 0.033s
I20260620 13:56:24.022132  6587 raft_consensus.cc:2393] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 2: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:56:24.023474  5847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.267s	user 0.015s	sys 0.033s
W20260620 13:56:23.966979  8048 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.011s	sys 0.016s
I20260620 13:56:23.997087  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:23.987924  7867 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:23.960889  8008 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:23.983739  7920 raft_consensus.cc:697] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:23.997282  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:56:24.003407  6027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.030s	sys 0.075s
W20260620 13:56:24.005246  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:23.997638  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
W20260620 13:56:23.976934  8049 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.200s	user 0.017s	sys 0.052s
I20260620 13:56:23.986389  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:24.026567  6027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.030s	sys 0.075s
I20260620 13:56:24.026418  5954 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:24.028204  6027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 1890) took 1310 ms. Trace:
I20260620 13:56:23.997018  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:24.028604  6027 rpcz_store.cc:276] 0620 13:56:22.717905 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:22.733102 (+ 15197us) service_pool.cc:224] Handling call
0620 13:56:22.733475 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:22.733725 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:23.372654 (+638929us) log.cc:844] Serialized 14 byte log entry
0620 13:56:24.027892 (+655238us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:24.027943 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:24.027990 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:24.028055 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:24.028156 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":962079,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"thread_start_us":1267825,"threads_started":2}
I20260620 13:56:23.988792  8034 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:24.024760  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260620 13:56:24.040210  5879 raft_consensus.cc:1240] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:24.043435  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:24.045336  6030 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:24.046350  6026 raft_consensus.cc:1240] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260620 13:56:24.019790  7752 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.006s	sys 0.041s
I20260620 13:56:24.013895  8068 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:24.016623  7946 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:24.013957  8029 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:24.048292  5997 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:24.012414  8045 raft_consensus.cc:740] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:24.021237  8020 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:23.990152  7947 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:23.987082  8040 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:24.019747  7973 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:24.105679  5883 raft_consensus.cc:1240] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:24.035040  7924 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:24.109822  5884 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260620 13:56:24.033970  7945 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:24.033800  8063 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:24.018760  7799 consensus_queue.cc:1059] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260620 13:56:24.052525  7752 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.006s	sys 0.041s
W20260620 13:56:24.118402  6032 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.004s	sys 0.007s
I20260620 13:56:23.977247  8072 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:24.119303  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:23.991143  8044 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:24.041683  7891 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:24.043443  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:24.150568  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:24.047320  8067 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:24.019155  8069 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260620 13:56:24.051839  7791 raft_consensus.cc:3055] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:24.040714  7910 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:24.106032  8068 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:24.047428  6583 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
W20260620 13:56:24.294068  5998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.027s	sys 0.046s
W20260620 13:56:24.623785  5998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.029s	sys 0.060s
W20260620 13:56:24.258842  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 73618.2us
I20260620 13:56:24.626811  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:24.332906  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:24.624153  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 1.02067e+06us
W20260620 13:56:24.624693  6032 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.007s	sys 0.013s
I20260620 13:56:24.113391  8041 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260620 13:56:24.544029  5878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.029s	sys 0.012s
W20260620 13:56:24.631379  5878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.034s	sys 0.013s
W20260620 13:56:24.631845  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:24.632568  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:24.633052  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:24.630761  6032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 1901) took 1060 ms. Trace:
W20260620 13:56:24.669631  5876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.017s	sys 0.013s
W20260620 13:56:24.670044  5876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.018s	sys 0.013s
I20260620 13:56:24.128017  8065 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election won for term 4
W20260620 13:56:24.180087  8061 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260620 13:56:24.403690  7948 consensus_meta.cc:287] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.336s	user 0.010s	sys 0.003s
I20260620 13:56:24.668684  6032 rpcz_store.cc:276] 0620 13:56:23.570607 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:23.572965 (+  2358us) service_pool.cc:224] Handling call
0620 13:56:23.604710 (+ 31745us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:24.630406 (+1025696us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:24.630442 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:24.630488 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0620 13:56:24.630521 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:24.630588 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:24.630698 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14607,"spinlock_wait_cycles":160550272,"thread_start_us":1025119,"threads_started":1}
I20260620 13:56:24.132416  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:24.414739  7979 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:24.256659  8034 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:24.668793  8049 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:24.590667  8037 consensus_meta.cc:287] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.981s	user 0.011s	sys 0.001s
W20260620 13:56:24.687425  7805 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.162s	user 0.024s	sys 0.020s
I20260620 13:56:24.623052  7791 raft_consensus.cc:740] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:56:24.720093  5954 consensus_meta.cc:287] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.000s
I20260620 13:56:24.118170  8029 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:24.711180  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 76624.6us
W20260620 13:56:24.711644  6552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.004s	sys 0.041s
I20260620 13:56:24.223896  7866 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:24.669149  8041 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:24.668457  7937 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260620 13:56:24.236186  8075 log.cc:927] Time spent T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260620 13:56:24.701227  7867 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:24.734072  5954 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
W20260620 13:56:24.742973  6552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.004s	sys 0.041s
W20260620 13:56:24.756757  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 714610us
I20260620 13:56:24.708884  7948 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:24.718367  5950 raft_consensus.cc:2393] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 2: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:24.181171  7945 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:24.180783  8063 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:24.721145  6579 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:24.545472  8082 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.251s
W20260620 13:56:24.716758  7805 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.024s	sys 0.021s
I20260620 13:56:24.701776  8065 raft_consensus.cc:697] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:24.126991  7946 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:24.768692  6551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.024s	sys 0.019s
W20260620 13:56:24.803509  6551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.024s	sys 0.019s
W20260620 13:56:24.803857  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 808549us
I20260620 13:56:24.496850  7920 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:24.141577  7904 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:24.772243  5850 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.004s	sys 0.031s
I20260620 13:56:24.722790  8049 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:24.717454  5875 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
W20260620 13:56:24.783201  5924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.000s	sys 0.049s
I20260620 13:56:24.543382  7973 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:24.752606  7866 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:24.669504  8067 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:24.715499  7979 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:24.708830  8034 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:24.757745  7867 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:24.836266  5848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.090s (SENT) [suppressed 17 similar messages]
I20260620 13:56:24.759234  8026 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:24.670396  8045 consensus_queue.cc:260] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:24.722076  8037 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.131593  8045 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:25.132864  8037 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:24.758275  8070 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:25.133682  8070 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:25.135640  8070 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:24.812282  5850 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.005s	sys 0.031s
W20260620 13:56:25.136337  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:25.137266  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:24.812369  5997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.004s	sys 0.023s
W20260620 13:56:25.138358  5997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.004s	sys 0.024s
W20260620 13:56:25.140036  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:25.140774  7920 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:25.141047  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:25.141422  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:25.141288  7920 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:25.141916  7919 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.142360  7919 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.143615  7920 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:25.143842  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 396) took 1170 ms. Trace:
W20260620 13:56:24.805925  5996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.010s	sys 0.015s
W20260620 13:56:24.814630  6582 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.011s	sys 0.017s
W20260620 13:56:24.816548  5924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.000s	sys 0.049s
I20260620 13:56:24.750154  8041 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:56:25.144520  5996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.010s	sys 0.015s
I20260620 13:56:24.759776  6552 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:24.825837  8063 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:24.798584  8030 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:25.144326  7919 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:25.145968  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 386278us
I20260620 13:56:25.146235  8030 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.146703  8030 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.147049  8026 raft_consensus.cc:697] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:25.148000  8026 consensus_queue.cc:237] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.148772  8030 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:24.799494  8008 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:24.800383  7891 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:25.149631  7891 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:24.823763  8065 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:24.785630  7948 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.145969  8063 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.151435  8107 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:25.151978  8107 raft_consensus.cc:697] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:25.151726  8063 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:25.153148  7948 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:25.152923  8107 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:24.802950  5999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.048s	sys 0.041s
W20260620 13:56:25.020752  7909 consensus_meta.cc:287] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.430s	user 0.010s	sys 0.003s
W20260620 13:56:24.867080  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 120604us
I20260620 13:56:24.928146  8034 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:25.007972  7927 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:25.004510  8074 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 1.085s	user 0.009s	sys 0.013s
I20260620 13:56:24.947855  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260620 13:56:24.925559  8001 consensus_meta.cc:287] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.959s	user 0.006s	sys 0.005s
I20260620 13:56:24.969214  6026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 376) took 1335 ms. Trace:
I20260620 13:56:24.912426  8044 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:24.908882  7867 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:24.874547  8079 log.cc:927] Time spent T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.424s	user 0.001s	sys 0.001s
I20260620 13:56:24.911691  7947 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:24.877434  8098 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:25.012239  8040 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:24.965814  7993 raft_consensus.cc:3055] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Stepping down as leader of term 1
W20260620 13:56:24.952684  7911 consensus_meta.cc:287] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 1.229s	user 0.007s	sys 0.005s
I20260620 13:56:25.010975  8072 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:24.975394  7791 consensus_queue.cc:260] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:24.925772  8080 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.497s	user 0.001s	sys 0.000s
I20260620 13:56:25.153787  8063 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:25.160735  7984 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:25.155972  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 319745us
I20260620 13:56:25.176854  8098 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.177294  7984 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:25.178512  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260620 13:56:25.165172  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 342687us
I20260620 13:56:25.179569  6580 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:25.180538  8091 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:25.181530  8001 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:25.181941  6580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 709) took 3234 ms (client timeout 2195 ms). Trace:
W20260620 13:56:25.182327  6580 rpcz_store.cc:269] 0620 13:56:21.947399 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:22.016646 (+ 69247us) service_pool.cc:224] Handling call
0620 13:56:25.181768 (+3165122us) spinlock_profiling.cc:243] Waited 3.12 s on lock 0x7b54005113d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:25.181872 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7173142912}
I20260620 13:56:24.964906  7833 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:25.183611  8001 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:25.183826  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:25.184224  6026 rpcz_store.cc:276] 0620 13:56:23.633416 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:23.633546 (+   130us) service_pool.cc:224] Handling call
0620 13:56:24.046023 (+412477us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:24.046787 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:24.968888 (+922101us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b540019ee50. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:24.969120 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806254464}
I20260620 13:56:25.185448  5849 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:25.186218  8072 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:25.007699  7910 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:25.186520  8040 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:25.157507  5884 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:25.157953  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:24.878378  7973 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:25.187757  5878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 371) took 2803 ms. Trace:
I20260620 13:56:25.188122  5878 rpcz_store.cc:276] 0620 13:56:22.384638 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:22.431082 (+ 46444us) service_pool.cc:224] Handling call
0620 13:56:22.460328 (+ 29246us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:22.477432 (+ 17104us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:22.477473 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:22.480485 (+  3012us) log.cc:844] Serialized 26 byte log entry
0620 13:56:22.966778 (+486293us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b1800055900. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc70ad22 00007f0fdc70cfc1 00007f0fdc70cf79 00007f0fdc70cf09 00007f0fdc70ced1 00007f0fdc70c1cd 0000000000389354 0000000000389199 00007f0fdc6ee03a
0620 13:56:23.113948 (+147170us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b1800055900. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:56:24.018809 (+904861us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:24.038186 (+ 19377us) log.cc:844] Serialized 14 byte log entry
0620 13:56:24.631854 (+593668us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:24.631951 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:25.187521 (+555570us) raft_consensus.cc:1685] finished
0620 13:56:25.187542 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:25.187677 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58842,"prepare.queue_time_us":24782,"prepare.run_cpu_time_us":7982,"prepare.run_wall_time_us":51290,"raft.queue_time_us":147903,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":59248,"spinlock_wait_cycles":19460864,"thread_start_us":1494198,"threads_started":2,"wal-append.queue_time_us":1761938}
I20260620 13:56:24.911494  7946 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:24.943817  8076 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 1.032s	user 0.020s	sys 0.017s
I20260620 13:56:24.872145  7996 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.191326  7993 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:25.191447  7996 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:24.900529  8049 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:25.192168  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:24.959879  5779 catalog_manager.cc:5696] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 1 to 3, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 3 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:25.192297  7993 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.193251  5849 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:25.193629  7996 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:24.889671  8088 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260620 13:56:25.153939  5999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.049s	sys 0.041s
I20260620 13:56:25.193801  5779 catalog_manager.cc:5696] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 2 to 3, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 3 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:56:24.977429  6579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 689) took 3322 ms (client timeout 2819 ms). Trace:
I20260620 13:56:25.154762  7891 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:24.888959  8029 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:24.889827  5923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.007s	sys 0.014s
I20260620 13:56:25.195387  5880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 368) took 2819 ms. Trace:
W20260620 13:56:24.877650  8078 log.cc:927] Time spent T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.742s	user 0.000s	sys 0.001s
I20260620 13:56:25.195680  8029 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:25.069394  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:24.909170  7979 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:25.196545  7996 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.196241  8029 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.196943  7979 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:25.197198  8049 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:25.197381  7979 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:25.197819  8049 raft_consensus.cc:697] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:25.197896  7979 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:25.198102  8098 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:25.077426  7752 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.198493  8029 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:24.891489  7866 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:24.903119  8021 consensus_meta.cc:287] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 1.381s	user 0.011s	sys 0.001s
W20260620 13:56:24.904814  7970 consensus_meta.cc:287] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 1.840s	user 0.012s	sys 0.001s
I20260620 13:56:25.198829  8049 consensus_queue.cc:237] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.199729  7970 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260620 13:56:24.831867  8048 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.003s	sys 0.009s
W20260620 13:56:25.200585  8048 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.005s	sys 0.011s
I20260620 13:56:24.901515  8068 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:24.814492  7805 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.201900  8040 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260620 13:56:25.111696  6553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.005s	sys 0.010s
I20260620 13:56:25.195389  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 1898) took 1626 ms. Trace:
I20260620 13:56:25.202800  6025 rpcz_store.cc:276] 0620 13:56:23.569135 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:23.569336 (+   201us) service_pool.cc:224] Handling call
0620 13:56:23.596295 (+ 26959us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:23.603392 (+  7097us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:23.603424 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:23.607675 (+  4251us) log.cc:844] Serialized 26 byte log entry
0620 13:56:23.995694 (+388019us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:23.995742 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:23.995807 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:25.195181 (+1199374us) raft_consensus.cc:1685] finished
0620 13:56:25.195204 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:25.195331 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6650,"raft.queue_time_us":19576,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":73520,"thread_start_us":373322,"threads_started":1,"wal-append.queue_time_us":1069409}
I20260620 13:56:25.144308  5955 rpcz_store.cc:276] 0620 13:56:23.972979 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:23.976181 (+  3202us) service_pool.cc:224] Handling call
0620 13:56:23.991788 (+ 15607us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:25.140921 (+1149133us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:25.140957 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:25.141018 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:25.141059 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:25.143592 (+  2533us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400043154. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:25.143642 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:25.143782 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2499,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"spinlock_wait_cycles":2641966464}
W20260620 13:56:25.166575  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:24.817390  7934 consensus_meta.cc:287] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 1.295s	user 0.012s	sys 0.002s
I20260620 13:56:25.205205  7934 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.206341  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:25.194974  6579 rpcz_store.cc:269] 0620 13:56:21.655342 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:21.656514 (+  1172us) service_pool.cc:224] Handling call
0620 13:56:24.977160 (+3320646us) spinlock_profiling.cc:243] Waited 2.91 s on lock 0x7b54006b0154. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:24.977305 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6691300608}
I20260620 13:56:25.207823  7934 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:25.208021  5876 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:25.208194  6026 raft_consensus.cc:1240] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:25.193583  7993 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:25.156155  5776 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47386 (request call id 231) took 5061 ms. Trace:
I20260620 13:56:25.212543  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:25.216845  7791 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:25.195881  5880 rpcz_store.cc:276] 0620 13:56:22.375698 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:22.380817 (+  5119us) service_pool.cc:224] Handling call
0620 13:56:22.389430 (+  8613us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:23.019122 (+629692us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:23.019155 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:23.026278 (+  7123us) log.cc:844] Serialized 26 byte log entry
0620 13:56:23.612889 (+586611us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:23.612952 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:24.919022 (+1306070us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:56:24.959763 (+ 40741us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b5400169ed4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:24.959815 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:25.195187 (+235372us) raft_consensus.cc:1685] finished
0620 13:56:25.195211 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:25.195331 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142240,"raft.queue_time_us":149173,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8159,"spinlock_wait_cycles":1175363328,"thread_start_us":572517,"threads_started":1,"wal-append.queue_time_us":871195}
W20260620 13:56:25.144604  6582 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.011s	sys 0.017s
I20260620 13:56:25.166074  8101 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:25.187073  8069 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.221624  8072 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:25.222045  8069 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:25.072721  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:25.185254  7911 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:25.006263  8093 raft_consensus.cc:3055] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:25.227165  7920 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.227437  8093 raft_consensus.cc:740] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:25.227773  7920 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:24.961558  7924 consensus_meta.cc:287] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.826s	user 0.000s	sys 0.007s
I20260620 13:56:25.228313  8093 consensus_queue.cc:260] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.229683  8093 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:25.210920  5776 rpcz_store.cc:276] 0620 13:56:20.094593 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:20.097606 (+  3013us) service_pool.cc:224] Handling call
0620 13:56:25.156087 (+5058481us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:56:21.915741 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:56:21.916371 (+   630us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:56:21.916413 (+    42us) write_op.cc:435] Acquired schema lock
0620 13:56:21.916434 (+    21us) tablet.cc:662] Decoding operations
0620 13:56:21.917262 (+   828us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:56:21.917357 (+    95us) write_op.cc:641] Partition lock acquired for write op
0620 13:56:21.917392 (+    35us) tablet.cc:685] Acquiring locks for 6 operations
0620 13:56:21.918153 (+   761us) tablet.cc:701] Row locks acquired
0620 13:56:21.918196 (+    43us) write_op.cc:260] PREPARE: finished
0620 13:56:21.918373 (+   177us) write_op.cc:270] Start()
0620 13:56:21.918493 (+   120us) write_op.cc:276] Timestamp: P: 1781963781918314 usec, L: 0
0620 13:56:21.918514 (+    21us) op_driver.cc:348] REPLICATION: starting
0620 13:56:21.940577 (+ 22063us) log.cc:844] Serialized 2380 byte log entry
0620 13:56:22.475254 (+534677us) op_driver.cc:464] REPLICATION: finished
0620 13:56:22.736962 (+261708us) write_op.cc:301] APPLY: starting
0620 13:56:22.744816 (+  7854us) tablet.cc:1367] starting BulkCheckPresence
0620 13:56:22.764653 (+ 19837us) tablet.cc:1370] finished BulkCheckPresence
0620 13:56:22.764801 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:56:22.768182 (+  3381us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:56:22.826001 (+ 57819us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0620 13:56:22.830766 (+  4765us) write_op.cc:312] APPLY: finished
0620 13:56:22.874037 (+ 43271us) log.cc:844] Serialized 53 byte log entry
0620 13:56:22.899760 (+ 25723us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:22.903488 (+  3728us) write_op.cc:454] Released schema lock
0620 13:56:22.903561 (+    73us) write_op.cc:341] FINISH: Updating metrics
0620 13:56:22.904008 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:22.907972 (+  3964us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16513,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":242058,"apply.run_cpu_time_us":3864,"apply.run_wall_time_us":184561,"num_ops":6,"prepare.queue_time_us":466876,"prepare.run_cpu_time_us":13558,"prepare.run_wall_time_us":169049,"raft.queue_time_us":316560,"raft.run_cpu_time_us":46299,"raft.run_wall_time_us":239369,"replication_time_us":535260,"thread_start_us":893663,"threads_started":4,"wal-append.queue_time_us":193285,"wal-append.run_cpu_time_us":22655,"wal-append.run_wall_time_us":1753944}]]}
I20260620 13:56:25.231614  8021 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:25.195536  5923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.007s	sys 0.022s
I20260620 13:56:25.232153  8021 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.234170  8021 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:24.930799  7945 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:24.987731  8067 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:25.185931  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 1.1585e+06us
W20260620 13:56:25.196796  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:25.236021  7920 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:25.236313  7924 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.236497  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:25.194454  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:25.201647  7805 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:25.236828  7924 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:25.238024  5924 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:25.238732  7805 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:25.057137  8020 consensus_meta.cc:287] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.929s	user 0.007s	sys 0.004s
I20260620 13:56:25.239265  8045 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:25.059579  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 390458us
I20260620 13:56:25.239696  8008 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:25.239869  8067 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260620 13:56:25.236188  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:25.240245  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:25.240749  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:25.241120  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 46754.4us
I20260620 13:56:25.239349  7946 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:25.197083  7996 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.113634  8006 ts_tablet_manager.cc:1929] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:56:25.138293  5867 tablet_service.cc:1558] Processing DeleteTablet for tablet 24c27735bbb449a98fab7edad2ba9837 with delete_type TABLET_DATA_TOMBSTONED (TS 2e82c0c231624695ac5a813230bf5038 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58442
W20260620 13:56:25.111331  6550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.000s	sys 0.010s
I20260620 13:56:25.243124  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:25.203809  8041 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:25.240463  8067 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:25.243626  6550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.001s	sys 0.010s
I20260620 13:56:25.256794  5779 catalog_manager.cc:5696] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 3 to 2, leader changed from <none> to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:56:25.202455  6553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.005s	sys 0.010s
I20260620 13:56:25.239948  8045 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.243427  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:25.244737  5849 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:25.283430  7904 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:25.286010  5998 connection.cc:256] RPC call timeout handler was delayed by -1.1466038919999164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260620 13:56:25.288542  5779 catalog_manager.cc:5696] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 2 to 3, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 3 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:56:25.307866  5998 connection.cc:256] RPC call timeout handler was delayed by -1.0609008459999814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260620 13:56:25.307786  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:25.308665  6580 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:25.309064  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:25.288697  5997 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:25.242377  7946 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:25.296214  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:25.311024  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 161957us
I20260620 13:56:25.311774  5998 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:25.308494  5779 catalog_manager.cc:5696] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 3 to 5, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 5 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:56:25.317718  8069 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:25.317998  7946 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:25.317651  7791 consensus_queue.cc:1059] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:25.319150  7791 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260620 13:56:25.319345  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 45200.2us
I20260620 13:56:25.319936  7791 raft_consensus.cc:3055] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:25.326665  6582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 619) took 1353 ms. Trace:
I20260620 13:56:25.327242  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:25.329469  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:25.283252  8036 raft_consensus.cc:2243] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:56:25.333350  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:25.296378  5849 raft_consensus.cc:2686] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 13:56:25.335443  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:25.335621  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 91008.2us
W20260620 13:56:25.332000  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 88672.4us
I20260620 13:56:25.336220  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:25.337074  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:25.338399  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:25.339588  6581 raft_consensus.cc:2410] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260620 13:56:25.340183  6030 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:25.340545  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:25.341274  6581 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:25.329864  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:25.320084  7973 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:25.345062  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:25.285880  7927 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:25.345857  6030 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:25.346359  6587 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:25.317513  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:25.239534  8020 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260620 13:56:25.378213  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:25.388779  6030 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:25.378566  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:25.347282  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:25.390524  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:25.387368  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 49031.7us
I20260620 13:56:25.385460  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:25.391515  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:25.392870  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:25.385540  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:25.393481  5959 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:25.393658  6585 raft_consensus.cc:2376] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4. Re-sending same reply.
I20260620 13:56:25.288990  8067 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:25.387737  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:25.399959  5954 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 1.
I20260620 13:56:25.400144  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:25.390764  6027 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:25.327067  6582 rpcz_store.cc:276] 0620 13:56:23.973394 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:23.973526 (+   132us) service_pool.cc:224] Handling call
0620 13:56:23.973882 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:23.974129 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:25.221891 (+1247762us) log.cc:844] Serialized 14 byte log entry
0620 13:56:25.326331 (+104440us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:25.326386 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:25.326430 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:25.326495 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:25.326609 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34657,"prepare.queue_time_us":941173,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"thread_start_us":1302582,"threads_started":2,"wal-append.queue_time_us":93586}
I20260620 13:56:25.289040  8019 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:25.198853  7752 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:25.301640  8072 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.398594  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:25.333047  7791 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:25.343943  6580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:46858
I20260620 13:56:25.411723  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:25.403007  6584 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:25.404368  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:25.412593  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:25.296994  8006 log.cc:1199] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/wals/29e2284e793941b4aa9829a72313998c
I20260620 13:56:25.405105  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:25.413234  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:25.413579  5879 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:25.414534  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:25.343977  8098 raft_consensus.cc:2764] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260620 13:56:25.406512  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:25.405718  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:25.421576  5882 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 4
I20260620 13:56:25.331533  7904 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.394982  8091 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.403807  5876 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:25.322395  7924 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:25.331034  7945 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.325644  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:25.410044  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:25.333072  8107 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:25.343896  7920 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:25.343729  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:25.407552  5877 raft_consensus.cc:3055] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:25.417603  5881 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:25.383014  8049 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:25.377063  8044 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.384924  7833 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.414158  6552 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:25.405731  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:25.386060  7984 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:25.440600  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:25.420095  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:25.377017  7973 raft_consensus.cc:697] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:25.420866  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:25.638345  5877 raft_consensus.cc:740] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:25.638942  5883 raft_consensus.cc:2393] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 3: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:25.423209  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:25.639554  5959 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:25.637418  6032 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:25.640465  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:25.524670  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:25.395365  7805 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 13:56:25.395517  8082 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 13:56:25.426788  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:25.402578  8021 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 13:56:25.427318  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:25.424258  6581 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:25.425796  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:25.428960  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:25.429736  8036 raft_consensus.cc:2272] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:56:25.431217  5829 placement_policy_util.cc:244] tablet 923bfc4f20d94a57b0d84d45e40b12ae: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260620 13:56:25.654098  5829 placement_policy_util.cc:244] tablet 24c27735bbb449a98fab7edad2ba9837: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260620 13:56:25.654305  6586 raft_consensus.cc:2393] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:25.432066  8104 consensus_queue.cc:1059] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:56:25.401335  7891 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:25.409539  7948 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:25.405788  8102 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:25.423858  8108 consensus_queue.cc:1059] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260620 13:56:25.433678  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:25.435051  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:25.426266  7799 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260620 13:56:25.406483  7911 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:25.413080  8008 consensus_queue.cc:1059] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260620 13:56:25.692061  5957 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:25.692545  8008 raft_consensus.cc:3055] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:25.692919  8008 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:25.693722  8008 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:25.543583  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:25.696425  8045 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:25.698491  7904 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:25.648769  8029 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.616734  7791 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.652787  6578 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:25.629566  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:25.419871  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:25.714542  5880 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:25.537128  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:25.519064  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:25.503882  5882 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:25.550613  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:25.715713  6029 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
W20260620 13:56:25.716566  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 166078us
I20260620 13:56:25.633507  6582 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
W20260620 13:56:25.580497  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:25.473868  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:25.720707  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:25.636889  6030 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:25.518332  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:25.416378  7909 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.641616  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:25.578555  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:25.724363  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:25.643411  5959 raft_consensus.cc:2393] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:56:25.646137  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:25.726364  6582 raft_consensus.cc:1240] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 1. Current term is 2. Ops: []
W20260620 13:56:25.727260  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:25.410607  7927 raft_consensus.cc:697] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:25.649629  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:25.727696  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:25.727993  5881 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:25.639686  5877 consensus_queue.cc:260] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:25.728753  5877 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:25.650609  5879 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:25.422775  8022 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:56:25.660182  5876 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:25.664310  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:25.436318  8062 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:25.741400  8062 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:25.742051  8062 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:25.634526  8049 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:25.743297  8049 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:25.472867  8034 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.424996  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:25.626804  8041 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:25.518198  8089 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:25.424899  8055 consensus_queue.cc:1059] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.243s
I20260620 13:56:25.673915  5956 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 4
I20260620 13:56:25.628647  8006 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58442 (request call id 86) took 4213 ms. Trace:
I20260620 13:56:25.682647  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:25.907256  6586 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:25.648378  8044 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.646960  8107 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.683888  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:25.688962  7752 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:25.411387  8019 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.285602  8101 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:25.421380  8072 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:25.426169  8012 consensus_queue.cc:1059] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.204s
I20260620 13:56:25.714583  5958 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:25.630820  6584 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:56:25.730441  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:25.944547  5959 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:25.730665  5954 raft_consensus.cc:2410] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260620 13:56:25.732640  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:25.630214  7945 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.735700  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:25.663491  8103 raft_consensus.cc:670] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260620 13:56:25.479357  8091 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.748631  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:25.645648  7833 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:25.970239  8125 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:25.699769  8029 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.712852  7791 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:25.694877  8008 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:25.824589  7996 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:25.780341  7979 consensus_meta.cc:287] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.582s	user 0.005s	sys 0.004s
I20260620 13:56:25.749414  7909 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:25.831549  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:25.734259  7911 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:25.889729  5880 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
W20260620 13:56:25.886816  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 124747us
I20260620 13:56:25.664515  7920 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:25.642843  7984 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.078s
W20260620 13:56:25.891320  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 259825us
I20260620 13:56:25.905193  8034 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:25.895768  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 481630us
I20260620 13:56:25.817373  7973 consensus_queue.cc:237] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:25.676587  7891 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:25.682727  8102 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:25.904583  8093 consensus_meta.cc:287] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.675s	user 0.014s	sys 0.009s
I20260620 13:56:25.886792  7866 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:56:25.923439  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 502375us
I20260620 13:56:26.040992  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:26.041913  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:25.938882  5956 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
W20260620 13:56:25.946234  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 213700us
W20260620 13:56:25.913126  8121 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.179s	user 0.000s	sys 0.012s
I20260620 13:56:25.953118  6580 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:26.043905  6580 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:25.917702  6579 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:25.958324  5882 raft_consensus.cc:1240] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:25.906447  5950 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:25.966946  5879 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:25.977144  8072 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:25.909049  8089 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:26.077605  8089 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:26.013783  8101 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:26.071605  5879 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:26.064788  7866 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:26.013125  7924 raft_consensus.cc:3055] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:26.079833  7924 raft_consensus.cc:740] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:26.081446  7866 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:25.948557  7946 consensus_meta.cc:287] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.000s
I20260620 13:56:25.946828  8055 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:25.994964  5883 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:26.014528  6551 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:26.033363  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:26.017513  8094 raft_consensus.cc:3055] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:26.013682  5997 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:26.090277  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 76705.5us
I20260620 13:56:26.090646  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:26.029047  7891 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:26.057901  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:25.994684  8125 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:25.993914  8107 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:26.066256  5849 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:25.993992  7945 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:26.021872  8034 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:26.016309  8036 ts_tablet_manager.cc:1916] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:56:26.071208  7799 consensus_queue.cc:1059] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
W20260620 13:56:26.071568  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:26.052726  7911 raft_consensus.cc:697] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:26.003810  7979 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:26.080943  7924 consensus_queue.cc:260] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:25.981835  8091 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:26.019637  7993 consensus_meta.cc:287] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.810s	user 0.006s	sys 0.011s
I20260620 13:56:26.083832  6587 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:25.979215  7927 consensus_queue.cc:237] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:26.035116  5881 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:25.997033  8029 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:26.016954  8026 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:26.092165  6028 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:26.083884  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:26.175508  5879 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:26.175966  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:26.176374  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:26.177054  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:26.177335  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:26.092942  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:26.090173  6030 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:26.178066  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:26.178978  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:26.179121  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:26.179561  6030 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:26.180356  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:26.180869  6030 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:26.181581  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:26.182515  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:26.094709  5882 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:26.183698  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:26.184294  5882 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:26.185297  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:26.186153  5882 raft_consensus.cc:2393] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:26.064260  8082 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:26.005887  7909 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:26.096290  5849 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:26.089978  8094 raft_consensus.cc:740] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:26.073403  8127 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260620 13:56:26.101081  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:26.115270  6032 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:56:26.116151  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:26.101469  5924 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.671s (SENT)
I20260620 13:56:26.072069  6583 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:26.061537  8108 raft_consensus.cc:3055] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:25.906733  8006 rpcz_store.cc:276] 0620 13:56:21.268172 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:21.268380 (+   208us) service_pool.cc:224] Handling call
0620 13:56:21.886195 (+617815us) ts_tablet_manager.cc:1151] Deleting tablet 29e2284e793941b4aa9829a72313998c
0620 13:56:21.899557 (+ 13362us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0620 13:56:24.116164 (+2216607us) tablet_metadata.cc:665] Metadata flushed
0620 13:56:25.024569 (+908405us) tablet_metadata.cc:665] Metadata flushed
0620 13:56:25.472158 (+447589us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":688081,"tablet-delete.queue_time_us":559872,"thread_start_us":354738,"threads_started":1}
I20260620 13:56:26.013584  7920 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:26.165863  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:25.991019  8049 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:26.169566  7924 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:26.169770  6026 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:26.119302  8101 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:26.115809  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:26.164609  6580 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:26.188422  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 92193.8us
I20260620 13:56:26.091468  5997 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:26.189011  6027 raft_consensus.cc:2393] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:26.189378  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:26.192714  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 91278us
I20260620 13:56:26.118961  8072 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:26.117404  7891 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:26.094341  7946 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:26.094239  8055 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:26.679742  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:26.209184  7970 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:26.692883  7970 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:26.694199  5882 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:26.694480  7891 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:26.647390  8029 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:26.695775  6585 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:26.696211  8029 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:26.697810  7891 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:26.698753  6025 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:26.375252  7911 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:26.701327  5955 raft_consensus.cc:1240] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260620 13:56:26.413813  8062 consensus_meta.cc:287] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.671s	user 0.005s	sys 0.006s
I20260620 13:56:26.192528  6033 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:56:26.150534  8125 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:26.216326  5876 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
W20260620 13:56:26.312141  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 297760us
I20260620 13:56:26.707041  5767 catalog_manager.cc:5027] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): tablet 29e2284e793941b4aa9829a72313998c (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:56:26.693877  7970 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:26.705818  8072 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:26.225631  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:26.449085  6550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.013s	sys 0.021s
I20260620 13:56:26.725068  6028 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:26.212946  8102 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:26.710047  8049 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:26.296511  7909 raft_consensus.cc:3055] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:26.748703  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:26.749965  5953 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:26.747710  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:26.187714  8026 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:26.692760  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:26.712461  8101 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:26.161582  8107 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:26.310956  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:26.167510  8122 log.cc:927] Time spent T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.161s	user 0.000s	sys 0.002s
I20260620 13:56:26.206579  7833 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:26.366900  8094 consensus_queue.cc:260] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:26.705396  8108 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:56:26.703631  6553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.004s	sys 0.009s
I20260620 13:56:26.211438  8082 raft_consensus.cc:697] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:26.208109  7979 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:26.365921  6578 consensus_meta.cc:287] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.586s	user 0.011s	sys 0.000s
I20260620 13:56:26.209303  8091 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:26.443895  7791 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:26.457345  7866 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:26.611239  8135 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:26.411091  8067 consensus_meta.cc:287] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 1.001s	user 0.012s	sys 0.000s
I20260620 13:56:26.721161  8006 tablet_replica.cc:333] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
W20260620 13:56:26.725574  6550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.016s	sys 0.024s
I20260620 13:56:26.199967  8044 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:26.195340  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:26.789525  6030 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:26.735456  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:26.708729  8129 consensus_queue.cc:1059] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260620 13:56:26.689424  7948 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.000s	sys 0.015s
I20260620 13:56:26.752615  6552 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:26.705904  8089 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:26.755589  6586 raft_consensus.cc:3055] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:26.725450  8072 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:26.757352  7945 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260620 13:56:26.761612  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:26.735785  7927 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:26.538513  7984 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:26.554857  6579 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:26.744306  8019 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:26.722700  8062 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:26.762562  8127 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:26.758997  8026 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:26.763759  8101 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:26.748729  7909 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:26.767601  7946 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:26.790696  6582 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:26.774808  8107 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:26.553661  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:26.247352  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 55307us
I20260620 13:56:26.716463  5849 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:26.724032  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:26.707854  5878 raft_consensus.cc:1240] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:26.727383  5879 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260620 13:56:26.463809  5877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.022s	sys 0.051s
I20260620 13:56:26.753827  5881 raft_consensus.cc:1813] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Handling vote request from an unknown peer 192c750f597c43858e1ad09e8d805685
I20260620 13:56:26.734696  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:26.237847  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:26.730235  5954 raft_consensus.cc:3055] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:26.756875  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:26.773882  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:26.731253  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:26.733803  5957 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:26.744643  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:27.231843  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 479148us
W20260620 13:56:27.227656  5997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.016s
W20260620 13:56:27.234342  5997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.002s	sys 0.016s
I20260620 13:56:27.234750  5880 raft_consensus.cc:2368] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7.
W20260620 13:56:27.234969  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 1.1435e+06us
W20260620 13:56:27.211838  5924 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.004s	sys 0.008s
I20260620 13:56:27.235720  5881 raft_consensus.cc:2410] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260620 13:56:26.769802  6553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.004s	sys 0.010s
I20260620 13:56:26.778570  6578 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
W20260620 13:56:26.943785  6585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46858 (request call id 622) took 1565 ms (client timeout 1939 ms). Trace:
I20260620 13:56:27.237059  7752 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:27.237532  6586 raft_consensus.cc:740] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:26.787484  7791 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:26.788914  7866 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:27.283075  6585 rpcz_store.cc:269] 0620 13:56:25.378690 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.404143 (+ 25453us) service_pool.cc:224] Handling call
0620 13:56:26.943278 (+1539135us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400508054. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:26.943479 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2950629120}
I20260620 13:56:27.285742  7866 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:26.956950  7920 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:27.012321  8055 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:27.241811  5956 raft_consensus.cc:2410] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260620 13:56:26.788787  8067 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:26.776029  8138 consensus_queue.cc:1059] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.519s
I20260620 13:56:27.286682  7984 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:27.288532  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2253) took 1167 ms. Trace:
I20260620 13:56:27.289179  8067 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:27.289507  7984 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:27.235766  5954 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:27.243919  5951 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
W20260620 13:56:27.244099  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.214314  5952 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:27.245256  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:27.001646  6583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 607) took 1676 ms. Trace:
I20260620 13:56:27.246268  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:26.938759  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 632) took 1535 ms. Trace:
I20260620 13:56:27.238770  7891 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:27.178704  5876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1275) took 1706 ms. Trace:
I20260620 13:56:27.190387  5884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1263) took 1787 ms. Trace:
W20260620 13:56:27.190763  5883 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1278) took 1712 ms (client timeout 1985 ms). Trace:
I20260620 13:56:27.250384  8072 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:27.272984  5924 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.009s	sys 0.008s
I20260620 13:56:27.288928  5879 rpcz_store.cc:276] 0620 13:56:26.120627 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:26.194688 (+ 74061us) service_pool.cc:224] Handling call
0620 13:56:26.726911 (+532223us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:27.280315 (+553404us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.288339 (+  8024us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:26.943991  6581 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
W20260620 13:56:27.280234  5959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.017s	sys 0.011s
I20260620 13:56:27.293701  5876 rpcz_store.cc:276] 0620 13:56:25.476961 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.781417 (+304456us) service_pool.cc:224] Handling call
0620 13:56:25.886897 (+105480us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:26.733550 (+846653us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.177866 (+444316us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54000519d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:27.178404 (+   538us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757048192}
I20260620 13:56:27.302011  6032 raft_consensus.cc:2410] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260620 13:56:27.302202  5875 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:27.301508  7752 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.303663  6582 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
W20260620 13:56:27.304461  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:26.799782  7948 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.000s	sys 0.016s
I20260620 13:56:26.779947  8091 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:27.313333  6031 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:27.294620  7891 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:27.314414  7891 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:27.315980  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 404) took 1679 ms. Trace:
I20260620 13:56:26.881088  8082 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:27.317092  8155 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:27.318094  8155 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.320266  7791 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:27.321738  5848 connection.cc:256] RPC call timeout handler was delayed by -1.047065722999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
I20260620 13:56:27.322398  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:27.316749  5955 rpcz_store.cc:276] 0620 13:56:25.636561 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.684146 (+ 47585us) service_pool.cc:224] Handling call
0620 13:56:25.684520 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:26.722017 (+1037497us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.315305 (+593288us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000799d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:27.315766 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2337635072}
W20260620 13:56:27.323679  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 630248us
I20260620 13:56:27.323915  5876 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:27.325163  8021 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:27.325621  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 609190us
I20260620 13:56:27.325990  8021 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:27.311436  8091 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:27.330384  8021 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:26.794293  8135 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.332329  6585 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:27.335330  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:27.336339  5997 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:27.337977  5997 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:27.339985  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:27.341485  8135 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:27.342482  5879 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:27.347625  6578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46858 (request call id 613) took 2020 ms. Trace:
I20260620 13:56:27.348305  6578 rpcz_store.cc:276] 0620 13:56:25.327067 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.332857 (+  5790us) service_pool.cc:224] Handling call
0620 13:56:27.347315 (+2014458us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:26.934052  8012 raft_consensus.cc:3055] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:27.347445  8107 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:27.349422  8012 raft_consensus.cc:740] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:27.350581  8012 consensus_queue.cc:260] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.351404  7791 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:27.351902  7791 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:27.352365  8012 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:27.303308  6587 rpcz_store.cc:276] 0620 13:56:25.403775 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.425569 (+ 21794us) service_pool.cc:224] Handling call
0620 13:56:26.938453 (+1512884us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54003b74d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:26.938652 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":989379456}
I20260620 13:56:27.355091  8094 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:27.361826  7911 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:27.362470  7911 raft_consensus.cc:697] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:56:27.363260  5877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.384s	user 0.027s	sys 0.059s
I20260620 13:56:27.364527  5877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1270) took 1957 ms. Trace:
W20260620 13:56:27.308734  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.365231  8136 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:26.861287  8145 log.cc:927] Time spent T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260620 13:56:27.365948  8136 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:27.294404  5883 rpcz_store.cc:269] 0620 13:56:25.478039 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.652482 (+174443us) service_pool.cc:224] Handling call
0620 13:56:27.190251 (+1537769us) spinlock_profiling.cc:243] Waited 80.8 ms on lock 0x7b54003fb6d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:27.190509 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185793408}
I20260620 13:56:27.367954  5882 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:27.369079  5883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2257) took 1247 ms. Trace:
I20260620 13:56:27.370118  6551 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:27.370682  5876 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:27.299081  6586 consensus_queue.cc:260] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.371364  5876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2259) took 1249 ms. Trace:
I20260620 13:56:27.371804  6586 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:27.363919  7911 consensus_queue.cc:237] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:27.377717  7752 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:27.365684  6026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 384) took 2154 ms (client timeout 1650 ms). Trace:
I20260620 13:56:26.957705  8029 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:27.379158  6026 rpcz_store.cc:269] 0620 13:56:25.211072 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.212290 (+  1218us) service_pool.cc:224] Handling call
0620 13:56:27.365194 (+2152904us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b540037cdd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:27.365407 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2199851264}
I20260620 13:56:27.380309  8136 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:27.357400  8146 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:27.381366  8146 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.292912  5954 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.358390  7945 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:27.382650  5954 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:27.357862  8131 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:27.382975  7945 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.383792  8131 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.356487  7924 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:27.356812  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:27.299356  6583 rpcz_store.cc:276] 0620 13:56:25.325297 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.332915 (+  7618us) service_pool.cc:224] Handling call
0620 13:56:25.405387 (+ 72472us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:26.710438 (+1305051us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.001238 (+290800us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54004a7754. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:27.001545 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449148672}
I20260620 13:56:27.387307  6582 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:27.387385  8131 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:27.385905  7945 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:27.387850  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:27.388856  6583 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:27.382097  6028 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260620 13:56:27.389611  8146 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:27.385948  7924 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.358615  5875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1276) took 1881 ms. Trace:
I20260620 13:56:27.393213  5875 rpcz_store.cc:276] 0620 13:56:25.477464 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.840325 (+362861us) service_pool.cc:224] Handling call
0620 13:56:25.896836 (+ 56511us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:27.302699 (+1405863us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.358251 (+ 55552us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b540030e3d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:27.358542 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3196764928}
I20260620 13:56:27.395573  5875 raft_consensus.cc:1240] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
W20260620 13:56:27.396222  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.396356  5875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2260) took 1273 ms. Trace:
I20260620 13:56:27.396890  5875 rpcz_store.cc:276] 0620 13:56:26.122427 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:27.394669 (+1272242us) service_pool.cc:224] Handling call
0620 13:56:27.395274 (+   605us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:27.396092 (+   818us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.396285 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:27.399411  5878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1265) took 1995 ms. Trace:
I20260620 13:56:27.399788  5878 rpcz_store.cc:276] 0620 13:56:25.404199 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.404344 (+   145us) service_pool.cc:224] Handling call
0620 13:56:25.424172 (+ 19828us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:27.306668 (+1882496us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.398960 (+ 92292us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400323f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:27.399199 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2951795072}
I20260620 13:56:27.400445  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:56:27.401844  6025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43502 (request call id 1913) took 1983 ms (client timeout 1896 ms). Trace:
I20260620 13:56:27.374766  8138 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:27.402726  8138 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:27.402043  5878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2261) took 1279 ms. Trace:
I20260620 13:56:27.403909  5878 rpcz_store.cc:276] 0620 13:56:26.122754 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:27.400784 (+1278030us) service_pool.cc:224] Handling call
0620 13:56:27.401201 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:27.401621 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:27.401647 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:27.401725 (+    78us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:56:27.401806 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.401885 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:27.401991 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:27.355566  7984 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
W20260620 13:56:27.404595  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 66866.8us
W20260620 13:56:27.405725  5952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1286) took 1934 ms (client timeout 1985 ms). Trace:
I20260620 13:56:27.400723  6031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 385) took 1304 ms. Trace:
I20260620 13:56:27.406509  5997 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:27.407056  6031 rpcz_store.cc:276] 0620 13:56:26.096269 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:26.189145 (+ 92876us) service_pool.cc:224] Handling call
0620 13:56:27.400517 (+1211372us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54001c9b54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:27.400647 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316465920}
I20260620 13:56:27.402093  5955 raft_consensus.cc:2393] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 2: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:27.407871  7920 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:27.408018  6032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2277) took 1312 ms. Trace:
I20260620 13:56:27.408475  6032 rpcz_store.cc:276] 0620 13:56:26.095773 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:26.192701 (+ 96928us) service_pool.cc:224] Handling call
0620 13:56:27.407785 (+1215084us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54000d4b54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:27.407946 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218848512}
I20260620 13:56:27.409770  7920 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:27.410527  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:27.370409  5882 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:27.409834  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:27.410830  7920 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:27.419405  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2258) took 1293 ms. Trace:
I20260620 13:56:27.403178  8138 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:27.421192  7920 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:27.421370  6028 raft_consensus.cc:1240] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260620 13:56:27.422456  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:27.423473  6033 raft_consensus.cc:1813] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Handling vote request from an unknown peer 192c750f597c43858e1ad09e8d805685
I20260620 13:56:27.424239  6033 raft_consensus.cc:2410] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260620 13:56:27.424247  8062 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:27.426446  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:27.427691  5955 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:27.428417  8155 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:27.427366  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:27.430693  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:26.925899  8125 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:27.431972  7970 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.002s
I20260620 13:56:27.432876  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:27.412107  6032 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260620 13:56:27.411827  6025 rpcz_store.cc:269] 0620 13:56:25.418109 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.418782 (+   673us) service_pool.cc:224] Handling call
0620 13:56:27.401380 (+1982598us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b54000d4154. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:27.401606 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2250154368}
I20260620 13:56:27.369504  5883 rpcz_store.cc:276] 0620 13:56:26.121645 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:27.367734 (+1246089us) service_pool.cc:224] Handling call
0620 13:56:27.368267 (+   533us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:27.368623 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:27.368645 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:27.368704 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0620 13:56:27.368777 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.368855 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:27.368971 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260620 13:56:27.403077  6579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 626) took 2096 ms (client timeout 1891 ms). Trace:
W20260620 13:56:27.406320  5952 rpcz_store.cc:269] 0620 13:56:25.471780 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.472031 (+   251us) service_pool.cc:224] Handling call
0620 13:56:27.405321 (+1933290us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54001964d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:27.405641 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3616133888}
I20260620 13:56:27.404682  6581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 619) took 2076 ms. Trace:
I20260620 13:56:27.294828  5884 rpcz_store.cc:276] 0620 13:56:25.402764 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.402872 (+   108us) service_pool.cc:224] Handling call
0620 13:56:25.418048 (+ 15176us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:25.418354 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:25.418392 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:25.418811 (+   419us) log.cc:844] Serialized 26 byte log entry
0620 13:56:25.632091 (+213280us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:56:25.741664 (+109573us) log.cc:844] Serialized 14 byte log entry
0620 13:56:26.006435 (+264771us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b1800397f60. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc70abf3 00007f0fdc70cfc1 00007f0fdc70cf79 00007f0fdc70cf09 00007f0fdc70ced1 00007f0fdc70c1cd 0000000000389354 0000000000389199 00007f0fdc6ee03a
0620 13:56:26.158159 (+151724us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:26.158246 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:27.189526 (+1031280us) raft_consensus.cc:1685] finished
0620 13:56:27.189791 (+   265us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:27.190156 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":145185,"prepare.queue_time_us":290854,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":157296,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":11766,"spinlock_wait_cycles":85523072,"thread_start_us":483127,"threads_started":3,"wal-append.queue_time_us":547349}
I20260620 13:56:27.398440  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:27.375929  8021 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:27.371937  5876 rpcz_store.cc:276] 0620 13:56:26.122174 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:27.369916 (+1247742us) service_pool.cc:224] Handling call
0620 13:56:27.370411 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:27.371136 (+   725us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.371313 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260620 13:56:27.076936  8126 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.016s	sys 0.011s
I20260620 13:56:27.398093  6551 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:27.309181  5959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.018s	sys 0.011s
I20260620 13:56:27.414734  6587 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:27.406677  7984 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:27.418864  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:27.432731  7970 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:27.366473  5877 rpcz_store.cc:276] 0620 13:56:25.407067 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.407194 (+   127us) service_pool.cc:224] Handling call
0620 13:56:25.407447 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:27.363930 (+1956483us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:27.363982 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:27.364100 (+   118us) raft_consensus.cc:1645] Marking committed up to 1
0620 13:56:27.364161 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.364245 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:27.364449 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15522,"raft.queue_time_us":33525,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":13490,"thread_start_us":1465516,"threads_started":1}
I20260620 13:56:27.434048  8125 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:27.435526  8072 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:26.866797  8108 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:26.939893  8130 raft_consensus.cc:3055] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:27.437932  5880 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:27.356859  8107 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:26.532156  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:27.352389  7791 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:27.440776  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:27.443527  5778 catalog_manager.cc:5696] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 4 to 3, leader changed from <none> to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:27.444882  6580 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:27.445658  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:27.446034  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:27.419889  5882 rpcz_store.cc:276] 0620 13:56:26.121917 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:27.369368 (+1247451us) service_pool.cc:224] Handling call
0620 13:56:27.369865 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:27.414750 (+ 44885us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.414938 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260620 13:56:27.453662  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 44054.7us
I20260620 13:56:27.450721  6581 rpcz_store.cc:276] 0620 13:56:25.328495 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.740491 (+411996us) service_pool.cc:224] Handling call
0620 13:56:26.943475 (+1202984us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:27.302972 (+359497us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.404234 (+101262us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400508050. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:27.404363 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2765606656}
W20260620 13:56:27.497244  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 99278.8us
I20260620 13:56:27.499437  5880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2267) took 1328 ms. Trace:
I20260620 13:56:27.501535  5954 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260620 13:56:27.382050  8026 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:27.502893  5878 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260620 13:56:27.501405  5880 rpcz_store.cc:276] 0620 13:56:26.171493 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:27.437272 (+1265779us) service_pool.cc:224] Handling call
0620 13:56:27.437700 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:27.496984 (+ 59284us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.499374 (+  2390us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:27.490206  7984 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:27.455631  7866 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:27.517434  5878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2264) took 1337 ms. Trace:
I20260620 13:56:27.522197  6586 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:27.518093  5878 rpcz_store.cc:276] 0620 13:56:26.170662 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:27.418191 (+1247529us) service_pool.cc:224] Handling call
0620 13:56:27.418645 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:27.503463 (+ 84818us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.507309 (+  3846us) spinlock_profiling.cc:243] Waited 81.3 ms on lock 0x7b540030fcd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:27.507615 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186999552}
I20260620 13:56:27.519074  8130 raft_consensus.cc:740] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:27.524871  8127 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:27.525440  8127 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:27.450330  6579 rpcz_store.cc:269] 0620 13:56:25.306119 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.317167 (+ 11048us) service_pool.cc:224] Handling call
0620 13:56:27.402687 (+2085520us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b540042d1d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:27.402866 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213779200}
I20260620 13:56:27.519552  8107 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.528131  6579 raft_consensus.cc:1240] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260620 13:56:27.528038  8089 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.529706  6584 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:27.530015  8107 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:27.530444  7909 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.531174  7927 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:27.531306  6033 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 1.
I20260620 13:56:27.531744  7909 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:27.531869  6578 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260620 13:56:27.510407  7984 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:27.532291  6031 raft_consensus.cc:2393] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:27.380478  8036 ts_tablet_manager.cc:1929] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260620 13:56:27.534065  8036 log.cc:1199] T 020dbb4b944d4deeba944d1a7c6d5c76 P 663684cf4ae54c929bf8240ca0b63a47: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/wals/020dbb4b944d4deeba944d1a7c6d5c76
I20260620 13:56:27.531210  6580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:46858 (request call id 606) took 2203 ms. Trace:
I20260620 13:56:27.527220  8101 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:27.526191  8130 consensus_queue.cc:260] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:27.520900  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:27.517469  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:27.530087  6579 raft_consensus.cc:1240] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260620 13:56:27.502431  8155 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:27.534668  6580 rpcz_store.cc:276] 0620 13:56:25.324950 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.325122 (+   172us) service_pool.cc:224] Handling call
0620 13:56:27.341378 (+2016256us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b5400508054. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7f3e1d 00007f0fe47c43d0 00007f0fddd463b4 00007f0fddd46342 00007f0fddd46271 00007f0fddd461ec 00007f0fddd454a2 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:27.444194 (+102816us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b4c004536c0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fddac6120 00007f0fddad7129 00007f0fddad783f 00007f0fdda9b9ab 00007f0fddac963c 00007f0fddac9afe 00007f0fddd579eb 00007f0fdf758875 00007f0fdf7a96ef 00007f0fdf7f3e35 00007f0fe47c43d0
0620 13:56:27.510275 (+ 66081us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392423040}
W20260620 13:56:27.531885  8126 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.424s	user 0.020s	sys 0.013s
I20260620 13:56:27.546001  7866 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:27.506156  8021 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:27.535321  7924 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:27.539341  6578 raft_consensus.cc:1240] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:27.551347  6581 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260620 13:56:27.530905  8089 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:27.530328  8019 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:27.531759  7927 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:27.543943  5848 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.626s (SENT)
I20260620 13:56:27.544157  8155 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:27.574437  6027 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:27.579402  7924 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:27.584159  5880 raft_consensus.cc:1240] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:27.583658  7924 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:27.585422  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:27.586401  7924 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:27.587320  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:27.587450  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:27.588624  5952 raft_consensus.cc:2393] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 2: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:27.592823  5998 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:27.597800  7970 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:27.599406  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:27.600111  8021 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:27.600275  6551 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:27.601078  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:27.601671  8130 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:27.603277  8125 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:56:27.601814  5881 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:27.602733  5878 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260620 13:56:27.601372  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.587010  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:27.602805  8107 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:27.621347  5779 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56594 (request call id 330) took 7272 ms. Trace:
I20260620 13:56:27.621723  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:27.622198  5954 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:27.622705  5883 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:27.623185  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2256) took 1490 ms. Trace:
I20260620 13:56:27.624488  8101 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:27.626196  8026 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:27.626430  8108 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:27.574618  5875 raft_consensus.cc:1240] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260620 13:56:27.628341  7866 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:27.628139  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:27.579339  8019 raft_consensus.cc:697] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:56:27.629065  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:27.630750  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 138813us
I20260620 13:56:27.620687  5778 catalog_manager.cc:5696] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 3, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 3 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:27.632906  5879 rpcz_store.cc:276] 0620 13:56:26.121377 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:27.341915 (+1220538us) service_pool.cc:224] Handling call
0620 13:56:27.342330 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:27.579716 (+237386us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:27.579750 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:27.602883 (+ 23133us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:27.602944 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.603018 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:27.612159 (+  9141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7553,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":21699}
W20260620 13:56:27.630988  5849 connection.cc:256] RPC call timeout handler was delayed by -1.5783759849999797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
I20260620 13:56:27.639328  5955 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260620 13:56:27.611485  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:27.574983  8155 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:27.645761  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.577701  5848 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:27.654245  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:27.659400  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.620741  8107 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:27.660336  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:27.657827  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:27.658764  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:27.669792  5880 raft_consensus.cc:2393] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 3: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:27.584196  8091 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.656613  5778 catalog_manager.cc:5696] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 3 to 6, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 6 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:56:27.671631  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:27.580192  8089 consensus_queue.cc:1059] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260620 13:56:27.612603  7891 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.668002  8107 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:27.678989  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:27.681517  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:27.682427  5997 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:27.680840  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:27.683970  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.686122  5954 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:27.679288  6031 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:27.687973  5959 raft_consensus.cc:2410] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260620 13:56:27.694103  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:27.697058  5952 raft_consensus.cc:2410] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260620 13:56:27.677774  5875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2268) took 1454 ms. Trace:
I20260620 13:56:27.701773  5849 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:27.703179  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:27.677403  5950 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 1.
I20260620 13:56:27.713690  8036 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43482 (request call id 83) took 5786 ms. Trace:
I20260620 13:56:27.704952  8101 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:27.714388  8091 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:27.714949  7920 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:27.715288  6583 raft_consensus.cc:2368] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3.
I20260620 13:56:27.715451  8029 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:27.715719  5956 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:27.621935  5779 rpcz_store.cc:276] 0620 13:56:20.354461 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:20.357543 (+  3082us) service_pool.cc:224] Handling call
0620 13:56:27.621046 (+7263503us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:56:25.958177 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:56:25.972090 (+ 13913us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:56:25.972151 (+    61us) write_op.cc:435] Acquired schema lock
0620 13:56:25.972179 (+    28us) tablet.cc:662] Decoding operations
0620 13:56:25.973117 (+   938us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:56:25.973202 (+    85us) write_op.cc:641] Partition lock acquired for write op
0620 13:56:25.973245 (+    43us) tablet.cc:685] Acquiring locks for 5 operations
0620 13:56:25.973974 (+   729us) tablet.cc:701] Row locks acquired
0620 13:56:25.974002 (+    28us) write_op.cc:260] PREPARE: finished
0620 13:56:25.974220 (+   218us) write_op.cc:270] Start()
0620 13:56:25.974373 (+   153us) write_op.cc:276] Timestamp: P: 1781963785974155 usec, L: 0
0620 13:56:25.974404 (+    31us) op_driver.cc:348] REPLICATION: starting
0620 13:56:26.019598 (+ 45194us) log.cc:844] Serialized 2075 byte log entry
0620 13:56:27.093943 (+1074345us) op_driver.cc:464] REPLICATION: finished
0620 13:56:27.105630 (+ 11687us) write_op.cc:301] APPLY: starting
0620 13:56:27.105766 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0620 13:56:27.106020 (+   254us) tablet.cc:1370] finished BulkCheckPresence
0620 13:56:27.106191 (+   171us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:56:27.107547 (+  1356us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:56:27.107878 (+   331us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0620 13:56:27.107955 (+    77us) write_op.cc:312] APPLY: finished
0620 13:56:27.108643 (+   688us) log.cc:844] Serialized 47 byte log entry
0620 13:56:27.128334 (+ 19691us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:27.128493 (+   159us) write_op.cc:454] Released schema lock
0620 13:56:27.128566 (+    73us) write_op.cc:341] FINISH: Updating metrics
0620 13:56:27.129131 (+   565us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:27.129173 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24089,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":11207,"apply.run_cpu_time_us":4184,"apply.run_wall_time_us":23502,"num_ops":5,"prepare.queue_time_us":560809,"prepare.run_cpu_time_us":17941,"prepare.run_wall_time_us":444128,"raft.queue_time_us":176391,"raft.run_cpu_time_us":1613,"raft.run_wall_time_us":30373,"replication_time_us":1119305,"spinlock_wait_cycles":247168,"thread_start_us":667642,"threads_started":4,"wal-append.queue_time_us":763554}]]}
W20260620 13:56:27.719403  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 43550.7us
W20260620 13:56:27.698916  5924 connection.cc:256] RPC call timeout handler was delayed by -2.7544726150000542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2819s for a response
I20260620 13:56:27.707577  8026 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:27.739435  5953 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:56:27.718211  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 201797us
I20260620 13:56:27.740371  5959 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:27.755637  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:27.763311  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 84105.1us
W20260620 13:56:27.764938  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.769491  5876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 389) took 1037 ms. Trace:
I20260620 13:56:27.731472  7970 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:27.733978  8101 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:27.775209  5924 connection.cc:256] RPC call timeout handler was delayed by -2.436772615000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31720000000000004s for a response
I20260620 13:56:27.770058  5876 rpcz_store.cc:276] 0620 13:56:26.732210 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:27.488346 (+756136us) service_pool.cc:224] Handling call
0620 13:56:27.540435 (+ 52089us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:27.583002 (+ 42567us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:27.648787 (+ 65785us) log.cc:844] Serialized 14 byte log entry
0620 13:56:27.769054 (+120267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:27.769127 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:27.769186 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.769274 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:27.769418 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":121701,"threads_started":2}
I20260620 13:56:27.774672  5881 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:27.731927  7866 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260620 13:56:27.740142  8029 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:27.776319  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:27.777174  8163 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260620 13:56:27.777453  7947 raft_consensus.cc:3055] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:27.779533  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:27.780267  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:27.780804  8127 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.781216  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:27.703363  5875 rpcz_store.cc:276] 0620 13:56:26.215805 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:27.455904 (+1240099us) service_pool.cc:224] Handling call
0620 13:56:27.554215 (+ 98311us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:27.649885 (+ 95670us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:27.668513 (+ 18628us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260620 13:56:27.784099  5829 auto_rebalancer.cc:591] Failed to schedule move for tablet b53823dabce64d5284772ca73d71ddc9: Illegal state: Replica 2e82c0c231624695ac5a813230bf5038 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:56:27.788282  7920 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:27.786556  8019 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.811381  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:27.788767  7970 raft_consensus.cc:697] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:27.794190  5953 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:56:27.816526  5848 leader_election.cc:336] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.636s (SENT)
W20260620 13:56:27.800236  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 142509us
I20260620 13:56:27.821470  5877 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:27.817332  5849 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:27.802181  8176 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260620 13:56:27.802879  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.827229  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:27.803442  8170 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:27.804072  7924 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:27.804591  6585 raft_consensus.cc:1813] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Handling vote request from an unknown peer 192c750f597c43858e1ad09e8d805685
I20260620 13:56:27.804873  8127 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:27.799201  5958 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:27.805768  5950 raft_consensus.cc:2410] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260620 13:56:27.806339  5956 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
W20260620 13:56:27.841097  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.806840  8082 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:27.786710  8101 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:27.807514  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:27.807859  7920 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.808172  7891 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:27.810690  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:27.811482  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:27.795444  7947 raft_consensus.cc:740] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:27.793911  8029 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:27.813208  7984 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.827509  5952 raft_consensus.cc:2410] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260620 13:56:27.803563  5924 connection.cc:256] RPC call timeout handler was delayed by -2.1844723389999672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
I20260620 13:56:27.824095  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:27.839564  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.840507  6585 raft_consensus.cc:2368] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4.
I20260620 13:56:27.856837  6581 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:27.803088  8177 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:27.849792  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:27.841826  7911 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:27.797873  7927 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:27.853925  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:27.858439  6584 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:27.862658  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:56:27.863004  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 72895.1us
I20260620 13:56:27.859807  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:27.860296  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 95708.8us
I20260620 13:56:27.859318  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:27.865228  6580 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260620 13:56:27.861925  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:27.873425  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.874864  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:27.875756  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.880035  6028 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 5: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:56:27.891878  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.897403  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:27.903352  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:27.856017  5951 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
W20260620 13:56:27.903661  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.943866  6031 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260620 13:56:27.943189  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 48268.2us
I20260620 13:56:27.937922  6030 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:27.843909  8170 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.903242  8160 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:27.948575  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.947757  5957 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 3
I20260620 13:56:27.854897  8082 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.948081  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:27.955564  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.955869  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:27.862344  7924 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.952977  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:27.955668  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:27.959584  6031 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:56:27.948518  8138 consensus_meta.cc:287] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.525s	user 0.006s	sys 0.013s
I20260620 13:56:27.960616  6586 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
W20260620 13:56:27.963968  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 169452us
I20260620 13:56:27.933284  6578 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260620 13:56:27.968019  8174 log.cc:927] Time spent T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260620 13:56:27.968744  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:27.735061  8036 rpcz_store.cc:276] 0620 13:56:21.937708 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:21.950369 (+ 12661us) service_pool.cc:224] Handling call
0620 13:56:22.426837 (+476468us) ts_tablet_manager.cc:1151] Deleting tablet 020dbb4b944d4deeba944d1a7c6d5c76
0620 13:56:22.432213 (+  5376us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0620 13:56:23.238761 (+806548us) spinlock_profiling.cc:243] Waited 8.31 ms on lock 0x7b540009cc54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8053d9 00007f0fe4812b82 00007f0fe48439d0 00007f0fe4829f3d 00007f0fe4829ee9 00007f0fe4829e79 00007f0fe4829e41 00007f0fe482906d 0000000000389354 0000000000389199
0620 13:56:26.896876 (+3658115us) tablet_metadata.cc:665] Metadata flushed
0620 13:56:27.379968 (+483092us) tablet_metadata.cc:665] Metadata flushed
0620 13:56:27.713490 (+333522us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1869839,"spinlock_wait_cycles":19108736,"tablet-delete.queue_time_us":394915,"thread_start_us":254978,"threads_started":1}
W20260620 13:56:27.969795  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:27.970786  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 176127us
I20260620 13:56:27.947800  8179 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260620 13:56:27.904297  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:27.956600  8175 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260620 13:56:27.956460  8131 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260620 13:56:27.987764  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 121799us
I20260620 13:56:27.968264  5949 tablet_service.cc:1558] Processing DeleteTablet for tablet 923bfc4f20d94a57b0d84d45e40b12ae with delete_type TABLET_DATA_TOMBSTONED (TS 192c750f597c43858e1ad09e8d805685 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:35974
I20260620 13:56:27.988864  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:27.995067  7920 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:27.999285  6028 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:28.002329  8170 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:28.069365  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:28.003530  8021 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:28.005456  7924 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:28.007241  8082 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:28.008888  7927 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:28.009959  7970 consensus_queue.cc:237] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.970630  8138 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.971801  7947 consensus_queue.cc:260] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.014109  6582 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:56:27.975749  7984 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:27.946841  8177 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:27.985539  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:28.035985  5953 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:28.066431  5952 raft_consensus.cc:1240] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260620 13:56:28.098078  6552 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:28.025463  7791 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.105186  6551 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:28.115192  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.107547  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:28.121215  6584 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
W20260620 13:56:28.127240  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 253992us
W20260620 13:56:28.127736  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 140463us
I20260620 13:56:27.967235  8160 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:28.090914  8026 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:28.132884  6587 raft_consensus.cc:2393] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:28.126608  7891 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:28.141458  6026 raft_consensus.cc:2368] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4.
I20260620 13:56:28.135207  5997 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:28.130069  8062 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:28.171657  8062 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:28.172142  8062 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:28.152319  5997 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:28.100590  8155 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.180832  8155 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:28.183544  7791 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:28.184566  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:28.185184  5957 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:28.186524  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:28.189103  8130 consensus_meta.cc:287] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.586s	user 0.011s	sys 0.006s
I20260620 13:56:28.188939  6551 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:28.153061  8107 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.191941  8107 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:28.192492  8107 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:28.192981  8107 raft_consensus.cc:697] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:28.194198  8107 consensus_queue.cc:237] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:28.153847  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 85691.3us
I20260620 13:56:28.198282  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:28.199383  8026 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:28.202934  8026 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:28.204408  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.206147  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.206809  5951 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 5
I20260620 13:56:28.157824  5767 catalog_manager.cc:5027] TS 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): tablet 020dbb4b944d4deeba944d1a7c6d5c76 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
W20260620 13:56:28.215457  5767 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 68796.9us
W20260620 13:56:28.216203  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 63965.4us
I20260620 13:56:28.217487  7927 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:28.217864  7927 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:28.218178  7927 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:28.162423  8138 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:28.144263  8082 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:28.091190  8021 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.163635  8185 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:28.168274  8006 raft_consensus.cc:2243] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260620 13:56:28.170069  8177 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:28.170797  8019 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:28.176041  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 210438us
W20260620 13:56:28.176900  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 105513us
I20260620 13:56:28.213016  8029 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:28.203415  8026 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:28.156364  8101 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:28.224086  5997 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:28.224844  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.233904  5959 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 5
I20260620 13:56:28.223510  8175 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260620 13:56:28.232668  7911 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 13:56:28.236626  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.237495  5957 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:28.237627  5997 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:28.240365  8006 raft_consensus.cc:2272] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 13:56:28.241114  8021 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:28.227468  8185 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:28.243497  8185 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:56:28.245044  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 58687.2us
I20260620 13:56:28.245954  5849 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:28.248350  5849 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:28.246861  7911 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:28.250536  7911 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:28.250344  8019 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.251235  7911 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:28.253136  8019 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:28.259420  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.259899  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:28.226351  7947 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:28.260316  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 275071us
I20260620 13:56:28.242316  8187 tablet_replica.cc:333] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:56:28.268035  5997 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:28.236889  8130 raft_consensus.cc:2764] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260620 13:56:28.261475  8175 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:28.261655  7791 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:28.278829  5957 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:28.287989  5849 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:28.267328  8072 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:56:28.273919  8126 raft_consensus.cc:2764] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260620 13:56:28.298489  8178 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:28.280639  8175 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:28.297851  5998 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:56:28.301793  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 103716us
I20260620 13:56:28.308364  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.281272  7791 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:28.308753  6552 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:28.312413  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.285879  8177 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:28.314435  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.316520  5956 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:28.300968  8072 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:28.308285  8175 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:28.311067  8160 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:28.315439  7791 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:28.324867  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.330084  8029 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:28.330299  7984 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:28.351920  7984 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:28.352375  7984 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:28.321033  7909 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260620 13:56:28.355453  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 46782.3us
W20260620 13:56:28.356060  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 58299.2us
W20260620 13:56:28.357407  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.349472  5956 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:28.335253  8177 raft_consensus.cc:697] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:28.367084  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:28.327991  7970 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:28.321174  8072 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:56:28.375332  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 99179.4us
I20260620 13:56:28.376710  6552 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:28.373893  7970 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:28.378186  7970 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:28.379204  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:28.379789  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:28.380988  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:28.379201  5848 leader_election.cc:336] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.903s (SENT)
I20260620 13:56:28.365661  7909 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:28.385100  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.384572  5950 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260620 13:56:28.389964  5950 raft_consensus.cc:1275] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260620 13:56:28.395243  7911 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.395995  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:28.397675  7911 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:28.395291  8006 ts_tablet_manager.cc:1916] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260620 13:56:28.400280  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.400632  8187 raft_consensus.cc:2243] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:56:28.401677  8187 raft_consensus.cc:2272] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:56:28.402370  5951 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:28.384689  8160 raft_consensus.cc:2764] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260620 13:56:28.406272  8177 consensus_queue.cc:237] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:28.341570  7927 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:28.416406  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 98266.9us
I20260620 13:56:28.417584  8178 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:28.419255  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:28.382831  8029 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:28.423000  8130 raft_consensus.cc:2764] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260620 13:56:28.423481  8029 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.426075  8029 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:28.425925  8191 log.cc:927] Time spent T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: Append to log took a long time: real 0.069s	user 0.001s	sys 0.002s
I20260620 13:56:28.427367  8155 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:28.427866  8155 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:28.428263  8155 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:56:28.439296  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.441844  5959 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
W20260620 13:56:28.439603  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 60437.2us
I20260620 13:56:28.426848  8029 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:28.452250  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:28.456727  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 60846.6us
I20260620 13:56:28.458134  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.459210  5956 raft_consensus.cc:2410] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260620 13:56:28.460525  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.462258  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:28.464815  8126 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:28.465359  8126 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:28.465802  8126 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:28.466025  8044 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:28.408527  7909 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:28.464968  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.465652  6552 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:28.470428  7970 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.431007  8062 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:28.477679  5848 leader_election.cc:336] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.966s (SENT)
I20260620 13:56:28.472750  8101 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:28.478742  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:28.479877  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.480628  8026 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.474486  8072 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.496107  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.496919  5951 raft_consensus.cc:2393] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:28.497282  8026 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:28.497519  8072 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:28.481271  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.497774  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.498312  5950 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:28.498483  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.473511  8082 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:28.499190  5956 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:28.499670  5952 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:28.483510  5954 raft_consensus.cc:1217] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-3.2]   Dedup: 3.2->[]
I20260620 13:56:28.500363  5954 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260620 13:56:28.500627  8062 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:28.502656  5954 raft_consensus.cc:1240] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:28.484520  8185 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:28.504196  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.504752  8185 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:28.504894  8125 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:28.504617  7791 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:28.488407  7984 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:28.490427  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.493251  5953 raft_consensus.cc:1813] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Handling vote request from an unknown peer 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:28.523727  5953 raft_consensus.cc:2368] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 2. Current term is 3.
I20260620 13:56:28.524667  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.524984  5956 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:28.525548  5953 raft_consensus.cc:2410] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260620 13:56:28.525962  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.526448  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.495260  7909 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:28.506126  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.528412  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.529011  8187 ts_tablet_manager.cc:1916] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260620 13:56:28.529274  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.529843  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.531616  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.532485  5955 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:28.535687  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.485059  8175 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:28.514228  7970 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:28.536526  5958 raft_consensus.cc:2393] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 3: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:28.514683  6551 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:28.516177  5997 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:28.520347  8126 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.527561  6552 leader_election.cc:400] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4.
I20260620 13:56:28.539247  8126 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:28.539844  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:28.522541  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.539284  6552 leader_election.cc:403] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260620 13:56:28.549024  5953 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:28.549364  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.550015  5959 raft_consensus.cc:1813] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Handling vote request from an unknown peer 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:28.550652  5959 raft_consensus.cc:2368] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5.
I20260620 13:56:28.550877  5952 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:28.554138  6551 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:28.552317  5848 leader_election.cc:336] T 29e2284e793941b4aa9829a72313998c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.090s (SENT)
W20260620 13:56:28.555368  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 46482.3us
I20260620 13:56:28.559082  6551 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:28.558926  5998 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:28.557276  8126 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:28.562681  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.568683  5954 raft_consensus.cc:1813] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Handling vote request from an unknown peer 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:28.569689  5954 raft_consensus.cc:2368] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5.
I20260620 13:56:28.542111  8175 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:28.575585  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:28.575615  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 187757us
I20260620 13:56:28.558975  7866 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:28.577694  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.568293  7947 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election won for term 5
W20260620 13:56:28.578373  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 62025us
I20260620 13:56:28.578454  5959 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:28.581782  5953 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:28.583582  6551 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:28.561659  7909 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:28.557386  8107 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:28.595288  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.595949  5955 raft_consensus.cc:2410] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260620 13:56:28.558977  8101 consensus_queue.cc:1059] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260620 13:56:28.602981  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 44188.2us
I20260620 13:56:28.603276  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.598222  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:28.612519  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.594386  5951 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260620 13:56:28.596549  7866 raft_consensus.cc:697] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:56:28.620316  5848 leader_election.cc:336] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.137s (SENT)
W20260620 13:56:28.628772  8200 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260620 13:56:28.609391  8185 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:28.645771  8185 raft_consensus.cc:697] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:28.609666  8062 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:28.596697  7947 raft_consensus.cc:697] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:28.609925  8091 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:28.585527  8126 raft_consensus.cc:697] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:28.568143  8198 consensus_queue.cc:1048] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260620 13:56:28.637583  7970 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:28.640884  7791 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:28.641846  7866 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.608989  7909 raft_consensus.cc:697] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:56:28.643695  5848 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.971s (SENT)
I20260620 13:56:28.644325  7984 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:28.644836  8101 raft_consensus.cc:3055] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
W20260620 13:56:28.671552  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 88184us
W20260620 13:56:28.680639  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 105203us
I20260620 13:56:28.649986  8072 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260620 13:56:28.670929  7970 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:28.683095  7970 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:28.685352  5998 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:56:28.685976  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 91508.7us
I20260620 13:56:28.688742  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.693646  7947 consensus_queue.cc:237] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.695667  8126 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:28.697794  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 54169.4us
W20260620 13:56:28.698796  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.701299  8194 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:28.701838  8194 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.679409  8062 raft_consensus.cc:697] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:28.704078  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:28.703809  7909 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.705415  8072 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:28.706578  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:28.707299  5881 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:28.708040  6552 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:28.638361  8155 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.691092  8185 consensus_queue.cc:237] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:28.681985  8101 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:56:28.823762  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 138470us
W20260620 13:56:28.824592  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 134157us
I20260620 13:56:28.846112  6552 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:28.805243  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.747020  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.842811  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:28.740247  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:28.747403  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:28.778405  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.742154  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:28.852123  5882 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:28.747725  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.748050  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.746678  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.860724  5954 raft_consensus.cc:1813] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Handling vote request from an unknown peer 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:28.861245  5954 raft_consensus.cc:2368] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 2. Current term is 3.
I20260620 13:56:28.861245  5953 raft_consensus.cc:2368] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4.
W20260620 13:56:28.861649  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.716814  5997 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:28.868209  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:28.691536  7927 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:28.872265  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 155581us
I20260620 13:56:28.759496  7891 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:28.875777  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:28.757483  8107 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4.
I20260620 13:56:28.706949  8026 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.169s
I20260620 13:56:28.744017  8194 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:28.882288  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.747597  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.815456  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:28.888026  5875 raft_consensus.cc:1275] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260620 13:56:28.743749  8019 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:28.890645  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:29.039925  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:29.106287  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:29.107120  5953 raft_consensus.cc:2410] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260620 13:56:29.104976  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 258951us
I20260620 13:56:28.703864  8062 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:28.959403  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:28.967173  5997 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:29.036028  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.963793  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:28.965193  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:28.955986  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:29.066865  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:29.067574  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:29.015940  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.112772  5958 raft_consensus.cc:2410] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260620 13:56:28.977196  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.110992  5877 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
W20260620 13:56:28.900148  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:29.028090  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 152091us
W20260620 13:56:28.959949  5848 leader_election.cc:336] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.951s (SENT)
W20260620 13:56:29.028656  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.066977  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:28.937583  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.112011  6025 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:29.114909  5959 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:29.118237  5956 raft_consensus.cc:2393] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:56:29.119009  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.119197  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:29.121097  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:29.118396  5878 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
W20260620 13:56:29.126372  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 159322us
I20260620 13:56:29.128356  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:29.128545  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:29.129739  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:29.130566  5955 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
W20260620 13:56:29.131011  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.131618  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:29.132292  5956 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260620 13:56:29.132424  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:28.963855  8125 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:29.132859  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:29.133934  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.036491  7947 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:29.110360  8044 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:28.889498  8175 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:29.133183  5956 pending_rounds.cc:85] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 5
I20260620 13:56:29.140826  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:29.113265  7891 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:29.136711  5958 raft_consensus.cc:3055] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:29.137280  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:29.136754  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:29.144595  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:56:29.144905  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 184987us
I20260620 13:56:29.145211  5959 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:29.139288  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:29.141574  5956 pending_rounds.cc:107] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260620 13:56:29.137946  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:29.145695  5957 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:29.145993  5956 raft_consensus.cc:2889] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:29.144469  5958 raft_consensus.cc:740] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:29.058706  8179 consensus_queue.cc:1059] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260620 13:56:29.131613  8206 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:29.147197  6025 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:28.959012  7970 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:29.141902  8044 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:29.160174  5848 leader_election.cc:336] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.981s (SENT)
I20260620 13:56:29.160835  5848 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:29.163123  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:29.164543  5958 consensus_queue.cc:260] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:29.165639  5958 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:29.147439  7891 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:29.149147  6552 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:29.146543  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:29.137204  8019 raft_consensus.cc:697] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:29.184629  8206 raft_consensus.cc:697] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:29.191671  8194 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:29.143304  5953 raft_consensus.cc:2393] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:29.149995  7909 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:29.192198  8019 consensus_queue.cc:237] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:29.192683  8206 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:29.174821  8044 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:28.959420  8101 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:29.195523  8101 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:29.147946  5952 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:29.149475  8175 raft_consensus.cc:697] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:29.175211  8006 ts_tablet_manager.cc:1929] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260620 13:56:29.206856  8006 log.cc:1199] T 24c27735bbb449a98fab7edad2ba9837 P 2e82c0c231624695ac5a813230bf5038: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/wals/24c27735bbb449a98fab7edad2ba9837
I20260620 13:56:29.208703  8006 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58442 (request call id 87) took 4070 ms. Trace:
I20260620 13:56:29.209201  8006 rpcz_store.cc:276] 0620 13:56:25.138011 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:25.138125 (+   114us) service_pool.cc:224] Handling call
0620 13:56:26.707338 (+1569213us) ts_tablet_manager.cc:1151] Deleting tablet 24c27735bbb449a98fab7edad2ba9837
0620 13:56:26.707435 (+    97us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0620 13:56:28.748587 (+2041152us) tablet_metadata.cc:665] Metadata flushed
0620 13:56:29.156287 (+407700us) tablet_metadata.cc:665] Metadata flushed
0620 13:56:29.208579 (+ 52292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1097430,"tablet-delete.queue_time_us":1463861}
I20260620 13:56:29.142584  7947 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:29.240330  7909 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:29.261786  7970 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:29.224417  8072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.013s	sys 0.026s
I20260620 13:56:29.304847  8044 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:29.309405  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:29.316776  8209 log.cc:927] Time spent T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.579s	user 0.013s	sys 0.028s
I20260620 13:56:29.319345  8177 raft_consensus.cc:3055] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:29.319958  8177 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:29.320919  8177 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:29.324949  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 218705us
W20260620 13:56:29.328203  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.343981  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:29.344626  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:29.376428  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:29.389542  6025 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:56:29.294312  8072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.013s	sys 0.026s
I20260620 13:56:29.201390  5959 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:56:29.369058  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:29.393062  5954 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:29.371203  8155 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:29.371963  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 225649us
W20260620 13:56:29.375373  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 229588us
W20260620 13:56:29.378364  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:29.399269  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.379137  5958 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260620 13:56:29.399966  5958 pending_rounds.cc:85] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 2
I20260620 13:56:29.400293  5958 pending_rounds.cc:107] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260620 13:56:29.400628  5958 raft_consensus.cc:2889] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:29.396723  8177 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:29.397220  5849 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:29.401714  6587 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:29.402282  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:29.367347  5767 catalog_manager.cc:5027] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): tablet 24c27735bbb449a98fab7edad2ba9837 (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
I20260620 13:56:29.401904  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:29.405165  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 250147us
I20260620 13:56:29.407611  6026 raft_consensus.cc:2393] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:29.409698  6552 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:29.322786  7891 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:29.416149  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:29.415676  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:29.415491  5767 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 48190.4us
I20260620 13:56:29.416813  6025 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:29.417433  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:29.418507  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:29.419868  6582 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260620 13:56:29.420295  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:29.420302  6582 pending_rounds.cc:85] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 5
I20260620 13:56:29.421852  6582 pending_rounds.cc:107] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260620 13:56:29.422098  6582 raft_consensus.cc:2889] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:29.421532  6581 raft_consensus.cc:2393] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:29.424104  5958 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:29.425625  5956 raft_consensus.cc:2393] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:29.430804  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:29.431293  6029 raft_consensus.cc:2393] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:56:29.434283  5848 leader_election.cc:336] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.023s (SENT)
I20260620 13:56:29.391952  8072 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:29.435312  7970 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:29.461875  5848 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:29.462338  7970 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:29.462800  7970 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:29.420521  8175 consensus_queue.cc:237] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:29.465066  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.459309  7947 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:29.468524  6552 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:29.469455  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:29.469967  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.470016  5958 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260620 13:56:29.471647  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.397848  8026 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260620 13:56:29.435184  6583 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 3: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:29.470563  5778 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56624 (request call id 342) took 6316 ms. Trace:
I20260620 13:56:29.429775  8107 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:29.470747  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:29.427314  8138 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:29.477998  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:29.480185  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:29.459683  8062 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:29.467501  8194 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:29.484172  6582 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:29.488168  8044 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:29.488924  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:29.489760  6586 raft_consensus.cc:2393] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:29.491703  5876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:56:29.492383  5876 raft_consensus.cc:606] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:56:29.492681  5876 raft_consensus.cc:614] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:56:29.494994  8072 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:29.500602  8194 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:29.482108  8107 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:29.503571  8107 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:29.503758  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:29.507277  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:29.511198  5954 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:56:29.502739  5779 catalog_manager.cc:5696] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 3, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:29.517122  5779 catalog_manager.cc:5696] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 3, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:29.511487  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:29.518633  5779 catalog_manager.cc:5696] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 3, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:29.521560  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:29.482525  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:29.521953  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:29.522236  6029 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:29.522564  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:29.522799  5875 raft_consensus.cc:2393] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 4: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:29.523352  6031 raft_consensus.cc:2393] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 5: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:29.524036  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:29.524195  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:29.524641  6030 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:29.524770  6031 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:29.525585  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:29.526669  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:29.521029  7866 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:29.527354  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:29.527563  7866 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:29.521782  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:29.527935  7866 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:29.528219  6033 raft_consensus.cc:2410] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260620 13:56:29.521560  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:29.529377  5877 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:29.529850  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:29.530405  6027 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:29.521561  6024 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260620 13:56:29.531746  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:29.528291  6026 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:29.534114  8126 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election won for term 2
W20260620 13:56:29.535293  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.484335  8205 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:29.520505  5779 catalog_manager.cc:5696] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:29.477931  5778 rpcz_store.cc:276] 0620 13:56:23.154394 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:23.158408 (+  4014us) service_pool.cc:224] Handling call
0620 13:56:29.470491 (+6312083us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:56:28.166951 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:56:28.168266 (+  1315us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:56:28.168338 (+    72us) write_op.cc:435] Acquired schema lock
0620 13:56:28.168367 (+    29us) tablet.cc:662] Decoding operations
0620 13:56:28.169219 (+   852us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:56:28.169331 (+   112us) write_op.cc:641] Partition lock acquired for write op
0620 13:56:28.169372 (+    41us) tablet.cc:685] Acquiring locks for 3 operations
0620 13:56:28.169997 (+   625us) tablet.cc:701] Row locks acquired
0620 13:56:28.170026 (+    29us) write_op.cc:260] PREPARE: finished
0620 13:56:28.170265 (+   239us) write_op.cc:270] Start()
0620 13:56:28.170444 (+   179us) write_op.cc:276] Timestamp: P: 1781963788170174 usec, L: 0
0620 13:56:28.170482 (+    38us) op_driver.cc:348] REPLICATION: starting
0620 13:56:28.206282 (+ 35800us) log.cc:844] Serialized 1307 byte log entry
0620 13:56:28.499568 (+293286us) op_driver.cc:464] REPLICATION: finished
0620 13:56:28.645525 (+145957us) write_op.cc:301] APPLY: starting
0620 13:56:28.645639 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0620 13:56:28.645799 (+   160us) tablet.cc:1370] finished BulkCheckPresence
0620 13:56:28.645948 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:56:28.675970 (+ 30022us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:56:28.676277 (+   307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0620 13:56:28.676321 (+    44us) write_op.cc:312] APPLY: finished
0620 13:56:28.676641 (+   320us) log.cc:844] Serialized 35 byte log entry
0620 13:56:28.677548 (+   907us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:28.677642 (+    94us) write_op.cc:454] Released schema lock
0620 13:56:28.677698 (+    56us) write_op.cc:341] FINISH: Updating metrics
0620 13:56:28.709175 (+ 31477us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:28.714430 (+  5255us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1682072,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":110576,"apply.run_cpu_time_us":6061,"apply.run_wall_time_us":48617,"num_ops":3,"prepare.queue_time_us":228278,"prepare.run_cpu_time_us":49254,"prepare.run_wall_time_us":162024,"raft.queue_time_us":70797,"raft.run_cpu_time_us":4000,"raft.run_wall_time_us":27624,"replication_time_us":328908,"thread_start_us":326313,"threads_started":4,"wal-append.queue_time_us":149649}]]}
W20260620 13:56:29.545851  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.522580  5950 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:56:29.548952  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.544773  6030 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:29.552380  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:29.550773  5877 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:29.545462  5779 catalog_manager.cc:5696] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 3, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
W20260620 13:56:29.556692  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 43815.4us
I20260620 13:56:29.556805  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:29.557550  5998 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:29.557669  5881 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:29.559453  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.563486  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:29.543195  8187 ts_tablet_manager.cc:1929] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260620 13:56:29.564277  5882 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:29.567981  5779 catalog_manager.cc:5696] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 1 to 2, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 2 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:29.624784  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:29.625700  5877 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:29.584264  5779 catalog_manager.cc:5696] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 1 to 2, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 2 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:29.631474  5779 catalog_manager.cc:5696] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 1 to 2, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 2 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:29.637735  6552 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:29.639735  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:29.640811  6025 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:29.542294  8125 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:29.633937  5779 catalog_manager.cc:5696] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 3 to 4, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 4 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:29.794147  5877 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
W20260620 13:56:29.673763  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.868672  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:29.935091  5997 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:29.869063  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:29.936209  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:29.885455  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:29.909721  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:29.937183  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.880823  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:29.944922  6587 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:29.946715  6582 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:29.646800  5779 catalog_manager.cc:5696] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 3, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:29.786001  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:29.660933  5880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:51382
I20260620 13:56:29.949666  5880 raft_consensus.cc:606] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
W20260620 13:56:29.649605  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 178684us
W20260620 13:56:29.755082  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 117856us
I20260620 13:56:29.881492  5957 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
W20260620 13:56:29.725420  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 167953us
W20260620 13:56:29.952880  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.829681  5881 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
W20260620 13:56:29.953778  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.553396  8126 raft_consensus.cc:697] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:29.958372  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:56:29.853130  5848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.538s (SENT) [suppressed 29 similar messages]
I20260620 13:56:29.963994  5882 raft_consensus.cc:2393] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 4: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:29.951512  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:29.972785  5959 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:29.970538  6030 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:29.976850  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:29.880093  8216 log.cc:927] Time spent T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260620 13:56:29.645038  8194 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:29.644035  8205 raft_consensus.cc:697] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:29.561982  8213 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:29.984969  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:29.868184  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:29.755852  8062 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:29.988094  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:29.988170  5952 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:29.958810  5779 catalog_manager.cc:5696] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 3, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 3 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:29.876863  7891 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:29.728762  8187 log.cc:1199] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/wals/923bfc4f20d94a57b0d84d45e40b12ae
I20260620 13:56:29.663451  8155 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:29.986760  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 133642us
I20260620 13:56:29.822830  8044 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:29.759063  8215 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:29.778448  8138 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260620 13:56:29.987478  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:29.823086  8091 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:29.776979  8177 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:29.958175  7791 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:30.045552  8194 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:30.051419  8044 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.057327  8044 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:30.058355  5957 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260620 13:56:29.649811  8226 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:30.063776  8226 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.064770  8091 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:30.018505  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 67147.2us
I20260620 13:56:30.068086  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:30.024194  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:29.870976  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:30.025377  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:30.028609  5849 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:30.039166  8187 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35974 (request call id 88) took 2098 ms. Trace:
W20260620 13:56:30.042335  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:30.047171  6031 consensus_meta.cc:287] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.522s	user 0.013s	sys 0.000s
I20260620 13:56:30.091800  6031 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
W20260620 13:56:30.048533  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:30.049722  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 56643.8us
I20260620 13:56:29.725173  8125 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.016758  5997 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:30.097252  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 68767.5us
W20260620 13:56:30.097539  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 80894us
I20260620 13:56:30.069234  5955 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
W20260620 13:56:30.083941  6027 consensus_meta.cc:287] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.553s	user 0.012s	sys 0.001s
I20260620 13:56:30.099452  6027 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:30.100309  6028 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260620 13:56:30.087946  6552 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:30.088994  5952 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:29.993116  8206 consensus_queue.cc:1059] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260620 13:56:30.043639  7947 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:30.052037  8177 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:30.084735  8107 consensus_meta.cc:287] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.000s
I20260620 13:56:30.113531  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:30.102666  8175 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:56:30.100419  8226 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:30.117669  8205 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.118623  8125 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:30.119222  8125 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:30.119679  8125 raft_consensus.cc:697] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:56:30.120353  7970 consensus_meta.cc:287] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.657s	user 0.005s	sys 0.004s
I20260620 13:56:30.120805  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:30.121652  8220 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:30.122345  8220 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.122788  7891 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:30.123214  8107 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.124284  7947 raft_consensus.cc:697] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:30.036556  8062 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.128000  5959 raft_consensus.cc:2410] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260620 13:56:30.143760  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260620 13:56:30.167810  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:30.173055  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:56:30.127279  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:30.100749  8138 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:30.151749  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1331) took 1009 ms. Trace:
I20260620 13:56:30.153142  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:56:30.127516  6026 consensus_meta.cc:287] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.593s	user 0.006s	sys 0.005s
I20260620 13:56:30.198624  6026 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:30.046113  8155 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.163373  7891 raft_consensus.cc:697] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:30.165795  8107 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:30.149163  8213 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:30.091495  8187 rpcz_store.cc:276] 0620 13:56:27.958376 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:27.967896 (+  9520us) service_pool.cc:224] Handling call
0620 13:56:28.241857 (+273961us) ts_tablet_manager.cc:1151] Deleting tablet 923bfc4f20d94a57b0d84d45e40b12ae
0620 13:56:28.241970 (+   113us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0620 13:56:28.958446 (+716476us) tablet_metadata.cc:665] Metadata flushed
0620 13:56:29.515226 (+556780us) tablet_metadata.cc:665] Metadata flushed
0620 13:56:30.038962 (+523736us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16635,"tablet-delete.queue_time_us":201983,"thread_start_us":82099,"threads_started":1}
W20260620 13:56:30.158245  7866 consensus_meta.cc:287] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.009s
I20260620 13:56:30.051755  8215 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.115185  8177 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:56:30.175909  6029 consensus_meta.cc:287] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.653s	user 0.013s	sys 0.000s
I20260620 13:56:30.244704  6029 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:30.194242  5958 rpcz_store.cc:276] 0620 13:56:29.142769 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:29.476675 (+333906us) service_pool.cc:224] Handling call
0620 13:56:29.476912 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:29.477143 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:29.656456 (+179313us) log.cc:844] Serialized 14 byte log entry
0620 13:56:30.151403 (+494947us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:30.151455 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:30.151514 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:30.151582 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:30.151692 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7427,"prepare.queue_time_us":173951,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":636679,"threads_started":2}
I20260620 13:56:30.120815  7970 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:30.157840  8226 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:30.216825  6552 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:30.221740  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:30.192902  8091 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:30.193747  8138 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:30.068135  8126 consensus_queue.cc:237] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.194408  8204 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:30.247570  6033 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:56:30.158532  8206 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260620 13:56:30.248787  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:30.204083  8044 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:30.253552  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:30.205883  8213 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:30.256769  5958 raft_consensus.cc:2410] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260620 13:56:30.206784  8072 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:30.263785  8240 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:30.265628  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1327) took 1129 ms. Trace:
I20260620 13:56:30.270426  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:30.256143  8138 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:30.254925  8107 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:30.286896  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:30.287292  5959 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260620 13:56:30.266183  5956 rpcz_store.cc:276] 0620 13:56:29.136088 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:29.426376 (+290288us) service_pool.cc:224] Handling call
0620 13:56:29.426744 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:29.714323 (+287579us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:29.714364 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:29.772863 (+ 58499us) log.cc:844] Serialized 26 byte log entry
0620 13:56:30.265154 (+492291us) raft_consensus.cc:1645] Marking committed up to 2
0620 13:56:30.265197 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:30.265267 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:30.265313 (+    46us) raft_consensus.cc:1685] finished
0620 13:56:30.265324 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:30.265575 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":694011,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":153,"thread_start_us":778829,"threads_started":2,"wal-append.queue_time_us":489756}
I20260620 13:56:30.258323  8044 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:30.295159  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:30.296393  5954 raft_consensus.cc:2410] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260620 13:56:30.297550  5957 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:56:30.200389  8125 consensus_queue.cc:237] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.245265  7866 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.301062  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:30.301684  5955 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:30.261665  8213 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:30.302989  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1328) took 1164 ms. Trace:
I20260620 13:56:30.259424  8226 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.279677  7791 raft_consensus.cc:697] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:30.314021  5953 rpcz_store.cc:276] 0620 13:56:29.136231 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:29.461239 (+325008us) service_pool.cc:224] Handling call
0620 13:56:29.475050 (+ 13811us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:29.475298 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:29.776844 (+301546us) log.cc:844] Serialized 14 byte log entry
0620 13:56:30.300541 (+523697us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:30.300616 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:30.300694 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:30.300781 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:30.300923 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":175457,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":58,"raft.queue_time_us":115487,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":40041,"spinlock_wait_cycles":3456,"thread_start_us":815227,"threads_started":3,"wal-append.queue_time_us":475823}
I20260620 13:56:30.261348  8204 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.300312  8044 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:30.342376  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260620 13:56:30.333482  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 211253us
I20260620 13:56:30.363233  5955 raft_consensus.cc:2410] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260620 13:56:30.301839  7909 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260620 13:56:30.264618  8240 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:30.361878  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:30.334753  8091 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:30.328027  8107 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:30.333436  8233 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:30.279698  7947 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.363802  8205 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:30.409046  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 157199us
I20260620 13:56:30.412175  5958 raft_consensus.cc:2393] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:30.420670  8233 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.413698  8240 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:30.429674  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 304884us
W20260620 13:56:30.432806  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 223624us
I20260620 13:56:30.311568  8175 raft_consensus.cc:697] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:30.307873  7891 consensus_queue.cc:237] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:30.469297  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:30.484297  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:30.434595  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:30.444109  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:30.445657  8243 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:30.483335  8236 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260620 13:56:30.533074  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 101354us
W20260620 13:56:30.547243  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:30.553218  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 132038us
I20260620 13:56:30.556031  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:30.540750  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:30.561721  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:30.562573  5876 raft_consensus.cc:2393] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 4: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:30.448266  8205 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.463500  8091 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.570216  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:30.571000  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:30.571548  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:30.572691  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:30.575551  5848 leader_election.cc:336] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.665s (SENT)
I20260620 13:56:30.577040  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:30.567041  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 132635us
I20260620 13:56:30.555485  8155 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:30.556082  7970 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:30.593134  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:30.594679  8233 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:30.573537  8107 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.537523  8243 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.583699  8250 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260620 13:56:30.584659  8235 log.cc:927] Time spent T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260620 13:56:30.556507  8220 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:30.586633  8175 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:30.587697  6032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 412) took 1061 ms. Trace:
I20260620 13:56:30.586391  8226 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:30.576668  8072 raft_consensus.cc:2764] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260620 13:56:30.580510  8062 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:56:30.600695  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:30.600030  8232 log.cc:927] Time spent T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260620 13:56:30.603385  8258 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:30.588716  8091 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:30.590322  8205 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:30.590008  8177 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:30.590972  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:30.592278  7927 raft_consensus.cc:3055] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:30.595397  7866 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:30.516327  7791 consensus_queue.cc:237] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:30.582342  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:30.598404  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:30.602048  5848 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.705s (SENT)
I20260620 13:56:30.633852  5848 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:30.601552  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 416) took 1080 ms. Trace:
W20260620 13:56:30.628060  8231 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260620 13:56:30.600207  6032 rpcz_store.cc:276] 0620 13:56:29.519397 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:29.519529 (+   132us) service_pool.cc:224] Handling call
0620 13:56:29.519839 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:29.533247 (+ 13408us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:29.533285 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:29.533757 (+   472us) log.cc:844] Serialized 26 byte log entry
0620 13:56:29.948628 (+414871us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:30.294230 (+345602us) log.cc:844] Serialized 14 byte log entry
0620 13:56:30.548107 (+253877us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b240038c5e8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc591614 00007f0fdc58f71b 00007f0fdc74a619 00007f0fdc74a2a5 00007f0fdc749800 00007f0fdf3c3828 00007f0fdf3c3f88 00007f0fdf39b738 00007f0fdf396b0a 00007f0fdf395f56
0620 13:56:30.575471 (+ 27364us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:30.575551 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:30.575598 (+    47us) raft_consensus.cc:1685] finished
0620 13:56:30.580417 (+  4819us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:30.580558 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14877,"prepare.queue_time_us":500389,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":250436,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":28545,"spinlock_wait_cycles":39424896,"thread_start_us":990765,"threads_started":3,"wal-append.queue_time_us":516511}
I20260620 13:56:30.629017  6029 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:30.597829  8250 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:30.583870  8215 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:30.634810  6033 rpcz_store.cc:276] 0620 13:56:29.520708 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:29.529240 (+  8532us) service_pool.cc:224] Handling call
0620 13:56:30.246121 (+716881us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:30.254814 (+  8693us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:30.601352 (+346538us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b540037cdd0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:30.601491 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647803648}
I20260620 13:56:30.628799  7927 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:30.639036  8091 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260620 13:56:30.641844  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 43579.7us
I20260620 13:56:30.649966  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:30.656613  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 57090.9us
I20260620 13:56:30.657106  5955 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:30.658891  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:30.659446  8194 raft_consensus.cc:2764] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260620 13:56:30.660228  8226 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260620 13:56:30.662518  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 60468.7us
I20260620 13:56:30.662611  8226 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260620 13:56:30.663800  5848 leader_election.cc:336] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.714s (SENT)
I20260620 13:56:30.664674  5848 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:30.667671  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:30.668260  6587 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:30.669730  6032 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:30.673209  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:30.674839  6032 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:30.678399  6581 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:30.687618  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:30.636072  8062 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260620 13:56:30.687942  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 88773.1us
I20260620 13:56:30.721462  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1323) took 1576 ms. Trace:
I20260620 13:56:30.710829  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:30.729068  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:30.834363  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:30.696219  6032 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260620 13:56:30.862571  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:30.903694  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:30.980381  5954 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:30.714701  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:30.980701  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:30.866412  5955 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260620 13:56:30.981161  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:30.891026  5849 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:30.979224  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 143956us
I20260620 13:56:30.713899  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:30.861361  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:30.981889  5998 connection.cc:256] RPC call timeout handler was delayed by -3.1431588829999555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260620 13:56:30.982340  6030 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 3
W20260620 13:56:30.982751  5998 connection.cc:256] RPC call timeout handler was delayed by -3.1156393579999531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260620 13:56:30.845826  6587 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
W20260620 13:56:30.983304  5998 connection.cc:256] RPC call timeout handler was delayed by -2.8249393579999378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260620 13:56:30.983626  6580 raft_consensus.cc:1240] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 3. Current term is 4. Ops: []
W20260620 13:56:30.836633  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 172922us
W20260620 13:56:30.984496  5848 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.743s (SENT)
W20260620 13:56:30.983837  5998 connection.cc:256] RPC call timeout handler was delayed by -1.8804084040000362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260620 13:56:30.657378  8250 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:30.984866  5848 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:30.985126  5998 connection.cc:256] RPC call timeout handler was delayed by -1.5591084039999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260620 13:56:30.838938  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:30.985543  5998 connection.cc:256] RPC call timeout handler was delayed by -1.4862084039999672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
I20260620 13:56:30.985162  6032 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:30.860162  6026 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:30.988333  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:30.988699  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:30.989104  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 98216.4us
W20260620 13:56:30.912038  8138 consensus_meta.cc:287] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.000s
I20260620 13:56:30.989257  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:30.992816  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:30.992929  6581 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:30.993355  5955 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:30.991436  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:30.994508  6587 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:30.716811  8204 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:30.991698  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:30.995621  5849 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:30.997342  6586 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:30.900867  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:30.715588  8194 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:30.715442  8241 raft_consensus.cc:2764] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260620 13:56:31.002056  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:30.852123  6583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 653) took 1305 ms. Trace:
I20260620 13:56:30.990933  7791 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:31.007237  6583 rpcz_store.cc:276] 0620 13:56:29.546366 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:29.551928 (+  5562us) service_pool.cc:224] Handling call
0620 13:56:29.827067 (+275139us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:30.035926 (+208859us) raft_consensus.cc:1534] Early marking committed up to index 5
0620 13:56:30.339461 (+303535us) log.cc:844] Serialized 14 byte log entry
0620 13:56:30.816514 (+477053us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:30.839673 (+ 23159us) log.cc:844] Serialized 26 byte log entry
0620 13:56:30.839867 (+   194us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:30.839929 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:30.840026 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:30.851839 (+ 11813us) raft_consensus.cc:1685] finished
0620 13:56:30.851858 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:30.852040 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12151,"prepare.queue_time_us":519153,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":28028,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":34183,"thread_start_us":541961,"threads_started":2,"wal-append.queue_time_us":477610}
I20260620 13:56:31.009994  7791 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:31.011711  8044 consensus_meta.cc:287] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.000s
I20260620 13:56:31.012149  8044 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:31.016268  8243 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:31.019419  6584 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:30.992215  8226 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:30.838479  8177 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:31.001353  6587 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:30.716661  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:31.028308  5950 raft_consensus.cc:2410] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260620 13:56:31.028370  5998 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:31.029798  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:30.739069  8213 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:31.002940  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:30.734827  7927 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:31.003690  8251 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260620 13:56:31.004173  6581 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:56:31.045532  8194 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:56:30.992259  8072 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:30.999799  7970 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:31.004454  8176 consensus_queue.cc:1059] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:56:31.001991  8026 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:56:31.026338  8268 consensus_queue.cc:1059] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:31.033736  6030 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:31.002907  6586 raft_consensus.cc:2410] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260620 13:56:31.000794  5848 leader_election.cc:336] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.798s (SENT)
I20260620 13:56:31.038069  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:31.042531  5955 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:30.996348  8138 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:31.046234  5956 raft_consensus.cc:3055] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:31.179636  5956 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:56:31.180984  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 95124.7us
I20260620 13:56:31.185070  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:31.080689  5849 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:31.186275  8226 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:31.186694  8226 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:31.187036  8226 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:31.190836  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:31.150563  8194 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260620 13:56:31.197948  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 197156us
W20260620 13:56:31.198812  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 118218us
I20260620 13:56:30.859786  5951 rpcz_store.cc:276] 0620 13:56:29.135503 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:29.879943 (+744440us) service_pool.cc:224] Handling call
0620 13:56:29.880304 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:29.880552 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 3
0620 13:56:29.880906 (+   354us) log.cc:844] Serialized 14 byte log entry
0620 13:56:30.604325 (+723419us) log.cc:844] Serialized 14 byte log entry
0620 13:56:30.637865 (+ 33540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:30.643028 (+  5163us) raft_consensus.cc:1645] Marking committed up to 3
0620 13:56:30.665433 (+ 22405us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:30.674697 (+  9264us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:30.711640 (+ 36943us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13196,"prepare.queue_time_us":46210,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":90,"raft.queue_time_us":70044,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":21454,"thread_start_us":677667,"threads_started":2,"wal-append.queue_time_us":453863}
W20260620 13:56:31.103184  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:31.202162  5849 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:31.270874  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 85840.1us
I20260620 13:56:31.211407  5954 raft_consensus.cc:2410] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260620 13:56:31.210067  7927 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:31.180711  8072 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:31.288519  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:31.209678  8253 consensus_queue.cc:1059] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:56:31.182099  7866 raft_consensus.cc:2764] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260620 13:56:31.079392  7791 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:31.290288  5998 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:31.202800  8268 consensus_queue.cc:1243] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer 2e82c0c231624695ac5a813230bf5038 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260620 13:56:31.079717  8251 consensus_queue.cc:1059] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.208s
I20260620 13:56:31.305521  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:31.302848  8226 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:31.303188  8177 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:31.307176  8177 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:31.307668  8177 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:31.309101  8226 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:31.293190  8072 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:31.315305  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:31.321076  8226 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:31.321151  8125 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260620 13:56:31.331459  8226 raft_consensus.cc:697] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:56:31.335722  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 151795us
W20260620 13:56:31.336416  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:31.339476  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:31.305805  7791 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:31.347425  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:31.323793  6551 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:31.362717  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:31.369881  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:31.354709  6551 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:31.369894  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 171090us
W20260620 13:56:31.376094  5848 leader_election.cc:336] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.896s (SENT)
I20260620 13:56:31.383234  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 1884) took 1113 ms. Trace:
I20260620 13:56:31.383854  5958 rpcz_store.cc:276] 0620 13:56:30.270008 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:30.270162 (+   154us) service_pool.cc:224] Handling call
0620 13:56:31.382894 (+1112732us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54001964d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:31.383139 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324075904}
I20260620 13:56:31.411746  6578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 654) took 1767 ms. Trace:
I20260620 13:56:31.412439  6578 rpcz_store.cc:276] 0620 13:56:29.644824 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:29.663316 (+ 18492us) service_pool.cc:224] Handling call
0620 13:56:31.411419 (+1748103us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54004a7754. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:31.411642 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280793472}
W20260620 13:56:31.413378  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:31.418177  8273 log.cc:927] Time spent T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260620 13:56:31.422494  8205 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:31.423206  8205 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:31.423640  8205 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:31.394765  8258 consensus_queue.cc:1048] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260620 13:56:31.439236  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:31.439044  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:31.441336  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:31.461257  8270 log.cc:927] Time spent T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260620 13:56:31.466246  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:31.468294  5953 raft_consensus.cc:2410] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260620 13:56:31.332674  8226 consensus_queue.cc:237] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:31.470268  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 268156us
I20260620 13:56:31.465891  6551 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:31.474061  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 98018.5us
I20260620 13:56:31.344947  7970 raft_consensus.cc:697] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:56:31.475919  5848 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.952s (SENT)
I20260620 13:56:31.400763  8259 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:31.333244  8204 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260620 13:56:31.478402  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:31.482375  5883 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:31.479332  5848 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:31.458070  8125 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:31.497641  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:31.479138  8213 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:31.500783  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:31.500664  7970 consensus_queue.cc:237] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:31.502142  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:31.503347  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:31.504673  8177 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:31.458325  8044 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:31.507474  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:31.507683  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:31.508442  5881 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 4: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:31.508683  5875 raft_consensus.cc:2393] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:31.509001  8138 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:31.509588  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:31.510360  5879 raft_consensus.cc:2393] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 3: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:31.511227  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:31.512058  5884 raft_consensus.cc:2393] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 4: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:31.512158  8205 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:31.499070  8125 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:31.513321  8125 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:31.514405  8205 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:31.507728  8044 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:31.516103  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:31.518115  5953 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 2.
I20260620 13:56:31.506788  8177 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:31.520260  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 44378.1us
W20260620 13:56:31.521142  5848 leader_election.cc:336] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.999s (SENT)
I20260620 13:56:31.523681  5876 raft_consensus.cc:1240] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:31.525390  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:31.535732  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:31.519846  5956 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:31.520491  8044 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:31.602749  5956 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:31.539799  6579 consensus_meta.cc:287] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260620 13:56:31.604184  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:31.614692  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:31.539372  8213 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260620 13:56:31.619691  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 98598us
W20260620 13:56:31.621970  5848 leader_election.cc:336] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.966s (SENT)
I20260620 13:56:31.622476  5848 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:31.549065  8253 consensus_queue.cc:1243] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 663684cf4ae54c929bf8240ca0b63a47 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260620 13:56:31.632252  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:31.633410  5883 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 5: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:31.635363  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:31.636258  5953 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:31.544190  8026 raft_consensus.cc:697] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:31.496080  8259 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:31.606462  8044 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:31.603464  8205 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:31.641004  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:31.663245  6033 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: []
W20260620 13:56:31.643872  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 163994us
I20260620 13:56:31.662907  5952 raft_consensus.cc:1240] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:31.666335  6552 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:31.620805  6579 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
W20260620 13:56:31.639758  8274 log.cc:927] Time spent T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260620 13:56:31.636109  8194 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:31.685600  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:31.686388  5955 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:31.637632  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:31.687716  5954 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260620 13:56:31.690369  5998 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:31.691821  5954 pending_rounds.cc:85] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 6
I20260620 13:56:31.691190  5882 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260620 13:56:31.692147  5954 pending_rounds.cc:107] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260620 13:56:31.690966  5956 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
W20260620 13:56:31.680517  5848 leader_election.cc:336] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.111s (SENT)
I20260620 13:56:31.692433  5954 raft_consensus.cc:2889] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:56:31.693568  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:31.694003  5998 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:31.692823  5956 pending_rounds.cc:85] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 5
I20260620 13:56:31.695741  5956 pending_rounds.cc:107] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260620 13:56:31.696054  5956 raft_consensus.cc:2889] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:31.697939  6580 raft_consensus.cc:1240] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:31.670418  7909 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:31.702669  5998 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:31.708591  5848 leader_election.cc:336] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.538s (SENT)
I20260620 13:56:31.709148  5848 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:31.709699  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:31.714752  5883 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260620 13:56:31.716259  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:31.716143  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:31.718178  8194 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260620 13:56:31.718493  5848 leader_election.cc:336] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.203s (SENT)
I20260620 13:56:31.719600  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:31.668552  8205 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:31.706274  8241 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:31.731232  5955 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:31.735602  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:31.710830  8285 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260620 13:56:31.734671  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 56414.3us
I20260620 13:56:31.741891  8205 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:31.744732  8250 consensus_meta.cc:287] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.000s
I20260620 13:56:31.721155  8176 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:31.712563  5876 raft_consensus.cc:1275] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260620 13:56:31.748238  5848 leader_election.cc:336] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.564s (SENT)
I20260620 13:56:31.710902  5953 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:31.757467  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:31.759794  5955 raft_consensus.cc:2393] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:31.757920  8177 consensus_queue.cc:1059] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:31.761046  8177 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:31.761716  8177 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:31.766273  8295 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:31.766980  8295 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:31.729928  8175 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election won for term 4
W20260620 13:56:31.763216  5848 leader_election.cc:336] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.625s (SENT)
W20260620 13:56:31.799824  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:31.778934  5848 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:31.777829  8241 raft_consensus.cc:3055] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:31.745311  8250 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:31.814833  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:31.779279  6552 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:31.819552  5881 raft_consensus.cc:2393] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 4: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:56:31.781073  8278 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.265s	user 0.001s	sys 0.001s
I20260620 13:56:31.819729  8260 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:31.755380  8282 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
W20260620 13:56:31.825901  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:31.826396  8295 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:31.830525  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 1945) took 1118 ms. Trace:
I20260620 13:56:31.836674  6033 rpcz_store.cc:276] 0620 13:56:30.712610 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:30.714089 (+  1479us) service_pool.cc:224] Handling call
0620 13:56:30.714369 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:31.663966 (+949597us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:31.830252 (+166286us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b54000d4b54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:31.830438 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2168192384}
I20260620 13:56:31.833652  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:31.834421  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:31.735827  8026 consensus_queue.cc:237] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:31.876046  5953 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:56:31.877825  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:31.877839  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:31.878935  6032 raft_consensus.cc:2410] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260620 13:56:31.801777  8175 raft_consensus.cc:697] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:31.876060  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:31.882014  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:31.794348  6024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 1943) took 1114 ms. Trace:
I20260620 13:56:31.887159  6031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 426) took 1313 ms. Trace:
W20260620 13:56:31.890093  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 127152us
W20260620 13:56:31.890573  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:31.892637  5848 leader_election.cc:336] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.754s (SENT)
W20260620 13:56:31.893942  5848 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.716s (SENT)
I20260620 13:56:31.882725  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:31.895892  5881 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:31.896575  5878 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:31.893399  6551 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:31.909736  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:31.909967  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:31.915071  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:31.915570  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:31.917315  6032 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260620 13:56:31.917815  6032 pending_rounds.cc:85] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 4
I20260620 13:56:31.918082  6032 pending_rounds.cc:107] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260620 13:56:31.918371  6032 raft_consensus.cc:2889] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:31.919200  6026 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260620 13:56:31.919342  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:31.919934  6580 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:31.815748  8241 raft_consensus.cc:740] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:31.921571  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:31.922330  6027 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:31.921890  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:31.932780  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:31.927331  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:31.898001  8281 log.cc:927] Time spent T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
W20260620 13:56:31.939292  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 46017.8us
I20260620 13:56:31.887806  6031 rpcz_store.cc:276] 0620 13:56:30.573590 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:30.573747 (+   157us) service_pool.cc:224] Handling call
0620 13:56:30.574113 (+   366us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:56:30.583985 (+  9872us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:30.584014 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:56:31.380895 (+796881us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b2c000c06c8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fde0f5c71 00007f0fde1055d2 00007f0fdf837de1 00007f0fdf7fc81a 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22
0620 13:56:31.381741 (+   846us) log.cc:844] Serialized 52 byte log entry
0620 13:56:31.660429 (+278688us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:31.688902 (+ 28473us) log.cc:844] Serialized 14 byte log entry
0620 13:56:31.693375 (+  4473us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:31.694295 (+   920us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:31.839904 (+145609us) raft_consensus.cc:1685] finished
0620 13:56:31.886692 (+ 46788us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:31.887050 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15086,"prepare.queue_time_us":25611,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":16704,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":12018,"spinlock_wait_cycles":52558080,"thread_start_us":278141,"threads_started":1,"wal-append.queue_time_us":355592}
I20260620 13:56:31.894595  5848 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:31.910990  7970 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:31.947451  5881 raft_consensus.cc:2410] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260620 13:56:31.951413  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:31.951917  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:31.953847  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:31.957098  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:31.957620  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:31.957976  5878 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:31.954706  6033 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:31.963898  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:31.964166  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:31.964658  5878 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
W20260620 13:56:31.966991  5997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.034s	sys 0.071s
W20260620 13:56:31.966864  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 72957us
W20260620 13:56:31.967535  5997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.034s	sys 0.071s
W20260620 13:56:31.967867  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 631350us
I20260620 13:56:31.923764  8297 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:31.970518  6027 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:31.988698  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:31.910589  8062 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260620 13:56:31.995450  8194 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260620 13:56:31.989666  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:31.990708  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:31.998128  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:31.999719  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:31.992161  8176 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:31.946633  8107 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:31.994591  8293 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:31.995361  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:31.998983  5884 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 5: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:56:32.000279  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 48953.2us
I20260620 13:56:32.000459  6033 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:32.003134  5880 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
W20260620 13:56:31.994002  8298 log.cc:927] Time spent T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
W20260620 13:56:32.013476  7927 consensus_meta.cc:287] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.721s	user 0.011s	sys 0.001s
I20260620 13:56:32.019577  6552 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:32.022317  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 82319.7us
I20260620 13:56:32.013962  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:32.032013  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:32.022488  5878 raft_consensus.cc:1240] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:31.959131  7891 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:32.030223  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:32.026126  6029 raft_consensus.cc:1240] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260620 13:56:32.014809  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:32.035555  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:32.040525  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:32.042148  5956 raft_consensus.cc:1275] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260620 13:56:32.012697  8251 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.035s	sys 0.035s
I20260620 13:56:32.010124  7909 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:31.970296  8287 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:32.026635  7970 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:32.009779  8258 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:32.044765  6026 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260620 13:56:32.119506  6026 pending_rounds.cc:85] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 5
I20260620 13:56:32.084578  8204 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:32.119782  6026 pending_rounds.cc:107] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260620 13:56:32.120191  6026 raft_consensus.cc:2889] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:32.040089  8289 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:32.091002  6584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 649) took 1188 ms. Trace:
W20260620 13:56:32.121515  8305 log.cc:927] Time spent T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260620 13:56:32.122581  8072 consensus_meta.cc:287] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.803s	user 0.012s	sys 0.001s
I20260620 13:56:32.122253  8310 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260620 13:56:32.123623  8291 log.cc:927] Time spent T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260620 13:56:32.124289  8310 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:32.125006  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 467) took 1120 ms. Trace:
I20260620 13:56:32.125372  5959 rpcz_store.cc:276] 0620 13:56:31.004459 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:31.048260 (+ 43801us) service_pool.cc:224] Handling call
0620 13:56:31.079168 (+ 30908us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:31.079593 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:31.079620 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:31.270023 (+190403us) log.cc:844] Serialized 26 byte log entry
0620 13:56:31.540499 (+270476us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:31.540543 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:31.540634 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:32.124812 (+584178us) raft_consensus.cc:1685] finished
0620 13:56:32.124834 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:32.124951 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7631,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":33029,"thread_start_us":230198,"threads_started":1,"wal-append.queue_time_us":526190}
W20260620 13:56:32.127308  8302 log.cc:927] Time spent T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260620 13:56:32.127388  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:32.091166  8205 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260620 13:56:32.128196  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:32.097819  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 119592us
I20260620 13:56:32.043812  5956 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260620 13:56:32.079324  7891 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.115892  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:32.115934  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 96438us
I20260620 13:56:32.135238  6028 raft_consensus.cc:2393] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:32.135926  6552 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:32.087771  8251 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.036s	sys 0.036s
I20260620 13:56:32.118142  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:32.118434  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:32.118026  7970 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.084358  8288 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:32.128189  5884 raft_consensus.cc:2393] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 4: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:32.129524  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:32.158737  5878 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:32.120958  6584 rpcz_store.cc:276] 0620 13:56:30.902695 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:31.021234 (+118539us) service_pool.cc:224] Handling call
0620 13:56:31.021594 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:31.021945 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:31.021971 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:31.035291 (+ 13320us) log.cc:844] Serialized 26 byte log entry
0620 13:56:31.321550 (+286259us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:31.603906 (+282356us) log.cc:844] Serialized 14 byte log entry
0620 13:56:31.604121 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:31.604188 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:32.090706 (+486518us) raft_consensus.cc:1685] finished
0620 13:56:32.090738 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:32.090926 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":451638,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":13729,"raft.queue_time_us":2044,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":20340,"thread_start_us":554631,"threads_started":2,"wal-append.queue_time_us":442047}
W20260620 13:56:32.158910  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 120335us
I20260620 13:56:32.032213  8062 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260620 13:56:32.030256  8107 raft_consensus.cc:697] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:56:32.173076  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 143010us
I20260620 13:56:32.165385  7970 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:32.175143  8309 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:32.175582  8107 consensus_queue.cc:237] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.179440  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:32.173450  8295 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:32.180629  8295 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.166611  5881 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:32.167559  5957 raft_consensus.cc:3055] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:32.168895  5998 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:32.183436  5957 raft_consensus.cc:740] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:56:32.170876  5924 connection.cc:256] RPC call timeout handler was delayed by -4.2497849369999585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260620 13:56:32.184355  5924 connection.cc:256] RPC call timeout handler was delayed by -4.2497849369999585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260620 13:56:32.184784  5924 connection.cc:256] RPC call timeout handler was delayed by -4.2128849370000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260620 13:56:32.185160  5924 connection.cc:256] RPC call timeout handler was delayed by -4.2128849370000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260620 13:56:32.185528  5924 connection.cc:256] RPC call timeout handler was delayed by -4.1813849369999616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
W20260620 13:56:32.185889  5924 connection.cc:256] RPC call timeout handler was delayed by -4.1165849369999705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
I20260620 13:56:32.186115  5848 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:32.186311  5924 connection.cc:256] RPC call timeout handler was delayed by -3.9707849369999622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
W20260620 13:56:32.186718  5924 connection.cc:256] RPC call timeout handler was delayed by -3.9707849369999622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
W20260620 13:56:32.142997  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:32.137844  8194 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:32.129098  6583 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:32.039911  8259 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:32.191550  5878 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:32.185176  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:32.194304  5998 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:56:32.187088  5924 connection.cc:256] RPC call timeout handler was delayed by -3.89068493700006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
I20260620 13:56:32.162288  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1339) took 1262 ms. Trace:
W20260620 13:56:32.188532  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 149579us
W20260620 13:56:32.195583  5924 connection.cc:256] RPC call timeout handler was delayed by -3.8267849369999567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260620 13:56:32.201284  5924 connection.cc:256] RPC call timeout handler was delayed by -3.8033849370000326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260620 13:56:32.201831  5924 connection.cc:256] RPC call timeout handler was delayed by -3.8033849370000326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260620 13:56:32.203603  5924 connection.cc:256] RPC call timeout handler was delayed by -3.7853849370000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
W20260620 13:56:32.204041  5924 connection.cc:256] RPC call timeout handler was delayed by -3.5810849370000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.242s for a response
W20260620 13:56:32.204479  5924 connection.cc:256] RPC call timeout handler was delayed by -3.5810849370000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.242s for a response
W20260620 13:56:32.204909  5924 connection.cc:256] RPC call timeout handler was delayed by -3.0392849370000476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3022s for a response
W20260620 13:56:32.205348  5924 connection.cc:256] RPC call timeout handler was delayed by -3.0392849370000476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3022s for a response
W20260620 13:56:32.205792  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6001849369999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.46210000000000007s for a response
W20260620 13:56:32.206246  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6001849369999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.46210000000000007s for a response
W20260620 13:56:32.206689  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6001849369999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.46210000000000007s for a response
I20260620 13:56:32.122941  8072 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.210556  5848 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:32.044124  8175 consensus_queue.cc:237] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:32.240860  8044 consensus_meta.cc:287] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260620 13:56:32.209848  8251 consensus_queue.cc:1059] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260620 13:56:32.248461  7970 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:32.250387  7891 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:32.251812  8320 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260620 13:56:32.252784  8316 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260620 13:56:32.254170  8301 log.cc:927] Time spent T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
W20260620 13:56:32.255154  8303 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
W20260620 13:56:32.255998  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 81931.6us
I20260620 13:56:32.237468  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:32.023761  8176 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.083590  8293 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.260219  5957 consensus_queue.cc:260] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:32.120718  8289 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.278738  8289 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:32.165829  8288 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.279305  8194 raft_consensus.cc:697] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:31.897533  6024 rpcz_store.cc:276] 0620 13:56:30.679476 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:30.710540 (+ 31064us) service_pool.cc:224] Handling call
0620 13:56:30.716142 (+  5602us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:30.716577 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:30.716615 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:30.838522 (+121907us) log.cc:844] Serialized 26 byte log entry
0620 13:56:30.973781 (+135259us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:30.974723 (+   942us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:30.977082 (+  2359us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:31.775901 (+798819us) raft_consensus.cc:1685] finished
0620 13:56:31.777044 (+  1143us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:31.779729 (+  2685us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3053,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":73519,"threads_started":1,"wal-append.queue_time_us":199185}
I20260620 13:56:32.280259  8194 consensus_queue.cc:237] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.281548  8288 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:32.282725  8257 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:32.283268  5878 raft_consensus.cc:1217] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[2.5-4.6]   Dedup: 2.5->[4.6-4.6]
I20260620 13:56:32.283733  5878 raft_consensus.cc:1240] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260620 13:56:32.269884  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:32.285513  5849 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:32.119513  8258 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.287454  5884 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:32.270685  5998 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:32.024212  8241 consensus_queue.cc:260] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.175693  8309 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.012863  8297 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.271018  8282 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:32.272929  8313 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:32.273283  8287 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260620 13:56:32.276021  8308 log.cc:927] Time spent T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260620 13:56:32.276536  8295 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:32.276882  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 66404.9us
W20260620 13:56:32.291289  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:32.291481  5876 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:32.322525  5957 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:32.262935  5881 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
W20260620 13:56:32.292492  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 156645us
I20260620 13:56:32.293668  5998 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:32.274876  8176 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:32.259845  8250 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:32.323647  6552 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:32.328874  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:32.290987  7970 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:32.330387  5998 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:32.276589  8293 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:32.291978  8251 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:32.294598  8257 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 13:56:32.333448  6030 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:32.263993  8044 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.342804  8176 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:32.209848  5950 rpcz_store.cc:276] 0620 13:56:30.897139 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:31.037739 (+140600us) service_pool.cc:224] Handling call
0620 13:56:31.212429 (+174690us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:31.296733 (+ 84304us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:31.300846 (+  4113us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:31.369493 (+ 68647us) log.cc:844] Serialized 26 byte log entry
0620 13:56:31.694590 (+325097us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:31.698888 (+  4298us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:31.707056 (+  8168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:32.129184 (+422128us) raft_consensus.cc:1685] finished
0620 13:56:32.133028 (+  3844us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:32.158844 (+ 25816us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":148492,"threads_started":1,"wal-append.queue_time_us":294626}
I20260620 13:56:32.344527  8258 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:32.342532  8286 consensus_queue.cc:1059] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260620 13:56:32.348249  5848 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:32.365324  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:32.339155  5953 consensus_queue.cc:237] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:32.344995  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:32.408039  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:32.411509  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 63330.9us
W20260620 13:56:32.408090  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 79334us
W20260620 13:56:32.406658  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 57149.8us
I20260620 13:56:32.412415  5848 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:32.414590  5957 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260620 13:56:32.415069  5957 pending_rounds.cc:85] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 1
I20260620 13:56:32.415395  5957 pending_rounds.cc:107] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260620 13:56:32.415666  5957 raft_consensus.cc:2889] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:32.335783  8295 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:32.423830  6030 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:32.409112  8282 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:32.429185  5848 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:32.432547  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:32.401942  7970 consensus_queue.cc:1059] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260620 13:56:32.450143  5880 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:32.320325  8316 consensus_queue.cc:1059] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260620 13:56:32.457090  8322 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:32.432562  8297 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:32.469725  5880 raft_consensus.cc:3055] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:56:32.471227  5880 raft_consensus.cc:740] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:32.491577  8323 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:32.473218  7970 consensus_queue.cc:1243] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 663684cf4ae54c929bf8240ca0b63a47 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260620 13:56:32.492336  5880 consensus_queue.cc:260] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:32.493860  5880 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:32.493600  8248 consensus_queue.cc:1048] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.143s
I20260620 13:56:32.499446  8072 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:32.501468  8309 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:32.467788  8194 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:32.503196  8044 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:32.504132  8330 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:32.504366  8176 consensus_queue.cc:1048] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:32.519532  5880 raft_consensus.cc:1275] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260620 13:56:32.520049  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:32.522800  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:32.525048  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:32.525355  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:32.526120  6580 raft_consensus.cc:2393] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:32.523078  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:32.504765  8330 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.554891  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:32.555078  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 231503us
I20260620 13:56:32.555882  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:32.521976  8323 consensus_queue.cc:1059] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260620 13:56:32.564917  8125 consensus_meta.cc:287] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.051s	user 0.011s	sys 0.003s
I20260620 13:56:32.565500  6579 raft_consensus.cc:1240] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260620 13:56:32.565936  8329 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:32.565448  8125 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:32.567137  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 107506us
W20260620 13:56:32.570571  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 157400us
I20260620 13:56:32.576746  5998 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:32.582828  6578 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260620 13:56:32.584596  8221 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260620 13:56:32.571285  8323 consensus_queue.cc:1243] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260620 13:56:32.588117  8333 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260620 13:56:32.591660  8125 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:32.592550  8288 raft_consensus.cc:3055] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:32.592993  8288 raft_consensus.cc:740] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:32.594148  8288 consensus_queue.cc:260] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.595556  8330 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:32.596354  8316 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:32.597015  8296 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.861s	user 0.006s	sys 0.002s
I20260620 13:56:32.597640  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:32.598309  8177 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:32.599128  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:32.600081  8313 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260620 13:56:32.600994  8317 log.cc:927] Time spent T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.511s	user 0.005s	sys 0.002s
I20260620 13:56:32.571411  8293 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:32.604403  6583 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:32.605379  8044 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:32.607764  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:32.644714  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:32.665397  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 81994.9us
W20260620 13:56:32.707751  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 84930.3us
W20260620 13:56:32.711371  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 103701us
I20260620 13:56:32.667369  8310 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:32.717574  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 269369us
W20260620 13:56:32.720302  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:32.720124  5848 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:32.723929  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:32.724713  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:32.728766  8255 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:32.729542  8339 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260620 13:56:32.597046  8316 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.734073  8316 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:32.735201  8339 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:32.737406  8026 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:32.737908  8026 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.741520  8026 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:32.745878  8316 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260620 13:56:32.748050  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 81227.1us
I20260620 13:56:32.748521  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:32.749433  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:32.749389  8316 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:32.751292  8304 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:32.751724  8304 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:32.752048  8304 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:32.751988  8260 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:32.751295  7891 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:32.754798  7891 raft_consensus.cc:697] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:32.755491  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:32.755831  5876 raft_consensus.cc:3055] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:56:32.755692  7891 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.756321  5876 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:32.667261  8329 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260620 13:56:32.757242  5876 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:32.758481  5876 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:32.711534  8309 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260620 13:56:32.694358  8221 consensus_queue.cc:1059] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260620 13:56:32.762765  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:32.766146  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:32.767163  8340 log.cc:927] Time spent T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.056s	user 0.001s	sys 0.001s
I20260620 13:56:32.768887  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:32.767537  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 47647.5us
I20260620 13:56:32.767822  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:32.769636  5882 raft_consensus.cc:2393] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:32.769886  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:32.771623  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:32.773588  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:32.773675  5924 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:32.774209  8334 log.cc:927] Time spent T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.349s	user 0.001s	sys 0.000s
I20260620 13:56:32.774744  8259 raft_consensus.cc:2764] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260620 13:56:32.776492  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:32.771703  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:32.772717  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:32.781342  6587 raft_consensus.cc:2393] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:32.781564  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:32.773478  8309 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:32.784739  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:32.788833  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:32.793305  5883 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:56:32.794205  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:32.778628  8304 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.801730  8304 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:32.802817  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:32.804198  8107 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:32.806476  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:32.787981  8309 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:32.809778  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:32.818883  8241 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:32.812884  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:32.814399  8290 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:32.788372  8257 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:32.760798  8310 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.819576  5998 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:32.822309  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:32.982280  5878 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:32.823550  8268 raft_consensus.cc:3055] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Stepping down as leader of term 4
W20260620 13:56:32.989595  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 170089us
I20260620 13:56:32.989817  5876 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260620 13:56:32.827214  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:32.849275  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:32.790957  8259 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:32.992628  8268 raft_consensus.cc:740] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:32.992828  8259 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:32.993418  8259 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:32.993641  5998 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:32.993738  8268 consensus_queue.cc:260] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:32.995249  8322 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260620 13:56:32.942088  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 93141.3us
I20260620 13:56:32.954574  8350 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:32.942071  5880 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:32.996215  8350 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:32.996677  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:32.998034  8329 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:56:32.998580  8350 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:32.824172  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:32.986694  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:32.999538  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:32.995208  8258 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:33.000022  8329 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:33.000237  8258 raft_consensus.cc:697] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:33.000599  8329 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:33.000558  8299 consensus_queue.cc:1059] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:33.001369  8258 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:33.001729  8329 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:33.002219  8299 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:33.003387  8125 raft_consensus.cc:3055] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:33.003557  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:33.003825  8125 raft_consensus.cc:740] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:32.992350  8297 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:33.004758  8125 consensus_queue.cc:260] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:33.006168  8125 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:33.006673  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:33.007421  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:33.007941  5876 raft_consensus.cc:2393] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 3: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:33.009048  8310 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:33.009812  5881 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 5: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:33.010252  8257 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:33.012308  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:33.013110  8350 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:32.941743  8304 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:33.015700  8304 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:33.021979  8288 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:32.948704  8290 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:33.027143  8290 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:33.027237  5880 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:56:32.942277  8205 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260620 13:56:32.946834  8309 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:32.947790  5875 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:33.031941  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:33.032738  5880 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:33.033459  8259 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:33.040830  6587 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:33.050544  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:33.051543  6586 raft_consensus.cc:2393] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:33.057986  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:33.059273  6586 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:33.060389  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:33.064153  6587 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:33.068511  6581 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:33.071168  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:33.071902  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:33.074295  6587 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:33.076761  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:33.039312  8268 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:33.080353  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:33.081403  6585 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:33.062533  7866 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:33.075918  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:33.078176  7891 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:33.083276  8249 raft_consensus.cc:3055] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:33.098441  6552 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:33.076462  8206 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:56:33.116721  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 267557us
I20260620 13:56:33.101578  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:33.101694  8259 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:33.103969  8293 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260620 13:56:33.111344  8287 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.012s	sys 0.021s
I20260620 13:56:33.089416  8313 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260620 13:56:33.101055  7866 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:33.131155  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:33.129268  8287 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.012s	sys 0.022s
I20260620 13:56:33.117018  8138 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:56:33.102638  8062 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260620 13:56:33.108429  8249 raft_consensus.cc:740] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:33.111500  7891 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:33.089226  8342 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260620 13:56:33.151456  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:33.152412  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:33.118922  8304 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:33.118340  8204 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260620 13:56:33.117575  8257 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:33.160148  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:33.168843  8107 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:33.126951  8206 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:33.194262  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:33.359450  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:33.202665  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:33.206257  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:33.210108  6580 raft_consensus.cc:2410] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260620 13:56:33.264065  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:33.210640  6031 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:56:33.395772  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:33.197122  5924 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:33.161765  8138 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:33.408005  8354 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260620 13:56:33.408143  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 211098us
I20260620 13:56:33.218695  6579 raft_consensus.cc:1240] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:33.218384  7891 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:33.190716  8259 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:33.397156  7866 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:33.420248  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:33.430323  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:33.432350  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:33.320951  8313 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:33.434293  5877 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
W20260620 13:56:33.443537  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:33.434931  6031 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:33.223968  8290 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:33.459641  6552 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:33.429384  8259 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:33.439394  7891 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:33.465121  6031 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:33.462776  6027 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260620 13:56:33.445850  8354 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 13:56:33.482816  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 50605us
I20260620 13:56:33.204061  8249 consensus_queue.cc:260] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:33.483713  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:33.467799  8293 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:33.467545  8259 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:33.489478  6027 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260620 13:56:33.447958  8313 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:33.496449  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:33.496905  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:33.497398  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:33.496799  8354 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:33.498045  8350 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:33.498647  8354 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:33.493422  8295 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260620 13:56:33.499295  8354 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:33.502238  8354 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:33.498498  8350 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:33.504629  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:33.508862  8019 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:33.509192  5876 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260620 13:56:33.510319  8316 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:56:33.511621  8354 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:33.512619  8354 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:33.514801  8354 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:33.506847  8350 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:33.490382  8293 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:33.514802  8332 log.cc:927] Time spent T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 1.091s	user 0.004s	sys 0.017s
I20260620 13:56:33.481305  7891 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:33.518617  8322 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:33.519315  8249 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:33.547144  5924 leader_election.cc:400] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7.
I20260620 13:56:33.547572  5924 leader_election.cc:403] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260620 13:56:33.479269  8138 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:33.535298  8325 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 1.103s	user 0.006s	sys 0.021s
I20260620 13:56:33.537312  8293 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:33.538403  8241 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:33.557593  5924 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:33.566970  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:33.595268  5848 leader_election.cc:336] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.837s (SENT)
I20260620 13:56:33.595963  5848 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:33.596908  5958 raft_consensus.cc:1275] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:56:33.597414  5953 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260620 13:56:33.597321  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:33.598495  5959 raft_consensus.cc:2410] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260620 13:56:33.598649  8213 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:33.601346  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:33.602377  5953 raft_consensus.cc:2410] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260620 13:56:33.607973  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:33.608824  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:33.609189  5958 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:33.559739  8206 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:33.570547  5924 raft_consensus.cc:2686] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260620 13:56:33.617393  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 59915.2us
I20260620 13:56:33.557648  8350 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7.
I20260620 13:56:33.609716  5953 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:33.549727  8322 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:33.574666  8309 consensus_meta.cc:287] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.000s
I20260620 13:56:33.624739  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 1952) took 1614 ms. Trace:
I20260620 13:56:33.631646  5954 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260620 13:56:33.603449  8295 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:33.639886  5950 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
W20260620 13:56:33.640961  8361 log.cc:927] Time spent T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260620 13:56:33.625267  6033 rpcz_store.cc:276] 0620 13:56:32.010465 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:32.019411 (+  8946us) service_pool.cc:224] Handling call
0620 13:56:32.025935 (+  6524us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:32.129267 (+103332us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:32.129301 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:32.135826 (+  6525us) log.cc:844] Serialized 26 byte log entry
0620 13:56:32.319721 (+183895us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:32.319773 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:32.319856 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:33.498967 (+1179111us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b240038c5e8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc591614 00007f0fdc58f71b 00007f0fdc74a619 00007f0fdc74a2a5 00007f0fdc7498ed 00007f0fdf37f4ae 00007f0fdf396c2c 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1
0620 13:56:33.624336 (+125369us) raft_consensus.cc:1685] finished
0620 13:56:33.624371 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:33.624654 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93315,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":39704704,"thread_start_us":286345,"threads_started":2,"wal-append.queue_time_us":295530}
I20260620 13:56:33.561764  8241 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:33.611090  8107 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:33.650872  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:33.627446  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1344) took 1586 ms. Trace:
I20260620 13:56:33.652396  5950 pending_rounds.cc:85] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 6
I20260620 13:56:33.663522  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:33.664165  5952 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:33.667688  5950 pending_rounds.cc:107] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260620 13:56:33.674407  5950 raft_consensus.cc:2889] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:33.636164  8309 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:33.667887  8290 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:33.655843  8295 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:33.705585  5956 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:33.661511  8107 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:33.670677  8364 consensus_queue.cc:1059] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260620 13:56:33.720753  5952 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:56:33.721860  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:33.722522  5952 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:33.723362  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:33.723362  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:33.709568  8362 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260620 13:56:33.698604  8255 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:33.735580  5952 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:33.741420  5997 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:33.715499  8313 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:33.743880  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:33.744154  5952 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:33.717778  8376 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:33.744577  8316 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:33.747303  8176 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:33.666034  5951 rpcz_store.cc:276] 0620 13:56:32.034250 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:32.037858 (+  3608us) service_pool.cc:224] Handling call
0620 13:56:32.133362 (+ 95504us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:32.168128 (+ 34766us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:32.172041 (+  3913us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:32.181564 (+  9523us) log.cc:844] Serialized 26 byte log entry
0620 13:56:32.412514 (+230950us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:32.418869 (+  6355us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:32.426273 (+  7404us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:33.514144 (+1087871us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:56:33.562983 (+ 48839us) raft_consensus.cc:1685] finished
0620 13:56:33.563024 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:33.620404 (+ 57380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5723008,"thread_start_us":223534,"threads_started":1,"wal-append.queue_time_us":241863}
I20260620 13:56:33.731132  8268 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260620 13:56:33.728034  8019 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260620 13:56:33.750741  8379 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:33.751549  8378 consensus_queue.cc:1059] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260620 13:56:33.758824  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 101181us
I20260620 13:56:33.805826  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:33.760743  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:33.732941  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:33.760592  5849 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:33.810527  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 50015.5us
I20260620 13:56:33.811430  5849 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:33.760093  5997 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:33.764765  8206 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:33.766026  6033 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:33.766921  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:33.816728  6030 raft_consensus.cc:2393] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:33.768925  6032 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
W20260620 13:56:33.813551  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 53505.8us
I20260620 13:56:33.770587  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:33.754863  8284 raft_consensus.cc:3055] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Stepping down as leader of term 4
W20260620 13:56:33.773357  8366 log.cc:927] Time spent T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260620 13:56:33.807551  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:33.751549  8295 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:33.821216  5950 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:33.818552  5997 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:33.736424  8255 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:33.855908  5997 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:33.823076  8287 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:33.802117  8286 consensus_queue.cc:1059] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260620 13:56:33.824167  8316 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:33.822106  8284 raft_consensus.cc:740] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:33.825026  8213 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:33.815375  8206 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:33.868892  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:33.837988  8241 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:33.853624  7791 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:33.854460  8322 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:33.862737  8312 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260620 13:56:33.886312  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 80617.6us
I20260620 13:56:33.863579  8316 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:33.857036  8176 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260620 13:56:33.882601  5951 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:33.863076  8290 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260620 13:56:33.893038  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:33.895539  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:33.883895  7791 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:33.897414  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:33.887975  8312 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:56:33.908862  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 93855.5us
I20260620 13:56:33.887120  8381 raft_consensus.cc:3055] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Stepping down as leader of term 2
W20260620 13:56:33.894099  8367 log.cc:927] Time spent T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260620 13:56:33.889726  8316 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:33.926312  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:33.886718  8386 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:33.940752  5957 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:33.895408  8309 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:33.875658  8259 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:33.915922  7791 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:33.960211  5997 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:33.944301  8312 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:33.924598  8206 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:33.948676  8368 log.cc:927] Time spent T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260620 13:56:33.939929  8381 raft_consensus.cc:740] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:33.967078  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:33.972923  8393 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:33.974709  8393 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:33.975229  8393 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:33.974761  8381 consensus_queue.cc:260] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:33.976243  8381 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:33.979269  8287 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:33.980499  6584 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260620 13:56:33.972767  8309 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:33.973138  8322 consensus_queue.cc:1059] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260620 13:56:33.982843  8322 raft_consensus.cc:3055] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:33.983273  8322 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:33.984205  8322 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:33.984665  8255 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:33.957787  8391 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:33.968653  7866 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260620 13:56:33.991677  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:33.993582  6033 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: []
I20260620 13:56:33.994943  5957 raft_consensus.cc:3055] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:33.995754  5957 raft_consensus.cc:740] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:33.950471  8295 consensus_queue.cc:1059] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260620 13:56:33.992715  5924 leader_election.cc:400] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3.
I20260620 13:56:33.997031  5924 leader_election.cc:403] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:56:33.999079  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:33.999668  5848 leader_election.cc:336] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.107s (SENT)
I20260620 13:56:33.898725  8284 consensus_queue.cc:260] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:34.007979  5924 leader_election.cc:400] T 923bfc4f20d94a57b0d84d45e40b12ae P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4.
I20260620 13:56:34.008527  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:33.987308  8322 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:34.010200  6033 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:34.004052  5957 consensus_queue.cc:260] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.015563  5957 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:33.996913  8384 log.cc:927] Time spent T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260620 13:56:33.993114  8391 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:34.014161  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:34.020735  6028 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
W20260620 13:56:34.011698  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:33.968351  8213 consensus_queue.cc:1059] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260620 13:56:34.018134  6580 raft_consensus.cc:1240] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:34.019132  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:33.993189  7866 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:34.036024  6587 raft_consensus.cc:1240] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260620 13:56:34.038484  6031 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:34.041522  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:34.042197  6028 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:34.045604  8284 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:34.047472  6578 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:34.032013  7866 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:34.049353  8259 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:34.050727  8293 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:34.052062  8249 consensus_meta.cc:287] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.002s
I20260620 13:56:34.019989  8386 raft_consensus.cc:3055] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:34.053241  6027 raft_consensus.cc:2410] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260620 13:56:34.063383  5957 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260620 13:56:34.064002  5957 pending_rounds.cc:85] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 5
I20260620 13:56:34.064435  5957 pending_rounds.cc:107] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260620 13:56:34.064579  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:34.064837  5957 raft_consensus.cc:2889] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:34.011515  8289 consensus_queue.cc:1059] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260620 13:56:34.023775  8391 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:34.071455  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 63447.9us
I20260620 13:56:34.073419  6028 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260620 13:56:34.073762  6028 pending_rounds.cc:85] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 5
I20260620 13:56:34.073976  6028 pending_rounds.cc:107] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260620 13:56:34.074184  6028 raft_consensus.cc:2889] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:34.079830  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:34.059123  8386 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:34.059216  8293 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:34.085815  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.087157  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.060295  8287 consensus_queue.cc:1059] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
W20260620 13:56:34.090576  8395 log.cc:927] Time spent T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260620 13:56:34.091351  8249 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:34.091826  8249 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:34.093838  8249 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:34.095670  8386 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:34.097371  8386 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:34.078267  8213 consensus_queue.cc:1059] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260620 13:56:34.089005  8390 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260620 13:56:34.078375  8309 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3.
I20260620 13:56:34.109624  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.104431  8289 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:34.115608  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.121549  5950 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:34.128798  6582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 656) took 1572 ms. Trace:
I20260620 13:56:34.129285  6582 rpcz_store.cc:276] 0620 13:56:32.556928 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:32.557998 (+  1070us) service_pool.cc:224] Handling call
0620 13:56:33.981054 (+1423056us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b580005fa98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:56:33.981219 (+   165us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:56:33.981591 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:33.981621 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:56:33.982204 (+   583us) log.cc:844] Serialized 52 byte log entry
0620 13:56:34.014629 (+ 32425us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:34.040050 (+ 25421us) log.cc:844] Serialized 14 byte log entry
0620 13:56:34.044985 (+  4935us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:34.045252 (+   267us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:34.128379 (+ 83127us) raft_consensus.cc:1685] finished
0620 13:56:34.128560 (+   181us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:34.128728 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17513,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":6914,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":6506,"spinlock_wait_cycles":2656000,"thread_start_us":32010,"threads_started":1,"wal-append.queue_time_us":100316}
I20260620 13:56:34.108728  8306 raft_consensus.cc:2764] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260620 13:56:34.138140  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:34.139089  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 52024.2us
I20260620 13:56:34.116014  8289 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:34.144140  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.149637  8312 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:34.152158  6026 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:34.142764  8289 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:34.157495  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1314) took 2320 ms. Trace:
I20260620 13:56:34.115073  8399 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260620 13:56:34.147678  8343 raft_consensus.cc:3055] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:34.171435  8343 raft_consensus.cc:740] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:34.172322  8343 consensus_queue.cc:260] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.160159  8306 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260620 13:56:34.168139  8369 log.cc:927] Time spent T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.405s	user 0.002s	sys 0.001s
I20260620 13:56:34.157912  5879 rpcz_store.cc:276] 0620 13:56:31.836966 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:31.875744 (+ 38778us) service_pool.cc:224] Handling call
0620 13:56:32.444651 (+568907us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:32.450766 (+  6115us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:32.450793 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:32.451288 (+   495us) log.cc:844] Serialized 26 byte log entry
0620 13:56:33.753880 (+1302592us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b1800339e20. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:56:33.867283 (+113403us) raft_consensus.cc:1645] Marking committed up to 3
0620 13:56:33.949908 (+ 82625us) log.cc:844] Serialized 14 byte log entry
0620 13:56:33.951042 (+  1134us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:33.951170 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:33.951227 (+    57us) raft_consensus.cc:1685] finished
0620 13:56:33.961159 (+  9932us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:34.157296 (+196137us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54003fa2d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:34.157413 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1755,"prepare.queue_time_us":115917,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":24091,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":11438,"spinlock_wait_cycles":1235874944,"thread_start_us":181478,"threads_started":2,"wal-append.queue_time_us":1452513}
I20260620 13:56:34.145407  8405 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:34.187667  8405 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:34.188103  8405 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:34.134948  7866 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:31.995635  5766 catalog_manager.cc:5027] TS 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): tablet 923bfc4f20d94a57b0d84d45e40b12ae (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
W20260620 13:56:34.197022  5766 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 2.20138e+06us
I20260620 13:56:34.134619  8393 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:34.229907  8393 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:34.233073  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:34.221752  8293 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:34.222397  8243 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:34.223641  8402 log.cc:927] Time spent T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260620 13:56:34.293565  6029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 443) took 1230 ms. Trace:
I20260620 13:56:34.293991  6029 rpcz_store.cc:276] 0620 13:56:33.063267 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:33.405705 (+342438us) service_pool.cc:224] Handling call
0620 13:56:33.416572 (+ 10867us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:33.435356 (+ 18784us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:33.436376 (+  1020us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:33.466043 (+ 29667us) log.cc:844] Serialized 26 byte log entry
0620 13:56:33.672945 (+206902us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:33.672983 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:33.673062 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:34.167491 (+494429us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:56:34.293263 (+125772us) raft_consensus.cc:1685] finished
0620 13:56:34.293285 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:34.293505 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":13045,"spinlock_wait_cycles":6742912,"thread_start_us":182118,"threads_started":1,"wal-append.queue_time_us":233642}
I20260620 13:56:34.296084  5878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 438) took 1230 ms. Trace:
I20260620 13:56:34.296492  5878 rpcz_store.cc:276] 0620 13:56:33.065577 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:33.090978 (+ 25401us) service_pool.cc:224] Handling call
0620 13:56:33.983724 (+892746us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b5800000f98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:56:33.983913 (+   189us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:33.984118 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:33.984150 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:33.984744 (+   594us) log.cc:844] Serialized 26 byte log entry
0620 13:56:34.053333 (+ 68589us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:34.053399 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:34.053516 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:34.295784 (+242268us) raft_consensus.cc:1685] finished
0620 13:56:34.295807 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:34.296021 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6947072,"thread_start_us":68139,"threads_started":1,"wal-append.queue_time_us":120315}
I20260620 13:56:34.300344  8138 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:34.300294  8243 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.300894  8138 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.302968  8312 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:34.303632  8343 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:34.254281  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:34.290411  8293 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:34.313581  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 59422.9us
I20260620 13:56:34.290759  8241 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:56:34.291244  8322 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:56:34.292207  6033 raft_consensus.cc:1240] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:34.289429  8176 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:34.261401  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 117414us
I20260620 13:56:34.321384  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.311896  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:34.314491  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:34.322788  6587 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:34.321417  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:34.325158  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:34.309885  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:34.309654  8364 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.029s	sys 0.053s
I20260620 13:56:34.329694  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.334663  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:34.333563  8364 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.030s	sys 0.054s
I20260620 13:56:34.318369  7927 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:34.318128  8062 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:34.331177  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.346511  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.332383  8044 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:34.332525  8381 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:34.341244  8258 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:34.341877  8393 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:34.341161  8176 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.372283  8176 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:34.368531  8213 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:34.374250  8213 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:34.345774  8295 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:34.343976  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:34.343118  7927 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:34.366052  8241 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:34.365729  8391 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:34.366106  7891 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:34.343154  8399 consensus_queue.cc:1059] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260620 13:56:34.375849  7866 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:34.329967  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 170316us
I20260620 13:56:34.420200  5956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0120e0a908b041479e2847fb24268985"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:56:34.420847  5956 raft_consensus.cc:606] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:34.421142  5956 raft_consensus.cc:614] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:56:34.341145  8306 consensus_queue.cc:1059] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260620 13:56:34.422333  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 69108.3us
W20260620 13:56:34.398051  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 66980.6us
I20260620 13:56:34.345649  8125 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260620 13:56:34.427343  6585 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:34.427413  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:34.428030  6587 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:34.428957  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:34.367651  8138 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:34.430936  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:34.411115  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:34.387001  8379 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260620 13:56:34.413107  8397 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:34.349524  8326 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260620 13:56:34.414124  8286 raft_consensus.cc:3055] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:34.436354  8286 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:34.358475  8299 consensus_queue.cc:1059] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260620 13:56:34.414422  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:34.416323  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.369307  8293 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:34.448554  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:34.392364  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:34.355989  8091 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260620 13:56:34.438401  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.438566  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:34.440832  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:34.443894  5953 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:34.374858  8316 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.360478  8251 consensus_queue.cc:1059] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260620 13:56:34.439558  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:34.446698  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:34.450634  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:34.452044  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:34.452112  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:34.454432  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:34.456811  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:34.455834  5884 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:34.465234  5875 raft_consensus.cc:2410] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260620 13:56:34.456954  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:34.457425  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:34.459050  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 109680us
I20260620 13:56:34.462445  5880 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:34.467742  5880 raft_consensus.cc:1240] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:34.469151  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.470270  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:34.471356  6551 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:34.483047  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:34.483505  5881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42748 (request call id 430) took 1720 ms. Trace:
I20260620 13:56:34.436373  7927 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:34.483855  5881 rpcz_store.cc:276] 0620 13:56:32.762410 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:32.762519 (+   109us) service_pool.cc:224] Handling call
0620 13:56:34.474481 (+1711962us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540030e3d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:34.483065 (+  8584us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566045952}
I20260620 13:56:34.472967  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:34.485049  5884 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:34.485532  5880 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260620 13:56:34.486042  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:34.486292  5884 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260620 13:56:34.460357  8125 raft_consensus.cc:3055] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:34.491789  5880 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:34.489813  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:34.493301  5879 raft_consensus.cc:2410] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260620 13:56:34.491128  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:34.495584  5875 raft_consensus.cc:1240] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260620 13:56:34.496573  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:34.497231  5880 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:34.497725  8391 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:34.498356  8391 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:34.460865  8407 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:34.499459  8407 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:34.500865  7791 consensus_meta.cc:287] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.010s
I20260620 13:56:34.501639  8407 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:34.501353  7791 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.471558  8414 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:34.471222  8251 consensus_queue.cc:1243] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 663684cf4ae54c929bf8240ca0b63a47 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260620 13:56:34.503226  6024 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260620 13:56:34.502933  8414 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:34.503907  8359 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.901s	user 0.002s	sys 0.000s
I20260620 13:56:34.504504  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:34.476840  8249 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260620 13:56:34.466521  5950 raft_consensus.cc:1240] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:34.506536  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:34.462111  8313 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:34.508930  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:34.495191  5998 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:34.490010  8293 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:34.516072  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:34.522545  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:34.495584  5878 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:34.467592  8306 raft_consensus.cc:3055] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
W20260620 13:56:34.520762  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 48094.5us
I20260620 13:56:34.528707  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:34.520149  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:34.530334  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:34.524060  8243 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:34.492130  8125 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:34.507534  7927 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:34.505278  8414 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:34.475018  8379 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260620 13:56:34.547425  7791 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:34.519538  8289 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.543258  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:34.517786  8213 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:34.554698  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:34.529486  8306 raft_consensus.cc:740] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:34.539907  8293 raft_consensus.cc:697] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:34.541220  8284 raft_consensus.cc:3055] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:34.508208  8176 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
W20260620 13:56:34.575682  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 49193.5us
I20260620 13:56:34.556965  8249 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:34.543387  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:34.539892  8408 log.cc:927] Time spent T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.380s	user 0.001s	sys 0.000s
I20260620 13:56:34.555954  5880 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:34.530710  5953 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:34.567078  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:34.585536  6030 raft_consensus.cc:1240] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260620 13:56:34.569235  8289 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:34.569557  6031 raft_consensus.cc:1240] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:34.564589  8091 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:34.560446  7927 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:34.574177  8288 raft_consensus.cc:3055] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:34.577710  8293 consensus_queue.cc:237] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.578596  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 728) took 1538 ms. Trace:
I20260620 13:56:34.581305  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:34.586153  5953 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260620 13:56:34.616442  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:34.544606  8316 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:34.593889  6024 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:34.587509  8304 consensus_queue.cc:1059] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260620 13:56:34.580914  8284 raft_consensus.cc:740] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:34.597050  5956 pending_rounds.cc:85] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 1
I20260620 13:56:34.624257  5956 pending_rounds.cc:107] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260620 13:56:34.624610  5956 raft_consensus.cc:2889] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:34.587904  8381 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:34.607337  6028 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:34.581200  8249 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:34.506806  8286 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.618166  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:34.621902  6585 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260620 13:56:34.623078  6587 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:34.611560  7927 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:34.633428  8392 raft_consensus.cc:3055] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:34.633492  6025 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8. Ops: []
I20260620 13:56:34.653781  8392 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:34.654845  8392 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.611843  8288 raft_consensus.cc:740] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:34.634279  5953 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:34.667284  6582 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:34.655956  8392 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:34.634832  8249 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:34.658390  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:34.611299  8091 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.627779  8289 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:34.720894  8364 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:34.633749  8125 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.692031  8044 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:34.726655  8288 consensus_queue.cc:260] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.729104  8125 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:34.730398  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:34.744277  8426 consensus_queue.cc:1059] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260620 13:56:34.614737  6579 rpcz_store.cc:276] 0620 13:56:33.039725 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:33.048585 (+  8860us) service_pool.cc:224] Handling call
0620 13:56:33.084119 (+ 35534us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:33.416093 (+331974us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:34.578240 (+1162147us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540048f654. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:34.578510 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304149888}
I20260620 13:56:34.690438  8326 consensus_queue.cc:1059] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260620 13:56:34.712361  8286 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:34.633455  8284 consensus_queue.cc:260] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.725278  8091 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:34.753260  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 257943us
I20260620 13:56:34.765427  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.758754  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:34.762961  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:34.798763  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:34.796017  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 338651us
I20260620 13:56:34.713285  8289 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.799612  5881 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:34.808091  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:34.808786  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:34.665122  8306 consensus_queue.cc:260] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:34.812882  5848 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.810196  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:34.814260  5879 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:34.796137  8288 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:34.811091  5875 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:34.817413  5848 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.818111  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:34.819023  5881 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:34.773459  8411 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:34.836620  5848 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.810519  8091 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:34.816972  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:34.819361  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:34.847220  5848 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:34.815447  8322 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:34.852339  6029 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:34.850289  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:34.838817  8297 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260620 13:56:34.864557  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 47673.2us
I20260620 13:56:34.852335  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:34.872761  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:34.848825  8414 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:34.874662  8414 raft_consensus.cc:697] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:34.876706  8414 consensus_queue.cc:237] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:34.879705  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:34.849737  8417 log.cc:927] Time spent T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.285s	user 0.003s	sys 0.004s
I20260620 13:56:34.881664  6552 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:34.888967  5879 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:34.879302  8306 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:34.892781  6552 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:34.892141  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:34.898566  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.896647  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:34.904408  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:34.907826  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:34.943573  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:34.853909  8410 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:34.986449  5876 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260620 13:56:34.982187  8446 log.cc:927] Time spent T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260620 13:56:34.985759  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 495) took 1094 ms. Trace:
I20260620 13:56:34.889943  8258 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260620 13:56:34.884855  8386 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.787s	user 0.013s	sys 0.012s
I20260620 13:56:34.874730  8249 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:34.991227  5954 rpcz_store.cc:276] 0620 13:56:33.891562 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.139557 (+247995us) service_pool.cc:224] Handling call
0620 13:56:34.142424 (+  2867us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:56:34.174948 (+ 32524us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:34.174990 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:56:34.311073 (+136083us) log.cc:844] Serialized 52 byte log entry
0620 13:56:34.397475 (+ 86402us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:34.455195 (+ 57720us) log.cc:844] Serialized 14 byte log entry
0620 13:56:34.463045 (+  7850us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:34.896396 (+433351us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b54000799d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:34.897022 (+   626us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:34.897101 (+    79us) raft_consensus.cc:1685] finished
0620 13:56:34.985475 (+ 88374us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:34.985682 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28127,"prepare.queue_time_us":59154,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":50,"raft.queue_time_us":15298,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":27870,"spinlock_wait_cycles":73648000,"thread_start_us":46078,"threads_started":1,"wal-append.queue_time_us":73487}
I20260620 13:56:34.976707  8399 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260620 13:56:35.005051  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 109292us
I20260620 13:56:35.006405  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:34.903144  8204 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260620 13:56:35.012389  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:34.904023  8241 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:35.014998  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:35.008625  8243 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:34.884081  8435 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:34.984666  8259 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:34.976430  8378 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:34.902505  8350 consensus_queue.cc:1059] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.123s
I20260620 13:56:35.002146  8258 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:34.895872  8309 consensus_queue.cc:1059] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
W20260620 13:56:35.019091  8405 consensus_meta.cc:287] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.823s	user 0.013s	sys 0.000s
W20260620 13:56:35.018560  8343 consensus_meta.cc:287] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.696s	user 0.004s	sys 0.008s
I20260620 13:56:35.026361  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:35.016803  8044 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:35.016706  8386 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:34.844849  8411 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:35.083631  5878 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260620 13:56:35.089020  5878 pending_rounds.cc:85] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 5
I20260620 13:56:35.089284  5878 pending_rounds.cc:107] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260620 13:56:35.089548  5878 raft_consensus.cc:2889] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:35.040808  8410 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:35.067940  6583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 667) took 1754 ms. Trace:
I20260620 13:56:35.105716  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:35.088356  8044 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:35.087466  8418 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260620 13:56:35.068941  8258 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:35.083974  8405 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:35.185691  5882 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 6. Ops: []
I20260620 13:56:35.186903  8405 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:35.131887  5884 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:35.132131  8249 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:35.132881  8410 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:35.133945  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:35.135486  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:35.139670  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:35.141000  5877 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:35.103559  8386 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:35.198837  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:35.037443  8259 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:35.146710  8364 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:35.117931  6583 rpcz_store.cc:276] 0620 13:56:33.306659 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:33.320784 (+ 14125us) service_pool.cc:224] Handling call
0620 13:56:33.402490 (+ 81706us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:33.432605 (+ 30115us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:33.440916 (+  8311us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:33.927572 (+486656us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b1800346f60. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6d8aa6 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fde0f5c71 00007f0fde1055d2 00007f0fdf837de1 00007f0fdf7fc81a
0620 13:56:34.579597 (+652025us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b2c000fb6b8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fde0f5c71 00007f0fde1055d2 00007f0fdf837de1 00007f0fdf7fc81a 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22
0620 13:56:34.580176 (+   579us) log.cc:844] Serialized 26 byte log entry
0620 13:56:34.789178 (+209002us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:34.789474 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:34.789913 (+   439us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:35.023521 (+233608us) raft_consensus.cc:1685] finished
0620 13:56:35.023565 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:35.060903 (+ 37338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5518,"raft.queue_time_us":25777,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":7798,"spinlock_wait_cycles":13972480,"thread_start_us":172883,"threads_started":1,"wal-append.queue_time_us":234509}
I20260620 13:56:35.149417  8423 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.165s
I20260620 13:56:35.205060  8364 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:35.150120  8413 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:35.042064  8435 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:35.207645  8255 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:35.209115  8435 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:35.210069  8419 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:35.210588  8419 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:35.157670  8373 log.cc:927] Time spent T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 1.405s	user 0.007s	sys 0.000s
I20260620 13:56:35.030290  8241 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:35.219992  7927 consensus_meta.cc:287] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.003s
I20260620 13:56:35.164367  8379 raft_consensus.cc:3055] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:35.150673  8428 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:35.169843  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1368) took 1310 ms. Trace:
I20260620 13:56:35.170266  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 477) took 1542 ms. Trace:
I20260620 13:56:35.104449  5951 raft_consensus.cc:2410] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260620 13:56:35.178844  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:35.150803  6024 consensus_meta.cc:287] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.000s
W20260620 13:56:35.180190  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:35.180032  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:35.238509  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 59740.1us
I20260620 13:56:35.233783  5955 rpcz_store.cc:276] 0620 13:56:33.627528 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:33.627634 (+   106us) service_pool.cc:224] Handling call
0620 13:56:33.635014 (+  7380us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:33.823796 (+188782us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:33.823842 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:33.833501 (+  9659us) log.cc:844] Serialized 26 byte log entry
0620 13:56:33.915765 (+ 82264us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:33.915806 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:35.169491 (+1253685us) spinlock_profiling.cc:243] Waited 79.6 ms on lock 0x7b5400251cd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:35.169536 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:35.169582 (+    46us) raft_consensus.cc:1685] finished
0620 13:56:35.169595 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:35.170213 (+   618us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14302,"raft.queue_time_us":117671,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":1635,"spinlock_wait_cycles":183028480,"thread_start_us":139089,"threads_started":2,"wal-append.queue_time_us":140926,"wal-append.run_cpu_time_us":1814,"wal-append.run_wall_time_us":1075517}
I20260620 13:56:35.183331  8376 raft_consensus.cc:3055] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:35.184894  8310 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:35.196581  8410 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:35.203362  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:35.117063  8329 raft_consensus.cc:3055] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:35.214237  5953 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:35.216162  6551 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:35.221150  8241 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:35.221896  8107 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:35.153097  8044 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:35.225523  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:35.264186  5876 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:35.225977  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:35.231355  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:35.228928  8312 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:35.198122  8289 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:35.180840  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:35.239552  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:35.227674  8358 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:35.212260  8259 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:35.223024  6583 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260620 13:56:35.308300  5876 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260620 13:56:35.308817  5876 pending_rounds.cc:85] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 5
I20260620 13:56:35.309109  5876 pending_rounds.cc:107] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260620 13:56:35.309424  5876 raft_consensus.cc:2889] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:35.311172  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1356) took 1710 ms. Trace:
I20260620 13:56:35.311779  5959 rpcz_store.cc:276] 0620 13:56:33.600661 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:33.600851 (+   190us) service_pool.cc:224] Handling call
0620 13:56:33.601261 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:33.601695 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:33.601735 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:33.602356 (+   621us) log.cc:844] Serialized 26 byte log entry
0620 13:56:33.687143 (+ 84787us) raft_consensus.cc:1645] Marking committed up to 2
0620 13:56:33.687196 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:33.687286 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:35.152195 (+1464909us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:56:35.284064 (+131869us) raft_consensus.cc:1685] finished
0620 13:56:35.284094 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:35.311059 (+ 26965us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31565,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":23170,"spinlock_wait_cycles":26500864,"thread_start_us":83358,"threads_started":1,"wal-append.queue_time_us":139814}
I20260620 13:56:35.276170  8107 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:35.228269  8286 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:35.242481  8313 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:35.240638  6024 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
W20260620 13:56:35.257220  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:35.342677  6027 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:35.240645  8376 raft_consensus.cc:740] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:35.230360  8379 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:35.275158  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:35.276732  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:35.257908  8435 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:35.353785  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:35.266475  5924 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5757f55132b747db98400dba7b8056df. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:56:35.257735  8299 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:35.252279  8329 raft_consensus.cc:740] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:35.283056  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:35.284998  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:35.357982  6585 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
W20260620 13:56:35.285379  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:35.305004  6582 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:35.229729  8364 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:35.229983  8428 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:35.237286  7927 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:35.341400  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:35.319947  5959 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260620 13:56:35.318197  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:35.351300  5954 raft_consensus.cc:3055] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Stepping down as leader of term 1
W20260620 13:56:35.354785  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 444400us
I20260620 13:56:35.409621  5954 raft_consensus.cc:740] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:35.292343  8289 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:35.252123  8310 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:35.374056  5884 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
W20260620 13:56:35.399027  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:35.399459  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:35.405309  6584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 677) took 1384 ms. Trace:
W20260620 13:56:35.404016  5957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.045s	sys 0.080s
I20260620 13:56:35.233606  5950 rpcz_store.cc:276] 0620 13:56:33.859717 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.122560 (+262843us) service_pool.cc:224] Handling call
0620 13:56:34.122913 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:34.520352 (+397439us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:35.169569 (+649217us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b5400306954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:35.169770 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":749165440}
I20260620 13:56:35.403999  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:35.408149  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 66887.4us
I20260620 13:56:35.401751  8428 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:35.409996  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:35.282114  8312 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:35.359423  8411 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:35.317436  8410 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260620 13:56:35.318071  8358 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:35.357064  8107 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:35.340447  8288 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260620 13:56:35.441238  6030 raft_consensus.cc:1240] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260620 13:56:35.543416  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 457) took 1005 ms. Trace:
W20260620 13:56:35.407769  8326 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.018s	sys 0.003s
W20260620 13:56:35.539958  6553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.056s	sys 0.117s
W20260620 13:56:35.906582  6553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.062s	sys 0.145s
I20260620 13:56:35.886693  6032 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
W20260620 13:56:35.800822  6029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.017s	sys 0.028s
W20260620 13:56:35.908617  6029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.021s	sys 0.032s
W20260620 13:56:35.781315  5880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.017s	sys 0.035s
W20260620 13:56:35.910558  5880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.023s	sys 0.038s
W20260620 13:56:35.603286  5875 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.008s	sys 0.025s
W20260620 13:56:35.914430  5875 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.010s	sys 0.031s
I20260620 13:56:35.444623  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:35.917325  5876 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
W20260620 13:56:35.897450  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 487503us
I20260620 13:56:35.920071  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:35.895594  6584 rpcz_store.cc:276] 0620 13:56:34.021258 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.021388 (+   130us) service_pool.cc:224] Handling call
0620 13:56:35.402378 (+1380990us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b580005fa98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:56:35.404710 (+  2332us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:35.404922 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:35.404949 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:35.404993 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:35.405027 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:35.405089 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:35.405243 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3136896}
W20260620 13:56:35.716033  6031 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.014s	sys 0.034s
W20260620 13:56:35.892890  5957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.052s	sys 0.098s
W20260620 13:56:35.509294  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:35.712752  5923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.015s	sys 0.024s
W20260620 13:56:35.524682  8443 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260620 13:56:35.927943  5880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 447) took 1179 ms. Trace:
I20260620 13:56:35.958714  5880 rpcz_store.cc:276] 0620 13:56:34.748474 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.749120 (+   646us) service_pool.cc:224] Handling call
0620 13:56:34.749519 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:34.749764 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:34.887615 (+137851us) log.cc:844] Serialized 14 byte log entry
0620 13:56:35.927503 (+1039888us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:35.927568 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:35.927624 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:35.927711 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:35.927860 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16201,"prepare.queue_time_us":553680,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"thread_start_us":1147646,"threads_started":2}
I20260620 13:56:35.732918  6024 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:35.547938  6026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 1960) took 1569 ms. Trace:
W20260620 13:56:35.787921  7891 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.021s	sys 0.032s
W20260620 13:56:35.956079  5923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.017s	sys 0.024s
I20260620 13:56:35.705865  8386 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:35.565485  5954 consensus_queue.cc:260] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:35.404352  8313 raft_consensus.cc:697] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:35.407176  8405 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:35.391813  8435 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:35.519796  8299 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:35.395465  8286 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:35.879202  6025 rpcz_store.cc:276] 0620 13:56:34.538301 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.654662 (+116361us) service_pool.cc:224] Handling call
0620 13:56:34.658940 (+  4278us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:34.677053 (+ 18113us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:34.677101 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:34.688860 (+ 11759us) log.cc:844] Serialized 26 byte log entry
0620 13:56:34.884406 (+195546us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:34.884446 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:34.884511 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:35.543170 (+658659us) raft_consensus.cc:1685] finished
0620 13:56:35.543192 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:35.543347 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":729,"raft.queue_time_us":5632,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":16831,"thread_start_us":161895,"threads_started":1,"wal-append.queue_time_us":617984}
I20260620 13:56:35.965739  6026 rpcz_store.cc:276] 0620 13:56:33.978066 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:33.978228 (+   162us) service_pool.cc:224] Handling call
0620 13:56:33.978547 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:34.152651 (+174104us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:35.547664 (+1395013us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54000596d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:35.547854 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398739328}
W20260620 13:56:35.928121  5883 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.024s	sys 0.048s
W20260620 13:56:35.954510  6031 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.029s	sys 0.043s
W20260620 13:56:35.497192  8306 consensus_meta.cc:287] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.606s	user 0.012s	sys 0.002s
W20260620 13:56:35.837621  8258 consensus_meta.cc:287] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.666s	user 0.005s	sys 0.005s
W20260620 13:56:35.519215  8440 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.446s	user 0.002s	sys 0.001s
I20260620 13:56:36.000651  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:36.136479  5883 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.278s	user 0.033s	sys 0.052s
I20260620 13:56:35.411981  8392 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:36.137032  6029 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:36.145653  8392 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:35.543522  8441 log.cc:927] Time spent T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
W20260620 13:56:35.927295  8326 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.019s	sys 0.004s
W20260620 13:56:35.575716  8125 consensus_meta.cc:287] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.823s	user 0.008s	sys 0.004s
I20260620 13:56:35.540577  8419 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:36.139711  8358 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:35.928130  8411 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:36.162053  8411 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:36.164652  8411 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:35.952767  8213 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260620 13:56:36.037106  8091 consensus_meta.cc:287] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.184s	user 0.009s	sys 0.004s
I20260620 13:56:35.541749  7927 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:35.981618  7891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.024s	sys 0.038s
I20260620 13:56:36.006582  8107 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:56:35.907462  8289 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:35.594082  8423 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:35.604673  8420 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:36.151800  8386 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:35.604874  8293 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:36.193637  5881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.020s	sys 0.011s
I20260620 13:56:36.144101  8299 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:35.548724  8376 consensus_queue.cc:260] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:35.543753  8379 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.197197  6028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 456) took 1659 ms. Trace:
I20260620 13:56:36.149122  8258 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:36.208412  5877 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.996s	user 0.024s	sys 0.018s
W20260620 13:56:36.217732  5877 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.024s	sys 0.018s
I20260620 13:56:36.156205  8306 consensus_queue.cc:1059] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260620 13:56:36.194585  5881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.021s	sys 0.011s
I20260620 13:56:35.573506  8329 consensus_queue.cc:260] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.214198  6028 rpcz_store.cc:276] 0620 13:56:34.538008 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.630983 (+ 92975us) service_pool.cc:224] Handling call
0620 13:56:34.678117 (+ 47134us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:34.678717 (+   600us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:34.678755 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:34.679239 (+   484us) log.cc:844] Serialized 26 byte log entry
0620 13:56:34.844404 (+165165us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:34.844447 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:34.844569 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:36.196978 (+1352409us) raft_consensus.cc:1685] finished
0620 13:56:36.196998 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.197136 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3331,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":3681,"thread_start_us":131000,"threads_started":1,"wal-append.queue_time_us":329247}
I20260620 13:56:36.237380  5881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 458) took 1356 ms. Trace:
W20260620 13:56:36.241045  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 361447us
I20260620 13:56:36.181859  8091 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:36.213748  8386 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:36.233469  8019 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.004s	sys 0.024s
I20260620 13:56:36.215842  8312 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:36.194474  8423 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.243358  8310 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:36.197822  8293 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.361769  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 1902) took 1977 ms. Trace:
I20260620 13:56:36.194698  8420 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:36.374596  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 444450us
I20260620 13:56:36.362432  5956 rpcz_store.cc:276] 0620 13:56:34.383849 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.576585 (+192736us) service_pool.cc:224] Handling call
0620 13:56:34.596768 (+ 20183us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:34.656515 (+ 59747us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:34.656560 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:34.657111 (+   551us) log.cc:844] Serialized 26 byte log entry
0620 13:56:34.796113 (+139002us) raft_consensus.cc:1645] Marking committed up to 2
0620 13:56:34.816511 (+ 20398us) log.cc:844] Serialized 14 byte log entry
0620 13:56:34.816868 (+   357us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:34.816988 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:35.183933 (+366945us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b18003cb140. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc70abf3 00007f0fdc70cfc1 00007f0fdc70cf79 00007f0fdc70cf09 00007f0fdc70ced1 00007f0fdc70c1cd 0000000000389354 0000000000389199 00007f0fdc6ee03a
0620 13:56:36.267744 (+1083811us) raft_consensus.cc:1685] finished
0620 13:56:36.361436 (+ 93692us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.361675 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15645,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":103,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"spinlock_wait_cycles":46861184,"thread_start_us":83282,"threads_started":1,"wal-append.queue_time_us":193455}
I20260620 13:56:36.196231  8313 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:36.389034  5847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.062s	sys 0.078s
W20260620 13:56:36.390985  5847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.062s	sys 0.078s
W20260620 13:56:36.262327  8019 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.005s	sys 0.024s
I20260620 13:56:36.372035  8397 raft_consensus.cc:3055] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
W20260620 13:56:36.402177  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 481650us
I20260620 13:56:36.264734  8386 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:36.403781  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:36.404721  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:36.387605  8289 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:36.411018  5875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 459) took 1528 ms. Trace:
I20260620 13:56:36.397286  8392 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:36.400285  8125 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:36.401201  8397 raft_consensus.cc:740] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:36.413899  5875 rpcz_store.cc:276] 0620 13:56:34.882891 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.883055 (+   164us) service_pool.cc:224] Handling call
0620 13:56:34.883488 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:34.883724 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:35.916077 (+1032353us) log.cc:844] Serialized 14 byte log entry
0620 13:56:36.410507 (+494430us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:36.410587 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:36.410652 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.410762 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.410934 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":528137,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":27669,"thread_start_us":1498375,"threads_started":2}
I20260620 13:56:36.400655  8405 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:36.410070  8286 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:36.400501  8419 consensus_queue.cc:1059] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260620 13:56:36.412446  8288 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:36.413653  8435 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:36.459311  5883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 457) took 1608 ms. Trace:
I20260620 13:56:36.414423  8465 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:36.474543  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:36.474982  8467 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:36.513346  8467 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.515805  8467 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:36.516521  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:36.517926  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:36.474543  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:36.519821  6026 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:36.472201  8312 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:36.467592  8019 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:36.478624  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:36.466264  8392 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:36.503901  8473 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:36.510339  8435 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:36.510808  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:36.520080  6028 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:36.476305  5998 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:36.478912  8299 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:36.458592  8469 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:36.511584  5883 rpcz_store.cc:276] 0620 13:56:34.850650 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.850805 (+   155us) service_pool.cc:224] Handling call
0620 13:56:34.857842 (+  7037us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:34.858074 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:36.138062 (+1279988us) log.cc:844] Serialized 14 byte log entry
0620 13:56:36.458899 (+320837us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:36.458958 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:36.459012 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.459084 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.459241 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41618,"prepare.queue_time_us":543980,"prepare.run_cpu_time_us":880,"prepare.run_wall_time_us":2287,"raft.queue_time_us":56815,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":12129,"thread_start_us":1557102,"threads_started":2}
W20260620 13:56:36.504563  8458 log.cc:927] Time spent T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260620 13:56:36.476440  8405 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:36.538251  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:36.519320  8461 log.cc:927] Time spent T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260620 13:56:36.532611  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 56385.4us
I20260620 13:56:36.478168  7927 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260620 13:56:36.511257  8460 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260620 13:56:36.534175  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:36.525136  8473 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:36.538925  6026 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:36.539456  5877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 462) took 1331 ms. Trace:
I20260620 13:56:36.504971  8289 consensus_queue.cc:1059] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260620 13:56:36.521302  8258 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:36.573446  5952 raft_consensus.cc:1240] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260620 13:56:36.544083  5875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1345) took 1237 ms. Trace:
I20260620 13:56:36.524915  8392 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:36.524400  8386 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:36.472438  8125 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.479305  8288 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.529656  8464 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:36.565369  5877 rpcz_store.cc:276] 0620 13:56:35.207876 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:35.209696 (+  1820us) service_pool.cc:224] Handling call
0620 13:56:35.210045 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:56:35.210440 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:35.210465 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:56:35.211593 (+  1128us) log.cc:844] Serialized 52 byte log entry
0620 13:56:36.218285 (+1006692us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:56:36.218332 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.218410 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:36.539228 (+320818us) raft_consensus.cc:1685] finished
0620 13:56:36.539249 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.539403 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2560,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":14163,"thread_start_us":1006255,"threads_started":1,"wal-append.queue_time_us":1201192}
I20260620 13:56:36.532430  8286 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:36.537631  8419 raft_consensus.cc:3055] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:36.574234  5875 rpcz_store.cc:276] 0620 13:56:35.306757 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.471834 (+1165077us) service_pool.cc:224] Handling call
0620 13:56:36.472251 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:36.472525 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 5
0620 13:56:36.503423 (+ 30898us) log.cc:844] Serialized 14 byte log entry
0620 13:56:36.543559 (+ 40136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:36.543628 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:36.543687 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.543891 (+   204us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.544029 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31378,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"thread_start_us":39690,"threads_started":1}
I20260620 13:56:36.538193  8358 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:36.584826  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 1904) took 2200 ms. Trace:
I20260620 13:56:36.589032  5952 rpcz_store.cc:276] 0620 13:56:34.384309 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.656580 (+272271us) service_pool.cc:224] Handling call
0620 13:56:36.572863 (+1916283us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:56:36.573118 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:36.580247 (+  7129us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.584731 (+  4484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3646848}
I20260620 13:56:36.590677  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:36.591485  5952 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:36.592634  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:36.593510  8286 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.596377  8286 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:36.600839  5848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.009s	sys 0.004s
W20260620 13:56:36.601325  5848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.009s	sys 0.004s
W20260620 13:56:36.601805  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:36.604851  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:36.525264  8312 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.538233  6024 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:36.543304  8397 consensus_queue.cc:260] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.549437  8293 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:36.527154  8019 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.522055  8465 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:36.630885  5998 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.685s (SENT) [suppressed 9 similar messages]
I20260620 13:56:36.534154  8435 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.570468  8473 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:36.578763  8392 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:36.636116  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1349) took 1319 ms. Trace:
I20260620 13:56:36.638657  5879 rpcz_store.cc:276] 0620 13:56:35.316697 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.624175 (+1307478us) service_pool.cc:224] Handling call
0620 13:56:36.635452 (+ 11277us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:36.635672 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:36.635709 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:36.635792 (+    83us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:56:36.635846 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.635912 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.636046 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:36.640316  5879 raft_consensus.cc:1240] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:36.640945  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1350) took 1322 ms. Trace:
I20260620 13:56:36.641413  5875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1348) took 1325 ms. Trace:
I20260620 13:56:36.641335  5879 rpcz_store.cc:276] 0620 13:56:35.318705 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.639764 (+1321059us) service_pool.cc:224] Handling call
0620 13:56:36.640146 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:36.640719 (+   573us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.640895 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:36.631645  8397 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:36.541115  8469 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.609102  8419 raft_consensus.cc:740] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:36.609319  8358 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:36.644083  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 465) took 1123 ms. Trace:
W20260620 13:56:36.650064  8466 log.cc:927] Time spent T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260620 13:56:36.649659  5879 rpcz_store.cc:276] 0620 13:56:35.520537 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.642379 (+1121842us) service_pool.cc:224] Handling call
0620 13:56:36.642712 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:36.642878 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:36.642901 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:36.642940 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:36.642982 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.643908 (+   926us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.644027 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:36.652093  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 466) took 1060 ms. Trace:
I20260620 13:56:36.633672  6031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 462) took 2049 ms. Trace:
W20260620 13:56:36.630918  8462 log.cc:927] Time spent T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260620 13:56:36.652448  5879 rpcz_store.cc:276] 0620 13:56:35.592002 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.651266 (+1059264us) service_pool.cc:224] Handling call
0620 13:56:36.651584 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:36.651770 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:36.651791 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:36.651832 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:36.651878 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.651936 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.652036 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:36.638660  8420 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:36.663369  6027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 463) took 2073 ms. Trace:
I20260620 13:56:36.635362  8423 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:36.664839  5878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 449) took 1906 ms. Trace:
I20260620 13:56:36.665349  5878 rpcz_store.cc:276] 0620 13:56:34.758040 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.759705 (+  1665us) service_pool.cc:224] Handling call
0620 13:56:34.760147 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:35.090251 (+330104us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.664543 (+1574292us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54002b20d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:36.664764 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743024384}
I20260620 13:56:36.663910  6027 rpcz_store.cc:276] 0620 13:56:34.590594 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.842822 (+252228us) service_pool.cc:224] Handling call
0620 13:56:35.342433 (+499611us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:35.343586 (+  1153us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.663062 (+1319476us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b540005a0d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:36.663276 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148307840}
I20260620 13:56:36.642021  5875 rpcz_store.cc:276] 0620 13:56:35.316365 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.587972 (+1271607us) service_pool.cc:224] Handling call
0620 13:56:36.588341 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:36.588590 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 2
0620 13:56:36.628829 (+ 40239us) log.cc:844] Serialized 14 byte log entry
0620 13:56:36.640971 (+ 12142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:36.641028 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0620 13:56:36.641087 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.641197 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.641354 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43377,"raft.queue_time_us":109,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":23808,"thread_start_us":11477,"threads_started":1,"wal-append.queue_time_us":11802}
W20260620 13:56:36.675220  5876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.005s	sys 0.016s
W20260620 13:56:36.675766  5876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.005s	sys 0.016s
I20260620 13:56:36.653630  8358 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:36.651548  8469 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:36.711459  8472 log.cc:927] Time spent T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260620 13:56:36.712220  8478 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:36.712848  8478 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:36.715973  8474 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260620 13:56:36.720257  8465 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:36.722163  8259 consensus_meta.cc:287] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 1.407s	user 0.014s	sys 0.007s
I20260620 13:56:36.722800  8259 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.724139  8019 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:36.724915  8259 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:36.622697  8464 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.726308  5952 raft_consensus.cc:2393] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:36.728916  5876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1342) took 1423 ms. Trace:
I20260620 13:56:36.739871  8405 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:36.741125  8125 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:36.751833  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 121049us
I20260620 13:56:36.699965  8299 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:36.770008  6028 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:36.691823  8420 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:36.773088  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:36.708052  8423 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:36.758875  8428 consensus_meta.cc:287] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.805s	user 0.005s	sys 0.009s
I20260620 13:56:36.789669  8420 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.800487  8435 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:36.760154  8299 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:36.809620  8044 consensus_meta.cc:287] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.529s	user 0.010s	sys 0.005s
I20260620 13:56:36.813366  8464 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:36.814133  8423 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.816952  8423 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:36.819262  8428 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.822504  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 505) took 2223 ms. Trace:
I20260620 13:56:36.806468  8473 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:36.833844  8410 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.009s	sys 0.013s
W20260620 13:56:36.835505  8410 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.009s	sys 0.013s
I20260620 13:56:36.839843  8486 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:36.840408  8486 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.842968  8486 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:36.845214  5849 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:36.846942  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:36.810350  8044 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.238054  5881 rpcz_store.cc:276] 0620 13:56:34.881052 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.884939 (+  3887us) service_pool.cc:224] Handling call
0620 13:56:34.885911 (+   972us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:34.886154 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 5
0620 13:56:35.292734 (+406580us) log.cc:844] Serialized 14 byte log entry
0620 13:56:36.236937 (+944203us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:36.237013 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:36.237089 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.237189 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.237312 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29658,"prepare.queue_time_us":610418,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":5422,"thread_start_us":1233015,"threads_started":2}
I20260620 13:56:36.853996  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1363) took 3242 ms. Trace:
I20260620 13:56:36.861586  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:36.861280  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:36.861902  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:36.885202  6586 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:56:36.876823  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:36.878625  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 473955us
I20260620 13:56:36.879844  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 506) took 2280 ms. Trace:
I20260620 13:56:36.848615  5877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1347) took 1532 ms. Trace:
I20260620 13:56:36.855182  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:36.892571  6585 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:36.893503  5877 rpcz_store.cc:276] 0620 13:56:35.315999 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.587767 (+1271768us) service_pool.cc:224] Handling call
0620 13:56:36.588226 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:36.588691 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:36.588734 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:36.632156 (+ 43422us) log.cc:844] Serialized 26 byte log entry
0620 13:56:36.848243 (+216087us) raft_consensus.cc:1645] Marking committed up to 1
0620 13:56:36.848319 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.848389 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:36.848431 (+    42us) raft_consensus.cc:1685] finished
0620 13:56:36.848444 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.848561 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11912,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":139,"thread_start_us":193773,"threads_started":1,"wal-append.queue_time_us":193213}
W20260620 13:56:36.861173  5884 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58452 (request call id 2294) took 2053 ms (client timeout 2072 ms). Trace:
W20260620 13:56:36.895536  5884 rpcz_store.cc:269] 0620 13:56:34.807711 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.807860 (+   149us) service_pool.cc:224] Handling call
0620 13:56:36.861005 (+2053145us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54003fa2d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:36.861113 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":711213312}
I20260620 13:56:36.895640  5956 rpcz_store.cc:276] 0620 13:56:34.599802 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.395953 (+1796151us) service_pool.cc:224] Handling call
0620 13:56:36.401211 (+  5258us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:36.401651 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:36.401685 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:36.402534 (+   849us) log.cc:844] Serialized 26 byte log entry
0620 13:56:36.879383 (+476849us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:36.879443 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.879541 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:36.879601 (+    60us) raft_consensus.cc:1685] finished
0620 13:56:36.879620 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.879772 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":73167,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":407734,"threads_started":1,"wal-append.queue_time_us":414510}
I20260620 13:56:36.876101  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:36.890094  6582 raft_consensus.cc:2393] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:36.898257  5883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1346) took 1591 ms. Trace:
I20260620 13:56:36.898663  5883 rpcz_store.cc:276] 0620 13:56:35.307056 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.536586 (+1229530us) service_pool.cc:224] Handling call
0620 13:56:36.563335 (+ 26749us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:36.564655 (+  1320us) raft_consensus.cc:1534] Early marking committed up to index 3
0620 13:56:36.586124 (+ 21469us) log.cc:844] Serialized 14 byte log entry
0620 13:56:36.897951 (+311827us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:36.898001 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0620 13:56:36.898046 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.898107 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.898208 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8810,"prepare.queue_time_us":21224,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":2303,"thread_start_us":302481,"threads_started":1}
W20260620 13:56:36.848657  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:36.879915  5959 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.011s	sys 0.010s
I20260620 13:56:36.880900  5958 rpcz_store.cc:276] 0620 13:56:33.611495 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:33.628523 (+ 17028us) service_pool.cc:224] Handling call
0620 13:56:33.629481 (+   958us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:33.695604 (+ 66123us) raft_consensus.cc:1534] Early marking committed up to index 4
0620 13:56:33.854449 (+158845us) log.cc:844] Serialized 14 byte log entry
0620 13:56:34.310496 (+456047us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b18003a17a0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b5da 00007f0fdf806e0a
0620 13:56:34.383977 (+ 73481us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:34.384503 (+   526us) log.cc:844] Serialized 26 byte log entry
0620 13:56:34.384643 (+   140us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:56:34.384674 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:35.266020 (+881346us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b54002a80d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:35.266089 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:36.853081 (+1586992us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b2400033038. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc591614 00007f0fdc58f71b 00007f0fdc74a619 00007f0fdc74a2a5 00007f0fdc749800 00007f0fdf3c3828 00007f0fdf3c3f88 00007f0fdf39b738 00007f0fdf396b0a 00007f0fdf395f56
0620 13:56:36.853692 (+   611us) raft_consensus.cc:1685] finished
0620 13:56:36.853741 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.853905 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13924,"prepare.queue_time_us":176119,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":20553,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":13695,"spinlock_wait_cycles":19468800,"thread_start_us":256157,"threads_started":3,"wal-append.queue_time_us":846879}
I20260620 13:56:36.936192  6586 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
W20260620 13:56:36.941655  5959 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.014s	sys 0.011s
W20260620 13:56:36.905459  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:36.944424  6582 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:36.860492  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:36.946457  8435 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:36.946533  8397 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:36.947167  8435 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.947386  8471 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260620 13:56:36.947283  8397 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:36.852582  8044 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:36.943055  8259 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:36.855288  8284 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:36.949986  8397 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:36.852682  8410 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:36.877554  8480 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:36.954269  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:36.856503  8420 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:36.967149  8410 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:36.967365  8480 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.969133  8410 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:36.970701  8480 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:36.954506  5849 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:36.973117  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:36.973346  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:36.857573  8486 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:36.955927  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:36.956358  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 54664.3us
I20260620 13:56:36.956820  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:36.973526  5954 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:56:36.849618  8299 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:36.975093  5956 raft_consensus.cc:2393] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:36.977689  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:36.977972  5924 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:36.979750  8480 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260620 13:56:36.976094  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:36.978655  8393 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:36.981600  8393 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:36.962440  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:36.975625  8467 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:36.982026  8393 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:36.982271  8467 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.982723  6030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 459) took 2401 ms. Trace:
I20260620 13:56:36.983150  6030 rpcz_store.cc:276] 0620 13:56:34.581988 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.709219 (+127231us) service_pool.cc:224] Handling call
0620 13:56:34.709616 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:35.879018 (+1169402us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.982374 (+1103356us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b54001c9b54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:36.982631 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1681820544}
I20260620 13:56:36.984442  8467 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:36.984977  8467 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:36.985522  8467 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.973701  5883 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:36.987939  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:36.974207  8464 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:36.989389  8464 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:36.989794  8464 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:36.989823  8480 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:36.979803  8176 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:36.991408  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:36.991683  8467 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:36.991534  8176 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.992429  8467 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:36.992913  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:36.994165  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:36.994710  8467 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:36.996382  5880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1344) took 1690 ms. Trace:
I20260620 13:56:37.025200  5880 rpcz_store.cc:276] 0620 13:56:35.306483 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:35.961365 (+654882us) service_pool.cc:224] Handling call
0620 13:56:35.961813 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:36.197232 (+235419us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:36.197268 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:36.207449 (+ 10181us) log.cc:844] Serialized 26 byte log entry
0620 13:56:36.641921 (+434472us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:36.641963 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.996004 (+354041us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b540030e8d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:36.996054 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:36.996100 (+    46us) raft_consensus.cc:1685] finished
0620 13:56:36.996114 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.996312 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5489,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":9333,"spinlock_wait_cycles":540522752,"thread_start_us":396763,"threads_started":1,"wal-append.queue_time_us":423189}
I20260620 13:56:36.855598  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:36.652747  6031 rpcz_store.cc:276] 0620 13:56:34.586135 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.842457 (+256322us) service_pool.cc:224] Handling call
0620 13:56:34.864393 (+ 21936us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:34.864688 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 5
0620 13:56:36.135940 (+1271252us) log.cc:844] Serialized 14 byte log entry
0620 13:56:36.633224 (+497284us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:36.633293 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:36.633367 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.633454 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.633605 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2758,"prepare.queue_time_us":227698,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":312,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8960,"thread_start_us":1735638,"threads_started":2,"wal-append.queue_time_us":513953}
W20260620 13:56:36.999655  5953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1386) took 2012 ms (client timeout 1689 ms). Trace:
I20260620 13:56:37.001502  8410 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:36.998014  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:36.994168  8176 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:37.007525  5877 raft_consensus.cc:1240] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:37.007783  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:37.038745  5958 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:37.039235  5878 raft_consensus.cc:2393] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:37.008311  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:37.010483  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:37.010854  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:37.011818  6027 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8. Ops: []
I20260620 13:56:37.012502  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:37.013866  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:37.036789  5954 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:56:37.015497  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:37.045143  6026 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:37.014376  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:37.046903  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:37.041960  5883 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:37.047763  5878 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:37.048861  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:37.048774  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:37.049820  5883 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:36.891742  8428 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:37.028324  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:37.083374  5880 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:37.029135  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 54312.7us
I20260620 13:56:36.849885  8019 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260620 13:56:37.005435  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:37.089603  5881 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
W20260620 13:56:37.034762  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:37.034628  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 274495us
W20260620 13:56:37.093693  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:37.002095  8288 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:37.044217  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:37.018548  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:37.098292  6025 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:37.046204  5879 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:37.043854  8480 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:37.052872  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:37.053318  8410 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:37.054628  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:37.034590  5953 rpcz_store.cc:269] 0620 13:56:34.987033 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:35.139356 (+152323us) service_pool.cc:224] Handling call
0620 13:56:36.999409 (+1860053us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b54003d13d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:36.999562 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46019968}
I20260620 13:56:37.055516  8393 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:37.056149  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:37.036036  8289 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:37.062474  8464 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:37.063786  8435 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:36.964875  8483 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:36.950263  8290 consensus_queue.cc:1059] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260620 13:56:37.064245  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 1911) took 2648 ms. Trace:
I20260620 13:56:37.137815  5954 rpcz_store.cc:276] 0620 13:56:34.415871 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:35.286661 (+870790us) service_pool.cc:224] Handling call
0620 13:56:35.316857 (+ 30196us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:36.973309 (+1656452us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b58002423d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf75848a 00007f0fdf7da827 00007f0fdf7f33c7 00007f0fdf7f4bbe 00007f0fdf7fef29 00007f0fdf7ff7f6 00007f0fdf7fc16f 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34
0620 13:56:37.058611 (+ 85302us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:37.064165 (+  5554us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1905095424}
I20260620 13:56:37.139714  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:37.022730  8259 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:37.023841  8469 consensus_queue.cc:1059] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
W20260620 13:56:37.065135  8295 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260620 13:56:36.940341  8392 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:37.080529  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:37.100804  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:37.146917  5881 raft_consensus.cc:2393] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:37.047261  8467 raft_consensus.cc:697] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:37.103255  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:37.103492  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:37.032133  8468 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:56:37.090260  8490 log.cc:927] Time spent T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.070s	user 0.001s	sys 0.001s
I20260620 13:56:37.156777  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:37.158366  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:37.157984  8467 consensus_queue.cc:237] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:37.161623  8312 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:37.105837  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:37.122658  8480 raft_consensus.cc:697] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:37.090577  8293 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:37.067070  8471 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:37.104394  6551 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:37.167526  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 63251.9us
I20260620 13:56:37.169821  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:37.135929  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:37.170898  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:37.171407  5883 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:37.172124  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:37.144959  5880 raft_consensus.cc:2410] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260620 13:56:37.146446  5958 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:37.129452  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:37.151355  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 47947.7us
I20260620 13:56:37.152627  5848 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:37.154228  5956 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:37.175485  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:37.155851  8468 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:37.163066  5953 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:37.180191  5884 raft_consensus.cc:2393] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 4: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:37.163439  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 1974) took 1932 ms. Trace:
I20260620 13:56:37.176162  5880 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:37.181741  6033 rpcz_store.cc:276] 0620 13:56:35.231403 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:35.906994 (+675591us) service_pool.cc:224] Handling call
0620 13:56:35.907520 (+   526us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:36.395249 (+487729us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:36.395287 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:36.395317 (+    30us) raft_consensus.cc:1645] Marking committed up to 2
0620 13:56:36.395340 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:37.163169 (+767829us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54001e55d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:37.163218 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:37.163377 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120964864}
I20260620 13:56:37.182296  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:37.179315  8471 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:37.188166  8453 consensus_queue.cc:1059] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:37.188834  8465 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:37.189613  8471 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:37.189690  8465 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:37.190076  8453 raft_consensus.cc:3055] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:37.190582  8453 raft_consensus.cc:740] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:37.164829  8423 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:37.191409  8423 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:37.191752  8423 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:37.194453  8468 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:37.130661  8289 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:37.196684  8286 raft_consensus.cc:3055] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:37.197080  8286 raft_consensus.cc:740] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:37.197269  8289 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:37.197917  8286 consensus_queue.cc:260] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:37.198475  5951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1377) took 2379 ms (client timeout 1750 ms). Trace:
I20260620 13:56:37.199260  5877 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:37.198892  5951 rpcz_store.cc:269] 0620 13:56:34.819414 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.872478 (+ 53064us) service_pool.cc:224] Handling call
0620 13:56:37.198228 (+2325750us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400262ad4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:37.198377 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312605440}
I20260620 13:56:37.204630  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:37.205267  5951 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:37.209616  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:37.210407  5958 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:37.211526  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:37.212374  5883 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:37.184175  6552 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:37.214802  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:37.220109  5877 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:37.144352  8483 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:37.221635  5879 raft_consensus.cc:2368] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6.
I20260620 13:56:37.224555  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:37.224120  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:37.225656  6028 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:37.227685  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:37.228400  5958 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:37.198897  8286 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:37.251257  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:37.208740  8405 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:37.260450  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:37.262252  6028 raft_consensus.cc:1240] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260620 13:56:37.280900  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:37.282099  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:37.234565  8468 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:37.308099  5958 raft_consensus.cc:2410] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260620 13:56:37.279834  8414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.992s	user 0.016s	sys 0.029s
I20260620 13:56:37.285532  5997 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:37.221131  8469 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:37.179529  8293 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:37.230652  8397 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:37.229980  8435 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:37.245000  8306 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:37.265775  8411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.009s	sys 0.022s
W20260620 13:56:37.308998  8414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.041s	user 0.016s	sys 0.029s
I20260620 13:56:37.319196  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:37.244454  8471 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.086s
I20260620 13:56:37.309800  8405 raft_consensus.cc:697] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:56:37.312770  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 289030us
I20260620 13:56:37.224223  8486 consensus_queue.cc:1059] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260620 13:56:37.324075  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:37.358480  6027 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:37.319175  8019 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:37.223783  8419 consensus_queue.cc:260] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:37.333961  8411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.009s	sys 0.025s
I20260620 13:56:37.334138  8393 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:37.314450  8399 raft_consensus.cc:3055] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:37.318588  8468 raft_consensus.cc:697] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:37.370622  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:37.319612  8044 consensus_queue.cc:1059] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260620 13:56:37.374275  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:37.264529  8480 consensus_queue.cc:237] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:37.223155  8453 consensus_queue.cc:260] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:37.325160  8469 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:37.336167  8306 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:37.335994  8435 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:37.345445  8397 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:37.375967  8393 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:37.373425  8399 raft_consensus.cc:740] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:37.310360  5997 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:36.753420  5876 rpcz_store.cc:276] 0620 13:56:35.305802 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:35.948479 (+642677us) service_pool.cc:224] Handling call
0620 13:56:35.949012 (+   533us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:35.978162 (+ 29150us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:35.978209 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:36.137260 (+159051us) log.cc:844] Serialized 26 byte log entry
0620 13:56:36.676260 (+539000us) raft_consensus.cc:1645] Marking committed up to 2
0620 13:56:36.727330 (+ 51070us) log.cc:844] Serialized 14 byte log entry
0620 13:56:36.728527 (+  1197us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.728604 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:36.728643 (+    39us) raft_consensus.cc:1685] finished
0620 13:56:36.728655 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.728839 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28587,"prepare.queue_time_us":75651,"raft.queue_time_us":215975,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":199,"thread_start_us":520572,"threads_started":1,"wal-append.queue_time_us":485511}
W20260620 13:56:37.988941  5924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.003s	sys 0.008s
W20260620 13:56:38.037912  6585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.011s	sys 0.012s
I20260620 13:56:37.373725  8486 consensus_queue.cc:1243] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer b0ce39342d8c4a64904b30b98de02b9f log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260620 13:56:37.375980  8468 consensus_queue.cc:237] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:37.993188  6550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.016s	sys 0.034s
W20260620 13:56:38.014207  6584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.014s	sys 0.033s
W20260620 13:56:38.037858  6586 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.000s	sys 0.009s
W20260620 13:56:37.982407  5883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.007s	sys 0.017s
W20260620 13:56:37.990679  5959 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.000s	sys 0.004s
W20260620 13:56:38.037691  5956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 1917) took 1633 ms (client timeout 2066 ms). Trace:
I20260620 13:56:38.013411  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1323) took 5233 ms. Trace:
I20260620 13:56:38.020716  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 1909) took 3634 ms. Trace:
I20260620 13:56:38.024426  5884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1352) took 1051 ms. Trace:
I20260620 13:56:38.047546  5877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42748 (request call id 471) took 1037 ms. Trace:
W20260620 13:56:38.151342  5922 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.021s	sys 0.016s
W20260620 13:56:37.990437  5998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.003s	sys 0.000s
W20260620 13:56:38.583359  5924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.340s	user 0.009s	sys 0.034s
I20260620 13:56:38.155632  5958 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:38.583395  6550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.325s	user 0.021s	sys 0.052s
W20260620 13:56:37.851015  8501 log.cc:927] Time spent T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260620 13:56:38.147491  8453 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:37.986474  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:37.440864  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:38.590854  5959 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.013s	sys 0.007s
W20260620 13:56:38.591094  5883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.364s	user 0.011s	sys 0.036s
W20260620 13:56:38.598208  5998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.223s	user 0.007s	sys 0.015s
W20260620 13:56:38.589725  6585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.223s	user 0.027s	sys 0.029s
W20260620 13:56:38.600749  6586 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.000s	sys 0.028s
W20260620 13:56:37.984057  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:38.597136  5922 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.344s	user 0.028s	sys 0.028s
I20260620 13:56:37.376484  8019 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260620 13:56:37.517099  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:37.851382  8498 log.cc:927] Time spent T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260620 13:56:38.162415  8435 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:37.910313  8286 consensus_meta.cc:287] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.000s
W20260620 13:56:38.014206  6583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.006s	sys 0.027s
I20260620 13:56:38.150446  8397 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:37.450079  8492 log.cc:927] Time spent T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.312s	user 0.001s	sys 0.001s
W20260620 13:56:38.584460  6584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.299s	user 0.027s	sys 0.040s
I20260620 13:56:38.045789  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:37.850425  8284 consensus_meta.cc:287] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.823s	user 0.011s	sys 0.001s
W20260620 13:56:38.331537  8044 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.001s	sys 0.010s
W20260620 13:56:37.883507  8423 consensus_meta.cc:287] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.691s	user 0.004s	sys 0.007s
I20260620 13:56:38.153585  8306 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:37.851475  8499 log.cc:927] Time spent T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260620 13:56:38.160243  8469 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:37.912151  8426 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.000s	sys 0.010s
I20260620 13:56:38.573937  5884 rpcz_store.cc:276] 0620 13:56:36.972982 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.973114 (+   132us) service_pool.cc:224] Handling call
0620 13:56:38.023760 (+1050646us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400324954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:38.024127 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473836288}
W20260620 13:56:37.725026  8358 consensus_meta.cc:287] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 1.013s	user 0.005s	sys 0.006s
I20260620 13:56:37.998164  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:38.573266  5882 rpcz_store.cc:276] 0620 13:56:32.780215 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:32.780439 (+   224us) service_pool.cc:224] Handling call
0620 13:56:34.483189 (+1702750us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:35.186103 (+702914us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:38.011275 (+2825172us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b540030e3d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:38.012831 (+  1556us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b540030e3d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:38.013137 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5530397952}
W20260620 13:56:37.523659  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 352502us
I20260620 13:56:38.532593  8290 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:56:38.034406  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:37.509591  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 293633us
I20260620 13:56:38.573793  5955 rpcz_store.cc:276] 0620 13:56:34.385571 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:35.239236 (+853665us) service_pool.cc:224] Handling call
0620 13:56:37.000512 (+1761276us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:37.000698 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:37.000724 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:37.000768 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0620 13:56:37.000808 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:37.000897 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:38.020083 (+1019186us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54003d13d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:38.020371 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4018842368}
I20260620 13:56:37.468897  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:38.574151  5877 rpcz_store.cc:276] 0620 13:56:37.009530 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:37.043979 (+ 34449us) service_pool.cc:224] Handling call
0620 13:56:38.022919 (+978940us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540040f954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:38.047313 (+ 24394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233021184}
W20260620 13:56:38.573102  5956 rpcz_store.cc:269] 0620 13:56:36.404418 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.977412 (+572994us) service_pool.cc:224] Handling call
0620 13:56:38.037140 (+1059728us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400305f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:38.037412 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404471552}
I20260620 13:56:37.565021  8392 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:38.633279  6587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.026s	sys 0.033s
W20260620 13:56:38.625741  8044 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.222s	user 0.002s	sys 0.019s
I20260620 13:56:37.399331  8483 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:38.625320  6583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.599s	user 0.006s	sys 0.057s
I20260620 13:56:37.793741  8293 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:38.626332  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 1.25162e+06us
I20260620 13:56:38.637490  6032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2317) took 1401 ms. Trace:
W20260620 13:56:38.638165  6587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.372s	user 0.027s	sys 0.033s
I20260620 13:56:37.511276  8259 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:38.158123  8393 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.645007  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 481) took 1594 ms. Trace:
I20260620 13:56:38.646806  6032 rpcz_store.cc:276] 0620 13:56:37.236600 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:37.997232 (+760632us) service_pool.cc:224] Handling call
0620 13:56:38.637368 (+640136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:38.648651  6031 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:38.652665  6031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2318) took 1415 ms. Trace:
I20260620 13:56:38.149993  8399 consensus_queue.cc:260] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:38.648403  8511 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:38.664573  8507 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:38.665160  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 679) took 1816 ms. Trace:
I20260620 13:56:38.665503  8507 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.660205  8310 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:38.668462  8483 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:38.668061  8310 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.665323  8511 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.669530  8483 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.658016  6031 rpcz_store.cc:276] 0620 13:56:37.236902 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:37.995223 (+758321us) service_pool.cc:224] Handling call
0620 13:56:38.652600 (+657377us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:38.665645  6587 rpcz_store.cc:276] 0620 13:56:36.848776 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.849076 (+   300us) service_pool.cc:224] Handling call
0620 13:56:36.849493 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:36.849704 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 7
0620 13:56:36.944041 (+ 94337us) log.cc:844] Serialized 14 byte log entry
0620 13:56:38.664595 (+1720554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:38.664689 (+    94us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:38.664740 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:38.664840 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:38.665042 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1090,"prepare.queue_time_us":182033,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":6320,"raft.queue_time_us":610399,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":1801114,"threads_started":3,"wal-append.queue_time_us":486922}
I20260620 13:56:38.661342  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 504) took 4062 ms. Trace:
W20260620 13:56:38.672322  5849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.010s	sys 0.021s
W20260620 13:56:38.674464  5849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.010s	sys 0.021s
I20260620 13:56:38.675802  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:38.676787  6580 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:38.677368  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:38.649549  6025 rpcz_store.cc:276] 0620 13:56:37.029955 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:37.123395 (+ 93440us) service_pool.cc:224] Handling call
0620 13:56:37.128609 (+  5214us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:37.131734 (+  3125us) raft_consensus.cc:1534] Early marking committed up to index 4
0620 13:56:37.131778 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:37.132389 (+   611us) log.cc:844] Serialized 26 byte log entry
0620 13:56:37.457425 (+325036us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:56:37.457485 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:37.457587 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:38.599696 (+1142109us) raft_consensus.cc:1685] finished
0620 13:56:38.602732 (+  3036us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:38.623698 (+ 20966us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2630,"raft.queue_time_us":4019,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":6052,"spinlock_wait_cycles":1920,"thread_start_us":324637,"threads_started":1,"wal-append.queue_time_us":973299}
W20260620 13:56:38.681631  5951 consensus_meta.cc:287] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 1.475s	user 0.014s	sys 0.010s
I20260620 13:56:38.679049  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:38.684273  5951 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
W20260620 13:56:38.682529  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 1.34503e+06us
W20260620 13:56:38.683713  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:38.669975  8531 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:36.824424  5950 rpcz_store.cc:276] 0620 13:56:34.599548 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:35.964692 (+1365144us) service_pool.cc:224] Handling call
0620 13:56:36.058513 (+ 93821us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:36.117163 (+ 58650us) raft_consensus.cc:1534] Early marking committed up to index 7
0620 13:56:36.643330 (+526167us) log.cc:844] Serialized 14 byte log entry
0620 13:56:36.822104 (+178774us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:36.822172 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:36.822232 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.822309 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:36.822439 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":400158,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":787,"thread_start_us":641017,"threads_started":2,"wal-append.queue_time_us":188654}
I20260620 13:56:38.685966  8423 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.683430  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:38.682245  8428 raft_consensus.cc:3055] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:38.687247  6578 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:38.680611  8019 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:38.683491  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:38.690563  6585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 687) took 1796 ms. Trace:
I20260620 13:56:38.682387  8507 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:38.693579  8530 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:38.696973  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:38.683571  8478 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:38.697734  8284 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:38.695430  8486 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:38.738477  8397 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:38.738876  8486 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:38.691391  5953 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:38.739697  8480 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:56:38.740110  5953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 515) took 1549 ms (client timeout 1854 ms). Trace:
I20260620 13:56:38.700572  8091 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:38.705664  8533 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:38.708673  8450 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 2.849s	user 0.014s	sys 0.017s
W20260620 13:56:38.706861  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:38.702961  8428 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:38.711869  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:38.713900  5997 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:38.704522  6585 rpcz_store.cc:276] 0620 13:56:36.862043 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.893211 (+ 31168us) service_pool.cc:224] Handling call
0620 13:56:36.945754 (+ 52543us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:37.333455 (+387701us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:37.333486 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:37.335643 (+  2157us) log.cc:844] Serialized 26 byte log entry
0620 13:56:38.641244 (+1305601us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:38.644685 (+  3441us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:38.654520 (+  9835us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:38.657828 (+  3308us) raft_consensus.cc:1685] finished
0620 13:56:38.657844 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:38.658743 (+   899us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78150,"raft.queue_time_us":83133,"spinlock_wait_cycles":23054720,"thread_start_us":1548249,"threads_started":2,"wal-append.queue_time_us":776980}
I20260620 13:56:38.718312  8329 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:38.702085  8531 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:38.721683  8310 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:38.726519  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:38.727881  8304 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:56:38.753861  8511 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:38.754323  8471 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:38.729532  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:38.730623  8464 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:38.730408  5952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 1914) took 2326 ms (client timeout 1567 ms). Trace:
I20260620 13:56:38.735339  8019 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:38.733177  8469 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:38.733963  8530 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:38.704887  6586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 688) took 1837 ms. Trace:
I20260620 13:56:38.739636  8397 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:38.701929  8426 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.272s	user 0.000s	sys 0.022s
W20260620 13:56:38.741302  5951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 517) took 1544 ms (client timeout 1641 ms). Trace:
W20260620 13:56:38.740557  5953 rpcz_store.cc:269] 0620 13:56:37.190818 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:38.033535 (+842717us) service_pool.cc:224] Handling call
0620 13:56:38.740022 (+706487us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:38.740767  8295 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:38.735790  6583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 682) took 1883 ms. Trace:
I20260620 13:56:38.749125  8478 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:38.754918  6579 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:38.749056  8533 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:38.752727  8534 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:38.753888  8304 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:38.750305  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:38.728193  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:38.755383  6580 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:38.776043  6578 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:38.775921  8358 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:38.755514  6584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 680) took 1906 ms. Trace:
I20260620 13:56:38.672842  5959 rpcz_store.cc:276] 0620 13:56:34.599234 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:35.443640 (+844406us) service_pool.cc:224] Handling call
0620 13:56:35.879263 (+435623us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:35.879490 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 5
0620 13:56:36.942243 (+1062753us) log.cc:844] Serialized 14 byte log entry
0620 13:56:38.604522 (+1662279us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:38.619737 (+ 15215us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:38.631588 (+ 11851us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:38.639388 (+  7800us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:38.661237 (+ 21849us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":535273,"prepare.run_cpu_time_us":6963,"prepare.run_wall_time_us":30473,"raft.queue_time_us":1187416,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":365,"thread_start_us":2554065,"threads_started":3,"wal-append.queue_time_us":628523}
I20260620 13:56:37.532236  8405 consensus_queue.cc:237] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.740610  8480 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:38.750118  8410 raft_consensus.cc:3055] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Stepping down as leader of term 3
W20260620 13:56:38.766198  5951 rpcz_store.cc:269] 0620 13:56:37.192083 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:37.204343 (+ 12260us) service_pool.cc:224] Handling call
0620 13:56:38.705050 (+1500707us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260620 13:56:38.759045  5952 rpcz_store.cc:269] 0620 13:56:36.403676 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.592368 (+188692us) service_pool.cc:224] Handling call
0620 13:56:38.729939 (+2137571us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540007a8d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:38.730195 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305363840}
I20260620 13:56:38.771927  8258 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:38.750612  8306 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:38.772605  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 1907) took 4380 ms. Trace:
I20260620 13:56:38.773307  8486 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:38.761795  6586 rpcz_store.cc:276] 0620 13:56:36.867608 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.943126 (+ 75518us) service_pool.cc:224] Handling call
0620 13:56:36.943585 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:37.346511 (+402926us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:37.346552 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:37.359629 (+ 13077us) log.cc:844] Serialized 26 byte log entry
0620 13:56:38.652329 (+1292700us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:56:38.662508 (+ 10179us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:38.692567 (+ 30059us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:38.692612 (+    45us) raft_consensus.cc:1685] finished
0620 13:56:38.692622 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:38.704842 (+ 12220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120541,"raft.queue_time_us":85191,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":14596,"thread_start_us":1529129,"threads_started":2,"wal-append.queue_time_us":1269418}
I20260620 13:56:38.776796  8304 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.782312  6585 raft_consensus.cc:2393] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:38.771198  8478 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.767197  8428 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.786067  8410 raft_consensus.cc:740] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:38.793390  8533 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:38.793612  8284 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:38.808095  6027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2321) took 1420 ms (client timeout 1869 ms). Trace:
I20260620 13:56:38.777599  8310 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:38.829924  6027 rpcz_store.cc:269] 0620 13:56:37.251424 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:37.403056 (+151632us) service_pool.cc:224] Handling call
0620 13:56:38.662368 (+1259312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:38.834941  8304 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:38.797192  5776 catalog_manager.cc:5696] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 2 to 3, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 3 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:38.835366  8310 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.837247  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:38.838799  5956 raft_consensus.cc:2410] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260620 13:56:38.838656  8259 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:38.842484  6024 raft_consensus.cc:2368] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6.
I20260620 13:56:38.842670  8522 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:38.843397  8524 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:38.786736  8286 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:38.781930  8295 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.839461  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:38.843956  8522 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:38.856529  5956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1392) took 1867 ms (client timeout 2446 ms). Trace:
W20260620 13:56:38.857695  5956 rpcz_store.cc:269] 0620 13:56:36.978836 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:38.764294 (+1785458us) service_pool.cc:224] Handling call
0620 13:56:38.846284 (+ 81990us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:38.859277  5955 raft_consensus.cc:2410] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260620 13:56:38.838689  8310 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:38.868762  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 68166.8us
I20260620 13:56:38.777285  6584 rpcz_store.cc:276] 0620 13:56:36.849188 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.849315 (+   127us) service_pool.cc:224] Handling call
0620 13:56:36.849629 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:36.849842 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:36.942467 (+ 92625us) log.cc:844] Serialized 14 byte log entry
0620 13:56:38.660662 (+1718195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:38.693963 (+ 33301us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:38.704359 (+ 10396us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:38.741411 (+ 37052us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:38.755452 (+ 14041us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":202579,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":590456,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":62,"thread_start_us":1771429,"threads_started":3,"wal-append.queue_time_us":589579}
I20260620 13:56:38.874478  8310 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:38.875321  8310 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.855702  8530 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:38.842635  8259 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.844120  8524 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:38.873193  5955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 1912) took 2470 ms (client timeout 2985 ms). Trace:
I20260620 13:56:38.848372  5950 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
W20260620 13:56:38.883371  5955 rpcz_store.cc:269] 0620 13:56:36.403126 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:38.764929 (+2361803us) service_pool.cc:224] Handling call
0620 13:56:38.873104 (+108175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:38.845513  8258 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:38.867583  8483 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:38.891786  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 130966us
I20260620 13:56:38.786068  5957 rpcz_store.cc:276] 0620 13:56:34.385016 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:34.725885 (+340869us) service_pool.cc:224] Handling call
0620 13:56:34.752586 (+ 26701us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:34.752997 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:34.753026 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:34.754209 (+  1183us) log.cc:844] Serialized 26 byte log entry
0620 13:56:35.953661 (+1199452us) raft_consensus.cc:1645] Marking committed up to 3
0620 13:56:36.246671 (+293010us) log.cc:844] Serialized 14 byte log entry
0620 13:56:36.261079 (+ 14408us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:36.261187 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:38.707283 (+2446096us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:56:38.759995 (+ 52712us) raft_consensus.cc:1685] finished
0620 13:56:38.763856 (+  3861us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:38.765633 (+  1777us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88103,"prepare.queue_time_us":529629,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":169174,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":12872,"spinlock_wait_cycles":7637376,"thread_start_us":1335378,"threads_started":2,"wal-append.queue_time_us":1061496}
I20260620 13:56:38.807932  8534 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.896915  5956 raft_consensus.cc:1240] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:38.898526  6551 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:38.899277  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 185648us
I20260620 13:56:38.844735  8469 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.903206  5959 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260620 13:56:38.906241  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:38.912042  5849 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:38.946108  8410 consensus_queue.cc:260] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.866845  8306 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:38.869113  8286 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:39.056209  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:39.106603  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 218849us
I20260620 13:56:38.946345  5997 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:56:38.948257  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 151611us
I20260620 13:56:39.057170  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:38.908957  8524 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:38.769441  6583 rpcz_store.cc:276] 0620 13:56:36.852615 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:36.852740 (+   125us) service_pool.cc:224] Handling call
0620 13:56:36.853112 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:36.853470 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:37.025268 (+171798us) log.cc:844] Serialized 14 byte log entry
0620 13:56:38.699769 (+1674501us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:38.699879 (+   110us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:38.699974 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:38.700967 (+   993us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:38.735719 (+ 34752us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10706,"prepare.queue_time_us":199236,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":41140,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":203,"thread_start_us":1787543,"threads_started":2,"wal-append.queue_time_us":1642207}
W20260620 13:56:39.204480  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:38.951363  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 53120.3us
I20260620 13:56:38.964673  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1374) took 4099 ms. Trace:
W20260620 13:56:39.178676  8515 log.cc:927] Time spent T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260620 13:56:38.946822  5883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1360) took 1929 ms. Trace:
I20260620 13:56:38.955193  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1378) took 4093 ms. Trace:
W20260620 13:56:39.278054  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:39.236227  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:39.284499  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:39.242383  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1379) took 4403 ms. Trace:
I20260620 13:56:39.239488  5849 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:39.244777  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:39.235412  5959 rpcz_store.cc:276] 0620 13:56:34.814066 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:38.787924 (+3973858us) service_pool.cc:224] Handling call
0620 13:56:38.845101 (+ 57177us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:38.912531 (+ 67430us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:38.913231 (+   700us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:39.184257  8358 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:39.187951  8422 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:38.947856  8536 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:39.059589  8539 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:39.216243  8399 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:39.088172  8478 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:39.193856  8428 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:39.179381  8423 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:56:39.307087  5957 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
W20260620 13:56:39.308211  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:39.308866  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:39.309325  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1384) took 4417 ms. Trace:
I20260620 13:56:39.310107  5957 rpcz_store.cc:276] 0620 13:56:34.891877 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.308124 (+4416247us) service_pool.cc:224] Handling call
0620 13:56:39.308661 (+   537us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:39.308944 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:39.308970 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:39.309035 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:39.309073 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.309130 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:39.309265 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:39.280550  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:39.063977  8258 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.282855  5956 rpcz_store.cc:276] 0620 13:56:34.821084 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:38.870186 (+4049102us) service_pool.cc:224] Handling call
0620 13:56:38.896673 (+ 26487us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:38.914097 (+ 17424us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:38.914363 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304}
I20260620 13:56:39.132872  8530 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:39.316141  8530 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:39.316442  6031 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:39.316675  8530 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:39.317113  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1385) took 4411 ms. Trace:
I20260620 13:56:39.318069  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:38.952813  8516 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:39.318893  6033 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:39.319344  8516 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:39.319816  8516 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:39.321012  8469 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:39.149194  8310 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:38.959179  8483 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:39.036870  5998 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:38.954437  8284 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:39.301333  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 56659.2us
W20260620 13:56:39.305161  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:39.305491  8304 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:39.306223  8551 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:39.370478  5958 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.752s	user 0.012s	sys 0.002s
W20260620 13:56:39.311658  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:39.312597  8306 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:39.191269  8019 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.285233  5955 rpcz_store.cc:276] 0620 13:56:34.838797 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.241037 (+4402240us) service_pool.cc:224] Handling call
0620 13:56:39.241506 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:39.241934 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:39.241973 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:39.242026 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0620 13:56:39.242073 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.242142 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:39.242286 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:39.373745  5958 raft_consensus.cc:2410] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260620 13:56:39.237221  8259 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:39.236817  8534 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:39.313980  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:39.315654  8423 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:39.305792  8422 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.239856  8286 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:39.317545  5957 rpcz_store.cc:276] 0620 13:56:34.905818 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.316043 (+4410225us) service_pool.cc:224] Handling call
0620 13:56:39.316501 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:39.316758 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:39.316782 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:39.316826 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:56:39.316854 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.316911 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:39.317030 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260620 13:56:39.353711  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:39.349210  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:39.233685  8290 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:39.300925  8524 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260620 13:56:39.367046  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 127759us
I20260620 13:56:39.276373  8533 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:39.341005  6033 raft_consensus.cc:1240] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:39.236634  8464 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:39.323717  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:39.336066  8453 consensus_meta.cc:287] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.705s	user 0.017s	sys 0.000s
W20260620 13:56:39.322717  5848 connection.cc:256] RPC call timeout handler was delayed by -1.1791640519999191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260620 13:56:39.235901  5883 rpcz_store.cc:276] 0620 13:56:37.017430 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:37.225429 (+207999us) service_pool.cc:224] Handling call
0620 13:56:37.225709 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:37.226030 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:37.226057 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:37.226486 (+   429us) log.cc:844] Serialized 26 byte log entry
0620 13:56:38.641985 (+1415499us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:38.910101 (+268116us) log.cc:844] Serialized 14 byte log entry
0620 13:56:38.946337 (+ 36236us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:38.946472 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:38.946544 (+    72us) raft_consensus.cc:1685] finished
0620 13:56:38.946561 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:38.946743 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20411,"prepare.queue_time_us":606547,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":36067,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":15177,"thread_start_us":1557954,"threads_started":2,"wal-append.queue_time_us":890519}
I20260620 13:56:39.243230  8507 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
I20260620 13:56:39.401084  6551 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:39.402436  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:39.402596  6551 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:39.375245  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1373) took 4558 ms. Trace:
W20260620 13:56:39.376479  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 430331us
I20260620 13:56:39.382419  6027 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:39.382014  8483 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.383816  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:39.370491  8304 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:39.384367  8480 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:39.382171  8364 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:39.387220  8478 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:39.388334  5952 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:39.326297  6579 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:39.245076  8549 consensus_queue.cc:1059] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.333s
I20260620 13:56:39.382156  8547 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:39.398797  6026 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:39.398538  8464 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:39.406322  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:39.405990  8551 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.407246  8543 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:39.422389  8290 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.378887  8423 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:39.366783  8539 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:39.414129  6582 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:39.327762  8258 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:39.422526  6030 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:39.423162  8532 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:39.423314  8543 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:39.419523  8478 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:39.408583  8019 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:39.412129  5953 rpcz_store.cc:276] 0620 13:56:34.813787 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:38.767256 (+3953469us) service_pool.cc:224] Handling call
0620 13:56:38.770955 (+  3699us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:56:38.772240 (+  1285us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:38.772273 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:56:38.773217 (+   944us) log.cc:844] Serialized 52 byte log entry
0620 13:56:39.193834 (+420617us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:39.370748 (+176914us) log.cc:844] Serialized 14 byte log entry
0620 13:56:39.371050 (+   302us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.371140 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:39.371181 (+    41us) raft_consensus.cc:1685] finished
0620 13:56:39.371191 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:39.372382 (+  1191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":533,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":2353,"thread_start_us":396813,"threads_started":2,"wal-append.queue_time_us":467419}
I20260620 13:56:39.425045  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1376) took 4605 ms. Trace:
I20260620 13:56:39.416505  8304 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:39.428582  6028 raft_consensus.cc:1240] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260620 13:56:39.410341  8533 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:39.322633  8536 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:39.434900  6551 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:39.423527  8364 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:39.440872  8312 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:39.441008  8543 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:39.441706  8286 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:39.440940  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 508) took 2557 ms. Trace:
I20260620 13:56:39.443501  5952 rpcz_store.cc:276] 0620 13:56:34.814550 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.387429 (+4572879us) service_pool.cc:224] Handling call
0620 13:56:39.387831 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:39.416840 (+ 29009us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.420089 (+  3249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:39.444489  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1389) took 4435 ms. Trace:
I20260620 13:56:39.455767  5956 rpcz_store.cc:276] 0620 13:56:35.008655 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.314338 (+4305683us) service_pool.cc:224] Handling call
0620 13:56:39.398091 (+ 83753us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:39.444047 (+ 45956us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:39.444094 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:39.444146 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:56:39.444188 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.444276 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:39.444423 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:39.423815  8547 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.432284  8423 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:39.457034  8312 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:39.454912  5957 rpcz_store.cc:276] 0620 13:56:36.883974 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.421671 (+2537697us) service_pool.cc:224] Handling call
0620 13:56:39.431502 (+  9831us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:39.440568 (+  9066us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:39.440598 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:39.440666 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:39.440701 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.440756 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:39.440884 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:39.462754  6030 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:39.435863  8532 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.473227  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1375) took 4658 ms. Trace:
W20260620 13:56:39.511574  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 71853.8us
I20260620 13:56:39.468291  8393 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:39.449815  8478 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:39.636570  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 65781.4us
I20260620 13:56:39.449563  8326 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:39.481457  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:39.641016  5951 rpcz_store.cc:276] 0620 13:56:34.814307 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:38.855746 (+4041439us) service_pool.cc:224] Handling call
0620 13:56:38.896673 (+ 40927us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:39.037130 (+140457us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:39.037168 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:39.235556 (+198388us) log.cc:844] Serialized 26 byte log entry
0620 13:56:39.389482 (+153926us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:39.389508 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.389556 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:39.472946 (+ 83390us) raft_consensus.cc:1685] finished
0620 13:56:39.472975 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:39.473156 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13004,"raft.queue_time_us":18451,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":19389,"thread_start_us":48824,"threads_started":1,"wal-append.queue_time_us":150330}
W20260620 13:56:39.651749  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 216934us
W20260620 13:56:39.571489  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 534846us
I20260620 13:56:39.481490  8549 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:39.460891  8286 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:39.468483  8483 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:39.689803  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:39.472785  8522 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:39.472707  8290 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:39.682973  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 283851us
I20260620 13:56:39.471217  8507 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:39.479177  8258 raft_consensus.cc:3055] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Stepping down as leader of term 4
W20260620 13:56:39.471518  5950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1395) took 2491 ms (client timeout 2073 ms). Trace:
I20260620 13:56:39.468780  8500 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:39.645112  8539 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:39.637883  8551 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:39.696497  6032 raft_consensus.cc:2410] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260620 13:56:39.654699  8428 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:39.703007  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1382) took 4835 ms. Trace:
I20260620 13:56:39.699772  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 510) took 2810 ms. Trace:
I20260620 13:56:39.687971  8286 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:39.697690  8258 raft_consensus.cc:740] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:39.705186  7927 raft_consensus.cc:3055] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:39.705756  7927 raft_consensus.cc:740] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:39.706187  8536 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:39.707126  7927 consensus_queue.cc:260] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:39.708586  7927 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:39.709018  8471 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:39.709671  8471 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:39.711092  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:39.711884  8364 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:39.713670  6552 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:39.715446  8125 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:39.716087  8125 raft_consensus.cc:697] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:39.717252  8125 consensus_queue.cc:237] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.703970  5959 rpcz_store.cc:276] 0620 13:56:34.864297 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.302380 (+4438083us) service_pool.cc:224] Handling call
0620 13:56:39.374112 (+ 71732us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:39.382336 (+  8224us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:39.430951 (+ 48615us) log.cc:844] Serialized 14 byte log entry
0620 13:56:39.695184 (+264233us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:39.695281 (+    97us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:39.698911 (+  3630us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.699009 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:39.699197 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40284,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":10508,"thread_start_us":286778,"threads_started":2}
I20260620 13:56:39.703233  8507 raft_consensus.cc:697] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:39.721654  8507 consensus_queue.cc:237] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.696110  8312 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:39.727466  8483 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:39.704079  5952 rpcz_store.cc:276] 0620 13:56:36.885134 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.472618 (+2587484us) service_pool.cc:224] Handling call
0620 13:56:39.655588 (+182970us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:39.695414 (+ 39826us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:39.695457 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:39.695518 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:39.695566 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.695644 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:39.695788 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260620 13:56:39.738451  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 360223us
I20260620 13:56:39.737183  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:39.721679  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 511) took 2836 ms. Trace:
I20260620 13:56:39.738173  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:39.744047  5959 rpcz_store.cc:276] 0620 13:56:36.885937 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.720235 (+2834298us) service_pool.cc:224] Handling call
0620 13:56:39.720964 (+   729us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:39.721241 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:39.721279 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:39.721355 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:39.721396 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.721469 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:39.721616 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:39.700423  8547 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:39.635424  8557 consensus_queue.cc:1059] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.178s
W20260620 13:56:39.750066  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 49735.4us
I20260620 13:56:39.700836  8500 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:39.754082  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:39.752933  5848 connection.cc:256] RPC call timeout handler was delayed by -1.0523432389999243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
W20260620 13:56:39.757483  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:39.695518  8405 consensus_queue.cc:1059] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.105s
I20260620 13:56:39.760319  8419 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:39.760987  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1393) took 2781 ms. Trace:
I20260620 13:56:39.763203  8483 raft_consensus.cc:697] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:39.741611  8549 raft_consensus.cc:697] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:39.771034  8483 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:39.763234  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:39.765545  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 71302.9us
I20260620 13:56:39.742090  8464 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:39.733907  8516 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.768112  5952 rpcz_store.cc:276] 0620 13:56:36.979124 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.739047 (+2759923us) service_pool.cc:224] Handling call
0620 13:56:39.760439 (+ 21392us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:39.760669 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:39.760695 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:39.760733 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:39.760759 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.760809 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:39.760935 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:39.700104  8530 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:39.775781  8284 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:39.701980  5951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "663684cf4ae54c929bf8240ca0b63a47"
 from {username='slave'} at 127.0.0.1:53076
W20260620 13:56:39.784009  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 302721us
I20260620 13:56:39.755991  8500 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:39.784503  5951 raft_consensus.cc:606] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Received request to transfer leadership to TS 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:39.778928  8405 raft_consensus.cc:3055] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:39.785048  5951 raft_consensus.cc:614] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260620 13:56:39.700951  5950 rpcz_store.cc:269] 0620 13:56:36.979603 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:38.696275 (+1716672us) service_pool.cc:224] Handling call
0620 13:56:39.471253 (+774978us) spinlock_profiling.cc:243] Waited 98.9 ms on lock 0x7b5400044054. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:39.471419 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227365248}
I20260620 13:56:39.785466  8284 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:39.691387  8326 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.795475  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:39.803923  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 103341us
I20260620 13:56:39.764196  8428 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.773043  8543 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.787602  8405 raft_consensus.cc:740] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:39.795475  8284 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:39.803037  8399 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:39.808542  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 516) took 2616 ms. Trace:
I20260620 13:56:39.814924  5959 rpcz_store.cc:276] 0620 13:56:37.191802 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.745599 (+2553797us) service_pool.cc:224] Handling call
0620 13:56:39.792498 (+ 46899us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:39.807968 (+ 15470us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:39.808076 (+   108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:39.808149 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:39.808206 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.808292 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:39.808464 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:39.824932  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 509) took 2940 ms. Trace:
I20260620 13:56:39.802947  8312 consensus_queue.cc:1059] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260620 13:56:39.825380  5953 rpcz_store.cc:276] 0620 13:56:36.884208 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.528709 (+2644501us) service_pool.cc:224] Handling call
0620 13:56:39.636371 (+107662us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:39.731776 (+ 95405us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:39.732280 (+   504us) log.cc:844] Serialized 14 byte log entry
0620 13:56:39.824592 (+ 92312us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:39.824652 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:39.824685 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.824738 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:39.824833 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":239,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"thread_start_us":86395,"threads_started":1}
I20260620 13:56:39.843214  8556 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:39.844067  8556 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:39.815282  8399 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:39.771710  8549 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:39.844671  8556 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:39.859181  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:39.863639  5883 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260620 13:56:39.872166  8423 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.874032  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:39.874688  8428 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:39.875141  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:39.875463  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:39.876659  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:39.876986  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:39.877385  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:39.877604  6585 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
W20260620 13:56:39.878063  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:39.878720  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:39.881062  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:39.882550  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:39.882840  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:39.849299  8399 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:39.884197  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:39.883949  8304 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.884876  6033 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:39.885929  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:39.886622  8304 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:39.887358  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:39.888878  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:39.889532  6029 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:39.889820  5953 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:39.891762  8405 consensus_queue.cc:260] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.892942  8532 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:39.894516  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:39.895920  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:39.897805  8364 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:39.898218  8364 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:39.898249  8481 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:39.898734  8364 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:39.898829  8481 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:39.899367  8481 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:39.901471  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:39.903561  5998 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:39.903723  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:39.905057  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:39.906445  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:39.906608  8516 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:39.908329  8410 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:39.908535  8530 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:39.876677  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:39.910733  6581 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:56:39.905121  7927 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:39.910547  8557 consensus_queue.cc:1059] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:56:39.902798  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:39.915150  5957 raft_consensus.cc:2410] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260620 13:56:39.916275  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:39.930611  5958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1391) took 2952 ms (client timeout 1990 ms). Trace:
I20260620 13:56:39.930681  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:39.931437  5958 rpcz_store.cc:269] 0620 13:56:36.978559 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:37.316603 (+338044us) service_pool.cc:224] Handling call
0620 13:56:39.919602 (+2602999us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b5400262ad4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:39.930508 (+ 10906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888678784}
I20260620 13:56:39.936163  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:39.914645  7927 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:39.940289  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:39.942390  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:39.939837  6032 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:39.947961  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:39.959376  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:39.959619  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:39.959436  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:39.967396  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:39.968124  6028 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:39.968554  8556 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:39.971661  8473 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:39.944804  7927 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:39.980748  5951 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:39.981834  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:39.982961  8091 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:39.983485  8091 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:39.983292  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:39.995487  8473 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:39.953059  8557 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:39.996268  8473 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:39.997145  8295 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:39.990388  5849 connection.cc:256] RPC call timeout handler was delayed by -1.526704885000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260620 13:56:40.008188  5849 connection.cc:256] RPC call timeout handler was delayed by -1.4520048850000649s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260620 13:56:40.009207  5849 connection.cc:256] RPC call timeout handler was delayed by -1.4520048850000649s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260620 13:56:40.009577  5849 connection.cc:256] RPC call timeout handler was delayed by -1.2108048850000159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260620 13:56:40.010604  5849 connection.cc:256] RPC call timeout handler was delayed by -1.0995676689999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260620 13:56:40.011003  5849 connection.cc:256] RPC call timeout handler was delayed by -1.0884048850000454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
I20260620 13:56:40.011324  5958 raft_consensus.cc:2410] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 7 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260620 13:56:40.000687  8530 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:40.012869  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 96643.6us
W20260620 13:56:40.006772  6582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46858 (request call id 691) took 1331 ms (client timeout 1685 ms). Trace:
W20260620 13:56:40.011359  5849 connection.cc:256] RPC call timeout handler was delayed by -1.0884048850000454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
I20260620 13:56:40.014420  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 522) took 1129 ms. Trace:
W20260620 13:56:40.014693  5849 connection.cc:256] RPC call timeout handler was delayed by -1.016302425000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260620 13:56:40.013743  6582 rpcz_store.cc:269] 0620 13:56:38.675555 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:38.676853 (+  1298us) service_pool.cc:224] Handling call
0620 13:56:40.006342 (+1329489us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54005af0d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:40.006568 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1621908864}
I20260620 13:56:40.015360  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.037709  5951 raft_consensus.cc:2393] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 5: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:40.038450  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.038637  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.039127  5958 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:40.014794  5959 rpcz_store.cc:276] 0620 13:56:38.884743 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.824409 (+939666us) service_pool.cc:224] Handling call
0620 13:56:39.852620 (+ 28211us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:39.908668 (+ 56048us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:39.909445 (+   777us) log.cc:844] Serialized 14 byte log entry
0620 13:56:40.014078 (+104633us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:40.014134 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:40.014188 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:40.014250 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:40.014368 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":248,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":106,"thread_start_us":104214,"threads_started":1}
W20260620 13:56:40.040653  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:40.011188  8533 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:39.964371  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 520) took 2771 ms. Trace:
I20260620 13:56:40.045562  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:40.043205  5997 connection.cc:256] RPC call timeout handler was delayed by -1.3038679679999632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
I20260620 13:56:40.000316  8313 raft_consensus.cc:3055] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Stepping down as leader of term 4
W20260620 13:56:40.048058  5997 connection.cc:256] RPC call timeout handler was delayed by -1.144567967999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
I20260620 13:56:40.015738  6579 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:56:40.004117  8326 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:39.999053  8473 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:40.001802  8534 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:40.051421  5997 connection.cc:256] RPC call timeout handler was delayed by -1.0698679680000396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
I20260620 13:56:40.051965  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.052307  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.026152  8531 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:40.012576  6024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2309) took 2976 ms (client timeout 2079 ms). Trace:
I20260620 13:56:40.054278  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:40.038668  8464 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:40.055917  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:56:40.058012  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:40.012485  8530 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.059237  5959 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:40.062369  5958 raft_consensus.cc:2393] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:40.069913  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.059362  8556 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:40.051293  8313 raft_consensus.cc:740] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:40.073751  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.064479  8420 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:40.081384  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.045054  8091 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.085403  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.090205  5951 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 6
I20260620 13:56:40.054759  8500 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.081472  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1390) took 5072 ms. Trace:
I20260620 13:56:40.096263  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:40.094350  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:40.097151  6029 raft_consensus.cc:2410] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260620 13:56:40.084856  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.100067  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:40.099265  5959 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260620 13:56:40.108134  8553 log.cc:927] Time spent T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.704s	user 0.004s	sys 0.013s
I20260620 13:56:40.108285  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:40.108475  8481 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.109068  6025 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:56:40.109477  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 67756.8us
I20260620 13:56:40.110314  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:40.072839  8364 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.116897  8478 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:40.118086  8364 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:40.119421  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.076999  8534 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.120296  8284 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.122221  8534 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:40.122565  8284 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:40.082844  8464 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.123066  8313 consensus_queue.cc:260] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:40.124532  8313 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:40.125252  8464 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:40.127012  8500 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:40.128903  8530 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:40.110718  8481 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:40.095325  5955 rpcz_store.cc:276] 0620 13:56:35.008964 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.379404 (+4370440us) service_pool.cc:224] Handling call
0620 13:56:39.387765 (+  8361us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:39.570316 (+182551us) raft_consensus.cc:1534] Early marking committed up to index 2
0620 13:56:39.654977 (+ 84661us) log.cc:844] Serialized 14 byte log entry
0620 13:56:39.801523 (+146546us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:39.801589 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0620 13:56:39.801639 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:40.081254 (+279615us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b540007a3d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:40.081297 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:40.081419 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4473,"prepare.queue_time_us":82490,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":95,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":6790,"spinlock_wait_cycles":319520512,"thread_start_us":76120,"threads_started":1,"wal-append.queue_time_us":217584}
I20260620 13:56:40.130508  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.131731  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.132727  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.133067  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.133220  5955 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:40.134136  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.134744  5956 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:40.135423  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 519) took 2942 ms. Trace:
I20260620 13:56:40.135851  5952 rpcz_store.cc:276] 0620 13:56:37.192589 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.785663 (+2593074us) service_pool.cc:224] Handling call
0620 13:56:39.806045 (+ 20382us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:39.812635 (+  6590us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:39.812669 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:39.851331 (+ 38662us) log.cc:844] Serialized 26 byte log entry
0620 13:56:39.950099 (+ 98768us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:56:39.950145 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.950318 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:40.135167 (+184849us) raft_consensus.cc:1685] finished
0620 13:56:40.135192 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:40.135351 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1542,"raft.queue_time_us":1676,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":16273,"thread_start_us":54650,"threads_started":1,"wal-append.queue_time_us":184523}
I20260620 13:56:40.137832  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.138588  5952 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:40.140599  8422 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:40.141449  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.110790  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.147081  5955 raft_consensus.cc:2393] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:56:40.147547  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:40.118297  5958 raft_consensus.cc:2410] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260620 13:56:40.150007  5951 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:40.151366  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.151494  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.152997  8478 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:40.153577  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.154822  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.152047  5955 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:40.152359  5953 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260620 13:56:40.155792  5953 pending_rounds.cc:85] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 5
I20260620 13:56:40.156059  5953 pending_rounds.cc:107] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260620 13:56:40.164690  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:40.165778  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:40.062057  6024 rpcz_store.cc:269] 0620 13:56:37.036470 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:37.066114 (+ 29644us) service_pool.cc:224] Handling call
0620 13:56:40.012250 (+2946136us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54000b72d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:40.012455 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3741438336}
I20260620 13:56:40.169250  5959 raft_consensus.cc:2393] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:40.162911  5953 raft_consensus.cc:2889] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:40.178249  8376 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:40.178719  8258 consensus_queue.cc:260] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:40.182363  5875 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260620 13:56:40.184147  5958 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:40.185426  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:40.187404  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.188297  5956 raft_consensus.cc:2393] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:40.191298  8423 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:40.192710  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:40.193212  6552 connection.cc:256] RPC call timeout handler was delayed by -1.9934727119999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260620 13:56:40.193610  6552 connection.cc:256] RPC call timeout handler was delayed by -1.9538727120000203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
I20260620 13:56:40.193847  8543 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:40.165582  8399 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:40.197871  5957 raft_consensus.cc:2393] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:56:40.194016  6552 connection.cc:256] RPC call timeout handler was delayed by -1.731572712000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260620 13:56:40.201005  6552 connection.cc:256] RPC call timeout handler was delayed by -1.7216727119999859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
W20260620 13:56:40.201398  6552 connection.cc:256] RPC call timeout handler was delayed by -1.6640727120000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
I20260620 13:56:40.202958  5884 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:56:40.151087  8397 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:40.204669  6029 raft_consensus.cc:2393] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 5: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:56:40.209117  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 98892.5us
I20260620 13:56:40.213399  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:40.200440  8091 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:40.048357  5950 rpcz_store.cc:276] 0620 13:56:37.192840 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:39.803738 (+2610898us) service_pool.cc:224] Handling call
0620 13:56:39.834703 (+ 30965us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:39.834976 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:39.837228 (+  2252us) log.cc:844] Serialized 14 byte log entry
0620 13:56:39.929771 (+ 92543us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:39.939664 (+  9893us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:39.943696 (+  4032us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:39.950935 (+  7239us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:39.959774 (+  8839us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4115,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":4844,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":9321,"thread_start_us":74524,"threads_started":1,"wal-append.queue_time_us":215533}
W20260620 13:56:40.215662  8574 log.cc:927] Time spent T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260620 13:56:40.222750  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.225962  8478 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:40.172683  8420 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:40.228680  8399 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:40.220854  5955 raft_consensus.cc:1240] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:40.228708  5881 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:40.253734  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.231895  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:40.160334  8517 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:40.233712  5849 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:40.233855  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 135826us
I20260620 13:56:40.242328  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:40.116950  8471 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.250361  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.250500  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.230021  8405 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:40.263584  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:40.264734  6582 raft_consensus.cc:2410] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260620 13:56:40.265460  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:40.269286  6581 raft_consensus.cc:2393] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:40.270525  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:40.248687  8478 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:40.271297  5957 raft_consensus.cc:2393] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:40.271350  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:40.274041  5952 raft_consensus.cc:2393] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:56:40.274139  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 44275.6us
I20260620 13:56:40.275393  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.276939  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.277340  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:40.279944  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.280121  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:40.242900  7927 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:40.283767  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:40.273139  8517 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.276746  8478 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:40.296222  8530 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:40.294963  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:40.297274  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.300235  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:40.303632  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.281663  8464 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:40.307184  6581 raft_consensus.cc:2393] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:56:40.314968  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:40.317955  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:40.319197  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:40.301391  8379 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:40.322389  8386 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:40.323536  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.324434  5955 raft_consensus.cc:2410] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260620 13:56:40.325476  8464 raft_consensus.cc:697] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:40.325626  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:40.326328  6579 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:56:40.326581  8464 consensus_queue.cc:237] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:40.327252  8419 consensus_meta.cc:287] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.006s
W20260620 13:56:40.327834  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:40.328372  8484 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:40.328855  8484 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:40.329535  8471 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:40.330204  8286 consensus_meta.cc:287] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.578s	user 0.006s	sys 0.004s
I20260620 13:56:40.304713  8530 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:40.331429  8530 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:40.322984  8386 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:40.332928  5954 raft_consensus.cc:2410] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260620 13:56:40.330648  8286 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.334940  8286 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:40.335412  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 99891.9us
I20260620 13:56:40.336351  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:40.336589  5997 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:40.339498  6585 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 1. Current term is 2. Ops: []
I20260620 13:56:40.341777  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:40.343214  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:40.343930  8559 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:40.344365  8559 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:40.344683  8559 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:40.351909  5881 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:40.347208  5882 raft_consensus.cc:2393] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 5: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:40.337960  8533 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:40.357566  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:40.358453  5951 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:40.345672  8549 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:40.360309  8549 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:40.360687  8549 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:40.347271  8579 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260620 13:56:40.318954  5950 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:40.367900  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:40.348925  8326 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260620 13:56:40.357860  8533 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:40.384395  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:40.347121  8517 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:40.409957  6581 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:40.378630  5997 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:40.363386  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 79703.3us
I20260620 13:56:40.348415  7927 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:40.420676  8313 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:40.421173  8313 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:40.421550  8313 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:40.370507  8286 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260620 13:56:40.425802  5997 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:40.426584  8560 raft_consensus.cc:3055] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:40.427170  8560 raft_consensus.cc:740] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:56:40.427350  5954 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1394) took 3448 ms (client timeout 1813 ms). Trace:
W20260620 13:56:40.427747  5954 rpcz_store.cc:269] 0620 13:56:36.979364 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:37.139416 (+160052us) service_pool.cc:224] Handling call
0620 13:56:40.419023 (+3279607us) spinlock_profiling.cc:243] Waited 3.19 s on lock 0x7b54001815d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:40.427279 (+  8256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7341250816}
I20260620 13:56:40.428085  8560 consensus_queue.cc:260] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:40.429337  8560 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:40.430652  8556 consensus_queue.cc:1059] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:56:40.431703  8556 raft_consensus.cc:3055] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:40.432078  8556 raft_consensus.cc:740] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:40.433768  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:40.426674  8557 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:40.435462  8557 raft_consensus.cc:697] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:40.435776  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.436493  8557 consensus_queue.cc:237] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:40.437132  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.433835  8484 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:40.411747  8533 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:40.439158  8556 consensus_queue.cc:260] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:40.440491  8556 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:40.440658  8386 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:40.443425  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.445436  5951 raft_consensus.cc:2410] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260620 13:56:40.401698  8284 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:40.446053  8484 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:40.446463  8284 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.449115  8284 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:40.446964  8258 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:40.450490  5776 catalog_manager.cc:5696] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 3 to 4, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 4 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:40.452342  5776 catalog_manager.cc:5696] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 3 to 4, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 4 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:56:40.458737  5779 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56610 (request call id 349) took 12245 ms (client timeout 15000 ms). Trace:
I20260620 13:56:40.459424  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.459954  6026 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:40.478257  8255 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:40.481170  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:40.478868  8255 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.356393  8471 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260620 13:56:40.486577  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:40.487390  6030 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:56:40.487478  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 150083us
I20260620 13:56:40.491364  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:40.491710  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:40.492151  5882 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:40.492506  6024 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:40.493672  8559 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.495095  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:40.498052  5876 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:40.499640  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.500495  6029 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:40.501135  8559 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:40.498230  8478 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.507593  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:40.508433  6585 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:40.509364  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.510125  5881 raft_consensus.cc:2393] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:40.511480  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:40.511719  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.512934  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.513276  8478 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:40.513993  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.573757  5883 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
W20260620 13:56:40.566749  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:40.576226  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:40.580468  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 69122.7us
I20260620 13:56:40.575493  5998 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:40.583287  8255 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:40.472102  8530 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.576066  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:40.514679  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:40.586618  5877 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:40.544490  5882 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:40.556507  8471 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:40.610666  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:40.612744  6581 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:40.611613  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.615483  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:40.617648  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:40.618279  6028 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:40.620083  5883 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:56:40.620609  6551 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:40.629289  6585 raft_consensus.cc:2393] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:40.631309  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:40.482066  8533 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.593380  8420 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:40.632858  5878 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 5: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:40.634158  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.636579  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.632218  6025 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:40.637324  6032 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:40.641407  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.642309  5953 raft_consensus.cc:2410] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260620 13:56:40.643242  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:40.643905  6579 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:40.653791  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:40.654750  5951 raft_consensus.cc:2410] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260620 13:56:40.656112  6552 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:40.659559  6029 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:56:40.660637  8530 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:40.461889  5779 rpcz_store.cc:269] 0620 13:56:28.213931 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:28.214246 (+   315us) service_pool.cc:224] Handling call
0620 13:56:28.463668 (+249422us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540002b7d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf766470 00007f0fdf80531a 00007f0fe55baaac 00007f0fe56b90ae 00007f0fe3b7e4a4 00007f0fe3b7e432 00007f0fe3b7e361 00007f0fe3b7e2dc 00007f0fe3b7d592 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:40.458521 (+11994853us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:56:30.513655 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:56:30.679279 (+165624us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:56:30.687705 (+  8426us) write_op.cc:435] Acquired schema lock
0620 13:56:30.695938 (+  8233us) tablet.cc:662] Decoding operations
0620 13:56:30.736000 (+ 40062us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:56:30.736062 (+    62us) write_op.cc:641] Partition lock acquired for write op
0620 13:56:30.736089 (+    27us) tablet.cc:685] Acquiring locks for 11 operations
0620 13:56:30.736990 (+   901us) tablet.cc:701] Row locks acquired
0620 13:56:30.737005 (+    15us) write_op.cc:260] PREPARE: finished
0620 13:56:30.737150 (+   145us) write_op.cc:270] Start()
0620 13:56:30.737264 (+   114us) write_op.cc:276] Timestamp: P: 1781963790737103 usec, L: 0
0620 13:56:30.737282 (+    18us) op_driver.cc:348] REPLICATION: starting
0620 13:56:30.737930 (+   648us) log.cc:844] Serialized 4392 byte log entry
0620 13:56:31.005464 (+267534us) op_driver.cc:464] REPLICATION: finished
0620 13:56:31.496607 (+491143us) write_op.cc:301] APPLY: starting
0620 13:56:31.518599 (+ 21992us) tablet.cc:1367] starting BulkCheckPresence
0620 13:56:31.619434 (+100835us) tablet.cc:1370] finished BulkCheckPresence
0620 13:56:31.632772 (+ 13338us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:56:31.634386 (+  1614us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:56:31.634755 (+   369us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0620 13:56:31.634818 (+    63us) write_op.cc:312] APPLY: finished
0620 13:56:31.668640 (+ 33822us) log.cc:844] Serialized 83 byte log entry
0620 13:56:31.681261 (+ 12621us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:31.700935 (+ 19674us) write_op.cc:454] Released schema lock
0620 13:56:31.709041 (+  8106us) write_op.cc:341] FINISH: Updating metrics
0620 13:56:31.752657 (+ 43616us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:31.755634 (+  2977us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21110,"reported_tablets":24,"spinlock_wait_cycles":253058816,"child_traces":[["op",{"apply.queue_time_us":461686,"apply.run_cpu_time_us":4848,"apply.run_wall_time_us":251443,"num_ops":11,"prepare.queue_time_us":297046,"prepare.run_cpu_time_us":7786,"prepare.run_wall_time_us":388592,"raft.queue_time_us":150093,"raft.run_cpu_time_us":34622,"raft.run_wall_time_us":315013,"replication_time_us":268037,"spinlock_wait_cycles":29056,"thread_start_us":677116,"threads_started":4,"wal-append.queue_time_us":114146,"wal-append.run_cpu_time_us":8957,"wal-append.run_wall_time_us":1890793}]]}
I20260620 13:56:40.668960  8293 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 13:56:40.671902  8588 log.cc:927] Time spent T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260620 13:56:40.681363  6026 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
W20260620 13:56:40.682462  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 56030.1us
I20260620 13:56:40.690968  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.690688  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:40.690845  8557 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260620 13:56:40.694893  5954 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:40.697904  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.698779  5877 raft_consensus.cc:2410] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260620 13:56:40.706646  5954 raft_consensus.cc:2410] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260620 13:56:40.711643  6024 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
W20260620 13:56:40.719605  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:40.722105  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.723599  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.724524  6033 raft_consensus.cc:2393] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:40.634521  8326 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:40.730423  8326 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:40.730824  8326 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:40.735534  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.736258  5879 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:40.737990  8533 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:40.738636  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:40.740200  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.741096  6030 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 8: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:40.747459  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.750524  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.750976  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.751938  5875 raft_consensus.cc:1275] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260620 13:56:40.751957  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.753968  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.755928  5880 raft_consensus.cc:2393] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:40.756048  5876 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:40.759043  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.759754  5950 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 2.
I20260620 13:56:40.759240  5954 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260620 13:56:40.760910  5954 pending_rounds.cc:85] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 5
I20260620 13:56:40.761165  5954 pending_rounds.cc:107] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260620 13:56:40.761399  5954 raft_consensus.cc:2889] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:40.762058  8549 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.762693  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.772891  5877 raft_consensus.cc:2410] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260620 13:56:40.763800  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.775484  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.780112  8313 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:40.784492  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:40.785571  6026 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 5: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:40.786490  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.806201  8471 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:40.766108  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:40.766950  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:40.847234  5951 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:40.812837  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.813999  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.814406  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.816017  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:40.852732  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:40.816092  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.819590  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:40.765208  8549 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:40.823282  8312 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:40.852346  5848 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.566s (SENT)
I20260620 13:56:40.824626  8556 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:40.868999  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:40.823714  5998 connection.cc:256] RPC call timeout handler was delayed by -1.9340956789999382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
I20260620 13:56:40.829916  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:40.869729  5998 connection.cc:256] RPC call timeout handler was delayed by -1.8839967640000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1685s for a response
I20260620 13:56:40.831239  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.831825  6027 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:40.832798  5880 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:40.833496  8313 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:40.835283  5883 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260620 13:56:40.874858  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.848517  6028 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:40.854483  6031 raft_consensus.cc:2368] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6.
I20260620 13:56:40.856235  6025 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:40.867682  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.860940  5848 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:40.869118  6032 raft_consensus.cc:2393] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:40.827643  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.870029  5882 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:40.798710  6579 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:40.771734  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:40.880323  5881 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 5: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:40.855525  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:40.881769  5878 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:56:40.884883  5877 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:40.875893  5884 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:40.879292  5879 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:40.896191  5998 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:40.897511  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:40.900640  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:40.897619  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 53859.1us
I20260620 13:56:40.902997  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:40.904012  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51262.6us
I20260620 13:56:40.904105  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:40.904700  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:40.852241  8557 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:40.908938  5875 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
W20260620 13:56:40.910497  5848 leader_election.cc:336] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.567s (SENT)
I20260620 13:56:40.911154  6026 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:40.912058  8530 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:40.912431  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:40.924304  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:40.913187  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:40.921689  5924 connection.cc:256] RPC call timeout handler was delayed by -1.9434986259999505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
I20260620 13:56:40.922521  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.922537  5997 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:40.932119  6032 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:40.932994  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:40.905388  8471 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:40.868883  6024 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
W20260620 13:56:40.938504  5924 connection.cc:256] RPC call timeout handler was delayed by -1.8066986259999567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
I20260620 13:56:40.935873  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:40.940136  5924 connection.cc:256] RPC call timeout handler was delayed by -1.7823986260000311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1685s for a response
W20260620 13:56:40.940533  5924 connection.cc:256] RPC call timeout handler was delayed by -1.7823986260000311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1685s for a response
W20260620 13:56:40.940824  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6653986259999556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260620 13:56:40.941125  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6356986260000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260620 13:56:40.920799  6551 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:40.935293  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.941924  6027 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
W20260620 13:56:40.941437  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6356986260000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260620 13:56:40.943363  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6167986259999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260620 13:56:40.943948  5924 connection.cc:256] RPC call timeout handler was delayed by -1.5591986260000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
W20260620 13:56:40.944480  5924 connection.cc:256] RPC call timeout handler was delayed by -1.4277986260000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
W20260620 13:56:40.945665  5924 connection.cc:256] RPC call timeout handler was delayed by -1.4277986260000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
W20260620 13:56:40.946144  5924 connection.cc:256] RPC call timeout handler was delayed by -1.4160986260000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260620 13:56:40.951697  5924 connection.cc:256] RPC call timeout handler was delayed by -1.4160986260000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
I20260620 13:56:40.955250  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:40.957609  5957 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:40.914006  8560 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:40.868675  8312 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.954351  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:40.971165  5882 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
W20260620 13:56:40.974303  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 53685.9us
I20260620 13:56:40.977533  5880 raft_consensus.cc:2393] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 4: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:56:40.977891  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 55424.7us
W20260620 13:56:40.975407  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 337592us
I20260620 13:56:40.925467  8326 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.884653  8556 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:40.975543  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:40.984977  6025 raft_consensus.cc:2393] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 4: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:40.993386  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:40.995230  7891 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260620 13:56:40.952859  7927 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260620 13:56:40.996395  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 94056.3us
I20260620 13:56:41.004721  5951 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:41.009438  8326 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:41.006620  5848 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:40.962280  8560 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:41.017529  6033 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:40.928710  8557 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:41.013986  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:41.019629  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:41.023646  8530 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:41.012533  5848 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:40.974797  8543 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260620 13:56:41.004187  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:41.037845  5849 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:41.029735  5848 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:41.024833  8560 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:41.048496  6030 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:41.028578  8530 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:41.029711  8478 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:41.040817  8386 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:41.042505  8284 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:41.049224  5950 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 6
I20260620 13:56:41.055074  8530 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:41.059514  8533 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:41.082749  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:41.064270  8284 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:41.088582  8284 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:41.089346  6030 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:41.095677  8530 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:41.102524  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:41.062969  8478 raft_consensus.cc:697] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:41.116945  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:41.117980  5958 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:41.122743  5955 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260620 13:56:41.098917  8533 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:41.129983  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:41.100747  8556 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:41.098990  8312 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:41.118664  8386 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:41.133883  5997 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:41.119412  8420 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:41.130935  8533 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:41.180927  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:41.157214  8464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.028s	sys 0.020s
I20260620 13:56:41.140588  8386 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:41.183320  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 206545us
I20260620 13:56:41.183090  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:41.195996  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 219389us
I20260620 13:56:41.151335  8312 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260620 13:56:41.207964  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 257070us
I20260620 13:56:41.184027  8500 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:41.220476  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:41.220985  6028 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:41.228190  6033 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:41.159236  8556 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260620 13:56:41.206846  8464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.028s	sys 0.023s
I20260620 13:56:41.211139  8386 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:41.195513  8557 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:41.160895  8420 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:41.245882  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:41.212595  8312 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:41.244940  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 215310us
W20260620 13:56:41.257112  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 219357us
I20260620 13:56:41.259042  5849 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:41.264142  8599 log.cc:927] Time spent T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260620 13:56:41.264273  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:41.267583  5998 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:41.273280  8587 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:41.274039  8587 raft_consensus.cc:697] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:41.259423  8471 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:41.277940  8471 raft_consensus.cc:697] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:41.245882  8293 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260620 13:56:41.279507  8471 consensus_queue.cc:237] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:41.252772  8312 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:56:41.258594  8464 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260620 13:56:41.301007  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 62340.6us
I20260620 13:56:41.302228  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:41.227396  8478 consensus_queue.cc:237] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:41.300064  6551 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:41.319501  6552 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:56:41.326450  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 76162.5us
I20260620 13:56:41.327862  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:41.328645  5954 raft_consensus.cc:2393] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:41.304000  8530 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:41.334064  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:41.337317  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:41.325323  7891 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:41.340154  5848 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:41.304535  8607 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:41.339483  8125 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260620 13:56:41.345021  8125 consensus_queue.cc:1243] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer 2e82c0c231624695ac5a813230bf5038 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260620 13:56:41.313843  8602 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:41.345118  8607 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:56:41.307735  8517 consensus_queue.cc:1059] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260620 13:56:41.350543  8125 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:41.339504  7891 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:41.354063  8608 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:41.327546  8326 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:41.331185  8464 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:41.365566  5848 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:41.331039  8606 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:41.292114  8587 consensus_queue.cc:237] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:41.379727  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 59540.8us
W20260620 13:56:41.366382  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 102186us
I20260620 13:56:41.354256  8386 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:41.376595  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 77584.6us
I20260620 13:56:41.348207  8603 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:41.385413  5849 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:41.378535  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:41.342532  8379 consensus_queue.cc:1059] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260620 13:56:41.371006  7891 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:41.398380  5953 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260620 13:56:41.399966  5953 pending_rounds.cc:85] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 2
I20260620 13:56:41.400226  5953 pending_rounds.cc:107] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260620 13:56:41.400523  5953 raft_consensus.cc:2889] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:41.377889  8464 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:41.402370  5848 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:41.405206  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:41.386480  8530 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260620 13:56:41.407408  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:41.389725  8603 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:41.432525  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 54103.6us
I20260620 13:56:41.434257  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.397620  8125 raft_consensus.cc:697] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:41.443413  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.443501  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.444375  6580 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:41.445088  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.405756  8464 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:41.388094  8602 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260620 13:56:41.454945  8604 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:41.455703  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.457968  8533 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:41.459494  8612 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:41.460697  8386 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:41.414990  8530 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:41.462179  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:41.443593  8600 log.cc:927] Time spent T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260620 13:56:41.434566  8603 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:41.482647  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:41.483575  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 322554us
I20260620 13:56:41.484057  8560 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:41.442170  8293 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election won for term 5
W20260620 13:56:41.491369  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 106048us
I20260620 13:56:41.491511  8284 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:41.493719  5849 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:41.495728  8284 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:41.498252  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.499342  6584 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:41.499876  6581 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:56:41.496788  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.459488  8420 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:41.503751  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:41.508644  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:41.517735  5957 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:41.518877  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:41.519729  5953 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 7
I20260620 13:56:41.529441  5953 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:41.485037  8612 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:41.502591  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.535305  8620 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:41.536427  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.538527  6026 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:56:41.539311  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:41.487444  8530 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:56:41.543766  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 141483us
I20260620 13:56:41.544616  6586 raft_consensus.cc:2368] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7.
I20260620 13:56:41.547405  5848 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:41.544571  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:41.552544  6033 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:41.555702  6579 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260620 13:56:41.557441  8284 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:41.557884  8284 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:41.558245  8284 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:41.563081  5876 pending_rounds.cc:85] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 4
I20260620 13:56:41.563544  5876 pending_rounds.cc:107] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260620 13:56:41.563845  5876 raft_consensus.cc:2889] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:56:41.565748  8619 log.cc:927] Time spent T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260620 13:56:41.563783  7891 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:41.570379  8500 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:41.570910  6026 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:41.545434  6580 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
W20260620 13:56:41.571475  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 77830.6us
I20260620 13:56:41.510020  8312 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:41.571007  8500 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:41.574177  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:41.572413  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:41.577816  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:41.578461  5924 leader_election.cc:400] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6.
I20260620 13:56:41.580751  5924 leader_election.cc:403] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:56:41.544407  8612 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:56:41.584975  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 45854.8us
I20260620 13:56:41.585793  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:41.587621  8471 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:41.591404  8471 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:41.593937  8471 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:41.595094  5950 consensus_meta.cc:287] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.000s
I20260620 13:56:41.595575  5950 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:41.596527  8533 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:41.486145  8604 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:41.574389  8125 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:41.588610  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.580511  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:41.603076  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:41.600281  6584 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:41.608436  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.609899  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:41.572839  7891 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:41.605069  5849 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:41.598929  8604 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:41.612124  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.584344  8622 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:41.620776  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:41.617144  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:41.622015  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:41.584334  8624 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:41.623268  5998 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:41.612249  8533 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:41.588284  8293 raft_consensus.cc:697] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:41.624022  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:41.628259  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:41.628504  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.599352  8386 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6.
I20260620 13:56:41.628297  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.615038  8618 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:41.635792  8551 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:41.636977  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:41.640116  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:41.642216  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:41.641201  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:41.642174  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 94842.5us
I20260620 13:56:41.630034  8420 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:41.653462  8420 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:41.654026  8420 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:41.655181  8615 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260620 13:56:41.621726  8611 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:41.652101  6028 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:41.655685  6584 raft_consensus.cc:2368] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5.
I20260620 13:56:41.648233  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:41.641850  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.652891  5848 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:41.668654  5848 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:41.630013  8620 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:41.672209  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:41.673843  6025 raft_consensus.cc:2410] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260620 13:56:41.692310  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 66004.6us
I20260620 13:56:41.693694  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:41.681317  6581 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:41.621977  8604 consensus_queue.cc:1059] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260620 13:56:41.696858  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:41.697376  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:41.642555  8533 raft_consensus.cc:697] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:41.631676  8607 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:41.633440  8258 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:41.622151  8622 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:41.664618  8313 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:41.657255  8618 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:41.651613  8551 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:41.701486  6027 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:41.701442  6586 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:41.697629  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:41.660197  8624 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:41.673172  8591 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:41.652868  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:41.708674  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.710426  5998 leader_election.cc:400] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5.
I20260620 13:56:41.663931  8611 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:41.712692  5952 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:41.704032  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:41.718371  5998 leader_election.cc:403] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260620 13:56:41.690639  8386 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260620 13:56:41.723090  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:41.724793  6584 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:41.712916  8618 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:41.719733  8293 consensus_queue.cc:237] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:41.713814  8551 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:41.709270  8622 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:41.734480  8632 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:41.706689  8464 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:41.725528  8560 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:41.722209  8611 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:41.797019  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 128460us
I20260620 13:56:41.715060  8313 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:41.766904  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:41.803184  5848 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:41.722447  8478 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:41.846496  6552 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:41.735275  8629 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260620 13:56:41.853199  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 142998us
I20260620 13:56:41.797019  6024 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:41.725514  8624 raft_consensus.cc:697] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:41.739668  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:41.797793  8633 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:41.854979  5952 raft_consensus.cc:2368] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6.
I20260620 13:56:41.865667  5883 raft_consensus.cc:1240] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 3. Current term is 5. Ops: []
I20260620 13:56:41.728088  8604 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5.
I20260620 13:56:41.856319  8533 consensus_queue.cc:237] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:41.873274  8624 consensus_queue.cc:237] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:41.875924  5875 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:56:41.876151  8612 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:41.875836  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:41.877473  5877 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:41.878481  6579 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:41.742376  8500 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:41.879556  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:41.880362  8312 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:41.880743  8500 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:41.881165  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:41.881881  8627 log.cc:927] Time spent T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260620 13:56:41.881929  5878 raft_consensus.cc:2368] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6.
I20260620 13:56:41.883175  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:41.883716  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:41.884438  5876 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:41.885752  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:41.886341  5883 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:41.887897  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:41.927645  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:41.927857  5875 raft_consensus.cc:1240] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 6. Ops: []
I20260620 13:56:41.850521  8386 consensus_queue.cc:1048] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260620 13:56:41.928915  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:41.929642  5877 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:41.930927  5956 raft_consensus.cc:1240] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:41.869696  8633 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:41.931424  8633 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:41.932454  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:41.932785  5953 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:41.931416  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:41.933764  5958 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:41.936442  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 48643.9us
I20260620 13:56:41.937846  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:41.940328  5884 raft_consensus.cc:2393] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:41.939895  6552 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:41.940869  5952 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:41.937528  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:41.944844  5959 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 9
W20260620 13:56:41.949932  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 146881us
I20260620 13:56:41.880785  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:41.895730  8632 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:41.927250  8255 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:41.932209  8500 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:41.856622  8478 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:41.959470  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:41.953172  5848 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:41.965087  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:41.937397  8464 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:41.968959  5877 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 5: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:41.971913  6552 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:41.972944  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 277426us
I20260620 13:56:41.974128  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:41.975818  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:41.978286  5958 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:56:41.981191  8423 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260620 13:56:41.981767  8628 log.cc:927] Time spent T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260620 13:56:41.969990  8379 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:41.966491  6579 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:41.995262  5880 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260620 13:56:41.984102  8517 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:42.002022  5848 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:42.003368  8636 log.cc:927] Time spent T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
W20260620 13:56:42.003998  8634 log.cc:927] Time spent T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260620 13:56:42.008167  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:42.009027  5880 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:42.011942  8622 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.011883  8530 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.029908  6586 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:42.014597  8612 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:42.013080  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:42.035861  5884 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260620 13:56:42.036888  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:42.040566  6586 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:56:42.010936  8420 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.038506  5880 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260620 13:56:42.044924  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:42.048857  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:42.046068  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:42.052390  5884 raft_consensus.cc:2393] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 5: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:42.053617  6584 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:42.052587  5848 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:42.053689  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 81819.8us
I20260620 13:56:42.055774  6584 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:42.051252  5882 raft_consensus.cc:1240] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260620 13:56:42.064079  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:42.065836  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:42.039085  8612 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:42.066875  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:42.067814  8635 log.cc:927] Time spent T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260620 13:56:42.082297  6586 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:42.033946  8622 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:42.082034  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:42.085743  6033 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:42.054312  6579 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:56:42.051194  8646 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260620 13:56:42.083253  8606 consensus_meta.cc:287] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.682s	user 0.007s	sys 0.004s
I20260620 13:56:42.095839  8258 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:56:42.099862  8284 consensus_meta.cc:287] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.000s
I20260620 13:56:42.054114  8464 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:42.061566  8607 raft_consensus.cc:697] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:42.124945  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:42.107013  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 65232.5us
I20260620 13:56:42.082990  8379 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:42.053787  8638 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:42.127332  5848 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:42.126284  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:42.089978  8620 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:42.093855  8612 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:42.129827  6584 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:42.129868  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:42.103400  8646 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:42.104221  8293 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:42.132937  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:42.131641  5998 leader_election.cc:400] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6.
I20260620 13:56:42.134524  6033 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:42.136593  5998 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:42.111125  8606 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:42.134805  8614 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:42.140767  8642 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:42.141480  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:42.140781  8647 consensus_queue.cc:1059] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260620 13:56:42.143498  8607 consensus_queue.cc:237] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:42.146275  8604 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:42.146732  8604 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:42.135075  8646 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:42.147142  8604 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:42.147909  8551 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.150107  8551 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:42.149055  6029 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:42.128141  8284 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:42.152844  8284 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:42.139477  8464 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:42.157078  8647 raft_consensus.cc:3055] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Stepping down as leader of term 5
W20260620 13:56:42.157438  8603 consensus_meta.cc:287] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.654s	user 0.007s	sys 0.001s
I20260620 13:56:42.157527  8647 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:42.157943  8603 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.125167  8258 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.159485  8620 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.161180  8258 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:42.135608  8293 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:42.163050  5881 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:42.165904  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:42.162560  8293 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:42.173884  6587 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:42.173480  5959 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:56:42.174430  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:42.176334  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 200607us
I20260620 13:56:42.177145  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:42.162556  8478 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:42.158664  8647 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.185519  8647 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:42.130934  8644 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260620 13:56:42.186724  8644 raft_consensus.cc:3055] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:42.187052  8644 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:42.187623  8420 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:42.190296  8642 consensus_queue.cc:1059] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:56:42.191219  8642 raft_consensus.cc:3055] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:42.191573  8642 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:42.192049  8611 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:42.193042  8642 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.188134  8644 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.196012  8644 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:42.198794  6579 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:56:42.188160  8643 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:42.199743  8643 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:42.200214  6579 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260620 13:56:42.204165  8258 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:42.204803  8549 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:56:42.204885  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:42.207711  8604 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:42.208530  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:42.210217  8603 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:42.210609  8604 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:42.211426  8611 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:42.212365  6551 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:42.213827  8255 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:42.214354  8255 raft_consensus.cc:697] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:42.217316  5924 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:42.212530  6579 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260620 13:56:42.200163  8643 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:42.228617  5924 leader_election.cc:400] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6.
I20260620 13:56:42.231320  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:42.235152  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:42.194845  8642 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:42.247454  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:42.239882  5877 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:42.266300  6579 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:42.267823  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:42.130303  8587 consensus_queue.cc:1059] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260620 13:56:42.146924  8633 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.180289  8551 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:42.234447  8611 raft_consensus.cc:2764] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260620 13:56:42.278090  5884 raft_consensus.cc:2368] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6.
I20260620 13:56:42.279860  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:42.247066  8650 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:56:42.281459  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:42.292268  6551 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:42.285845  5883 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:42.298628  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:42.299611  6579 raft_consensus.cc:2368] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6.
I20260620 13:56:42.300906  5876 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 5: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:42.271879  8632 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:56:42.177578  8618 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:42.304777  5876 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:56:42.309039  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:42.311270  5924 leader_election.cc:400] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6.
I20260620 13:56:42.312278  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:42.312103  5883 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:42.314195  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:42.314585  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:42.317013  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 121110us
I20260620 13:56:42.317736  5997 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:42.287587  8650 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:42.246384  8255 consensus_queue.cc:237] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.320874  5956 raft_consensus.cc:1240] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
W20260620 13:56:42.323208  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:42.323168  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:42.325554  6579 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:42.323745  8587 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:42.344591  8662 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:42.331945  5848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.784s (SENT) [suppressed 21 similar messages]
I20260620 13:56:42.315909  8611 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:42.302188  8602 consensus_queue.cc:1059] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260620 13:56:42.301175  8603 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260620 13:56:42.301478  8617 consensus_queue.cc:1059] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260620 13:56:42.318661  8423 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:42.375924  8656 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:42.375691  8604 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260620 13:56:42.377684  5997 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:42.381520  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:42.322341  8650 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:42.309301  8607 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260620 13:56:42.427484  8614 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:42.426993  8293 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.430449  5997 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:42.322583  8646 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:42.458226  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:42.459650  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 127751us
W20260620 13:56:42.439594  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 147428us
I20260620 13:56:42.482553  6586 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:42.434444  8611 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260620 13:56:42.537132  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 222592us
I20260620 13:56:42.538894  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:42.541518  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:42.523562  8551 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:42.546237  5848 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:42.529560  8614 raft_consensus.cc:697] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:56:42.536388  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 94644.2us
I20260620 13:56:42.555941  5997 leader_election.cc:400] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6.
I20260620 13:56:42.551545  5876 raft_consensus.cc:1240] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260620 13:56:42.556391  5997 leader_election.cc:403] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260620 13:56:42.555985  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:42.559044  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:42.539819  8423 raft_consensus.cc:697] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:42.544224  8611 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:42.559146  5997 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:42.567646  8614 consensus_queue.cc:237] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:42.568614  8618 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:42.562515  8549 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6.
I20260620 13:56:42.575714  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:42.587847  5883 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:42.544392  8656 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:42.544852  8551 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:42.589524  8551 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:56:42.575767  8655 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260620 13:56:42.605288  8652 log.cc:927] Time spent T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260620 13:56:42.611248  8649 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:42.612481  5880 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:42.597708  8669 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:42.662191  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:42.600852  8656 raft_consensus.cc:697] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:42.601917  8657 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:56:42.688774  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:42.675127  8646 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:42.603811  8633 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:42.679631  8423 consensus_queue.cc:237] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.681044  8662 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:42.682369  8656 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.615276  8643 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:42.673645  8293 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:42.713734  8657 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:56:42.726348  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 165278us
I20260620 13:56:42.669101  8669 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:42.730794  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:42.736788  5884 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260620 13:56:42.743170  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:42.750761  5883 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
W20260620 13:56:42.799489  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 51497.4us
I20260620 13:56:42.825201  8633 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:42.825814  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:42.826040  8633 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.845973  6586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 773) took 1298 ms. Trace:
I20260620 13:56:42.851229  5951 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:56:42.857179  6586 rpcz_store.cc:276] 0620 13:56:41.547442 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:42.084598 (+537156us) service_pool.cc:224] Handling call
0620 13:56:42.100998 (+ 16400us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:42.483179 (+382181us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:42.845630 (+362451us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54005afd54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:42.845871 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876904832}
I20260620 13:56:42.828189  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:42.858531  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:42.860399  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:42.846700  8326 raft_consensus.cc:3055] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:42.868561  8326 raft_consensus.cc:740] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:42.869765  8326 consensus_queue.cc:260] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:42.881872  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43502 (request call id 2019) took 1241 ms. Trace:
I20260620 13:56:42.880466  5924 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:42.877707  8326 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:42.904595  8618 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:42.827131  8668 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:42.841698  8543 raft_consensus.cc:3055] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:42.918869  6033 rpcz_store.cc:276] 0620 13:56:41.640781 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:41.640935 (+   154us) service_pool.cc:224] Handling call
0620 13:56:42.881540 (+1240605us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b540037c8d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:42.881781 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996110592}
W20260620 13:56:42.937991  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:42.849582  8642 consensus_meta.cc:287] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.571s	user 0.012s	sys 0.000s
I20260620 13:56:42.964814  8633 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:42.966118  8633 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:42.968214  5950 raft_consensus.cc:1240] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:42.829576  8551 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:42.973382  8551 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:42.976873  8557 raft_consensus.cc:3055] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:56:42.977397  8557 raft_consensus.cc:740] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:42.977478  8669 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:42.978318  8557 consensus_queue.cc:260] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:42.979425  8650 consensus_meta.cc:287] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.538s	user 0.003s	sys 0.009s
I20260620 13:56:42.979698  8557 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:42.979833  8650 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:42.820436  8657 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:42.985692  8648 log.cc:927] Time spent T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.809s	user 0.005s	sys 0.020s
I20260620 13:56:42.840304  8643 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:42.827329  8646 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:42.850135  8313 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:42.992926  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 112584us
I20260620 13:56:42.996419  5924 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:42.997601  6579 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:42.946149  8543 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:43.004477  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:43.010663  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:42.993780  8650 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:43.014398  8690 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:43.015633  8656 raft_consensus.cc:2764] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260620 13:56:43.017573  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:43.017963  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 223846us
I20260620 13:56:43.018852  5924 leader_election.cc:400] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7.
I20260620 13:56:43.019158  5924 leader_election.cc:403] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:56:42.994655  8611 raft_consensus.cc:697] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:43.004475  8643 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260620 13:56:43.023495  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 83031.5us
I20260620 13:56:43.022145  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:43.024947  8611 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.024942  5998 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:43.032985  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:43.036302  5881 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:42.989881  8668 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } attrs { replace: true } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:43.023595  8656 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:56:43.039533  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:43.038369  8662 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:43.042223  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.042981  5950 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:43.044107  8633 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:56:43.043744  8313 consensus_queue.cc:1059] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:43.045173  8313 raft_consensus.cc:3055] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:43.045274  8643 consensus_queue.cc:1059] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:43.045672  8313 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:43.046317  8643 raft_consensus.cc:3055] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:43.046698  8643 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:56:43.047489  8679 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260620 13:56:43.047832  8643 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.048553  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.049067  8643 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:43.049875  8615 raft_consensus.cc:3055] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:43.049616  8543 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.050246  8615 raft_consensus.cc:740] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:43.052771  8668 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:43.028790  8690 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7.
I20260620 13:56:43.054560  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:43.059417  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:43.059301  5959 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260620 13:56:43.059892  5959 pending_rounds.cc:85] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 4
I20260620 13:56:43.060130  5959 pending_rounds.cc:107] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260620 13:56:43.060685  5959 raft_consensus.cc:2889] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:43.061595  5954 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260620 13:56:43.066329  5958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:56:43.067003  5958 raft_consensus.cc:606] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:43.037417  8614 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:43.067747  5958 raft_consensus.cc:614] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:56:43.069764  8255 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:43.046651  8313 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.069778  8642 consensus_queue.cc:1059] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260620 13:56:43.073225  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.076437  8551 consensus_queue.cc:1059] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:43.039533  8650 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:43.078501  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.076480  8313 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:43.060091  8615 consensus_queue.cc:260] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.082211  6583 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
W20260620 13:56:43.097504  6583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46858 (request call id 705) took 1584 ms (client timeout 1523 ms). Trace:
I20260620 13:56:43.096874  8551 raft_consensus.cc:3055] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:43.097714  6029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2021) took 1452 ms. Trace:
W20260620 13:56:43.098656  6026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 499) took 2201 ms (client timeout 2112 ms). Trace:
I20260620 13:56:43.102627  8608 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:43.106570  8616 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
W20260620 13:56:43.098583  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:43.125630  6580 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:43.109637  6581 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:43.102744  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:43.073750  5998 leader_election.cc:400] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6.
W20260620 13:56:43.125253  6026 rpcz_store.cc:269] 0620 13:56:40.896868 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:40.932673 (+ 35805us) service_pool.cc:224] Handling call
0620 13:56:43.098491 (+2165818us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b54001c8754. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:43.098590 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390665600}
I20260620 13:56:43.096174  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:43.124493  6029 rpcz_store.cc:276] 0620 13:56:41.645871 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:41.646093 (+   222us) service_pool.cc:224] Handling call
0620 13:56:41.655500 (+  9407us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:42.151419 (+495919us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:43.097503 (+946084us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54001c6954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:43.097664 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134590336}
I20260620 13:56:43.133419  5998 leader_election.cc:403] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260620 13:56:43.135221  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:43.132346  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:43.139315  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:43.140055  5955 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:43.140493  5959 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:56:43.139300  6585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 765) took 1665 ms (client timeout 1821 ms). Trace:
W20260620 13:56:43.140828  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 67242.2us
I20260620 13:56:43.141091  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:43.141376  6585 rpcz_store.cc:269] 0620 13:56:41.476666 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:41.485878 (+  9212us) service_pool.cc:224] Handling call
0620 13:56:43.096015 (+1610137us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b580005fa98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:56:43.139241 (+ 43226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2424576}
I20260620 13:56:43.141918  6026 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:43.142248  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:43.142511  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:43.143231  6033 raft_consensus.cc:2393] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 5: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:43.084331  8615 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:43.107481  8614 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:43.143493  6032 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:43.143227  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:43.145280  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:43.150352  6026 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:43.095881  8642 raft_consensus.cc:3055] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:43.155609  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:43.155992  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:43.124257  8551 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:43.127553  8255 raft_consensus.cc:697] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:43.163664  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:43.139740  8649 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:43.160435  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.157341  8258 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6.
I20260620 13:56:43.144294  8608 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.169620  5958 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:43.126508  8603 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260620 13:56:43.126346  8091 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260620 13:56:43.144719  8624 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:43.157166  8618 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:43.147440  8613 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:43.188198  6026 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:43.205199  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:43.243897  5957 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:43.155644  8614 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:43.163852  8549 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:43.145159  8616 consensus_queue.cc:1243] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer 2e82c0c231624695ac5a813230bf5038 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260620 13:56:43.159135  8557 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:43.158941  8642 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:43.147377  8587 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:43.245200  8692 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:43.260790  8695 log.cc:927] Time spent T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260620 13:56:43.262897  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:43.264382  8557 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:56:43.119715  6583 rpcz_store.cc:269] 0620 13:56:41.513276 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:41.553043 (+ 39767us) service_pool.cc:224] Handling call
0620 13:56:43.054388 (+1501345us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b580005fa98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:56:43.097415 (+ 43027us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14515584}
I20260620 13:56:43.267161  5878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1377) took 1386 ms. Trace:
I20260620 13:56:43.283630  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:43.285256  5878 rpcz_store.cc:276] 0620 13:56:41.880470 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:41.882881 (+  2411us) service_pool.cc:224] Handling call
0620 13:56:43.266935 (+1384054us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54000519d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:43.267077 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820420864}
W20260620 13:56:43.307723  6578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46858 (request call id 697) took 1819 ms (client timeout 2095 ms). Trace:
W20260620 13:56:43.308466  6578 rpcz_store.cc:269] 0620 13:56:41.488506 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:41.490253 (+  1747us) service_pool.cc:224] Handling call
0620 13:56:43.262735 (+1772482us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b580005fa98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:56:43.307511 (+ 44776us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60427520}
I20260620 13:56:43.304255  8500 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:43.310498  8500 raft_consensus.cc:697] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:43.311908  8500 consensus_queue.cc:237] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.248031  8607 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:43.315853  8607 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.316959  8618 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:43.317647  8618 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:43.318476  8607 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:43.286711  8587 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:43.321559  5875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1378) took 1440 ms. Trace:
I20260620 13:56:43.322079  8587 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:43.321988  5875 rpcz_store.cc:276] 0620 13:56:41.881156 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:41.884989 (+  3833us) service_pool.cc:224] Handling call
0620 13:56:41.885262 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:41.928360 (+ 43098us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:43.321296 (+1392936us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b54003fa2d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:43.321497 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97403136}
I20260620 13:56:43.322728  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 501) took 1761 ms. Trace:
I20260620 13:56:43.323670  8642 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.323304  5879 rpcz_store.cc:276] 0620 13:56:41.561003 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:41.563960 (+  2957us) service_pool.cc:224] Handling call
0620 13:56:41.564322 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:42.987540 (+1423218us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:42.987582 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:42.988188 (+   606us) log.cc:844] Serialized 26 byte log entry
0620 13:56:43.026971 (+ 38783us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:43.026997 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:43.322322 (+295325us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b540040f954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:43.322374 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:43.322419 (+    45us) raft_consensus.cc:1685] finished
0620 13:56:43.322432 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:43.322657 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4062,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4782,"spinlock_wait_cycles":3272116992,"thread_start_us":17472,"threads_started":1,"wal-append.queue_time_us":62670}
I20260620 13:56:43.286130  8551 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.326331  8618 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:43.326745  8551 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:43.326937  5877 raft_consensus.cc:1240] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260620 13:56:43.325080  8642 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:43.331396  8671 raft_consensus.cc:3055] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:43.331790  8671 raft_consensus.cc:740] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:43.332712  8671 consensus_queue.cc:260] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.337000  8530 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:43.337677  8530 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:56:43.298066  8692 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:43.346701  8692 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:43.302754  8557 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:43.351897  8255 consensus_queue.cc:237] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.355444  8671 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:43.358429  8661 log.cc:927] Time spent T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.926s	user 0.006s	sys 0.004s
I20260620 13:56:43.249402  8613 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:43.367520  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 497) took 1818 ms. Trace:
I20260620 13:56:43.368100  8613 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:43.368016  5882 rpcz_store.cc:276] 0620 13:56:41.549509 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:41.549694 (+   185us) service_pool.cc:224] Handling call
0620 13:56:41.550011 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:42.064599 (+514588us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:43.367251 (+1302652us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b540040db54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:43.367457 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152074624}
I20260620 13:56:43.370045  8692 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:43.370599  8692 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:43.372241  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1443) took 1441 ms. Trace:
I20260620 13:56:43.372603  5956 rpcz_store.cc:276] 0620 13:56:41.930312 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:41.931708 (+  1396us) service_pool.cc:224] Handling call
0620 13:56:41.931971 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:42.324010 (+392039us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:43.371993 (+1047983us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54002611d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:43.372150 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894018816}
I20260620 13:56:43.374495  8608 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:43.376773  8692 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:43.381917  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 718) took 1342 ms. Trace:
I20260620 13:56:43.382788  6579 rpcz_store.cc:276] 0620 13:56:42.039952 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:42.420333 (+380381us) service_pool.cc:224] Handling call
0620 13:56:42.420610 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:42.999177 (+578567us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:43.381561 (+382384us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b54005af0d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:43.381831 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1326463360}
I20260620 13:56:43.384537  8676 raft_consensus.cc:3055] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:43.385167  8676 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:43.386070  8676 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.395733  8676 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:43.401820  5956 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260620 13:56:43.405647  5953 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:43.406935  5951 raft_consensus.cc:1240] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:43.422962  5876 raft_consensus.cc:1217] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[2.5-6.7]   Dedup: 2.5->[4.6-6.7]
W20260620 13:56:43.433790  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 271056us
I20260620 13:56:43.434265  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:43.435612  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:43.436798  5958 raft_consensus.cc:2410] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260620 13:56:43.437417  5957 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:43.438309  5879 raft_consensus.cc:1240] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:43.423731  5876 pending_rounds.cc:85] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 5
I20260620 13:56:43.444746  5876 pending_rounds.cc:107] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260620 13:56:43.445176  5876 raft_consensus.cc:2889] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:43.450306  8614 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:43.445855  8326 consensus_meta.cc:287] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.000s
I20260620 13:56:43.501024  8471 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:43.501535  6586 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260620 13:56:43.501606  8471 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.503952  8471 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:43.505255  8701 log.cc:927] Time spent T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.224s	user 0.002s	sys 0.000s
I20260620 13:56:43.510149  7891 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:43.517365  8637 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:43.517944  8637 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.409333  8517 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260620 13:56:43.519261  8556 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:43.519869  8556 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:43.495028  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 46947.9us
I20260620 13:56:43.415493  8649 raft_consensus.cc:697] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:43.511375  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:43.531886  6579 raft_consensus.cc:2376] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4. Re-sending same reply.
I20260620 13:56:43.511694  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:43.512048  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.512156  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:43.512641  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.535141  5954 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:43.512759  8543 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:43.521657  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:43.542001  6026 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:43.451874  5882 raft_consensus.cc:3055] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:43.543311  5882 raft_consensus.cc:740] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:43.544035  5882 consensus_queue.cc:260] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.544994  5882 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:43.546023  8642 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:43.547205  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:43.546532  8642 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:43.511147  6583 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:43.498060  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.512651  5956 raft_consensus.cc:1275] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260620 13:56:43.551460  5956 pending_rounds.cc:85] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 3
I20260620 13:56:43.444643  8624 raft_consensus.cc:697] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:43.522722  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.555461  5957 raft_consensus.cc:2376] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5. Re-sending same reply.
I20260620 13:56:43.522891  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.523389  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:43.524581  5953 raft_consensus.cc:1275] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260620 13:56:43.452610  6033 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:43.556521  5953 pending_rounds.cc:85] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 1
I20260620 13:56:43.556353  6551 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:43.452893  6029 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:43.443774  8478 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:43.550333  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:43.561558  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:43.538288  8556 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:43.565006  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:43.566835  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 43564.1us
I20260620 13:56:43.567401  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.570094  5959 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:43.539691  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:43.551800  5956 pending_rounds.cc:107] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260620 13:56:43.556842  5953 pending_rounds.cc:107] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260620 13:56:43.574750  5953 raft_consensus.cc:2889] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:43.557873  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.560424  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:43.575544  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.575870  5998 leader_election.cc:400] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6.
I20260620 13:56:43.576275  5952 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:43.563952  6032 raft_consensus.cc:3055] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:43.570554  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:43.571506  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:43.572753  5848 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:43.579015  6587 raft_consensus.cc:2393] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:43.579808  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:43.581297  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:43.581902  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:43.582734  5883 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:43.577797  6032 raft_consensus.cc:740] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:43.584203  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:43.586148  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:43.586396  6026 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:43.586809  6584 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:43.588426  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:43.594015  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:43.594269  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.599192  5956 raft_consensus.cc:2917] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
W20260620 13:56:43.599961  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 43677.7us
I20260620 13:56:43.600660  5959 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:43.596700  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:43.583748  6032 consensus_queue.cc:260] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.601441  6581 raft_consensus.cc:2393] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:43.601887  5954 raft_consensus.cc:2393] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:43.549352  8642 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:43.606513  5957 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:43.608408  6032 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:43.595947  5848 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:43.610562  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:43.610576  5956 raft_consensus.cc:2889] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:43.615989  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:43.616814  5883 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:56:43.617187  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:43.623360  5959 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260620 13:56:43.626351  5882 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:43.626618  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:43.494570  8602 consensus_queue.cc:1059] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260620 13:56:43.598116  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.582224  8293 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:43.640684  5998 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:56:43.634824  8703 log.cc:927] Time spent T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260620 13:56:43.629901  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:43.646339  5881 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 6
I20260620 13:56:43.531703  8422 consensus_queue.cc:1059] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260620 13:56:43.573325  8326 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
W20260620 13:56:43.636042  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 45550.6us
W20260620 13:56:43.642443  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 46583.7us
I20260620 13:56:43.657442  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:43.658782  5953 raft_consensus.cc:2410] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260620 13:56:43.659790  5848 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:43.643215  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:43.597281  8312 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:43.598670  8559 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:43.603358  8591 consensus_queue.cc:1059] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260620 13:56:43.648054  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:43.649425  5849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.050s
W20260620 13:56:43.778136  5849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.000s	sys 0.050s
W20260620 13:56:43.778535  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 639797us
I20260620 13:56:43.647877  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:43.576731  8478 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:43.674413  6027 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:56:43.644394  8677 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:43.700810  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:43.685608  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:43.677641  8697 log.cc:927] Time spent T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260620 13:56:43.716878  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:43.716221  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:43.702029  8614 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:43.750134  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 179306us
I20260620 13:56:43.672112  8312 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.674830  5997 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:43.650962  8379 raft_consensus.cc:3055] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:43.603137  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:43.670709  8420 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:43.683588  8632 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260620 13:56:43.774526  6025 raft_consensus.cc:1240] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:43.636861  8705 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:43.649062  8613 consensus_queue.cc:1059] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260620 13:56:43.843148  8613 consensus_queue.cc:1243] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer b0ce39342d8c4a64904b30b98de02b9f log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260620 13:56:43.645439  8629 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:56:43.669305  8556 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:43.841432  8420 raft_consensus.cc:697] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:43.844269  8556 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:43.845134  8420 consensus_queue.cc:237] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.846576  8556 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:43.777300  5848 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:43.846731  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:43.847733  8379 raft_consensus.cc:740] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:43.848349  8692 consensus_queue.cc:1059] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260620 13:56:43.848747  8557 consensus_meta.cc:287] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.000s
I20260620 13:56:43.789953  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:43.783388  6581 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:43.788403  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.850383  5953 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:43.797529  5883 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:43.800129  5882 raft_consensus.cc:2410] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260620 13:56:43.851716  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:43.852042  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:43.852510  5883 raft_consensus.cc:2393] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 5: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:43.852715  8613 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:43.853286  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:43.853240  8613 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.853566  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:43.854009  5883 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:43.854439  5882 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:43.856307  8613 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:43.852531  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:43.806121  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:43.833451  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:43.833940  8700 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:43.784849  8608 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:43.862929  8608 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:43.790620  8677 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:43.863425  8608 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:43.863487  8677 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:43.865734  8478 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:43.791826  5880 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:56:43.839279  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:43.867381  8656 raft_consensus.cc:3055] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:43.867816  8656 raft_consensus.cc:740] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:43.868919  8656 consensus_queue.cc:260] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:43.872920  5879 raft_consensus.cc:2393] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:43.874053  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:43.840364  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 165662us
I20260620 13:56:43.841372  8258 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:43.848255  8668 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:43.860723  8312 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:43.836222  8591 raft_consensus.cc:3055] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:43.879208  8591 raft_consensus.cc:740] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:43.880393  8591 consensus_queue.cc:260] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:43.713888  8624 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.848176  6026 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:43.888953  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:43.889914  6024 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:43.890619  8614 consensus_queue.cc:1059] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:56:43.685521  8649 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:43.891916  8313 raft_consensus.cc:3055] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:56:43.892320  8313 raft_consensus.cc:740] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:43.893131  8313 consensus_queue.cc:260] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:43.895700  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:43.896481  5884 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:43.898025  5875 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 2. Current term is 3. Ops: []
I20260620 13:56:43.898140  8669 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:56:43.901693  8556 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:43.901872  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:43.902333  8556 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:43.902907  6030 raft_consensus.cc:2376] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6. Re-sending same reply.
I20260620 13:56:43.904587  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:43.906442  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:43.091488  8560 consensus_queue.cc:1175] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b0ce39342d8c4a64904b30b98de02b9f" responder_term: 4 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260620 13:56:43.911631  8657 raft_consensus.cc:3055] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:43.912079  8657 raft_consensus.cc:740] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:43.782955  5881 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:43.890859  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:43.854849  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:43.816125  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42074 (request call id 17) took 11541 ms. Trace:
W20260620 13:56:43.943161  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 165944us
I20260620 13:56:43.923461  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:43.926008  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:43.917074  5884 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260620 13:56:43.922186  6028 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:56:43.955246  5952 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:43.928949  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:43.956753  6029 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:56:43.956918  6551 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.4.155.254:37547, user_credentials={real_user=slave}} blocked reactor thread for 124194us
I20260620 13:56:43.933084  6032 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:43.921443  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.974293  5953 raft_consensus.cc:2393] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 5: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:43.952361  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:43.958247  8629 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election won for term 5
W20260620 13:56:43.976487  6612 heartbeater.cc:646] Failed to heartbeat to 127.4.155.254:37547 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.155.254:37547 timed out after 15.000s (SENT)
W20260620 13:56:43.962319  8671 consensus_meta.cc:287] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.606s	user 0.001s	sys 0.009s
I20260620 13:56:43.976910  6029 raft_consensus.cc:1275] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260620 13:56:43.977617  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:43.978251  6028 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:43.978657  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:43.977874  6580 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
W20260620 13:56:43.980682  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 53627.8us
I20260620 13:56:43.953219  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:43.975261  5879 raft_consensus.cc:2393] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:43.981603  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:43.984148  6031 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:56:43.984784  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:43.928694  8676 consensus_meta.cc:287] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.006s
W20260620 13:56:43.930083  8551 consensus_meta.cc:287] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.003s
I20260620 13:56:44.007850  6025 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260620 13:56:43.985003  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:43.987260  6026 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:43.985548  6579 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:43.984571  5997 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:43.989365  6029 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:43.994794  5955 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260620 13:56:43.995443  6032 raft_consensus.cc:1240] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: []
W20260620 13:56:43.987960  8255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.036s	sys 0.058s
I20260620 13:56:43.796223  8642 consensus_queue.cc:1059] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.190s
I20260620 13:56:43.916927  8608 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:43.953544  5956 rpcz_store.cc:276] 0620 13:56:32.255724 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:32.256092 (+   368us) service_pool.cc:224] Handling call
0620 13:56:32.453955 (+197863us) log.cc:844] Serialized 506 byte log entry
0620 13:56:33.036308 (+582353us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b5400147e20. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf77cf06 00007f0fdf77687a 00007f0fdf775af4 00007f0fdf75628a 00007f0fdf75d133 00007f0fdf75d0b9 00007f0fdf75d049 00007f0fdf75d011 00007f0fdf75c1dd 0000000000389354
0620 13:56:34.052749 (+1016441us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b5400147e20. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf775522 00007f0fdf75628a 00007f0fdf75d133 00007f0fdf75d0b9 00007f0fdf75d049 00007f0fdf75d011 00007f0fdf75c1dd 0000000000389354 0000000000389199 00007f0fdc70ac75
0620 13:56:43.728007 (+9675258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19713,"raft.queue_time_us":103098,"raft.run_cpu_time_us":25331,"raft.run_wall_time_us":1720788,"spinlock_wait_cycles":132818944,"thread_start_us":136055,"threads_started":1,"wal-append.queue_time_us":329358,"wal-append.run_cpu_time_us":2330,"wal-append.run_wall_time_us":1215746}
I20260620 13:56:44.011795  6030 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:44.036204  6028 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:43.806507  8673 consensus_queue.cc:1059] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.201s
I20260620 13:56:43.988700  8637 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:43.981225  6024 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:44.035976  6027 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:43.995048  8591 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:43.958007  8657 consensus_queue.cc:260] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.078744  5875 raft_consensus.cc:1240] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:44.002130  8629 raft_consensus.cc:697] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:43.999845  8543 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:44.069907  6031 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:43.991590  8530 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:44.137342  8530 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:44.010975  8255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.037s	sys 0.059s
I20260620 13:56:43.962152  8557 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:44.075595  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 53620.3us
I20260620 13:56:44.063428  5882 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
W20260620 13:56:44.080658  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:44.148203  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:43.988195  8663 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260620 13:56:44.136626  8258 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:44.030264  8704 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:44.071004  8312 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:44.008868  8500 consensus_queue.cc:1059] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260620 13:56:44.043514  8671 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260620 13:56:44.198068  6033 raft_consensus.cc:1275] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260620 13:56:44.170097  8642 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260620 13:56:44.215343  8715 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260620 13:56:44.172369  8704 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:44.173447  8657 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:44.219305  8587 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:44.219573  8613 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:44.220046  8587 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.220194  8613 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.222064  8587 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:44.197923  8312 raft_consensus.cc:697] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:44.225014  6025 raft_consensus.cc:1240] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:44.139567  8530 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:44.044607  8602 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.181s
I20260620 13:56:44.256458  6033 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260620 13:56:44.238257  8643 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:44.222079  8613 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:44.260502  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 412629us
I20260620 13:56:44.238209  8611 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:44.264027  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:44.261909  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 271972us
I20260620 13:56:44.238592  8556 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:44.238111  8671 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:44.241150  8704 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:44.266148  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:44.267357  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:44.269543  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
W20260620 13:56:44.275625  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:44.273313  8671 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.290087  8608 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:44.272974  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:44.290907  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:44.291500  6024 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:44.291667  5958 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:44.268344  8629 consensus_queue.cc:237] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:44.292805  5954 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:44.293645  8557 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:44.266651  8643 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:44.300969  8643 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:44.301570  8643 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:44.302057  8643 raft_consensus.cc:697] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:56:44.303370  5848 leader_election.cc:336] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.830s (SENT)
I20260620 13:56:44.272493  8312 consensus_queue.cc:237] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:44.271306  8668 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:44.305377  8643 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.270046  8611 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:44.309001  8671 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:44.309835  8611 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:44.274561  8649 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:44.310676  8719 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:44.317301  8543 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:44.319796  6033 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
W20260620 13:56:44.318591  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 52517.7us
I20260620 13:56:44.320190  6033 pending_rounds.cc:85] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 6
I20260620 13:56:44.320443  6033 pending_rounds.cc:107] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260620 13:56:44.320652  6033 raft_consensus.cc:2889] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:44.320748  5849 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:44.325055  8551 raft_consensus.cc:3055] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:44.325635  8551 raft_consensus.cc:740] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:44.359931  5849 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:44.369345  5849 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:44.372622  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 103140us
I20260620 13:56:44.380288  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:44.391403  8657 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:44.392107  8657 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.395751  8657 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:44.400544  8719 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:44.401729  8719 consensus_queue.cc:1059] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:56:44.402976  8719 raft_consensus.cc:3055] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:44.326779  8551 consensus_queue.cc:260] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:44.404021  8608 consensus_queue.cc:1059] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:44.404860  8551 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:44.404934  8724 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:44.405658  8724 raft_consensus.cc:697] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:44.408072  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:44.410518  5924 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:44.423264  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:44.438778  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:44.327937  8709 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:44.441849  8611 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:56:44.408264  8719 raft_consensus.cc:740] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:44.454397  5924 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:44.466750  8719 consensus_queue.cc:260] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:44.468024  8719 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:44.441319  8530 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:44.456583  8705 raft_consensus.cc:3055] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:44.456746  8731 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:44.458005  8624 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:44.459658  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:44.471493  8705 raft_consensus.cc:740] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:44.459890  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:44.474543  8705 consensus_queue.cc:260] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.475720  8705 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:44.439334  8710 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260620 13:56:44.477254  8677 consensus_meta.cc:287] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.005s
I20260620 13:56:44.477747  8677 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.480114  8677 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:44.451633  8608 consensus_queue.cc:1048] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260620 13:56:44.483953  6586 raft_consensus.cc:2368] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6.
I20260620 13:56:44.488354  8379 consensus_queue.cc:260] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.495482  8639 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:44.496153  8639 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.498265  8639 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:44.498767  8639 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:44.445393  8668 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:56:44.500982  8668 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:44.501428  8668 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:56:44.406705  8724 consensus_queue.cc:237] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:44.524586  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:44.528324  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:44.528335  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:44.540685  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:44.540612  5998 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:44.545095  6583 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:44.550628  5998 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:56:44.554098  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:44.556942  5998 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:44.512941  8422 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260620 13:56:44.584533  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:44.544744  8255 raft_consensus.cc:3055] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:44.547061  8549 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:44.505980  8639 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.584200  8551 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:44.593858  8611 raft_consensus.cc:697] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:56:44.594940  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 94475.9us
I20260620 13:56:44.600942  5998 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:56:44.601783  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 147492us
I20260620 13:56:44.607456  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:44.586395  8675 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:44.610850  5998 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:44.615273  5879 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260620 13:56:44.615815  5882 raft_consensus.cc:1240] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260620 13:56:44.595422  8731 raft_consensus.cc:697] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:44.596364  8591 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:44.590540  8255 raft_consensus.cc:740] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:44.622160  5882 raft_consensus.cc:1240] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:44.623986  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:44.627908  8624 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:44.628459  8624 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:44.629456  8639 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:44.630496  8624 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:44.631893  8731 consensus_queue.cc:237] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:44.610023  8549 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:44.610446  8675 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:44.635893  8675 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:44.622637  8591 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:44.639753  5997 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:44.641131  8255 consensus_queue.cc:260] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.642588  8255 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:56:44.642871  5776 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47386 (request call id 232) took 15949 ms (client timeout 15000 ms). Trace:
I20260620 13:56:44.643692  8734 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:44.643780  8422 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:44.644738  8734 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:44.644591  8422 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.645112  8556 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:44.645545  8556 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:44.645928  8556 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:44.605967  8560 consensus_queue.cc:1059] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260620 13:56:44.612368  8559 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260620 13:56:44.646855  8422 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:44.621634  8657 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:44.648536  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:44.655817  6028 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
W20260620 13:56:44.656769  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:44.657315  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:44.658272  6028 raft_consensus.cc:2410] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260620 13:56:44.639838  8611 consensus_queue.cc:237] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:44.639986  8591 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:44.632298  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:44.667382  6552 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:44.674316  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:44.689077  8293 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:44.689733  8293 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:44.690094  8293 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:44.700603  6030 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260620 13:56:44.702548  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:44.676080  7927 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:44.707310  8736 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:44.710235  8471 consensus_queue.cc:1059] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:56:44.684304  8617 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:44.712724  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:44.643301  5776 rpcz_store.cc:269] 0620 13:56:28.693339 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:28.693648 (+   309us) service_pool.cc:224] Handling call
0620 13:56:44.642794 (+15949146us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:56:40.998176 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:56:40.999029 (+   853us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:56:40.999095 (+    66us) write_op.cc:435] Acquired schema lock
0620 13:56:40.999144 (+    49us) tablet.cc:662] Decoding operations
0620 13:56:40.999876 (+   732us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:56:40.999966 (+    90us) write_op.cc:641] Partition lock acquired for write op
0620 13:56:40.999997 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0620 13:56:41.000454 (+   457us) tablet.cc:701] Row locks acquired
0620 13:56:41.000474 (+    20us) write_op.cc:260] PREPARE: finished
0620 13:56:41.000674 (+   200us) write_op.cc:270] Start()
0620 13:56:41.000862 (+   188us) write_op.cc:276] Timestamp: P: 1781963801000601 usec, L: 0
0620 13:56:41.000882 (+    20us) op_driver.cc:348] REPLICATION: starting
0620 13:56:41.001565 (+   683us) log.cc:844] Serialized 1298 byte log entry
0620 13:56:41.505628 (+504063us) op_driver.cc:464] REPLICATION: finished
0620 13:56:41.514474 (+  8846us) write_op.cc:301] APPLY: starting
0620 13:56:41.514567 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0620 13:56:41.514688 (+   121us) tablet.cc:1370] finished BulkCheckPresence
0620 13:56:41.514802 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:56:41.515934 (+  1132us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:56:41.516573 (+   639us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0620 13:56:41.516653 (+    80us) write_op.cc:312] APPLY: finished
0620 13:56:41.519156 (+  2503us) log.cc:844] Serialized 35 byte log entry
0620 13:56:41.542644 (+ 23488us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:41.542816 (+   172us) write_op.cc:454] Released schema lock
0620 13:56:41.542897 (+    81us) write_op.cc:341] FINISH: Updating metrics
0620 13:56:41.552157 (+  9260us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:41.552200 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4502319,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":8499,"apply.run_cpu_time_us":3524,"apply.run_wall_time_us":28950,"mutex_wait_us":13243,"num_ops":3,"prepare.queue_time_us":497891,"prepare.run_cpu_time_us":44087,"prepare.run_wall_time_us":293371,"raft.queue_time_us":52854,"raft.run_cpu_time_us":8933,"raft.run_wall_time_us":8933,"replication_time_us":504521,"thread_start_us":639527,"threads_started":4,"wal-append.queue_time_us":376643,"wal-append.run_cpu_time_us":5848,"wal-append.run_wall_time_us":1160976}]]}
I20260620 13:56:44.718607  8556 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:44.676769  8422 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:44.767171  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 54539.4us
I20260620 13:56:44.740381  7927 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.772622  7927 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:44.773551  8671 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:44.711252  8639 consensus_queue.cc:1059] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260620 13:56:44.758503  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:44.760517  5848 leader_election.cc:336] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.297s (SENT)
I20260620 13:56:44.703467  8313 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:56:44.775449  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:44.807129  6027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 519) took 1252 ms. Trace:
I20260620 13:56:44.807746  6027 rpcz_store.cc:276] 0620 13:56:43.554896 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:43.795663 (+240767us) service_pool.cc:224] Handling call
0620 13:56:44.806730 (+1011067us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54001c6e54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:44.806895 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351346944}
I20260620 13:56:44.718744  8675 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:44.756484  8617 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:44.843760  8745 log.cc:927] Time spent T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260620 13:56:44.903580  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 44856.1us
I20260620 13:56:44.899559  8705 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260620 13:56:44.917260  7927 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:44.917901  7927 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.918663  8710 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:44.828429  8617 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:44.935546  8671 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:44.936337  8671 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:44.944746  8556 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:44.784876  8422 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.053603  8422 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:44.956133  8668 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:45.066664  8668 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:45.112140  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 504765us
I20260620 13:56:45.113168  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:45.113898  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:45.117614  7927 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.119695  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 520) took 1220 ms. Trace:
I20260620 13:56:45.120193  6033 rpcz_store.cc:276] 0620 13:56:43.899427 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:44.257531 (+358104us) service_pool.cc:224] Handling call
0620 13:56:44.273122 (+ 15591us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:44.321085 (+ 47963us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:45.119468 (+798383us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b54000b7cd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:45.119634 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107797632}
W20260620 13:56:45.121341  5848 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.225s (SENT)
I20260620 13:56:45.121969  5848 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:45.122797  8608 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:45.132704  5876 raft_consensus.cc:1240] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5. Ops: []
W20260620 13:56:45.113665  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 246643us
W20260620 13:56:45.136132  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:45.136034  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:45.142302  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.145148  6033 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:45.148947  5924 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:45.133694  8557 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:45.151832  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:45.137264  8420 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:45.158303  8670 consensus_queue.cc:1059] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:56:45.157893  8557 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.114989  8591 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.165493  8738 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:45.167047  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:45.175269  8722 log.cc:927] Time spent T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.868s	user 0.007s	sys 0.007s
I20260620 13:56:45.177794  5878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 520) took 1749 ms. Trace:
I20260620 13:56:45.150404  8671 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:45.151000  8746 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:45.136180  8293 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.179823  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:45.180323  6031 raft_consensus.cc:1240] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:45.191301  6033 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:45.151015  8731 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:45.178390  5878 rpcz_store.cc:276] 0620 13:56:43.428424 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:43.429781 (+  1357us) service_pool.cc:224] Handling call
0620 13:56:43.430232 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:43.430726 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:43.430766 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:43.447596 (+ 16830us) log.cc:844] Serialized 26 byte log entry
0620 13:56:43.913632 (+466036us) spinlock_profiling.cc:243] Waited 46.7 ms on lock 0x7b180040eca0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:56:44.262310 (+348678us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:44.262364 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:44.262432 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:45.174600 (+912168us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:56:45.177516 (+  2916us) raft_consensus.cc:1685] finished
0620 13:56:45.177543 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:45.177720 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27436,"raft.queue_time_us":7549,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2973,"spinlock_wait_cycles":197478400,"thread_start_us":348252,"threads_started":1,"wal-append.queue_time_us":858947}
I20260620 13:56:45.168442  8420 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.193924  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:45.195188  8591 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.190665  8611 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 13:56:45.206488  6580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 779) took 1637 ms (client timeout 1848 ms). Trace:
W20260620 13:56:45.206488  6026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43502 (request call id 2030) took 1688 ms (client timeout 2007 ms). Trace:
W20260620 13:56:45.207408  6026 rpcz_store.cc:269] 0620 13:56:43.517920 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:43.600222 (+ 82302us) service_pool.cc:224] Handling call
0620 13:56:45.206348 (+1606126us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b54000b77d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:45.206432 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34480384}
I20260620 13:56:45.208678  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.160560  8741 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:45.201699  6033 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:45.164533  8675 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:45.189646  8556 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:45.206925  6580 rpcz_store.cc:269] 0620 13:56:43.569629 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:43.581058 (+ 11429us) service_pool.cc:224] Handling call
0620 13:56:45.206307 (+1625249us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54005f5fd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:45.206423 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":910406912}
I20260620 13:56:45.187906  8643 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:45.166169  8738 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.229383  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:45.231844  6026 raft_consensus.cc:2376] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5. Re-sending same reply.
I20260620 13:56:45.219075  8737 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:45.198019  8746 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:45.243629  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.244815  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:45.245319  6029 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:45.245491  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.246371  6582 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:45.246953  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.247431  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:45.248135  6581 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:45.249953  6587 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:45.252765  8379 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:45.268639  6584 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:56:45.209117  8731 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.267035  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:45.276697  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 123471us
W20260620 13:56:45.278127  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:45.254333  8125 raft_consensus.cc:3055] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:45.231067  8556 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.275573  8557 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.233671  8643 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:45.290076  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:45.294380  8617 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.296123  6030 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260620 13:56:45.296741  8643 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:45.298810  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.304584  6033 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:45.310319  8746 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:45.312731  8734 consensus_meta.cc:287] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.001s
I20260620 13:56:45.313231  8734 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:45.313971  5779 catalog_manager.cc:5696] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 5 to 7, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 7 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:56:45.315757  8420 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.315987  8293 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:45.317479  8556 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.317559  6583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 787) took 1391 ms. Trace:
I20260620 13:56:45.323235  6583 rpcz_store.cc:276] 0620 13:56:43.926073 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:43.939299 (+ 13226us) service_pool.cc:224] Handling call
0620 13:56:44.542820 (+603521us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:44.545595 (+  2775us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:45.317348 (+771753us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b5400620550. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:45.317497 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386882304}
I20260620 13:56:45.318357  6580 raft_consensus.cc:2410] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260620 13:56:45.320890  6030 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260620 13:56:45.320282  5779 catalog_manager.cc:5696] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 3, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:56:45.319643  8255 consensus_meta.cc:287] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.677s	user 0.013s	sys 0.000s
I20260620 13:56:45.340474  8738 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.342525  8617 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:45.344118  6033 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260620 13:56:45.344661  6033 pending_rounds.cc:85] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 6
I20260620 13:56:45.344878  6033 pending_rounds.cc:107] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260620 13:56:45.345110  6033 raft_consensus.cc:2889] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:56:45.346096  8751 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
W20260620 13:56:45.350171  8313 consensus_meta.cc:287] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.539s	user 0.006s	sys 0.003s
I20260620 13:56:45.282341  8125 raft_consensus.cc:740] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:45.329380  8656 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:45.351785  8125 consensus_queue.cc:260] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.353634  8125 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:45.322708  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:45.320268  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 153306us
I20260620 13:56:45.328408  5779 catalog_manager.cc:5696] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 4, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 4 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:45.361063  5779 catalog_manager.cc:5696] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:45.362684  8738 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:45.364436  8734 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:45.365144  8734 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.364441  8738 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.370215  8738 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.371973  8734 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.372275  8731 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.362231  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:45.373517  8731 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:45.375536  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:45.378127  8731 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:45.409209  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:45.412272  6029 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:45.416458  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.417270  6032 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:45.409044  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:45.421232  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:45.421852  5951 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:45.438334  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:45.443040  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.447052  5950 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:45.449404  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 73972.9us
I20260620 13:56:45.450547  5924 leader_election.cc:400] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6.
I20260620 13:56:45.450910  5924 leader_election.cc:403] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:56:45.456619  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:45.457813  5958 raft_consensus.cc:2410] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260620 13:56:45.460459  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 162928us
I20260620 13:56:45.467610  5956 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: []
I20260620 13:56:45.436969  8642 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:45.476251  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 199356us
I20260620 13:56:45.476130  5951 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:45.478471  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.478746  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.479204  6584 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:45.480748  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:45.481794  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.483531  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:45.483706  6032 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:56:45.481776  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:45.468436  8754 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:45.469190  8746 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 6
I20260620 13:56:45.486501  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:45.476558  5950 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:56:45.487663  5881 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260620 13:56:45.487870  5875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1410) took 1637 ms. Trace:
I20260620 13:56:45.498224  5875 rpcz_store.cc:276] 0620 13:56:43.850639 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:43.898727 (+ 48088us) service_pool.cc:224] Handling call
0620 13:56:43.952688 (+ 53961us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:44.080313 (+127625us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:45.487565 (+1407252us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54002b39d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:45.487797 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289318784}
I20260620 13:56:45.489374  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:45.467279  8705 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:45.376418  5779 catalog_manager.cc:5696] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 4, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 4 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:45.484925  6027 raft_consensus.cc:1275] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:45.500829  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.495991  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:45.503175  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 220842us
I20260620 13:56:45.502861  5779 catalog_manager.cc:5696] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 3, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 3 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:56:45.510002  6032 raft_consensus.cc:1275] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260620 13:56:45.513545  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:45.525808  5884 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:45.516120  5879 raft_consensus.cc:1275] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:56:45.513438  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:45.521893  6584 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260620 13:56:45.532454  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.535816  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.538745  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.539420  6587 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:45.475075  8642 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.542534  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:45.542166  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.540727  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:45.542151  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.544284  6581 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
W20260620 13:56:45.541177  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:45.526924  8629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.232s	user 0.015s	sys 0.015s
I20260620 13:56:45.489362  8704 consensus_queue.cc:1048] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260620 13:56:45.545810  5779 catalog_manager.cc:5696] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 5 to 7, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 7 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:45.551043  5779 catalog_manager.cc:5696] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 4, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 4 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:45.552776  5779 catalog_manager.cc:5696] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:45.553578  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:45.558100  6587 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:56:45.559089  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.559654  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:45.560153  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.560916  6587 raft_consensus.cc:2393] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:45.561692  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.566344  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:45.571784  8734 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:45.572521  8734 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.575816  8734 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.554864  5779 catalog_manager.cc:5696] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 3 to 4, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 4 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:45.590834  8734 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:45.591665  8734 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:45.596403  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:45.547112  8629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.252s	user 0.015s	sys 0.016s
I20260620 13:56:45.598886  8629 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:45.599591  8642 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.599954  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:45.515132  8754 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.604034  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.604918  6579 raft_consensus.cc:2410] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:56:45.567375  5957 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:45.605613  6583 raft_consensus.cc:2393] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:45.510479  7927 consensus_queue.cc:1059] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260620 13:56:45.604961  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:45.604835  8704 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:45.606890  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 122573us
I20260620 13:56:45.518302  8705 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:45.611676  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 52855.7us
I20260620 13:56:45.587560  5779 catalog_manager.cc:5696] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 4, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 4 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:45.606493  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:45.616151  5779 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 3, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 3 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:45.616998  8738 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:45.617758  8738 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.621495  8738 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.618052  5779 catalog_manager.cc:5696] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 3 to 4, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 4 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
W20260620 13:56:45.607270  8729 log.cc:927] Time spent T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260620 13:56:45.630079  8757 log.cc:927] Time spent T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260620 13:56:45.635308  8674 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:45.636175  8674 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:45.637691  5829 auto_rebalancer.cc:591] Failed to schedule move for tablet 5757f55132b747db98400dba7b8056df: Aborted: Op aborted by new leader
I20260620 13:56:45.642138  8543 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260620 13:56:45.644727  8692 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:45.646940  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:45.650034  8731 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:45.645573  8692 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.650607  8705 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:45.651918  5779 catalog_manager.cc:5696] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 3, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 3 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:45.654156  5950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:53076
I20260620 13:56:45.657094  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:45.660570  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:45.671583  5950 raft_consensus.cc:606] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:45.671955  5950 raft_consensus.cc:614] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:56:45.652706  8756 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:45.663699  8759 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:45.626462  8704 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.670842  6028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 524) took 1051 ms. Trace:
I20260620 13:56:45.638839  8674 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:45.672394  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:45.679299  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:45.680341  5779 catalog_manager.cc:5696] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 5 to 8, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 8 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:56:45.612205  8754 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:45.689795  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:45.690955  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:45.628854  8738 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:45.682170  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:45.694476  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:45.696004  5959 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:45.685635  5958 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:56:45.698167  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:45.698222  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:45.698426  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:45.684314  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:45.682667  6028 rpcz_store.cc:276] 0620 13:56:44.619733 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:44.658870 (+ 39137us) service_pool.cc:224] Handling call
0620 13:56:44.672566 (+ 13696us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:44.673805 (+  1239us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:44.673835 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:44.674250 (+   415us) log.cc:844] Serialized 26 byte log entry
0620 13:56:45.299086 (+624836us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b180047b0c0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:56:45.468938 (+169852us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:45.468975 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:45.469044 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:45.670636 (+201592us) raft_consensus.cc:1685] finished
0620 13:56:45.670650 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:45.670796 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":719,"raft.queue_time_us":825,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":8277,"spinlock_wait_cycles":6118144,"thread_start_us":169658,"threads_started":1,"wal-append.queue_time_us":950454}
I20260620 13:56:45.699375  5958 raft_consensus.cc:2393] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:45.699492  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:45.699694  5779 catalog_manager.cc:5696] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 3, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:56:45.699003  6033 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:45.701138  5779 catalog_manager.cc:5696] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:56:45.702293  5779 catalog_manager.cc:5696] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:45.703521  5779 catalog_manager.cc:5696] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:45.704480  5779 catalog_manager.cc:5696] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 2, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:56:45.656561  7927 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:45.707975  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.710301  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:45.708823  6033 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:45.709108  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:45.710124  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:45.713143  6031 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:56:45.714164  8740 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 1.086s	user 0.007s	sys 0.010s
I20260620 13:56:45.714941  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:45.715816  5957 raft_consensus.cc:2393] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:45.716673  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:45.717295  5957 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:45.717831  8602 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:45.718367  8602 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.719274  8293 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:45.709851  8656 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:45.719841  8293 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.696411  8543 consensus_queue.cc:1059] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260620 13:56:45.722077  8543 raft_consensus.cc:3055] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:45.722345  8293 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:45.722508  8543 raft_consensus.cc:740] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:45.723959  7927 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:45.680171  8756 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:45.725788  8755 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:45.726358  7927 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:45.727305  8125 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:45.726918  7927 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:45.727763  8125 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:45.728210  8692 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.728154  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.729622  6030 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
W20260620 13:56:45.729789  5829 auto_rebalancer.cc:591] Failed to schedule move for tablet 8dbd1edec8054c1ba05721321572fbbf: Illegal state: Replica 663684cf4ae54c929bf8240ca0b63a47 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:56:45.710337  8738 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.733651  8738 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.696516  8313 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:45.734448  8313 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:45.734856  8313 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:45.737545  8735 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 1.082s	user 0.004s	sys 0.007s
I20260620 13:56:45.740765  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:45.740916  8543 consensus_queue.cc:260] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.708957  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:45.742251  8543 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:45.742646  8668 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:45.743981  8602 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:45.745250  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:45.706609  5779 catalog_manager.cc:5696] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 3 to 5, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 5 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:45.756420  5779 catalog_manager.cc:5696] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 5, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 5 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:45.748382  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:45.749290  6031 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:56:45.741468  5957 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:56:45.749456  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.674530  8420 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:45.741474  5956 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:45.766484  5952 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260620 13:56:45.752104  5950 raft_consensus.cc:2410] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260620 13:56:45.750082  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.681806  8758 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:45.707894  8471 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:45.774303  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:45.711404  8591 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:45.728310  8125 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:45.778337  5950 raft_consensus.cc:2410] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260620 13:56:45.751423  8731 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:56:45.781837  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.710832  8734 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.782595  6030 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:45.782781  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:45.784240  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:45.784809  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.753650  8549 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:45.791544  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260620 13:56:45.791857  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.795426  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.805410  6026 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:45.783663  8668 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260620 13:56:45.799954  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.801393  8704 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.816325  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.765605  8692 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:45.709015  8615 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260620 13:56:45.811914  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:45.810567  5924 leader_election.cc:336] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.848s (SENT)
I20260620 13:56:45.806654  8731 raft_consensus.cc:697] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:45.777281  8755 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:45.828490  8755 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:45.829041  8755 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:45.829185  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:56:45.830426  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.831130  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:45.833340  8642 raft_consensus.cc:3055] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:56:45.833779  8642 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:45.831066  6026 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:45.834882  8780 consensus_queue.cc:1059] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:56:45.835850  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.836057  8780 raft_consensus.cc:3055] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:45.836421  8780 raft_consensus.cc:740] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:45.837157  8780 consensus_queue.cc:260] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:45.838306  8780 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:45.807080  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:45.775694  8656 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260620 13:56:45.782109  8471 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:45.841714  8721 log.cc:927] Time spent T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 1.535s	user 0.001s	sys 0.016s
I20260620 13:56:45.842738  8471 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:45.776260  8643 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260620 13:56:45.846426  8746 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6.
I20260620 13:56:45.817330  8549 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:45.849874  8549 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:45.850494  8692 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.852782  8692 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:45.828817  8731 consensus_queue.cc:237] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:45.860200  6030 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260620 13:56:45.869700  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 178785us
I20260620 13:56:45.879542  5998 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:56:45.877735  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:45.888159  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:45.827819  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:45.886520  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:45.888357  5877 raft_consensus.cc:1275] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260620 13:56:45.890717  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 62972.6us
I20260620 13:56:45.876843  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:45.889043  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:45.892711  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:45.897910  6027 raft_consensus.cc:1275] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260620 13:56:45.900466  5998 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:45.903185  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:45.921411  6551 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:45.906875  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:45.922331  5882 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:45.913533  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:45.923599  5884 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:45.913847  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.923447  6551 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:45.924849  6032 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:45.921875  5876 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:45.896826  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:45.928704  8643 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:56:45.929489  8643 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:45.933284  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:45.945385  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 68615.7us
I20260620 13:56:45.946419  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:45.948285  6026 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260620 13:56:45.948347  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 47978.5us
I20260620 13:56:45.875917  8704 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:45.943228  5849 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:45.955618  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:45.949661  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:45.960274  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:45.961292  5956 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:45.834640  8642 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:45.950947  8674 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:56:45.951491  8293 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:45.951643  8556 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:45.963423  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:45.952037  8668 consensus_queue.cc:1048] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:45.948493  8710 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:45.988982  8710 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:45.894483  8692 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:45.953030  8656 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:56:45.921864  7927 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:45.949460  8758 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:45.958715  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:45.973699  6030 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:45.898197  8549 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:45.963325  8773 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:45.998186  8549 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:45.998349  8773 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.980118  5849 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:45.976925  8471 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:45.982631  8781 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:45.985162  8125 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.985638  8756 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:45.988325  8775 log.cc:927] Time spent T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260620 13:56:45.873703  8313 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:45.956455  8649 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:46.003613  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 44975.1us
I20260620 13:56:45.973958  8639 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:46.025938  8639 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:46.026549  8639 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:45.973404  8615 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:45.973534  8675 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:45.948997  8746 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260620 13:56:45.977689  8557 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:45.973413  8556 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:45.997026  8293 raft_consensus.cc:697] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:46.000680  7927 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:45.954190  8734 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260620 13:56:46.037055  5998 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:46.002251  8471 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:46.001720  8692 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:46.019784  8642 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:56:46.005806  8781 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:46.076788  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:46.080520  5950 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260620 13:56:46.081305  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:46.079084  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 123531us
I20260620 13:56:46.186532  6580 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:46.084333  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:46.189054  5952 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:46.017794  8602 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:56:45.966162  8704 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.086688  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:46.087488  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:46.083822  5997 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:46.127386  5955 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
W20260620 13:56:46.128950  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 125659us
I20260620 13:56:46.080837  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:46.135011  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 98023.8us
I20260620 13:56:46.070472  8738 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:46.085701  8629 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:46.093212  8556 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:46.068624  8710 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:46.186839  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:46.082903  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 113673us
I20260620 13:56:46.190433  6585 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:46.197245  5998 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:46.130156  8471 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:46.123999  7927 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:46.036684  8615 consensus_queue.cc:1059] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.100s
I20260620 13:56:46.037143  8649 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:46.172698  8781 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:46.200206  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 116478us
I20260620 13:56:46.201591  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:46.073879  8675 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:46.171415  8671 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:46.201334  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:46.217029  5875 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:46.092980  8557 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.119551  8608 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260620 13:56:46.225744  5924 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:46.212962  8643 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:46.216115  8549 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:46.196808  8789 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:56:46.212347  8591 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:46.207556  8602 raft_consensus.cc:697] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:46.223917  8803 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:46.207305  6578 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:46.233855  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:46.225814  8746 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:46.236091  6551 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:46.236423  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:46.225122  8615 raft_consensus.cc:3055] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:46.216058  8785 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:46.225286  8710 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:46.250829  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:46.228484  8629 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260620 13:56:46.245587  8736 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:46.266692  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:46.268500  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:46.240633  8734 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:46.216848  8293 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.231456  8671 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:46.263641  8782 log.cc:927] Time spent T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.093s	user 0.001s	sys 0.001s
I20260620 13:56:46.279313  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:46.255816  8543 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:46.257803  8615 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:46.267375  8313 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:46.276242  8746 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:46.288522  5829 auto_rebalancer.cc:591] Failed to schedule move for tablet 0e0ab32eab32415c8e9ea1fda9508733: Illegal state: Replica 192c750f597c43858e1ad09e8d805685 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:56:46.289192  8692 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:56:46.292096  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:46.253490  8803 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:46.298530  8675 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:46.299896  8557 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:46.301077  8649 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:46.292940  8125 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:46.249472  8591 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.306129  8671 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:46.288579  8756 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:46.264475  8789 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260620 13:56:46.274073  8759 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:46.308324  8704 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:46.292416  5876 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
W20260620 13:56:46.310410  8788 log.cc:927] Time spent T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260620 13:56:46.310534  8668 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:46.471730  8668 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:46.311385  8791 log.cc:927] Time spent T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260620 13:56:46.264233  8674 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:46.270473  8736 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:46.271960  8773 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:46.444059  8639 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.387603  7927 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.273630  8643 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:46.383163  8543 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:46.404963  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 212669us
I20260620 13:56:46.276321  8785 raft_consensus.cc:697] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:56:46.388595  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 105847us
I20260620 13:56:46.407235  8608 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:46.436105  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 238943us
I20260620 13:56:46.275889  8710 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.493233  8543 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:46.493690  8736 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:56:46.495314  8787 log.cc:927] Time spent T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260620 13:56:46.495262  8608 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:46.444929  6028 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260620 13:56:46.449503  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:46.504360  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:46.505811  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:46.507051  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:46.508951  6030 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260620 13:56:46.287174  8602 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.450381  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:46.512039  6026 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:46.463963  8756 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:46.466902  8792 log.cc:927] Time spent T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260620 13:56:46.467522  8795 log.cc:927] Time spent T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
I20260620 13:56:46.432631  8656 consensus_queue.cc:1048] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260620 13:56:46.443663  8746 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:46.521821  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:46.537156  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:46.537868  6579 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:46.463430  8759 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:46.538908  8759 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:46.498353  8704 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:46.541224  8704 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.543725  8817 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:46.544672  8755 consensus_meta.cc:287] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.001s
I20260620 13:56:46.544798  8756 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:46.545118  8755 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:46.545517  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:46.545120  8818 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:46.547091  8818 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:46.544282  8817 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.537361  8639 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:46.449652  5877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.006s	sys 0.032s
I20260620 13:56:46.547712  6583 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:46.526902  8789 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:46.610630  6579 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:46.619453  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:46.616226  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:46.639479  7927 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:46.641861  5849 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:46.642354  5950 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:46.642765  5924 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:46.546738  8556 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:46.565382  8790 log.cc:927] Time spent T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.339s	user 0.003s	sys 0.000s
I20260620 13:56:46.646164  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:46.616765  8670 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:46.561676  8746 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:46.520025  8692 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:46.548074  8549 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:46.656920  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:46.547376  8803 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:46.549714  8674 raft_consensus.cc:697] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:46.562116  8643 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:46.670966  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 417472us
I20260620 13:56:46.660714  5950 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:46.537875  8591 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:46.642767  8789 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:46.562315  8773 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:46.666961  8556 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:46.655938  8656 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:46.566360  8608 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:46.649505  8731 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:46.649012  8801 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:46.661152  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:46.705847  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 50298.1us
I20260620 13:56:46.690129  8756 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:46.554744  8736 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.693275  6552 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:46.520087  8615 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:46.691390  5849 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:46.572520  8808 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:46.663967  8670 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.699046  8704 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:46.653469  8530 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260620 13:56:46.702630  7927 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:56:46.702836  5997 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:46.704435  6551 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:46.706566  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:46.621089  8818 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:46.657276  8471 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.693955  8789 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:46.788583  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:46.691641  8643 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:46.789261  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:46.789386  6030 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
W20260620 13:56:46.786548  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 80076.2us
I20260620 13:56:46.663074  8649 consensus_queue.cc:1059] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260620 13:56:46.695884  8629 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:46.792074  8758 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:46.718107  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:46.708673  8738 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:46.797075  8125 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:46.796937  8758 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.797672  8125 raft_consensus.cc:697] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:56:46.785765  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 83031.5us
I20260620 13:56:46.794847  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:46.794587  8656 consensus_queue.cc:1059] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:56:46.668596  8668 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:46.550868  8785 consensus_queue.cc:237] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:46.796269  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 91894.4us
I20260620 13:56:46.800083  6033 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:46.801028  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:46.823058  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:46.717104  8293 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:46.800053  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:46.810031  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:46.811095  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:46.812121  5952 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260620 13:56:46.812928  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:46.813606  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:46.828791  5955 raft_consensus.cc:2393] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:46.797286  8738 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:46.816586  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:46.829989  5956 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:46.700006  8773 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.716425  8808 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:46.829031  5953 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:46.846299  7927 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260620 13:56:46.780181  8557 consensus_queue.cc:1175] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "192c750f597c43858e1ad09e8d805685" responder_term: 5 status { last_received { term: 5 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 5 index: 3 } }
W20260620 13:56:46.849752  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 131729us
I20260620 13:56:46.781430  8801 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:46.836311  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:46.795575  8736 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:46.804250  8556 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:46.788906  8731 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:46.851629  5849 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:46.901854  5953 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:46.847937  5997 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:46.855705  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 55717.4us
I20260620 13:56:46.905897  6033 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:46.907923  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:46.830504  8293 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:46.909960  5877 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:46.916566  5957 raft_consensus.cc:2393] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:46.909330  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:46.913376  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:46.858465  7927 raft_consensus.cc:3055] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:46.919255  7927 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:46.920807  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:46.922489  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:46.923815  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:46.924994  5951 raft_consensus.cc:2393] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:46.837606  8738 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:46.798537  8125 consensus_queue.cc:237] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.852564  8808 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:46.925714  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:46.819540  8746 consensus_queue.cc:1059] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260620 13:56:46.979359  5953 raft_consensus.cc:1240] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260620 13:56:46.883381  8617 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:46.885334  8668 raft_consensus.cc:3055] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Stepping down as leader of term 4
W20260620 13:56:46.899955  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 48415.3us
I20260620 13:56:46.925688  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:46.947271  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:46.931226  5950 raft_consensus.cc:2393] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:47.035615  5849 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:46.884124  8556 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:46.910809  8649 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260620 13:56:46.989388  8825 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260620 13:56:46.993985  8827 log.cc:927] Time spent T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260620 13:56:46.994843  8670 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:46.900249  8420 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:46.913566  8781 consensus_meta.cc:287] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.000s
I20260620 13:56:47.001119  8738 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:47.003929  8815 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260620 13:56:47.005729  8643 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:47.042174  8556 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:46.803562  8674 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.108058  8615 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:47.009526  8734 consensus_queue.cc:1059] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260620 13:56:47.110978  8734 raft_consensus.cc:3055] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:47.111532  8734 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:47.112660  8734 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.114634  8734 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:46.883152  8704 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:56:47.012337  8471 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:46.927676  8758 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:46.855906  8710 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:47.025369  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 177560us
I20260620 13:56:47.116874  8755 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:47.118252  5997 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:47.028914  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:47.014880  8829 log.cc:927] Time spent T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.210s	user 0.000s	sys 0.002s
I20260620 13:56:46.898046  8656 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:47.121750  8656 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:47.122342  8656 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:47.124559  8817 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:47.042754  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:47.043262  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:47.125443  6585 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:47.131013  8643 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:47.131407  8825 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260620 13:56:47.131731  8643 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.133816  6585 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:47.134343  8643 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:47.143399  8738 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:47.148213  8773 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:47.061390  8420 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:47.152424  8420 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:47.068439  8781 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.157733  8781 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:47.159386  5881 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260620 13:56:46.853516  8814 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:47.044806  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:47.040992  5849 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:47.174597  6584 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:47.175150  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:47.175343  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 134446us
W20260620 13:56:47.176365  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 58212.6us
I20260620 13:56:47.177431  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:47.041158  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:47.047986  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:47.179147  5876 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:47.179278  5880 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:47.051796  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:47.052102  5848 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:47.053227  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:47.180830  5955 raft_consensus.cc:2393] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 5: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:46.850070  8759 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:46.928681  8293 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:47.195602  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:47.058759  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:47.035480  8801 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:47.063323  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 217121us
I20260620 13:56:47.007084  7927 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.066627  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:47.034854  8668 raft_consensus.cc:740] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:56:47.071305  8822 log.cc:927] Time spent T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260620 13:56:47.071833  8824 log.cc:927] Time spent T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260620 13:56:47.044879  8530 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:47.060453  8642 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:47.218545  8642 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:47.222105  8642 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:47.056515  8746 raft_consensus.cc:3055] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:47.092571  8629 raft_consensus.cc:3055] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:47.223428  8629 raft_consensus.cc:740] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:47.044996  8828 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:47.224478  8828 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:47.224920  8828 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:47.226079  8803 consensus_queue.cc:1048] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:56:47.051390  8731 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260620 13:56:47.037468  8617 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.229041  8803 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:56:47.229976  8617 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:47.230768  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 178723us
W20260620 13:56:47.162134  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 96505.6us
I20260620 13:56:47.184446  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:47.191444  5875 raft_consensus.cc:2393] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:56:47.200578  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 418899us
I20260620 13:56:47.199612  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:47.196827  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
W20260620 13:56:47.203202  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:47.236654  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:47.237496  5951 raft_consensus.cc:2393] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:56:47.165477  8543 consensus_meta.cc:287] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.001s
I20260620 13:56:47.216275  5849 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:56:47.237836  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:47.238111  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:47.239753  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:47.222772  8746 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:47.193786  8817 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:47.201912  8643 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:47.256189  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:47.251390  5879 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
W20260620 13:56:47.267032  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 67470.5us
I20260620 13:56:47.272342  6584 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:47.270875  5998 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:47.234601  8781 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:47.245057  8710 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:47.249547  8731 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:47.249127  8809 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:47.293641  8731 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:47.294102  8731 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:47.293825  8809 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:47.252871  8642 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:47.284557  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:47.289875  8675 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:47.213873  8608 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260620 13:56:47.262868  8817 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:47.271591  8643 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:47.249064  8738 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260620 13:56:47.277236  8549 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:47.197404  8814 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:47.287050  8758 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:47.255564  8543 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.297333  8781 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:47.301745  8821 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:47.210754  8801 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.233927  8668 consensus_queue.cc:260] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:47.308936  8817 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:47.349880  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:47.314702  8643 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:47.314245  8710 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260620 13:56:47.361022  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 76575.8us
I20260620 13:56:47.366984  8803 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:47.375447  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:47.375895  8543 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:47.376080  6580 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:47.375591  8803 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.378438  8803 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:47.379297  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:47.379748  6579 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260620 13:56:47.315042  8675 raft_consensus.cc:697] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:47.381196  6583 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:47.381735  8675 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.374666  6584 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260620 13:56:47.328387  8549 raft_consensus.cc:697] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:47.388463  8549 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.308735  8642 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.395949  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:47.322710  8615 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:47.323717  8758 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:47.373504  8818 consensus_meta.cc:287] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.556s	user 0.013s	sys 0.000s
I20260620 13:56:47.458021  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:47.395334  8692 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.726s	user 0.010s	sys 0.003s
I20260620 13:56:47.461419  6583 raft_consensus.cc:2393] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:47.373106  8710 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:47.372845  8821 raft_consensus.cc:697] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:47.466656  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:47.467886  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:47.433281  8543 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:47.472909  6026 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:47.432780  8803 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:47.473043  6029 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:47.436239  8668 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:47.444994  8758 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:56:47.475075  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:47.482337  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:47.483629  6030 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260620 13:56:47.492697  6033 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:47.458432  8826 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:47.464450  8591 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:47.457403  8816 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:47.494910  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:47.473169  8710 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:47.515744  6033 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260620 13:56:47.468797  8692 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260620 13:56:47.467986  8789 consensus_meta.cc:287] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.649s	user 0.009s	sys 0.001s
I20260620 13:56:47.512225  6025 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:47.456805  8615 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.457127  8556 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:47.472990  8837 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:47.494815  8759 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:47.535801  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 264973us
I20260620 13:56:47.525346  6029 raft_consensus.cc:2410] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260620 13:56:47.466809  8818 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.484750  8738 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:47.556878  5954 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:56:47.534495  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:47.471546  8293 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:47.565300  5958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.000s	sys 0.012s
I20260620 13:56:47.562642  7927 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:56:47.569738  5958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.000s	sys 0.013s
I20260620 13:56:47.565896  6030 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:47.490152  8543 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.520454  8826 raft_consensus.cc:697] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:47.561925  8837 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:47.578514  6584 raft_consensus.cc:2368] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8.
I20260620 13:56:47.526072  8802 consensus_queue.cc:1059] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
W20260620 13:56:47.565831  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 349651us
I20260620 13:56:47.495335  8803 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:47.573964  5998 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 1.977s (SENT) [suppressed 24 similar messages]
I20260620 13:56:47.527259  8809 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:47.514712  8591 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.534704  8789 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.521584  8816 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:47.630314  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 184651us
W20260620 13:56:47.636819  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 62884.9us
W20260620 13:56:47.612442  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:47.639488  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:47.597496  8828 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:47.580783  8837 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:56:47.651042  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:47.567292  8781 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:47.647346  8832 log.cc:927] Time spent T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.278s	user 0.001s	sys 0.001s
I20260620 13:56:47.655059  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:47.570712  8738 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.625713  8754 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260620 13:56:47.682407  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:47.699841  5879 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260620 13:56:47.777153  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 122225us
I20260620 13:56:47.573230  8821 consensus_queue.cc:237] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.605360  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:47.782559  5957 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:56:47.698012  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:47.783459  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 203907us
I20260620 13:56:47.794409  5878 raft_consensus.cc:2410] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:56:47.800913  6030 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:47.803323  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:47.662809  8801 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:47.804242  7927 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:47.756860  8656 consensus_meta.cc:287] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.622s	user 0.012s	sys 0.000s
I20260620 13:56:47.813699  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:47.828392  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:47.814523  8860 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:47.836319  8860 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:47.837268  8860 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:47.837702  8860 raft_consensus.cc:697] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:47.838392  8789 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:47.838881  8643 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.839495  8803 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:47.839609  8293 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:47.730350  8556 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:47.840276  5953 raft_consensus.cc:2368] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6.
I20260620 13:56:47.842022  8643 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:47.843927  8816 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:47.844094  8734 consensus_meta.cc:287] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.678s	user 0.012s	sys 0.000s
I20260620 13:56:47.845410  8543 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:47.845800  8808 consensus_meta.cc:287] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.810s	user 0.007s	sys 0.005s
I20260620 13:56:47.846210  8808 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:47.776265  8853 log.cc:927] Time spent T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260620 13:56:47.851796  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:47.852686  5875 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:47.804196  5876 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:47.823495  7927 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.807174  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:47.668735  8826 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.802729  8549 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:47.863819  8549 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:47.864907  8710 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:47.833936  8828 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:47.834527  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:47.847868  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1497) took 1033 ms. Trace:
I20260620 13:56:47.752229  8642 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:47.850108  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:47.860062  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:47.861454  8313 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:47.861879  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:47.867245  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:47.786424  8615 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:47.804919  8836 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:47.876995  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:47.826246  8804 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:47.889065  8710 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:47.889358  8804 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.875553  5997 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:47.883494  8313 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.891942  8804 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:47.894544  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:47.884526  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:47.869114  5959 rpcz_store.cc:276] 0620 13:56:46.813992 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:46.814127 (+   135us) service_pool.cc:224] Handling call
0620 13:56:46.814658 (+   531us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:56:47.050155 (+235497us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:47.050184 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:56:47.059548 (+  9364us) log.cc:844] Serialized 52 byte log entry
0620 13:56:47.580910 (+521362us) raft_consensus.cc:1645] Marking committed up to 3
0620 13:56:47.618875 (+ 37965us) log.cc:844] Serialized 14 byte log entry
0620 13:56:47.619089 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:47.619212 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:47.847603 (+228391us) raft_consensus.cc:1685] finished
0620 13:56:47.847623 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:47.847799 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35959,"prepare.queue_time_us":14937,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":54988,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":44856,"thread_start_us":564010,"threads_started":2,"wal-append.queue_time_us":615083}
I20260620 13:56:47.838554  8860 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:47.897878  5955 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 8
I20260620 13:56:47.903414  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:47.906752  5880 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:47.884644  8738 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:47.848830  8656 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:47.915477  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 58796.3us
I20260620 13:56:47.915588  8785 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:56:47.916096  8656 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:47.916168  8785 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:47.916709  8785 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:56:47.922024  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:47.922322  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:47.922732  5950 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:47.886390  8818 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:47.925153  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:47.925740  5950 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:56:47.918756  5997 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:47.923909  5954 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260620 13:56:47.925562  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:47.927706  5954 pending_rounds.cc:85] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 7
I20260620 13:56:47.928160  5954 pending_rounds.cc:107] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260620 13:56:47.928253  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:47.922825  5959 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:47.928689  5954 raft_consensus.cc:2889] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:47.932009  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:47.932989  5879 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:47.927829  5951 raft_consensus.cc:2393] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:47.947957  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:47.948796  5879 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:47.951547  5955 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:56:47.887933  8836 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:56:47.928647  8854 log.cc:927] Time spent T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.105s	user 0.001s	sys 0.001s
I20260620 13:56:47.956826  5997 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:47.961135  5959 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:56:47.970423  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:47.899941  8549 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:47.979417  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 151086us
I20260620 13:56:47.978775  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:47.982312  5997 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:48.003882  5997 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:47.973850  8817 consensus_meta.cc:287] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.003s
I20260620 13:56:47.996311  8849 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:47.932487  8591 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:47.947635  8818 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:47.995998  8656 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:48.021463  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:48.028416  6551 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:48.097642  5880 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:48.036067  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:48.097946  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 69661.6us
I20260620 13:56:48.039448  8828 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:56:48.040102  8556 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:48.098502  5879 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:48.040458  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:48.035753  8675 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:56:48.054567  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:48.079905  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:48.083840  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:48.092988  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 55035.4us
I20260620 13:56:48.104118  8656 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:48.106791  8656 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:48.108464  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:48.109709  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:48.111090  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:48.111882  6583 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:48.081944  8849 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:47.973351  8836 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:48.100363  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 1999) took 1178 ms. Trace:
I20260620 13:56:48.118176  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:48.102357  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 1993) took 1190 ms. Trace:
I20260620 13:56:48.119861  6585 raft_consensus.cc:2393] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:48.119289  5958 rpcz_store.cc:276] 0620 13:56:46.921941 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:46.966092 (+ 44151us) service_pool.cc:224] Handling call
0620 13:56:46.977683 (+ 11591us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:46.978042 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 1
0620 13:56:46.978079 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:46.978635 (+   556us) log.cc:844] Serialized 26 byte log entry
0620 13:56:47.572373 (+593738us) raft_consensus.cc:1645] Marking committed up to 1
0620 13:56:47.573209 (+   836us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:47.573277 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:48.100172 (+526895us) raft_consensus.cc:1685] finished
0620 13:56:48.100190 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:48.100309 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":593373,"threads_started":1,"wal-append.queue_time_us":765951}
I20260620 13:56:48.122002  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:48.122627  5877 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:48.095474  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:48.044371  8313 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:48.120023  5952 rpcz_store.cc:276] 0620 13:56:46.912250 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:46.912369 (+   119us) service_pool.cc:224] Handling call
0620 13:56:46.912650 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:46.913108 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:47.311243 (+398135us) log.cc:844] Serialized 14 byte log entry
0620 13:56:48.101199 (+789956us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b18003ab5e0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc68540a 00007f0fe5dca5d9 00007f0fdc70d240 00007f0fdc707ce4 00007f0fdc707c55 00007f0fe31f6247 00007f0fdf806d87 00007f0fdf81649f 00007f0fdf816418
0620 13:56:48.101824 (+   625us) log.cc:844] Serialized 14 byte log entry
0620 13:56:48.102026 (+   202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:48.102074 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:48.102123 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:48.102187 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:48.102309 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18980,"prepare.queue_time_us":1070925,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":7198,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":9126,"spinlock_wait_cycles":7163776,"thread_start_us":662118,"threads_started":2,"wal-append.queue_time_us":466537}
I20260620 13:56:48.033556  8865 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260620 13:56:48.126593  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:48.128952  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:48.133178  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:48.130375  6583 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:48.101361  8293 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:56:48.103000  8675 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:48.081545  8817 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:48.140554  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:48.164427  5882 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 8
I20260620 13:56:48.120345  8849 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:48.166795  8828 raft_consensus.cc:697] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:48.079660  8746 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:48.134545  8313 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:48.114122  8556 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:48.117843  8656 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:48.138370  8754 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:48.185336  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:48.168936  8731 consensus_meta.cc:287] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.874s	user 0.015s	sys 0.000s
I20260620 13:56:48.165426  8675 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:56:48.190554  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:48.194700  5875 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
W20260620 13:56:48.207769  8869 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260620 13:56:48.206770  8746 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:48.223675  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:48.235821  8867 log.cc:927] Time spent T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260620 13:56:48.237076  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:48.242302  5882 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:56:48.176756  8293 raft_consensus.cc:697] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:48.250829  5879 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:48.254679  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:48.266654  5876 raft_consensus.cc:2410] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:56:48.262493  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:48.276273  8756 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:48.205190  8754 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:48.277433  8874 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260620 13:56:48.278643  8754 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:48.279723  8837 consensus_meta.cc:287] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.638s	user 0.007s	sys 0.005s
I20260620 13:56:48.279894  8756 raft_consensus.cc:697] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:48.280179  8837 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:48.280835  8756 consensus_queue.cc:237] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:48.268765  8293 consensus_queue.cc:237] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:48.282835  8837 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:48.238675  8557 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:48.222759  8785 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:48.190475  8313 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:48.192443  8656 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:48.206401  8731 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:49.005332  6550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.003s	sys 0.007s
I20260620 13:56:48.249831  8781 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:49.221202  6550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.003s	sys 0.009s
I20260620 13:56:49.221836  8781 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:48.344811  8828 consensus_queue.cc:237] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.226450  8656 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.227469  8876 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:49.228500  8876 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:48.883037  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:49.231894  6031 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:49.233172  8785 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:49.233582  8731 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.233922  8313 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:48.893621  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:49.060684  8818 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:49.235965  5876 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:56:48.322672  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:48.844102  5950 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260620 13:56:48.977741  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:48.842413  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:48.844761  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:48.892097  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:48.980676  5924 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.002s	sys 0.003s
W20260620 13:56:49.042281  8675 consensus_meta.cc:287] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.792s	user 0.008s	sys 0.005s
W20260620 13:56:49.220541  8859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.021s	sys 0.019s
I20260620 13:56:48.288578  8877 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:48.641386  8836 consensus_meta.cc:287] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
W20260620 13:56:49.243260  5924 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.007s	sys 0.005s
I20260620 13:56:48.401634  6026 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260620 13:56:49.236747  5950 pending_rounds.cc:85] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 5
I20260620 13:56:48.632738  8849 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:48.971132  8549 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:48.403445  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:48.575830  8862 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.736s	user 0.002s	sys 0.005s
W20260620 13:56:48.541312  8758 consensus_meta.cc:287] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.029s	user 0.006s	sys 0.006s
I20260620 13:56:49.249215  5950 pending_rounds.cc:107] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260620 13:56:48.617918  8556 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.274003  6032 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:48.321703  8704 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:49.275821  8837 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:49.275660  8704 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.276628  8837 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.279915  6028 raft_consensus.cc:2393] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:49.283236  8557 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.284238  8656 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:49.285075  8656 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.286419  8557 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:48.383186  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.288475  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:49.289495  5953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2003) took 2050 ms (client timeout 1753 ms). Trace:
W20260620 13:56:49.289992  5953 rpcz_store.cc:269] 0620 13:56:47.239297 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:47.239457 (+   160us) service_pool.cc:224] Handling call
0620 13:56:49.288993 (+2049536us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54000799d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:49.289219 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362192640}
I20260620 13:56:49.291746  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.292769  6026 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:49.294320  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:49.294548  8731 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:48.314087  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.295848  8731 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.297171  6024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43502 (request call id 2056) took 1043 ms. Trace:
I20260620 13:56:49.297596  6024 rpcz_store.cc:276] 0620 13:56:48.253749 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:48.261339 (+  7590us) service_pool.cc:224] Handling call
0620 13:56:49.296976 (+1035637us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:49.298229  6027 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260620 13:56:49.298873  8675 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.300654  8731 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.301255  8675 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.302294  8836 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.296263  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:49.303272  8731 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:49.304780  8836 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.304095  8731 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.305004  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:49.305586  8860 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.000s	sys 0.012s
W20260620 13:56:49.306042  8860 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.000s	sys 0.012s
I20260620 13:56:49.306542  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.305999  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.309903  6028 raft_consensus.cc:2368] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10.
W20260620 13:56:49.264621  8859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.022s	sys 0.019s
I20260620 13:56:49.286319  7927 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.272511  5950 raft_consensus.cc:2889] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:49.327380  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.310990  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.236068  8818 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.341528  6031 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:56:49.348294  8860 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:49.349437  8704 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.349288  8860 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.350189  6027 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:49.352730  6029 raft_consensus.cc:1240] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:49.311094  8731 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.370381  6024 raft_consensus.cc:1240] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
W20260620 13:56:49.371344  8668 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.019s	sys 0.029s
W20260620 13:56:49.371754  5880 consensus_meta.cc:287] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 1.271s	user 0.014s	sys 0.009s
W20260620 13:56:49.371886  8668 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.020s	sys 0.030s
I20260620 13:56:49.372298  5880 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:49.373380  5880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58452 (request call id 2369) took 1352 ms. Trace:
I20260620 13:56:49.373626  8781 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.373723  5880 rpcz_store.cc:276] 0620 13:56:48.020923 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:48.021135 (+   212us) service_pool.cc:224] Handling call
0620 13:56:49.373144 (+1352009us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:56:49.374562  8877 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.377283  8877 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.370810  8758 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.343762  8876 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:49.367019  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 1.06045e+06us
I20260620 13:56:49.404318  8731 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:49.405967  8883 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.098s	user 0.001s	sys 0.001s
I20260620 13:56:49.405542  8731 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.407161  8756 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:49.407822  8756 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.410597  8731 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.415815  6029 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260620 13:56:49.401610  5959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.018s	sys 0.081s
I20260620 13:56:49.424157  6027 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260620 13:56:49.428066  5959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.249s	user 0.019s	sys 0.082s
I20260620 13:56:49.428642  8860 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.463734  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.464869  6027 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
W20260620 13:56:49.465621  8863 log.cc:927] Time spent T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 1.631s	user 0.016s	sys 0.016s
I20260620 13:56:49.470079  8814 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:49.475363  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.478936  8781 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:49.503221  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:49.504169  8656 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.505030  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:49.505293  8758 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:49.505481  6584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 804) took 2110 ms (client timeout 1956 ms). Trace:
I20260620 13:56:49.505988  5882 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:49.508010  8818 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.519997  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2374) took 1154 ms. Trace:
I20260620 13:56:49.430158  8549 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.524384  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.525326  8849 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.525115  6026 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:49.447829  8859 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:49.526166  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.526551  8859 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.524750  6029 raft_consensus.cc:2393] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:49.520715  5879 rpcz_store.cc:276] 0620 13:56:48.289787 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:48.289967 (+   180us) service_pool.cc:224] Handling call
0620 13:56:48.813944 (+523977us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:48.814672 (+   728us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:56:49.327337 (+512665us) log.cc:844] Serialized 14 byte log entry
0620 13:56:49.443589 (+116252us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:49.443662 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:49.443725 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:49.443814 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:49.443983 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":622724,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":7165,"raft.queue_time_us":6061,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":19625,"thread_start_us":572521,"threads_started":2,"wal-append.queue_time_us":183126}
I20260620 13:56:49.529507  6029 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:49.530040  8859 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.526883  6030 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:49.519898  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:49.534801  6024 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:49.536667  6027 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:49.538902  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:49.540233  6031 raft_consensus.cc:2393] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 5: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:49.543648  8781 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.548511  6027 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: []
I20260620 13:56:49.549821  8898 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:49.550880  8898 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:49.558784  5829 auto_rebalancer.cc:591] Failed to schedule move for tablet ab83097997ba42219f9a63aad224f786: Illegal state: Replica 663684cf4ae54c929bf8240ca0b63a47 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:56:49.526994  8549 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:49.505993  6584 rpcz_store.cc:269] 0620 13:56:47.395374 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:47.395598 (+   224us) service_pool.cc:224] Handling call
0620 13:56:49.504923 (+2109325us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54004eb954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:49.505189 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331967232}
I20260620 13:56:49.563670  8898 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.570005  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:49.571036  6027 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:49.575450  8860 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:49.575851  8836 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:49.576335  8860 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.576627  8836 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.577052  6030 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:56:49.578224  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:49.578703  8860 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.576336  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.546994  8781 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.579610  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:49.488250  8731 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:49.607251  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.578926  8836 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:49.612769  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 207152us
I20260620 13:56:49.614650  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.617138  5880 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:49.623745  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:49.625293  5954 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:49.631773  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:56:49.634923  6578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46858 (request call id 750) took 3102 ms (client timeout 1528 ms). Trace:
I20260620 13:56:49.614374  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:49.634097  5954 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:49.631664  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:49.620820  6029 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:49.635295  8704 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:49.639451  5953 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:56:49.640770  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:49.635596  6578 rpcz_store.cc:269] 0620 13:56:46.531981 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:46.545190 (+ 13209us) service_pool.cc:224] Handling call
0620 13:56:49.634363 (+3089173us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b54005113d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:49.634654 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2271322496}
I20260620 13:56:49.642537  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:49.644007  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:49.639715  5957 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:49.613885  8781 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:49.637108  8629 consensus_queue.cc:260] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.650202  8781 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.651027  8629 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:49.652392  8895 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:49.654234  8840 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 1.976s	user 0.017s	sys 0.017s
I20260620 13:56:49.654732  8860 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:49.655057  8859 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:49.655241  8656 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:49.655401  8860 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.655895  8859 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.656193  8656 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.657251  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:49.657888  8860 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.658450  8656 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.659433  8704 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.660948  8668 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:49.658016  8859 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.661623  8668 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.662552  8704 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.663625  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:56:49.664017  5998 leader_election.cc:336] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 1.624s (SENT)
I20260620 13:56:49.664484  5998 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:49.662433  8859 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:49.665387  8557 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:49.658736  8894 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:49.664970  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:49.666282  8894 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.667225  8557 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:49.669407  8894 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.658473  8860 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:49.670047  8859 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:49.670516  8831 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 2.611s	user 0.009s	sys 0.023s
I20260620 13:56:49.670701  8860 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.649326  5997 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:49.653599  8895 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.675523  8809 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:49.675952  8895 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.675971  8809 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:49.677276  8809 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:49.677623  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:49.679147  8816 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:49.679562  8816 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:49.676769  8808 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.679970  8781 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.679992  8816 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:49.682677  8860 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.672971  6027 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
W20260620 13:56:49.684935  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:49.688380  8906 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:49.689913  8881 log.cc:927] Time spent T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.342s	user 0.000s	sys 0.003s
I20260620 13:56:49.684260  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2384) took 1291 ms. Trace:
I20260620 13:56:49.695920  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 644) took 1585 ms. Trace:
I20260620 13:56:49.623835  8731 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.696333  5959 rpcz_store.cc:276] 0620 13:56:48.110955 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:48.111436 (+   481us) service_pool.cc:224] Handling call
0620 13:56:48.115620 (+  4184us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:48.119959 (+  4339us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:48.119988 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:48.130926 (+ 10938us) log.cc:844] Serialized 26 byte log entry
0620 13:56:49.563799 (+1432873us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:49.563912 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:49.564048 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:49.689043 (+124995us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:56:49.691613 (+  2570us) raft_consensus.cc:1685] finished
0620 13:56:49.691636 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:49.695827 (+  4191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6526,"raft.queue_time_us":4386,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":18884,"spinlock_wait_cycles":14275456,"thread_start_us":1249947,"threads_started":1,"wal-append.queue_time_us":1183134}
I20260620 13:56:49.698202  8731 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.637804  8836 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:49.699348  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 71944us
I20260620 13:56:49.699550  5958 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:49.699901  8836 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.700889  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:49.701342  5957 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:49.702639  6027 raft_consensus.cc:2393] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:49.711516  5880 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:49.712678  5953 raft_consensus.cc:1275] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260620 13:56:49.719602  6025 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:49.719946  5954 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
W20260620 13:56:49.721894  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:49.676057  8859 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.690776  6033 rpcz_store.cc:276] 0620 13:56:48.392771 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:48.392954 (+   183us) service_pool.cc:224] Handling call
0620 13:56:48.393402 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:48.421523 (+ 28121us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:48.421558 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:49.409057 (+987499us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b2c000c06c8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fde0f5c71 00007f0fde1055d2 00007f0fdf837de1 00007f0fdf7fc81a 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22
0620 13:56:49.409711 (+   654us) log.cc:844] Serialized 26 byte log entry
0620 13:56:49.571459 (+161748us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:49.571523 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:49.571656 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:49.681080 (+109424us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b54003a0820. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf77219e 00007f0fdf77cd10 00007f0fdf77ccb8 00007f0fdf77cc38 00007f0fdf77cbf3 00007f0fdf77be7c 00007f0fe56671f6 00007f0fe56619a8 00007f0fdf7b8bab 00007f0fdf7bb6a0
0620 13:56:49.683913 (+  2833us) raft_consensus.cc:1685] finished
0620 13:56:49.683933 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:49.684064 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":212742,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":63592576,"thread_start_us":91389,"threads_started":1,"wal-append.queue_time_us":132395}
I20260620 13:56:49.691715  8812 raft_consensus.cc:3055] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:49.728632  8836 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.729001  8812 raft_consensus.cc:740] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:56:49.730420  5951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1507) took 1904 ms (client timeout 2528 ms). Trace:
W20260620 13:56:49.730866  5951 rpcz_store.cc:269] 0620 13:56:47.825761 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:47.826336 (+   575us) service_pool.cc:224] Handling call
0620 13:56:49.723218 (+1896882us) spinlock_profiling.cc:243] Waited 59.1 ms on lock 0x7b5400305a54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:49.730249 (+  7031us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135838976}
I20260620 13:56:49.673157  8668 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.736193  5997 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:49.744168  8704 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:49.745115  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.745182  8704 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.748139  8675 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:49.748224  8839 consensus_queue.cc:1048] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:56:49.749012  8675 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:49.749660  8675 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:49.772348  6032 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260620 13:56:49.742303  8837 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.772838  6032 pending_rounds.cc:85] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 5
I20260620 13:56:49.779846  6032 pending_rounds.cc:107] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260620 13:56:49.780242  6032 raft_consensus.cc:2889] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:49.784282  8704 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.785321  8704 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:49.786167  8704 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.799727  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:49.800511  5880 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:49.742421  8906 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.801990  8911 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:49.803272  8906 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.802791  8911 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.806056  8911 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.809768  5880 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
W20260620 13:56:49.811453  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 100488us
I20260620 13:56:49.813820  5998 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:49.797696  5997 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:49.818718  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 94679us
I20260620 13:56:49.809960  6024 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:49.827772  6026 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:49.814085  8911 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:49.833343  8911 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.834246  8704 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.832320  8781 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:49.835624  8781 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.836476  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:49.836628  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.836891  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.837172  5875 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:49.837478  6027 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:49.837896  8865 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:49.838515  8859 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:49.839275  8859 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:49.841416  8841 log.cc:927] Time spent T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 2.100s	user 0.007s	sys 0.026s
I20260620 13:56:49.844470  8912 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:49.845510  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:49.845435  8675 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.846513  8836 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:49.852425  8836 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:49.857450  8821 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.939s	user 0.016s	sys 0.039s
W20260620 13:56:49.857944  8821 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.016s	user 0.016s	sys 0.039s
I20260620 13:56:49.846493  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:49.847589  8755 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:49.776026  8812 consensus_queue.cc:260] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.845359  8912 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.849712  5875 raft_consensus.cc:3055] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:49.864982  6025 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:49.868153  5875 raft_consensus.cc:740] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:49.841450  8859 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.874639  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:49.865818  8755 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:49.875416  6033 raft_consensus.cc:1240] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:49.881937  8759 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:49.874162  8839 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:49.878296  8629 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:49.886914  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1504) took 2407 ms. Trace:
W20260620 13:56:49.887171  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 73532.3us
I20260620 13:56:49.889366  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:49.871361  8865 raft_consensus.cc:697] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:49.890166  5956 rpcz_store.cc:276] 0620 13:56:47.476748 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:47.476882 (+   134us) service_pool.cc:224] Handling call
0620 13:56:47.482673 (+  5791us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:47.777503 (+294830us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:47.777535 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:47.777580 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:47.777612 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:49.871459 (+2093847us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54002a85d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:49.877535 (+  6076us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:49.883769 (+  6234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677502848}
I20260620 13:56:49.879154  8755 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:49.893903  5880 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:49.890559  5882 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:49.876029  8836 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.892665  5848 leader_election.cc:400] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6.
I20260620 13:56:49.895809  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:49.899173  5848 leader_election.cc:403] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260620 13:56:49.891525  5875 consensus_queue.cc:260] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.901391  8759 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.896148  8812 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:49.897830  8617 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:49.903918  8759 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.903813  8617 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:49.901443  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:49.906548  8617 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:49.910387  5876 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:49.902973  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:49.911455  5955 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:56:49.908533  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:49.914292  8758 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:49.893342  8821 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:49.930743  8758 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.934715  5875 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:49.930768  8917 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6.
I20260620 13:56:49.941200  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:49.919938  8759 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:49.901028  8809 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.943454  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:49.944309  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:49.946164  8758 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.910992  8629 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.946887  8759 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.947299  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1512) took 2026 ms. Trace:
I20260620 13:56:49.951681  8675 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:49.955806  8773 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:49.919569  8911 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:49.958683  5882 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:49.959769  5880 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:49.962970  5876 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:49.967221  8817 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:49.969787  5950 rpcz_store.cc:276] 0620 13:56:47.920756 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:47.926817 (+  6061us) service_pool.cc:224] Handling call
0620 13:56:47.927271 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:49.399350 (+1472079us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:49.946885 (+547535us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b5400043dd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:49.947238 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105428224}
W20260620 13:56:49.974298  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 59652.8us
I20260620 13:56:49.976925  8836 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:49.984287  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:49.995507  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:49.995757  8859 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:56:49.997041  6584 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260620 13:56:49.984036  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:49.991410  8836 raft_consensus.cc:697] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:50.002482  8836 consensus_queue.cc:237] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:50.004921  8629 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:50.006655  8912 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:50.009063  8759 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:50.010085  8773 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:49.969915  8756 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:50.025900  8617 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:50.026922  8617 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.987748  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:49.994410  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:50.036686  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:50.028230  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:49.968132  8816 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:49.973763  8781 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:50.040793  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 46496.6us
I20260620 13:56:50.043768  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.049535  6578 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260620 13:56:50.049588  6584 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:49.963835  8821 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:50.052444  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 151582us
I20260620 13:56:50.018599  8773 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:50.039661  8814 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:50.054051  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:50.058920  6583 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:49.984628  8865 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.161377  5849 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:50.178412  5955 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:56:50.059510  6579 raft_consensus.cc:1240] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:50.099303  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.190708  5997 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:50.046528  8756 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260620 13:56:50.191586  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:50.194389  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 210596us
W20260620 13:56:50.195951  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 147764us
I20260620 13:56:50.198465  8912 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:50.199194  8912 raft_consensus.cc:697] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:50.108507  8617 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:50.200387  8912 consensus_queue.cc:237] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:50.201082  5998 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:50.202075  8556 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:50.124055  8839 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260620 13:56:50.203577  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:50.203725  8642 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:50.205186  8642 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:50.205462  8556 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:50.205583  8642 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:50.209998  5997 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:50.213904  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 161341us
I20260620 13:56:50.214085  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:50.215289  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.216066  6583 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:50.216928  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.217144  6552 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:50.218375  8379 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:50.218377  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.220367  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.221700  6583 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:50.221975  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:50.085906  8781 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:50.060277  8809 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:50.097568  8890 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:50.191397  8814 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:50.231776  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:50.195122  8756 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:50.231678  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:50.112520  8817 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:50.236248  5953 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:50.235519  5997 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:50.238162  5959 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:50.234632  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:50.055884  8755 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.233414  8808 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:50.251880  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.257077  8556 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:56:50.261168  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:50.266805  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.267913  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.268426  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:50.238693  8756 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:50.232869  8781 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:50.274613  5959 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:56:50.235926  8814 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:50.238785  8812 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:50.274175  5958 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:50.285465  8781 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:50.300381  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:50.307796  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:50.308684  5959 raft_consensus.cc:2393] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:50.310459  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.311239  6580 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:50.294839  5953 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
W20260620 13:56:50.295686  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:50.313804  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:50.278331  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.276898  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:50.314188  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:50.314535  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:50.314904  5953 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:50.281692  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.316241  6026 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:50.273144  8808 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:50.285157  6581 raft_consensus.cc:2368] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7.
I20260620 13:56:50.284329  8839 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:50.294257  5952 raft_consensus.cc:1275] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260620 13:56:50.294788  8556 raft_consensus.cc:697] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:50.267961  8821 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:50.314548  5876 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
W20260620 13:56:50.286634  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 69586.6us
I20260620 13:56:50.305198  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:50.282663  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:50.280460  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 50349.7us
I20260620 13:56:50.319118  5997 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:50.249490  8816 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:50.323778  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.324406  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:50.336236  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 282079us
I20260620 13:56:50.249686  8890 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.354305  8675 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:50.355151  8675 raft_consensus.cc:697] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:50.356671  8755 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:50.356509  8675 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:50.357406  8890 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:50.361647  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.326640  8839 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:50.363256  8839 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:50.363569  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.341794  8817 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:50.364416  5849 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:50.326288  8808 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:50.367844  5998 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:50.371443  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.372259  5849 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:50.378703  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.382129  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.382441  5876 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260620 13:56:50.383324  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.378283  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.381556  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.390808  6033 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:50.382858  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.391496  5877 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:56:50.383397  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.381206  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.392334  5878 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:56:50.392750  6025 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 9: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:50.393838  5875 raft_consensus.cc:2410] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260620 13:56:50.369871  8814 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.382862  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.396564  5881 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:50.396483  8556 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:50.397670  8814 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:50.397792  8816 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:50.379846  6031 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260620 13:56:50.382445  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.398973  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.404253  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.372483  8812 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:50.408655  8916 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:50.410604  5849 leader_election.cc:400] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10.
I20260620 13:56:50.411377  5849 leader_election.cc:403] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:56:50.413379  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.414058  6031 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:50.415774  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:50.423012  6582 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:50.433842  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.433746  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.367079  8817 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:50.434767  5882 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:50.442940  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.443964  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.431571  8906 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 10
I20260620 13:56:50.447330  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.449981  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.458473  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.460346  6551 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:50.414893  8642 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.457593  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:50.461160  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 182461us
I20260620 13:56:50.464425  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:50.465466  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:50.465590  8817 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:50.466014  8817 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:50.466681  8817 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:50.469339  8916 consensus_queue.cc:1059] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:50.472522  8773 raft_consensus.cc:3055] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:50.473016  8773 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:50.474087  8773 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.475232  8804 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:50.475677  8804 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:50.476090  8804 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:50.478078  8821 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:50.479007  6027 raft_consensus.cc:2393] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:50.478629  8821 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.479439  8754 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:50.479873  8754 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:50.480278  8754 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:50.481141  8821 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:50.488562  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.490159  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:50.486863  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.491468  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.486831  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.492259  6580 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:50.493166  8781 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:50.495489  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 49642.3us
I20260620 13:56:50.498224  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.499028  6582 raft_consensus.cc:2393] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:50.478552  8642 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:50.491503  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.499776  8471 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:50.519980  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.543969  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:50.546689  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:50.553915  8471 raft_consensus.cc:697] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:50.554919  8826 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260620 13:56:50.513556  8773 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:50.557639  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:50.520951  8781 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:50.561542  8906 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10.
I20260620 13:56:50.562077  8756 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:50.535658  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:50.535626  6586 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260620 13:56:50.573185  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:50.579788  5951 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:50.519280  8837 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:50.589460  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.594422  6580 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:50.594756  5879 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
W20260620 13:56:50.596155  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 60609.5us
I20260620 13:56:50.607820  5956 raft_consensus.cc:2393] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 4: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:50.605684  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:50.582207  8916 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:50.617177  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.544070  8812 consensus_queue.cc:1059] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260620 13:56:50.604561  8379 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260620 13:56:50.622113  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 121019us
I20260620 13:56:50.622761  5849 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:50.627671  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:50.581067  8804 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.616240  8916 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:50.635715  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:50.636399  6026 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:50.626643  8379 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:50.610540  8837 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:50.639585  8916 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:50.652009  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:50.654291  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.638198  8906 raft_consensus.cc:2764] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260620 13:56:50.663924  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.637801  5778 catalog_manager.cc:5696] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 4 to 6, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 6 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:50.644481  8379 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:50.663089  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.669441  6586 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260620 13:56:50.677208  5876 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:56:50.678130  6031 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260620 13:56:50.679490  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.681214  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.681650  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:50.632005  8471 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.686838  8255 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:50.687525  8255 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:50.688035  8255 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:50.688624  8837 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:50.688894  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:50.689730  8837 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:50.690420  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:50.693234  8817 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.695295  8912 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:50.695832  8912 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:50.696223  8912 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:50.697369  8754 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.698567  6587 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:56:50.700802  8808 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.704136  8781 raft_consensus.cc:3055] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:50.705245  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:50.705888  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:50.704739  8781 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:50.707702  6030 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:50.708689  8781 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.710199  8781 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:50.711508  8839 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.710821  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:50.716962  8937 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260620 13:56:50.718895  8933 log.cc:927] Time spent T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260620 13:56:50.722136  6551 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:50.723362  6551 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:50.726168  8821 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:50.726100  8758 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:56:50.718762  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:50.727377  6026 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:50.730154  5880 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 7
W20260620 13:56:50.737623  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:50.739425  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:50.741897  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:50.745765  8911 raft_consensus.cc:2764] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260620 13:56:50.745117  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:50.743335  5778 catalog_manager.cc:5696] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 1 to 2, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:50.749984  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:50.750864  5876 raft_consensus.cc:2393] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:50.756323  6580 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:56:50.760653  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:50.732296  8821 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:50.733974  8808 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:50.735033  8758 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:50.770018  8758 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:56:50.770524  8836 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:50.746883  8859 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:50.771332  8859 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:50.771898  8859 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:50.771175  8836 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:50.776384  8836 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:50.784062  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
W20260620 13:56:50.789166  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:50.763724  5778 catalog_manager.cc:5696] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 1 to 4, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 4 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:50.788689  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:50.769510  8821 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:56:50.818532  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 404018us
I20260620 13:56:50.765515  8911 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260620 13:56:50.832573  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 109273us
I20260620 13:56:50.810977  8755 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260620 13:56:50.850890  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:50.812276  8817 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:50.834693  8754 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:50.847857  8906 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:50.864888  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 250039us
I20260620 13:56:50.812561  8756 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:50.866187  5880 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:50.866714  8756 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:50.855381  8911 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:56:50.875700  8673 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:50.883308  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:50.816969  8255 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.845566  8755 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:50.903473  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 91557.9us
I20260620 13:56:50.893651  5779 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56624 (request call id 343) took 9650 ms. Trace:
W20260620 13:56:50.906234  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:50.841014  6026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29e2284e793941b4aa9829a72313998c"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:56:50.910216  6026 raft_consensus.cc:606] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:56:50.892217  8755 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:56:50.910655  6026 raft_consensus.cc:614] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:56:50.909752  5778 catalog_manager.cc:5696] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 3 to 4, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 4 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:50.880481  8911 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:50.905298  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:50.886029  8804 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:50.918394  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:50.884703  8837 raft_consensus.cc:697] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:56:50.914717  6552 connection.cc:256] RPC call timeout handler was delayed by -1.7701726149999786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260620 13:56:50.890908  8673 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:50.886451  8906 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:50.924871  6552 connection.cc:256] RPC call timeout handler was delayed by -1.6306726149999804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
W20260620 13:56:50.931545  6552 connection.cc:256] RPC call timeout handler was delayed by -1.5820726149999018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
W20260620 13:56:50.931955  6552 connection.cc:256] RPC call timeout handler was delayed by -1.4200726149999809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
W20260620 13:56:50.932262  6552 connection.cc:256] RPC call timeout handler was delayed by -1.38857261499993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260620 13:56:50.931370  5778 catalog_manager.cc:5696] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 1 to 6, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 6 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:56:50.932581  6552 connection.cc:256] RPC call timeout handler was delayed by -1.2634726149999551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
W20260620 13:56:50.932986  6552 connection.cc:256] RPC call timeout handler was delayed by -1.0312726149999207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2445s for a response
I20260620 13:56:50.933646  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:50.917810  8911 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:50.933480  5778 catalog_manager.cc:5696] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 2 to 4, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 4 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:56:50.963935  5778 catalog_manager.cc:5696] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 3 to 4, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 4 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:50.974015  6026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:56:50.970610  5955 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260620 13:56:50.977291  6026 raft_consensus.cc:606] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:50.973155  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:50.940945  8471 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:50.955300  8912 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.008608  5950 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:56:50.937711  8859 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:51.010802  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 154775us
I20260620 13:56:51.023193  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:51.028671  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 160299us
W20260620 13:56:51.025925  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 120717us
I20260620 13:56:50.972739  8673 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:51.035048  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:51.033771  5778 catalog_manager.cc:5696] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 1 to 3, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 3 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:50.906517  5779 rpcz_store.cc:276] 0620 13:56:41.257063 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:41.264618 (+  7555us) service_pool.cc:224] Handling call
0620 13:56:50.847135 (+9582517us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:56:46.216445 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:56:46.387994 (+171549us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:56:46.432831 (+ 44837us) write_op.cc:435] Acquired schema lock
0620 13:56:46.432886 (+    55us) tablet.cc:662] Decoding operations
0620 13:56:46.553564 (+120678us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:56:46.553653 (+    89us) write_op.cc:641] Partition lock acquired for write op
0620 13:56:46.553713 (+    60us) tablet.cc:685] Acquiring locks for 22 operations
0620 13:56:46.908478 (+354765us) tablet.cc:701] Row locks acquired
0620 13:56:46.908498 (+    20us) write_op.cc:260] PREPARE: finished
0620 13:56:47.024051 (+115553us) write_op.cc:270] Start()
0620 13:56:47.036256 (+ 12205us) write_op.cc:276] Timestamp: P: 1781963806981924 usec, L: 0
0620 13:56:47.036287 (+    31us) op_driver.cc:348] REPLICATION: starting
0620 13:56:47.289011 (+252724us) log.cc:844] Serialized 8615 byte log entry
0620 13:56:48.124243 (+835232us) op_driver.cc:464] REPLICATION: finished
0620 13:56:49.307683 (+1183440us) write_op.cc:301] APPLY: starting
0620 13:56:49.307899 (+   216us) tablet.cc:1367] starting BulkCheckPresence
0620 13:56:49.308606 (+   707us) tablet.cc:1370] finished BulkCheckPresence
0620 13:56:49.308759 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:56:49.311570 (+  2811us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:56:49.370626 (+ 59056us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0620 13:56:49.370749 (+   123us) write_op.cc:312] APPLY: finished
0620 13:56:49.371997 (+  1248us) log.cc:844] Serialized 152 byte log entry
0620 13:56:49.581516 (+209519us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:49.624248 (+ 42732us) write_op.cc:454] Released schema lock
0620 13:56:49.624335 (+    87us) write_op.cc:341] FINISH: Updating metrics
0620 13:56:49.625257 (+   922us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:49.625294 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16209,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":1174410,"apply.run_cpu_time_us":47240,"apply.run_wall_time_us":317476,"num_ops":22,"prepare.queue_time_us":214313,"prepare.run_cpu_time_us":25328,"prepare.run_wall_time_us":1375416,"raft.queue_time_us":132514,"raft.run_cpu_time_us":56499,"raft.run_wall_time_us":328104,"replication_time_us":1057830,"thread_start_us":795401,"threads_started":5,"wal-append.queue_time_us":551454,"wal-append.run_cpu_time_us":18514,"wal-append.run_wall_time_us":2538050}]]}
I20260620 13:56:50.993719  8804 consensus_queue.cc:1059] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260620 13:56:51.035362  8940 consensus_queue.cc:1059] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260620 13:56:50.996222  8379 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.012214  8945 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:51.040985  5951 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:51.042546  5956 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:51.098431  8255 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:51.098820  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:51.099784  8859 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:51.100481  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:51.103797  8941 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260620 13:56:51.041543  8617 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:51.108296  8839 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:51.136111  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:51.137578  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:51.139024  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:51.140246  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:50.968402  8837 consensus_queue.cc:237] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:51.097651  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 57304.4us
I20260620 13:56:51.142040  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:51.142350  6032 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260620 13:56:51.113653  8557 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260620 13:56:51.127076  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 109619us
I20260620 13:56:51.128098  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:51.129560  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:51.147894  6026 raft_consensus.cc:2393] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:51.133371  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:51.141026  6029 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:56:51.144654  5849 connection.cc:256] RPC call timeout handler was delayed by -1.373665165000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
I20260620 13:56:51.083628  8948 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260620 13:56:51.044582  8946 log.cc:927] Time spent T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260620 13:56:51.149076  5849 connection.cc:256] RPC call timeout handler was delayed by -1.3691651650000267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260620 13:56:51.148492  6033 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
W20260620 13:56:51.150221  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 127159us
W20260620 13:56:51.156020  5849 connection.cc:256] RPC call timeout handler was delayed by -1.3277651650000735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
I20260620 13:56:51.153023  8906 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:51.159050  5951 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260620 13:56:51.115218  8945 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:51.161394  8953 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260620 13:56:51.163200  8379 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:51.164055  8821 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.165122  8911 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.169166  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:51.199474  6030 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:56:51.156431  5849 connection.cc:256] RPC call timeout handler was delayed by -1.2908651650000138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
I20260620 13:56:51.037037  8809 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260620 13:56:51.205267  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:51.044634  8773 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260620 13:56:51.147342  8859 raft_consensus.cc:2764] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260620 13:56:51.206602  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:51.175626  8945 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:51.207929  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:51.208539  8821 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:51.209143  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:51.209527  5956 raft_consensus.cc:1240] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260620 13:56:51.210523  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:51.211341  8755 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.212239  8758 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.213380  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:51.214083  5959 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:56:51.214290  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 63327.8us
W20260620 13:56:51.194573  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 64199.7us
I20260620 13:56:51.155618  8948 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:51.158331  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:51.199930  5849 connection.cc:256] RPC call timeout handler was delayed by -1.277365164999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
I20260620 13:56:51.200995  8543 raft_consensus.cc:3055] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:51.204164  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:51.157279  8673 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:51.238969  8804 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:51.268365  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:51.240999  8949 consensus_queue.cc:1059] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:51.242228  5997 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:51.129172  8943 consensus_queue.cc:1059] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260620 13:56:51.214320  8758 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:51.215165  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 45858.8us
I20260620 13:56:51.245935  6032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:56:51.214745  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:51.279695  6032 raft_consensus.cc:606] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:51.248989  5998 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:51.198101  5951 raft_consensus.cc:1240] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260620 13:56:51.280109  6032 raft_consensus.cc:614] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:56:51.279894  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:51.214648  8773 raft_consensus.cc:3055] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Stepping down as leader of term 5
W20260620 13:56:51.260736  5849 connection.cc:256] RPC call timeout handler was delayed by -1.2053651649999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
W20260620 13:56:51.284816  5849 connection.cc:256] RPC call timeout handler was delayed by -1.0892651650000289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
I20260620 13:56:51.251622  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:51.264595  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:51.213980  8755 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:51.266644  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:51.269610  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:51.294644  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 45734.3us
I20260620 13:56:51.276265  6026 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260620 13:56:51.281095  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:51.287211  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:51.297261  5998 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:51.290138  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:51.290479  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:51.291657  5881 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260620 13:56:51.259658  8948 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:51.298975  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:51.294849  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:51.306305  5959 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:51.307548  6031 raft_consensus.cc:2410] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260620 13:56:51.303221  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:51.308418  5876 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:51.304828  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:51.310781  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.311455  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:51.311513  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:51.312096  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:51.304131  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:51.312611  5880 raft_consensus.cc:2410] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260620 13:56:51.313016  6029 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 7
I20260620 13:56:51.313881  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:51.301860  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:51.315631  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:51.316606  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.262004  8543 raft_consensus.cc:740] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:51.316684  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:51.317502  6587 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:51.304876  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:51.312204  6584 raft_consensus.cc:2376] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6. Re-sending same reply.
I20260620 13:56:51.318884  6027 raft_consensus.cc:2393] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 4: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:51.286028  8557 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:51.320116  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:51.320394  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.320485  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:51.321583  6026 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260620 13:56:51.318475  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:51.323379  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:51.323576  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:51.323997  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:51.324186  5829 auto_rebalancer.cc:591] Failed to schedule move for tablet d562ae472315433ca373f0a47f931afa: Illegal state: Replica 192c750f597c43858e1ad09e8d805685 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:56:51.325290  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:51.329239  5875 raft_consensus.cc:2410] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:56:51.325490  8912 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:51.325829  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 46053.7us
I20260620 13:56:51.284546  8773 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:51.331818  5879 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:51.332336  6552 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:51.298908  8808 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:56:51.321136  6024 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:51.338932  5878 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260620 13:56:51.299430  8916 consensus_meta.cc:287] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
I20260620 13:56:51.339505  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.210898  8836 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.344487  5957 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:56:51.345012  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:51.346015  8773 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.347012  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:51.334571  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:51.334957  8471 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:51.305006  8839 consensus_queue.cc:1059] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260620 13:56:51.351307  8821 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:51.352327  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:51.376546  5878 raft_consensus.cc:2410] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:56:51.350824  6552 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:51.354717  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:51.351240  8557 raft_consensus.cc:697] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:51.356832  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:51.362838  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:51.314934  8642 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260620 13:56:51.365495  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:51.367223  5876 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:56:51.368043  5951 raft_consensus.cc:1240] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
W20260620 13:56:51.369786  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 72625.4us
I20260620 13:56:51.370182  5957 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:51.379751  5952 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:51.383522  6578 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:51.383749  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:51.401975  5958 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:51.404789  8911 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:51.365269  8953 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260620 13:56:51.406699  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:51.404958  8557 consensus_queue.cc:237] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.410859  5880 raft_consensus.cc:2376] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8. Re-sending same reply.
I20260620 13:56:51.343928  8916 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.400276  8471 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:51.431085  8471 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.433543  8945 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:51.392733  8859 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:51.387008  8773 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:51.391701  8758 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:51.405510  8781 raft_consensus.cc:3055] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:51.458097  5955 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:51.482304  5952 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: []
I20260620 13:56:51.484961  6029 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
W20260620 13:56:51.486397  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:51.481261  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 130514us
I20260620 13:56:51.487980  6552 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:51.488988  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 134331us
I20260620 13:56:51.485368  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:51.492064  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:51.490787  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:51.496542  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:51.455073  8781 raft_consensus.cc:740] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:51.480569  8916 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:51.510394  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:51.511140  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:51.523142  6030 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:56:51.480753  8836 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:51.559791  6027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:56:51.560581  6027 raft_consensus.cc:606] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:51.561010  6027 raft_consensus.cc:614] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:56:51.562060  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:51.491750  8814 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:51.564913  5882 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:51.567233  8875 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:51.496694  8758 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:51.494014  8940 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:51.587631  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 90608.9us
I20260620 13:56:51.590181  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:51.591566  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:51.581521  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:51.498667  8953 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:51.599872  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:51.600549  5880 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:51.509951  8966 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:51.497296  8943 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:51.494779  8859 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.085s
I20260620 13:56:51.495505  8379 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.085s
I20260620 13:56:51.511090  8945 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:51.605180  5924 leader_election.cc:336] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.984s (SENT)
I20260620 13:56:51.609453  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:51.628046  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:51.515291  8673 consensus_queue.cc:1059] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260620 13:56:51.632519  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:51.636929  5881 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:51.518097  8617 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260620 13:56:51.635416  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:51.639496  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 75264.9us
I20260620 13:56:51.602986  8756 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election won for term 7
W20260620 13:56:51.644268  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 127405us
I20260620 13:56:51.609937  5848 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:51.609453  8966 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:51.558756  8804 consensus_queue.cc:1059] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260620 13:56:51.627547  8754 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:51.517815  8950 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260620 13:56:51.652150  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:51.645598  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 135287us
I20260620 13:56:51.652861  5880 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:51.603173  8953 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:51.601882  8836 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260620 13:56:51.594071  8947 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260620 13:56:51.654649  8949 raft_consensus.cc:3055] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:56:51.688776  8949 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:51.689769  8949 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.691461  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.692293  6586 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:51.650125  8912 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:51.627524  8916 consensus_queue.cc:1059] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260620 13:56:51.655279  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:51.656092  6026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:56:51.519219  8543 consensus_queue.cc:260] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.661831  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:51.736569  5875 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:51.736634  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 82829.6us
I20260620 13:56:51.686859  8944 raft_consensus.cc:3055] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:51.696926  5959 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:51.649152  8966 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:51.714515  6026 raft_consensus.cc:606] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:51.606232  8940 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:51.664227  8953 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:51.697808  8952 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:51.740440  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:51.742376  6026 raft_consensus.cc:614] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:56:51.742758  5959 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:51.664593  8756 raft_consensus.cc:697] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:56:51.683415  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:51.777056  5950 raft_consensus.cc:1240] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:51.645092  8557 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260620 13:56:51.785323  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.691039  8949 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:56:51.783847  5880 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:51.785321  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.649951  8781 consensus_queue.cc:260] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:51.741897  8944 raft_consensus.cc:740] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:51.801090  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:51.791244  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.755137  8916 consensus_queue.cc:1243] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260620 13:56:51.743988  8754 raft_consensus.cc:697] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:51.805670  5880 raft_consensus.cc:2410] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260620 13:56:51.735085  6578 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:51.806434  6551 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:51.818735  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.792073  8543 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:51.819182  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:51.826766  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 221600us
W20260620 13:56:51.829556  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 216698us
I20260620 13:56:51.830202  5881 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:51.830935  5998 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:51.780952  8617 consensus_queue.cc:1059] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260620 13:56:51.826205  5875 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:51.848567  5998 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:51.832891  5877 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:56:51.850004  8965 log.cc:927] Time spent T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260620 13:56:51.850534  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:51.852751  8940 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:51.853047  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.854182  6583 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:51.855468  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.855293  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.856437  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.856771  8814 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:56:51.788383  8756 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.857703  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.860819  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.821156  8379 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:51.861274  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:51.797674  8969 consensus_queue.cc:1059] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260620 13:56:51.807444  8906 consensus_queue.cc:1059] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260620 13:56:51.789444  8952 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.821532  8809 consensus_queue.cc:1059] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260620 13:56:51.827602  8673 consensus_queue.cc:1059] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260620 13:56:51.871610  8754 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:51.872807  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:51.873757  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:51.875653  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:51.874711  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:51.804649  8958 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:51.877444  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:52.041531  6585 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260620 13:56:52.039490  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:52.146912  5882 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.548s	user 0.014s	sys 0.007s
I20260620 13:56:52.148442  6585 pending_rounds.cc:85] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 6
I20260620 13:56:52.147955  6586 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:52.146435  5959 raft_consensus.cc:2393] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:52.133881  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260620 13:56:52.150787  5875 raft_consensus.cc:1275] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260620 13:56:52.147238  6581 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:56:52.149997  6585 pending_rounds.cc:107] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260620 13:56:52.157298  6585 raft_consensus.cc:2889] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:56:51.890883  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:52.147369  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 298863us
W20260620 13:56:52.159138  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:52.148967  5882 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:52.152314  8911 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260620 13:56:52.117488  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 312233us
I20260620 13:56:51.885241  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:52.160998  5829 auto_rebalancer.cc:591] Failed to schedule move for tablet 71fbe22bd18849f1b94912bb0bdf5bbe: Illegal state: Leader has not yet committed an operation in its own term
I20260620 13:56:52.161543  6583 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
W20260620 13:56:52.157692  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 284046us
I20260620 13:56:51.878378  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:52.163048  5883 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:56:51.883275  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:52.164472  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:52.156410  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:56:52.167057  8978 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:56:51.945888  8642 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:52.154052  8875 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:52.168682  8875 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.167057  5876 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6. Ops: []
W20260620 13:56:52.171351  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:52.172996  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:51.996106  8948 consensus_meta.cc:287] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.003s
I20260620 13:56:52.176237  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:52.179214  5882 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:56:52.180074  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:52.179610  5959 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:52.196239  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:52.042595  8943 raft_consensus.cc:3055] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:56:51.996392  8255 raft_consensus.cc:3055] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:51.877187  8980 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:52.036934  8758 raft_consensus.cc:3055] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:52.048802  8817 raft_consensus.cc:3055] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:52.202078  5998 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:52.039906  8826 raft_consensus.cc:3055] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Stepping down as leader of term 6
W20260620 13:56:52.203769  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:52.203562  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 54051.7us
I20260620 13:56:52.019675  6578 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:52.168118  8952 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:52.214433  8967 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.437s	user 0.002s	sys 0.002s
I20260620 13:56:52.204624  8943 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:52.216401  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:52.217371  5882 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:52.200562  8642 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:52.205145  8379 raft_consensus.cc:697] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:52.202610  8773 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:51.997920  8966 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.208202  8255 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:52.208217  8821 raft_consensus.cc:3055] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:56:52.207717  8947 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:52.209144  8804 raft_consensus.cc:3055] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:52.205614  8808 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:51.908010  8953 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.206250  8557 consensus_queue.cc:1059] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260620 13:56:52.209367  8875 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:52.209360  8758 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:52.210464  8817 raft_consensus.cc:740] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:52.228266  5880 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260620 13:56:52.237497  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:52.216220  8826 raft_consensus.cc:740] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:52.204149  8948 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:52.234165  8773 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.249361  8911 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260620 13:56:52.207969  8809 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260620 13:56:52.227349  8642 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:52.264932  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 54628.3us
I20260620 13:56:52.258932  5882 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260620 13:56:52.235738  8821 raft_consensus.cc:740] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:52.241761  8804 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:52.261598  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:52.260905  5849 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:52.269618  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:52.270562  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:52.270366  8826 consensus_queue.cc:260] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:52.271327  8911 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:52.271486  8826 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:52.271692  5849 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:52.271957  8911 raft_consensus.cc:697] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:52.273063  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:52.272974  8911 consensus_queue.cc:237] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.274591  8758 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.276036  8758 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:52.276118  8948 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:52.276470  8773 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:52.264420  8756 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:52.277410  8756 raft_consensus.cc:697] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:52.278148  8781 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:56:52.279588  8986 log.cc:927] Time spent T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260620 13:56:52.230242  8983 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:56:52.249899  8952 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:52.280593  8953 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:52.281004  8952 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:52.281482  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:52.281493  5953 raft_consensus.cc:2368] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6.
I20260620 13:56:52.282505  8817 consensus_queue.cc:260] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:52.283242  8952 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:52.283542  8817 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:52.283861  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2013) took 1078 ms. Trace:
I20260620 13:56:52.284075  8839 raft_consensus.cc:3055] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:51.999346  8944 consensus_queue.cc:260] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.219403  8943 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.281396  8255 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.278492  8756 consensus_queue.cc:237] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:52.296952  8255 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:52.259387  5876 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:52.284271  5953 rpcz_store.cc:276] 0620 13:56:51.205686 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:51.208884 (+  3198us) service_pool.cc:224] Handling call
0620 13:56:52.283641 (+1074757us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001824d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:52.283781 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2464436608}
I20260620 13:56:52.284550  8839 raft_consensus.cc:740] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:56:52.302677  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:52.304037  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 102028us
I20260620 13:56:52.258155  8808 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:52.312232  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:52.312259  5849 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:52.289708  8978 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:52.292511  8773 raft_consensus.cc:2764] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260620 13:56:52.289147  8958 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:52.293883  8940 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:52.322005  5876 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:56:52.300454  8953 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:52.331981  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:52.339573  5953 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:52.347378  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:52.348253  5883 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 6
I20260620 13:56:52.344254  5848 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:52.366465  5951 raft_consensus.cc:1240] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260620 13:56:52.368701  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:52.369508  6029 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:52.371879  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:52.372607  6025 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:52.377252  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:52.337438  8943 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:56:52.384174  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 50145.7us
I20260620 13:56:52.387145  5849 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:52.382016  8982 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:52.281086  8379 consensus_queue.cc:237] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.338261  8940 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:52.342373  8916 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:52.410614  8773 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:52.386736  8958 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:52.411422  8958 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:52.411911  8958 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:56:52.418781  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 150884us
I20260620 13:56:52.420424  5849 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:52.371452  8906 consensus_queue.cc:1059] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260620 13:56:52.409245  8940 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:52.404534  8642 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:52.436450  6029 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:56:52.415714  8982 raft_consensus.cc:697] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:56:52.486600  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:52.493175  6025 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:52.399614  8839 consensus_queue.cc:260] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:52.477620  8964 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260620 13:56:52.461030  8966 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:52.523721  8997 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:52.499508  8953 raft_consensus.cc:697] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:52.537768  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:52.541494  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:56:52.547909  8993 log.cc:927] Time spent T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260620 13:56:52.549429  8996 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260620 13:56:52.550848  8808 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:52.553264  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:52.553670  5883 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:52.554005  5884 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
W20260620 13:56:52.554474  5884 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1466) took 1203 ms (client timeout 1541 ms). Trace:
I20260620 13:56:52.555305  8982 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.524461  8997 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:52.559665  8804 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.561111  8997 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:52.561249  8804 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:52.569586  5879 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:56:52.570714  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1460) took 1221 ms. Trace:
I20260620 13:56:52.571240  5879 rpcz_store.cc:276] 0620 13:56:51.349158 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:51.406632 (+ 57474us) service_pool.cc:224] Handling call
0620 13:56:51.999932 (+593300us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b5800000f98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:56:52.541325 (+541393us) spinlock_profiling.cc:243] Waited 8.62 ms on lock 0x7b5800000f98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d369c 00007f0fdc6d325b 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:56:52.570629 (+ 29304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42806912}
W20260620 13:56:52.554912  5884 rpcz_store.cc:269] 0620 13:56:51.350626 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:51.383407 (+ 32781us) service_pool.cc:224] Handling call
0620 13:56:52.038206 (+654799us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b5800000f98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d36ee 000000000036f859 00007f0fe474b8e0 00007f0fe48147c4 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:56:52.553187 (+514981us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b5800000f98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d378c 00007f0fdc6d36f6 000000000036f859 00007f0fe474b8e0 00007f0fe48147c4 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:56:52.554405 (+  1218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11710592}
W20260620 13:56:52.586339  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:52.587392  8964 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260620 13:56:52.588541  6585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 787) took 1298 ms. Trace:
I20260620 13:56:52.593443  6585 rpcz_store.cc:276] 0620 13:56:51.290051 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:51.290450 (+   399us) service_pool.cc:224] Handling call
0620 13:56:51.320710 (+ 30260us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:52.158383 (+837673us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:52.588263 (+429880us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b540059f954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:52.588480 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1656865024}
W20260620 13:56:52.588675  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:52.589465  8969 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:52.596487  8969 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.591885  5881 raft_consensus.cc:1275] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260620 13:56:52.599435  5881 pending_rounds.cc:85] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 1
I20260620 13:56:52.599702  5881 pending_rounds.cc:107] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260620 13:56:52.599956  5881 raft_consensus.cc:2889] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:56:52.600476  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:52.599161  8958 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:52.608095  5881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1469) took 1236 ms. Trace:
I20260620 13:56:52.608619  5881 rpcz_store.cc:276] 0620 13:56:51.369438 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:51.833339 (+463901us) service_pool.cc:224] Handling call
0620 13:56:52.590499 (+757160us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b5800000f98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:56:52.590814 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:52.602343 (+ 11529us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:52.605870 (+  3527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14994304}
I20260620 13:56:52.609630  5878 raft_consensus.cc:2368] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7.
I20260620 13:56:52.612877  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:52.613607  6585 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:52.614077  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:52.614655  6586 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:52.617903  8940 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.619494  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:52.620713  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:52.621935  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:52.609078  8958 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:52.622397  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:52.669322  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:52.666476  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 288257us
W20260620 13:56:52.641254  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:52.622790  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:52.634466  5998 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 1.526s (SENT) [suppressed 25 similar messages]
I20260620 13:56:52.680027  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:52.680862  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:52.688226  5878 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1464) took 1338 ms (client timeout 1616 ms). Trace:
W20260620 13:56:52.688907  5878 rpcz_store.cc:269] 0620 13:56:51.350121 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:51.392977 (+ 42856us) service_pool.cc:224] Handling call
0620 13:56:51.997482 (+604505us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b5800000f98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:56:52.537559 (+540077us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b5800000f98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d369c 00007f0fdc6d325b 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:56:52.687937 (+150378us) spinlock_profiling.cc:243] Waited 70.8 ms on lock 0x7b54002701d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:52.688146 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199693696}
I20260620 13:56:52.691004  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:52.691934  6585 raft_consensus.cc:2410] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:56:52.693645  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:52.694362  5953 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:52.641835  8642 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:52.693905  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:52.703931  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:52.641254  8969 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:52.705631  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:52.710383  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:52.719358  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:52.711880  5950 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260620 13:56:52.723536  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:52.729806  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:52.734974  5953 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:52.719765  8978 raft_consensus.cc:697] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:56:52.739862  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 105460us
W20260620 13:56:52.740738  5998 leader_election.cc:336] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 1.541s (SENT)
W20260620 13:56:52.743358  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:52.743257  5998 leader_election.cc:336] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 1.616s (SENT)
I20260620 13:56:52.743865  5998 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:52.727769  8756 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election won for term 6
W20260620 13:56:52.758231  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 87074.3us
I20260620 13:56:52.621929  8821 consensus_queue.cc:260] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.760517  5953 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:52.761252  9012 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:52.762065  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:52.717839  8642 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.765146  8642 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:52.703922  8911 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260620 13:56:52.768150  5829 auto_rebalancer.cc:591] Failed to schedule move for tablet d1b89d9f1eec4bfba2f3b0052c49f040: Illegal state: Replica 2e82c0c231624695ac5a813230bf5038 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:56:52.736372  8952 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:56:52.783710  5998 leader_election.cc:336] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 1.625s (SENT)
I20260620 13:56:52.783018  8978 consensus_queue.cc:237] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:52.757576  8940 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:52.778421  8953 consensus_queue.cc:237] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:52.801753  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 381404us
W20260620 13:56:52.816596  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:52.816833  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:52.817651  5998 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 1.766s (SENT)
I20260620 13:56:52.808809  8821 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:56:52.805071  9011 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:52.827477  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:52.839054  5849 leader_election.cc:400] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7.
I20260620 13:56:52.839593  5849 leader_election.cc:403] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:56:52.842427  8756 raft_consensus.cc:697] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:52.844906  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:52.845666  6581 raft_consensus.cc:2376] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6. Re-sending same reply.
I20260620 13:56:52.845381  8756 consensus_queue.cc:237] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:52.849514  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 77234.9us
I20260620 13:56:52.857740  8983 raft_consensus.cc:3055] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:56:52.857594  8997 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:56:52.858299  8983 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:56:52.859586  5998 leader_election.cc:336] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 1.926s (SENT)
I20260620 13:56:52.843798  9012 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260620 13:56:52.860605  5998 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 2.005s (SENT)
I20260620 13:56:52.861011  5998 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:52.863375  9012 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:56:52.865928  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:52.852942  5849 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:52.862932  5998 leader_election.cc:336] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 2.122s (SENT)
I20260620 13:56:52.868357  5998 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:52.869189  6585 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:56:52.847904  9011 raft_consensus.cc:697] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:52.874078  6587 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:52.878496  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:52.887910  6581 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:56:52.891858  8952 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260620 13:56:52.899067  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 46214us
I20260620 13:56:52.880761  8875 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:52.907415  8875 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:52.907984  8875 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.910745  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:52.911662  5955 raft_consensus.cc:2410] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260620 13:56:52.913041  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:52.910248  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:56:52.931452  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 54728.5us
I20260620 13:56:52.938797  5849 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:52.940265  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:52.941937  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 79023.1us
W20260620 13:56:52.929787  9013 log.cc:927] Time spent T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260620 13:56:52.930250  9015 log.cc:927] Time spent T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260620 13:56:52.949723  5849 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:52.929944  9025 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7.
I20260620 13:56:52.952237  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:52.955525  5998 leader_election.cc:336] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 2.314s (SENT)
I20260620 13:56:52.956022  8952 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:52.958261  9012 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:52.964367  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:52.930204  9007 log.cc:927] Time spent T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.139s	user 0.001s	sys 0.001s
I20260620 13:56:52.883307  8983 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.961551  6587 raft_consensus.cc:2410] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:56:52.962316  5848 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:52.928340  8875 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:52.966703  6027 raft_consensus.cc:1240] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:52.967317  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:52.968952  6025 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:52.969201  6580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 816) took 1116 ms. Trace:
I20260620 13:56:52.973842  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:52.972491  6028 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260620 13:56:52.976888  6024 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:52.972927  9011 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:52.979980  5875 raft_consensus.cc:1240] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:52.974563  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:52.980988  6029 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:52.969594  6580 rpcz_store.cc:276] 0620 13:56:51.852473 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:51.852760 (+   287us) service_pool.cc:224] Handling call
0620 13:56:52.969034 (+1116274us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b54006c5f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:52.969144 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1837280000}
I20260620 13:56:52.972996  8940 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:52.981750  8944 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:52.982226  8940 raft_consensus.cc:697] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:52.983412  8940 consensus_queue.cc:237] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:52.960618  9019 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260620 13:56:52.988906  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:52.991854  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:52.993427  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:52.994154  6587 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
W20260620 13:56:53.000103  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 44673us
I20260620 13:56:53.003204  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:53.007581  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:53.015548  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:53.016292  5950 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
I20260620 13:56:53.022697  6032 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:53.014008  8875 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260620 13:56:53.033999  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.003136  8952 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:53.040786  5878 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:53.045413  5877 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260620 13:56:53.046968  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:53.048547  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:53.049434  6578 raft_consensus.cc:2393] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 5: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:56:53.049695  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:52.971515  9012 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:53.051419  8839 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:53.052397  9012 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:53.053597  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:53.007827  8804 consensus_queue.cc:1059] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260620 13:56:53.063902  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:53.067384  5953 raft_consensus.cc:2393] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:53.059681  8773 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:53.074383  9034 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:53.069164  8978 consensus_queue.cc:1059] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260620 13:56:53.074885  8773 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.076546  9031 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260620 13:56:53.040895  8952 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.078037  8773 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:53.080286  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:53.080811  8255 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:53.081866  8906 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:53.081554  8255 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.082402  8906 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:53.078593  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 68959.9us
W20260620 13:56:53.086843  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:53.086813  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.059940  8940 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:53.091614  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:53.090204  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 77579.4us
I20260620 13:56:53.059988  8781 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:53.063462  8808 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:53.102494  6585 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260620 13:56:53.105330  6585 pending_rounds.cc:85] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 5
I20260620 13:56:53.105607  6585 pending_rounds.cc:107] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260620 13:56:53.105952  6585 raft_consensus.cc:2889] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:53.106652  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.103484  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.108233  6587 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:53.078183  8804 raft_consensus.cc:3055] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:53.080344  8952 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:53.108304  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.088276  8817 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:53.091496  9012 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:53.090940  9019 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:53.126327  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:53.090709  8958 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:53.123800  5924 leader_election.cc:336] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.620s (SENT)
W20260620 13:56:53.125893  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:53.105501  9025 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:53.133273  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:53.134757  6585 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:53.116267  8809 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:53.115600  8804 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:53.138433  8804 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.134980  8958 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.139889  8804 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:53.142118  8958 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:53.147594  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.165194  6580 raft_consensus.cc:2410] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260620 13:56:53.108734  8940 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:53.169977  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 89763.1us
I20260620 13:56:53.177659  5849 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:53.174801  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:53.178642  6027 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:53.173863  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:53.179291  5849 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:53.182825  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:53.121966  8781 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:53.145449  8255 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:53.135368  8814 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:53.188556  5998 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:53.192655  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.193588  6580 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
W20260620 13:56:53.193033  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 76944.1us
I20260620 13:56:53.125819  8817 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:53.195786  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:53.196787  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:53.196887  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:53.202184  6027 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:53.181281  8958 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:53.144259  9019 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.163744  8808 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260620 13:56:53.223668  6580 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:56:53.228659  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:53.183094  8875 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260620 13:56:53.176635  8997 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260620 13:56:53.195974  8966 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:53.187732  8992 consensus_queue.cc:1048] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260620 13:56:53.238698  6585 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10. Ops: []
I20260620 13:56:53.211383  8906 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:53.195586  8980 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260620 13:56:53.252053  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.255932  8817 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:53.258383  9043 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:53.262538  9019 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:53.264073  5924 leader_election.cc:336] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.954s (SENT)
W20260620 13:56:53.264928  5924 leader_election.cc:336] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.956s (SENT)
I20260620 13:56:53.265285  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.243508  8966 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:53.282634  6582 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
W20260620 13:56:53.292815  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 113608us
I20260620 13:56:53.294507  5849 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:53.296588  5849 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:53.276219  9034 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:53.304725  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.306470  5849 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:53.287312  8966 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:53.309361  6032 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260620 13:56:53.309830  6028 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260620 13:56:53.309811  5849 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:53.311939  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:53.312332  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:53.305759  9028 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:53.307337  8958 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:53.308845  9025 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:53.318902  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.319391  8817 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:53.355434  8821 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:53.355566  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:53.355688  8817 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:53.356199  8821 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.331720  8916 raft_consensus.cc:3055] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:53.306030  8906 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:53.343791  8781 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:53.367799  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 49007us
I20260620 13:56:53.368990  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:53.377161  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:53.377882  6581 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:56:53.375594  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:53.382210  5849 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:53.458644  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:53.461052  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 269980us
W20260620 13:56:53.452384  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:53.357259  8773 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260620 13:56:53.466682  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:53.358888  9025 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:53.361270  8916 raft_consensus.cc:740] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:53.390831  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:53.376392  9038 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:53.378592  9043 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:53.380533  8781 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:56:53.460508  8839 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:53.478715  5998 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:53.479617  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 88900.5us
I20260620 13:56:53.461072  8675 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:53.469663  9025 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:53.464658  8906 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:53.345008  9028 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:53.507467  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:53.507751  5849 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:53.510262  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:53.511452  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:53.511700  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:53.512264  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:53.512598  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:53.513073  5879 raft_consensus.cc:2376] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7. Re-sending same reply.
I20260620 13:56:53.513703  5883 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:53.469257  8940 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:53.469702  9019 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:53.527858  5953 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260620 13:56:53.519958  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:53.506852  8958 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:53.529055  8958 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:53.529495  8958 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:53.523862  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:53.524966  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:53.531307  9046 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:53.531852  5884 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 6: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:53.525573  9052 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:56:53.527782  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:53.533460  5879 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:53.525974  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:53.537024  9024 raft_consensus.cc:3055] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:53.537496  9024 raft_consensus.cc:740] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:53.519817  8817 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:53.531807  9046 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:53.539706  9046 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:56:53.542209  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:53.467653  9023 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260620 13:56:53.478088  9029 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260620 13:56:53.516825  8675 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.567483  6032 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:53.546432  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:53.506554  8781 raft_consensus.cc:697] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:53.571862  8781 consensus_queue.cc:237] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.506735  8839 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.547840  8958 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.575302  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:53.576376  8958 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:53.576737  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:53.553333  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:53.554170  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:53.555094  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:53.596547  6025 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:53.560377  9028 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:53.479153  9038 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.578526  5882 raft_consensus.cc:2393] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:53.548908  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:53.600922  5883 raft_consensus.cc:2376] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10. Re-sending same reply.
W20260620 13:56:53.589764  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:53.596524  6031 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:53.556332  8821 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:53.597541  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:53.538373  9024 consensus_queue.cc:260] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.610908  9024 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:56:53.619626  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:53.625124  6031 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
W20260620 13:56:53.629089  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:53.632102  8972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.002s	sys 0.010s
I20260620 13:56:53.631085  5880 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:56:53.637899  6031 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260620 13:56:53.656888  6026 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260620 13:56:53.659339  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:53.660203  5883 raft_consensus.cc:2376] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7. Re-sending same reply.
I20260620 13:56:53.662850  8675 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:53.640139  8972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.002s	sys 0.010s
W20260620 13:56:53.665380  9027 log.cc:927] Time spent T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.757s	user 0.008s	sys 0.007s
I20260620 13:56:53.670007  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:53.675432  6025 raft_consensus.cc:1240] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:53.675741  6583 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:53.686189  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:53.664301  6024 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:53.686815  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:53.600939  8966 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.663406  9038 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:53.667708  9043 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:53.696486  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:53.697642  6025 raft_consensus.cc:1217] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Deduplicated request from leader. Original: 3.6->[5.7-5.7]   Dedup: 5.7->[]
I20260620 13:56:53.698649  6552 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:53.699240  6025 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260620 13:56:53.700867  8839 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:53.701802  6025 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8. Ops: []
W20260620 13:56:53.702590  6582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 812) took 1887 ms (client timeout 2095 ms). Trace:
W20260620 13:56:53.703070  6582 rpcz_store.cc:269] 0620 13:56:51.817039 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:51.821071 (+  4032us) service_pool.cc:224] Handling call
0620 13:56:53.702402 (+1881331us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540065fc54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:53.702529 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2613760768}
I20260620 13:56:53.703258  6025 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:56:53.705977  6024 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260620 13:56:53.637982  8916 consensus_queue.cc:260] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.711079  6027 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:53.718362  8821 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:53.734527  8916 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:53.740540  8966 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:53.744822  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 833) took 1052 ms. Trace:
I20260620 13:56:53.745250  6579 rpcz_store.cc:276] 0620 13:56:52.692279 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:53.168244 (+475965us) service_pool.cc:224] Handling call
0620 13:56:53.168800 (+   556us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:53.181877 (+ 13077us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:53.181915 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:53.186119 (+  4204us) log.cc:844] Serialized 26 byte log entry
0620 13:56:53.684738 (+498619us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:53.698078 (+ 13340us) log.cc:844] Serialized 14 byte log entry
0620 13:56:53.710445 (+ 12367us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:53.710525 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:53.744635 (+ 34110us) raft_consensus.cc:1685] finished
0620 13:56:53.744654 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:53.744763 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1481,"prepare.queue_time_us":41109,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":4652,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":16296,"thread_start_us":460052,"threads_started":1,"wal-append.queue_time_us":547374}
I20260620 13:56:53.769403  8983 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:53.688700  8943 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260620 13:56:53.763345  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.776528  8969 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:53.712069  9043 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:53.778013  5883 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:53.778880  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:53.779076  5849 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.783722  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.786419  9057 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:53.794579  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.795624  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:53.795670  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:53.796545  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.797281  6582 raft_consensus.cc:1240] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:53.797580  6552 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:53.778369  8781 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:53.798804  8255 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:56:53.799165  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:53.801630  8944 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:53.802170  8944 raft_consensus.cc:697] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:53.798300  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.804105  6552 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:53.811815  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 333155us
I20260620 13:56:53.812126  9042 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:56:53.812341  8969 consensus_queue.cc:1059] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:56:53.813263  8808 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:56:53.813655  9042 raft_consensus.cc:3055] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:56:53.814071  9042 raft_consensus.cc:740] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:53.814852  9042 consensus_queue.cc:260] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:53.815891  9067 log.cc:927] Time spent T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260620 13:56:53.794471  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.816846  8809 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:53.817131  6585 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:53.803601  8944 consensus_queue.cc:237] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.817730  9043 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:53.817536  8809 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:53.818940  6583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 836) took 1073 ms. Trace:
I20260620 13:56:53.819511  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:53.820199  6032 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
W20260620 13:56:53.820746  9065 log.cc:927] Time spent T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260620 13:56:53.820842  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.821115  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:52.673486  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:53.822242  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:53.823122  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:53.823407  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:53.823724  6024 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:53.824594  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:53.819396  6583 rpcz_store.cc:276] 0620 13:56:52.745979 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:52.761812 (+ 15833us) service_pool.cc:224] Handling call
0620 13:56:53.818784 (+1056972us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b540013c4d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:53.818885 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1329233152}
I20260620 13:56:53.806191  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:53.812580  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:53.828804  6581 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:53.808290  8971 consensus_queue.cc:1059] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:56:53.832361  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:53.838259  5958 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:53.832911  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:53.833184  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.833719  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:53.839759  6030 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:53.826843  8809 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:53.850026  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:53.843502  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:53.851590  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.856073  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.857638  6587 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:53.852794  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.859687  6583 raft_consensus.cc:2376] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9. Re-sending same reply.
W20260620 13:56:53.856465  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 111595us
I20260620 13:56:53.858052  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.861019  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:53.861591  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:53.852535  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.862370  6582 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:56:53.863452  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.864429  6582 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:56:53.865435  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.858500  5849 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.867453  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.867839  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.869309  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:53.861742  6583 raft_consensus.cc:2376] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9. Re-sending same reply.
I20260620 13:56:53.870579  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.871202  6032 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:56:53.871457  6585 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:53.870615  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.873289  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:53.873896  6029 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:53.868538  6587 raft_consensus.cc:2376] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4. Re-sending same reply.
I20260620 13:56:53.875605  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.876754  6025 raft_consensus.cc:1240] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:53.880471  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.881484  6585 raft_consensus.cc:2410] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:56:53.882081  5849 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.885838  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.885610  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.890213  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:53.892412  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:53.893057  6586 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:53.893461  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.894595  5998 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:53.895699  5998 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:53.896926  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.856000  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.872592  8958 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:53.904505  6587 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:53.876025  8255 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:53.905676  6582 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260620 13:56:53.907027  6582 pending_rounds.cc:85] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 6
I20260620 13:56:53.907313  6582 pending_rounds.cc:107] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260620 13:56:53.902621  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:53.903591  5875 raft_consensus.cc:1240] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:53.901328  5849 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:53.909555  6582 raft_consensus.cc:2889] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:53.879182  9057 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:53.906176  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:53.851873  8804 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260620 13:56:53.885280  9043 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:53.856992  8821 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260620 13:56:53.868474  8814 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260620 13:56:53.892134  8906 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:53.891893  8773 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:56:53.931479  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:53.867175  9046 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.873519  8379 consensus_queue.cc:1059] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260620 13:56:53.919186  9052 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:53.981607  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:53.911252  8958 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:53.912119  9024 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:53.984182  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:53.897998  8943 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260620 13:56:53.907604  8940 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:53.912860  8255 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:53.925913  9058 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:53.991290  5877 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:53.995941  5884 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:53.928948  9050 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:53.925997  8980 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260620 13:56:53.997607  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 100736us
I20260620 13:56:54.000128  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:54.000435  5881 raft_consensus.cc:2368] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7.
I20260620 13:56:54.004356  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:54.004557  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:53.924435  8971 consensus_queue.cc:1059] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260620 13:56:54.001228  8255 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:53.988832  8809 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:54.019764  8675 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:54.020483  8675 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:53.998986  9024 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:53.994601  8970 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:53.995139  8958 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:54.099772  6581 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:56:53.990813  9052 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:54.081544  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 201778us
I20260620 13:56:54.114115  5883 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:53.999171  8940 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:53.980960  9025 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.123692  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:54.035032  9070 log.cc:927] Time spent T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260620 13:56:54.125813  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 121320us
I20260620 13:56:54.128641  5998 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:54.032285  9024 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:54.001135  9009 consensus_queue.cc:1059] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.266s
I20260620 13:56:54.130285  8557 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:54.123500  8821 raft_consensus.cc:3055] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:54.140359  8821 raft_consensus.cc:740] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:54.141311  8821 consensus_queue.cc:260] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.125321  8940 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:54.147755  5878 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:54.148738  9025 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:54.149791  6024 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
W20260620 13:56:54.124578  9073 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260620 13:56:54.040797  8809 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.154542  8809 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:54.121872  9052 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:54.164522  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:54.166385  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:54.166874  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:54.167090  5958 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:56:54.168704  8989 raft_consensus.cc:2764] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260620 13:56:54.169094  5998 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:54.169623  9076 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:54.170065  9076 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.170507  9012 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:56:54.171137  9012 raft_consensus.cc:697] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:54.173751  9012 consensus_queue.cc:237] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:54.174729  9019 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:56:54.171283  8952 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:54.175881  8952 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.178440  8952 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:54.170086  8557 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:54.172179  9009 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:56:54.180099  9009 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:54.180913  9009 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.182821  9009 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:56:54.171093  5998 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:54.183480  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:54.023056  8675 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:54.142848  8821 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:54.188503  5884 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:54.183790  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:54.191962  6586 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:54.193459  5998 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:54.198704  5880 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:54.026088  8255 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.207904  5848 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:54.208653  5881 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:54.209993  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:54.210501  5880 raft_consensus.cc:1240] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:54.211027  5881 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 6: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:54.213135  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:54.172227  9076 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:54.195731  9019 raft_consensus.cc:697] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:54.230250  6587 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260620 13:56:54.225445  5924 leader_election.cc:336] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.943s (SENT)
I20260620 13:56:54.216917  5848 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:54.231380  5924 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:54.232594  5848 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:54.228407  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:54.228652  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:54.239562  5881 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260620 13:56:54.215205  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:54.282150  6024 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:54.284657  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:54.281802  9046 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:54.198014  8809 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:54.209487  8675 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:54.332520  6579 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260620 13:56:54.333173  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:54.234357  8992 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260620 13:56:54.295452  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 91584.3us
I20260620 13:56:54.297241  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:54.234179  9025 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:54.234201  8952 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:56:54.295981  9070 log.cc:927] Time spent T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260620 13:56:54.283456  8773 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:54.297973  8809 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:54.289826  5881 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260620 13:56:54.365358  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 139966us
I20260620 13:56:54.363169  5998 leader_election.cc:400] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7.
I20260620 13:56:54.330615  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:54.386765  8809 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:54.331513  8675 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:54.387673  8675 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:54.387579  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:54.389099  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:54.389673  5881 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:54.353155  6024 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260620 13:56:54.391218  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:54.386782  5998 leader_election.cc:403] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260620 13:56:54.362313  9005 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:54.400815  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:54.417300  6026 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:54.401517  8944 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:56:54.402880  8804 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:54.407472  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:54.418510  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 55521.2us
I20260620 13:56:54.431025  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:54.361688  8992 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:54.443137  8992 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:54.462463  6031 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260620 13:56:54.398548  9019 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.519467  8255 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:54.550246  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 253064us
I20260620 13:56:54.467883  8969 consensus_queue.cc:1059] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260620 13:56:54.486696  6026 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:54.585997  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:54.591614  6552 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:56:54.599066  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 160189us
W20260620 13:56:54.598662  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 206657us
I20260620 13:56:54.585178  8875 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7.
W20260620 13:56:54.608438  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:54.590289  9057 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election won for term 7
W20260620 13:56:54.609556  5924 leader_election.cc:336] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 2.121s (SENT)
I20260620 13:56:54.617199  6026 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260620 13:56:54.598806  8944 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:54.597982  9005 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:54.598397  9025 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:54.631489  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:54.591428  8971 consensus_queue.cc:1059] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260620 13:56:54.603969  9024 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:54.683856  8983 consensus_meta.cc:287] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.908s	user 0.012s	sys 0.000s
I20260620 13:56:54.684226  9024 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:54.686372  9024 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:54.683590  8971 raft_consensus.cc:3055] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:54.696223  8675 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:54.697974  8940 consensus_meta.cc:287] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.554s	user 0.006s	sys 0.002s
W20260620 13:56:54.703765  9090 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260620 13:56:54.715204  6025 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: []
W20260620 13:56:54.704957  9081 log.cc:927] Time spent T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260620 13:56:54.627224  9087 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:54.623406  9057 raft_consensus.cc:697] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:54.607687  9082 consensus_queue.cc:1059] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260620 13:56:54.713851  5879 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260620 13:56:54.638562  9046 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:54.670434  8809 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:54.726900  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:54.649076  8255 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:54.708096  8971 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:54.734448  5879 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260620 13:56:54.735636  8255 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.692586  9005 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:54.741923  8255 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:54.745674  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:54.746747  6029 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:56:54.730446  9009 consensus_meta.cc:287] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.000s
I20260620 13:56:54.752760  6033 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:56:54.753818  6032 raft_consensus.cc:2410] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260620 13:56:54.706264  9025 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:54.738894  9052 consensus_meta.cc:287] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
I20260620 13:56:54.732936  8804 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260620 13:56:54.752049  9042 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:54.717788  8940 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.763640  6027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2430) took 1489 ms. Trace:
I20260620 13:56:54.729140  9087 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.773528  6027 rpcz_store.cc:276] 0620 13:56:53.274405 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:53.274614 (+   209us) service_pool.cc:224] Handling call
0620 13:56:53.274991 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:53.715553 (+440562us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:54.763261 (+1047708us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b540005a0d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:54.763541 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002331392}
I20260620 13:56:54.747622  9005 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:54.731815  9046 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.778435  5883 raft_consensus.cc:2393] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:54.761675  6029 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:54.777096  6027 raft_consensus.cc:1275] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260620 13:56:54.772439  8958 consensus_meta.cc:287] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.649s	user 0.012s	sys 0.000s
I20260620 13:56:54.780436  6029 raft_consensus.cc:1240] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:54.784628  9025 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:54.785539  6029 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260620 13:56:54.785920  8940 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:54.786947  6029 raft_consensus.cc:1240] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:54.787178  9043 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260620 13:56:54.788326  8821 consensus_meta.cc:287] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.002s
I20260620 13:56:54.757826  9082 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260620 13:56:54.784673  9038 raft_consensus.cc:3055] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:54.795334  9077 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:54.795603  9038 raft_consensus.cc:740] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:54.795967  9077 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:54.796736  8379 raft_consensus.cc:3055] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:54.796512  9038 consensus_queue.cc:260] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.797226  8379 raft_consensus.cc:740] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:54.797784  9038 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:54.802240  6586 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
W20260620 13:56:54.807483  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:54.768345  9052 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:54.805260  9043 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:54.798342  8379 consensus_queue.cc:260] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.885828  8675 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:54.892267  8809 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:54.892655  9046 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:54.899441  9043 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.915567  5881 raft_consensus.cc:2393] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:54.923979  8379 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:54.925457  9043 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:54.926503  8944 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:54.929041  9087 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:54.931012  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:54.789224  9057 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.780267  8971 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.791085  8958 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.954833  8980 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:54.960661  8980 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.939246  9005 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:54.964151  9005 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.966631  9005 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:54.976645  5998 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:54.978351  5998 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:54.984746  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:54.985664  5952 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:54.988060  9043 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:54.988677  9043 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:54.990769  9043 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:54.995416  9043 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:54.995965  9043 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:55.003672  5875 raft_consensus.cc:2393] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:56:55.004432  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 187633us
I20260620 13:56:55.009102  6584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 803) took 1632 ms. Trace:
W20260620 13:56:55.009124  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:55.021795  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.024363  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.025190  5959 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
W20260620 13:56:55.020613  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:55.022653  5955 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:56:55.048607  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:55.037328  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:55.009683  6584 rpcz_store.cc:276] 0620 13:56:53.376681 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:53.376857 (+   176us) service_pool.cc:224] Handling call
0620 13:56:53.377135 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:53.655598 (+278463us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:53.655630 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:53.659209 (+  3579us) log.cc:844] Serialized 26 byte log entry
0620 13:56:53.835160 (+175951us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:53.877813 (+ 42653us) log.cc:844] Serialized 14 byte log entry
0620 13:56:53.989460 (+111647us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:54.178398 (+188938us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b18001f1980. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc70ad22 00007f0fdc70cfc1 00007f0fdc70cf79 00007f0fdc70cf09 00007f0fdc70ced1 00007f0fdc70c1cd 0000000000389354 0000000000389199 00007f0fdc6ee03a
0620 13:56:55.008654 (+830256us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b540059f954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:55.008738 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:55.008806 (+    68us) raft_consensus.cc:1685] finished
0620 13:56:55.008828 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:55.009027 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18351,"prepare.queue_time_us":44084,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":39,"raft.queue_time_us":31786,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":10041,"spinlock_wait_cycles":621812864,"thread_start_us":237286,"threads_started":2,"wal-append.queue_time_us":207082}
I20260620 13:56:54.998962  8971 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:55.052743  8980 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:55.076668  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:55.075048  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:55.055652  9024 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:56:55.084067  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.039119  8997 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:55.047721  8966 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:55.039490  8969 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:54.936956  8992 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.064780  8958 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:55.068092  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:55.072371  6580 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:56:55.073261  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.104717  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:55.105131  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:55.074334  9052 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:55.038875  8983 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 13:56:55.064214  5878 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1480) took 1554 ms (client timeout 1570 ms). Trace:
I20260620 13:56:55.050879  9096 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:55.059296  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:55.105371  6583 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:55.040872  9043 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:55.109149  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:56:55.110720  5878 rpcz_store.cc:269] 0620 13:56:53.509954 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:53.510080 (+   126us) service_pool.cc:224] Handling call
0620 13:56:55.063901 (+1553821us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b5400033754. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:55.064120 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464240384}
I20260620 13:56:55.122434  6030 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:56:55.111837  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:55.112605  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:55.124310  6587 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:55.086427  8944 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:55.116122  5882 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:56:55.085916  6027 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:55.117741  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:55.131458  5876 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:55.118497  6024 raft_consensus.cc:2393] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:55.137317  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:55.099709  8943 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:55.103561  8875 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:55.141716  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:55.145067  6587 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:55.141906  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:55.101630  9042 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:55.147617  6585 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:56:55.106761  8966 raft_consensus.cc:697] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:56:55.151685  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 199725us
I20260620 13:56:55.154735  6585 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:55.156013  5882 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260620 13:56:55.158095  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:55.162550  5876 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:55.158879  6552 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:55.165391  5998 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:55.167387  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:55.090855  8997 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.174976  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:55.142817  9005 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:55.175819  6587 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:56:55.140588  9102 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:55.170866  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:55.103395  8969 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.136346  9101 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260620 13:56:55.179718  6585 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:55.181066  5876 raft_consensus.cc:1275] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260620 13:56:55.185333  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 136800us
I20260620 13:56:55.191635  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:55.197238  6026 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:56:55.172158  8875 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:55.171813  9038 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:56:55.172215  9024 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:55.175071  8983 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:55.145834  8944 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.163810  9043 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260620 13:56:55.129441  9096 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.203433  6551 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:55.204571  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:55.163287  9052 consensus_queue.cc:1059] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260620 13:56:55.149467  8943 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.188998  9102 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:55.153823  9042 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.176492  8804 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260620 13:56:55.205361  9038 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:55.195717  9005 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:55.196523  8557 consensus_queue.cc:1048] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260620 13:56:55.250649  9019 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:55.268113  9019 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.269558  8992 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:55.270746  9095 log.cc:927] Time spent T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260620 13:56:55.271047  9094 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.385s	user 0.001s	sys 0.001s
W20260620 13:56:55.255190  9098 log.cc:927] Time spent T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260620 13:56:55.260952  8969 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:55.274127  9042 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:55.222757  9083 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:55.270749  9019 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:55.225945  8875 raft_consensus.cc:697] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:55.277199  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 711) took 1439 ms. Trace:
I20260620 13:56:55.263074  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.267325  8944 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:55.261229  9052 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:55.215076  9102 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:55.277630  5950 rpcz_store.cc:276] 0620 13:56:53.838006 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:53.839286 (+  1280us) service_pool.cc:224] Handling call
0620 13:56:53.878282 (+ 38996us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:53.878635 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:53.878664 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:54.967452 (+1088788us) spinlock_profiling.cc:243] Waited 7.53 ms on lock 0x7b2c00030018. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fde0f5c71 00007f0fde1055d2 00007f0fdf837de1 00007f0fdf7fc81a 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22
0620 13:56:54.968007 (+   555us) log.cc:844] Serialized 26 byte log entry
0620 13:56:55.169033 (+201026us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:55.169076 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:55.169159 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:55.276905 (+107746us) raft_consensus.cc:1685] finished
0620 13:56:55.276924 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:55.277139 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4039,"spinlock_wait_cycles":17314560,"thread_start_us":200577,"threads_started":1,"wal-append.queue_time_us":234760}
W20260620 13:56:55.304804  5875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1499) took 1405 ms (client timeout 1616 ms). Trace:
I20260620 13:56:55.308636  5880 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:55.212050  9024 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:55.305505  5875 rpcz_store.cc:269] 0620 13:56:53.899859 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:53.909115 (+  9256us) service_pool.cc:224] Handling call
0620 13:56:55.304544 (+1395429us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002d00d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:55.304740 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2339766016}
I20260620 13:56:55.249708  9038 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:56:55.208756  8983 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:55.315431  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 45794.6us
I20260620 13:56:55.275009  9083 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:55.310936  9052 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:55.321379  6028 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:55.316361  8958 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:56:55.323722  9099 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260620 13:56:55.329185  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:55.283151  9110 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:55.345995  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.295248  9046 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:55.329411  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 139468us
W20260620 13:56:55.341485  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 116289us
I20260620 13:56:55.349967  6586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 862) took 1122 ms. Trace:
I20260620 13:56:55.350339  6586 rpcz_store.cc:276] 0620 13:56:54.227866 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:54.228071 (+   205us) service_pool.cc:224] Handling call
0620 13:56:55.349794 (+1121723us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b540051fc54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:55.349899 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1273849728}
I20260620 13:56:55.348620  6551 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:55.334657  9083 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:55.357379  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:55.239192  8966 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.331897  8992 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:55.346653  8970 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:55.380246  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.382517  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:55.388051  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.389521  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.408262  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:55.412480  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 599) took 1055 ms. Trace:
I20260620 13:56:55.413396  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.414129  5950 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:55.412998  6025 rpcz_store.cc:276] 0620 13:56:54.356791 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:54.728098 (+371307us) service_pool.cc:224] Handling call
0620 13:56:54.738061 (+  9963us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:54.738486 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:54.738518 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:54.752497 (+ 13979us) log.cc:844] Serialized 26 byte log entry
0620 13:56:55.109268 (+356771us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:56:55.109304 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:55.109367 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:55.412238 (+302871us) raft_consensus.cc:1685] finished
0620 13:56:55.412256 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:55.412418 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":167,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":9707,"thread_start_us":341508,"threads_started":1,"wal-append.queue_time_us":405740}
I20260620 13:56:55.371618  9042 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:55.347613  8958 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:55.422430  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:55.424077  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:55.359449  9046 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:55.426374  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 74757.7us
I20260620 13:56:55.428879  6551 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:55.429148  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:55.410296  9087 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:55.352762  9110 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:55.437008  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.437892  5950 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:55.425074  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:55.446169  6551 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:55.408910  9060 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260620 13:56:55.370329  8875 consensus_queue.cc:237] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:55.407277  8992 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.455117  5924 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:55.412074  9101 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260620 13:56:55.424799  9117 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:55.433003  9087 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:55.473723  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:55.482106  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 55041.5us
I20260620 13:56:55.483812  6552 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:55.445011  8997 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:55.448247  9042 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:55.498965  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:55.436012  8944 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260620 13:56:55.468694  8911 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:55.455678  9019 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:55.488061  9087 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:55.496161  9096 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:55.495854  9103 log.cc:927] Time spent T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260620 13:56:55.552773  9005 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:55.510041  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:55.594910  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 84976.4us
I20260620 13:56:55.595484  5883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42748 (request call id 602) took 1701 ms. Trace:
I20260620 13:56:55.595834  5883 rpcz_store.cc:276] 0620 13:56:53.893899 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:54.114769 (+220870us) service_pool.cc:224] Handling call
0620 13:56:55.595290 (+1480521us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b5400378f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:55.595432 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1499704576}
I20260620 13:56:55.596472  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:55.597604  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:55.510572  9104 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.261s	user 0.001s	sys 0.001s
I20260620 13:56:55.599511  9096 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:56:55.601853  5884 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
W20260620 13:56:55.538955  9112 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260620 13:56:55.555218  9122 consensus_queue.cc:1059] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:56:55.604792  9122 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:56:55.522887  9019 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.607496  9019 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:55.556732  8773 raft_consensus.cc:3055] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:55.502183  9042 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:55.524011  9024 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:55.494103  8943 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:55.501288  6578 raft_consensus.cc:2393] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:55.508169  9116 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:55.565671  8379 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:55.566154  9046 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:55.567247  9111 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:56:55.567948  8983 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:55.568465  9115 log.cc:927] Time spent T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.245s	user 0.002s	sys 0.000s
I20260620 13:56:55.569458  9110 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:55.572058  9043 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:55.572412  8971 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:55.573228  6583 raft_consensus.cc:2410] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260620 13:56:55.573292  6580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 850) took 1723 ms (client timeout 1795 ms). Trace:
I20260620 13:56:55.574640  8992 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:55.575356  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 614) took 1293 ms. Trace:
W20260620 13:56:55.652468  6580 rpcz_store.cc:269] 0620 13:56:53.850325 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:53.862981 (+ 12656us) service_pool.cc:224] Handling call
0620 13:56:55.573132 (+1710151us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54005af0d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:55.573235 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2719617920}
W20260620 13:56:55.575488  6033 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 576) took 2029 ms (client timeout 2052 ms). Trace:
W20260620 13:56:55.654204  6033 rpcz_store.cc:269] 0620 13:56:53.545843 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:53.546071 (+   228us) service_pool.cc:224] Handling call
0620 13:56:55.575311 (+2029240us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54004006d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:55.575413 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2564476800}
I20260620 13:56:55.576129  6032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2438) took 1363 ms. Trace:
I20260620 13:56:55.576845  9052 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:55.543576  8948 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:55.652678  5879 rpcz_store.cc:276] 0620 13:56:54.281637 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:54.751251 (+469614us) service_pool.cc:224] Handling call
0620 13:56:54.756605 (+  5354us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:56:54.757006 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:54.757045 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:56:54.757686 (+   641us) log.cc:844] Serialized 52 byte log entry
0620 13:56:55.088367 (+330681us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:56:55.115888 (+ 27521us) log.cc:844] Serialized 14 byte log entry
0620 13:56:55.128740 (+ 12852us) log.cc:844] Serialized 14 byte log entry
0620 13:56:55.140851 (+ 12111us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:55.140952 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:55.274948 (+133996us) spinlock_profiling.cc:243] Waited 8.77 ms on lock 0x7b18000277c0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc70abf3 00007f0fdc70cfc1 00007f0fdc70cf79 00007f0fdc70cf09 00007f0fdc70ced1 00007f0fdc70c1cd 0000000000389354 0000000000389199 00007f0fdc6ee03a
0620 13:56:55.575152 (+300204us) raft_consensus.cc:1685] finished
0620 13:56:55.575177 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:55.575298 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27742,"prepare.queue_time_us":109129,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":11690,"raft.queue_time_us":24215,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":14468,"spinlock_wait_cycles":20168960,"thread_start_us":280758,"threads_started":1,"wal-append.queue_time_us":353542}
W20260620 13:56:55.589123  9114 log.cc:927] Time spent T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
W20260620 13:56:55.590775  9113 log.cc:927] Time spent T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260620 13:56:55.493515  9118 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:55.551972  9125 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:55.661281  9125 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.663929  9038 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.667608  6582 raft_consensus.cc:2368] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10.
I20260620 13:56:55.635679  9116 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:55.663735  5884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1497) took 1764 ms. Trace:
I20260620 13:56:55.672792  5884 rpcz_store.cc:276] 0620 13:56:53.899379 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:54.196204 (+296825us) service_pool.cc:224] Handling call
0620 13:56:55.601682 (+1405478us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:55.602271 (+   589us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:55.663549 (+ 61278us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400378f50. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:55.663673 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3231776128}
W20260620 13:56:55.608886  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 177487us
W20260620 13:56:55.609678  6024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 600) took 1223 ms (client timeout 1620 ms). Trace:
I20260620 13:56:55.620268  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:55.674235  6024 rpcz_store.cc:269] 0620 13:56:54.386011 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:54.391450 (+  5439us) service_pool.cc:224] Handling call
0620 13:56:55.609458 (+1218008us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54000d5054. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:55.609600 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591392512}
I20260620 13:56:55.636409  9111 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:55.675071  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 54915.1us
I20260620 13:56:55.675554  9111 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:56:55.626542  9042 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:55.675877  5924 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:55.676712  8948 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:55.677347  9110 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:55.677426  8948 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:55.678326  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:55.610005  8773 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:55.679133  9110 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:55.680852  8948 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:56:55.681116  9116 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:55.681789  9083 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.683393  9077 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:55.683863  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:55.682865  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:55.685141  8948 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:55.687000  5849 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:55.687486  6586 raft_consensus.cc:2393] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:55.688016  9046 consensus_queue.cc:1059] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:56:55.689114  9046 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:55.689800  9046 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:56:55.690204  9046 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:55.690575  9046 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:55.691493  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.692875  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:55.693655  5959 raft_consensus.cc:2393] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:55.637848  5880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 609) took 1514 ms. Trace:
I20260620 13:56:55.635033  5998 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:55.692196  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:55.578944  8958 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:55.694365  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.694614  5849 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:55.694814  5880 rpcz_store.cc:276] 0620 13:56:54.123775 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:54.232256 (+108481us) service_pool.cc:224] Handling call
0620 13:56:55.308358 (+1076102us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:55.309295 (+   937us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:55.637537 (+328242us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002d00d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:55.637689 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2461762944}
W20260620 13:56:55.695055  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 60133.4us
I20260620 13:56:55.696712  5998 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:55.696336  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:55.655772  6032 rpcz_store.cc:276] 0620 13:56:54.212425 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:54.212829 (+   404us) service_pool.cc:224] Handling call
0620 13:56:55.575953 (+1363124us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b540014dcd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:55.576077 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241134336}
I20260620 13:56:55.700068  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:55.700937  5955 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 7
I20260620 13:56:55.706176  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.710304  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:55.636543  9005 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:55.635926  9024 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:56:55.716907  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.725739  6032 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:55.717777  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:55.631910  8379 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:55.731420  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 247691us
I20260620 13:56:55.732492  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.732788  5924 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:55.733916  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:55.735066  5884 raft_consensus.cc:2410] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260620 13:56:55.737592  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:55.740420  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.741109  6025 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:55.748416  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.749056  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:55.719182  9077 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:55.751899  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:55.751724  5997 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:55.758385  5954 raft_consensus.cc:1240] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:55.757469  5955 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:55.723129  8980 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:56:55.729748  9043 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:55.732323  8379 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:55.715329  9130 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:55.709949  9052 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:55.749225  6028 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:55.721743  9117 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:55.763942  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.779801  5955 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:55.766837  8983 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260620 13:56:55.768963  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 48051.4us
I20260620 13:56:55.770331  5878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2435) took 1465 ms. Trace:
I20260620 13:56:55.739255  9110 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260620 13:56:55.772833  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 56077.7us
I20260620 13:56:55.724371  9116 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260620 13:56:55.756978  9077 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:55.775910  5953 raft_consensus.cc:1275] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260620 13:56:55.791858  5849 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:55.748090  9024 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:55.777702  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:55.783833  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:55.773559  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 327466us
I20260620 13:56:55.763451  9005 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:55.760694  9060 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:55.781136  5878 rpcz_store.cc:276] 0620 13:56:54.304650 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:55.135637 (+830987us) service_pool.cc:224] Handling call
0620 13:56:55.136092 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:55.136299 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 5
0620 13:56:55.342325 (+206026us) log.cc:844] Serialized 14 byte log entry
0620 13:56:55.769677 (+427352us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:55.769751 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:55.769817 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:55.769916 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:55.770079 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60414,"prepare.queue_time_us":26332,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":8981,"thread_start_us":544886,"threads_started":2}
I20260620 13:56:55.794458  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:55.794907  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.795670  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.774958  9130 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:55.801183  5849 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:55.818212  6028 raft_consensus.cc:2376] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8. Re-sending same reply.
I20260620 13:56:55.819199  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:55.819911  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 54335us
I20260620 13:56:55.793888  9077 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:55.823594  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.790556  8958 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:55.822764  5849 leader_election.cc:400] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10.
I20260620 13:56:55.754871  9121 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260620 13:56:55.767798  8997 consensus_queue.cc:1059] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260620 13:56:55.829557  9060 raft_consensus.cc:697] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:55.830996  5849 leader_election.cc:403] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:56:55.836500  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.800284  9005 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:55.839037  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.835064  5997 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:55.845515  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:55.846264  5954 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:55.762991  8773 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.846505  5997 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:55.783777  9052 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:55.847704  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 70073.1us
I20260620 13:56:55.821826  9130 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:55.861109  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.819437  9043 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260620 13:56:55.870930  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:55.856137  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:55.858902  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.847554  9005 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:55.829499  9038 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:55.844061  9127 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:55.884712  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:55.885375  6583 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260620 13:56:55.885856  6583 pending_rounds.cc:85] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 6
I20260620 13:56:55.886029  6582 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:56:55.886246  6583 pending_rounds.cc:107] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260620 13:56:55.886691  6583 raft_consensus.cc:2889] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:55.845978  8997 consensus_queue.cc:1243] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer 2e82c0c231624695ac5a813230bf5038 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260620 13:56:55.822111  9133 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260620 13:56:55.915309  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 57561.8us
I20260620 13:56:55.878690  5954 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:56:55.889219  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:55.892473  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:55.895540  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:55.865938  8983 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:55.920718  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.900231  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.859661  9050 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:55.862197  8971 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:55.859825  9086 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:55.885358  6584 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:55.908248  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:55.918223  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:55.838337  8958 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:55.892812  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.920605  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:55.896004  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:55.923859  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:55.923859  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.929237  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.930675  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:55.940443  5950 raft_consensus.cc:2393] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:55.862666  9087 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.941955  5882 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260620 13:56:55.918205  9133 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:55.944636  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:55.919961  8997 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:55.910132  9127 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:55.943295  9116 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:55.951577  9116 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.952113  9152 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:55.952497  9110 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:56:55.953346  9057 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:55.953814  9057 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.951061  9127 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:56:55.965920  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 102310us
I20260620 13:56:55.869266  9117 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:55.998482  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 73539.1us
I20260620 13:56:56.007591  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:56:55.975802  8970 consensus_meta.cc:287] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.003s
I20260620 13:56:55.955870  9133 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:55.941349  8971 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:55.909610  9024 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.017640  8911 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:56.007967  8969 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:55.944242  9142 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260620 13:56:55.961521  8997 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:55.999402  9110 consensus_queue.cc:1059] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260620 13:56:56.033977  8970 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260620 13:56:56.046207  9145 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260620 13:56:56.035329  9101 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:56.012898  8948 consensus_queue.cc:1059] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260620 13:56:55.945729  9060 consensus_queue.cc:237] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.065726  9124 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 10
I20260620 13:56:55.952785  9152 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:56.071919  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:56.078670  9102 consensus_meta.cc:287] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.760s	user 0.012s	sys 0.001s
I20260620 13:56:56.086764  9042 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.071986  9052 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:56.116925  9102 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:56.117422  6581 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:56.118031  5952 raft_consensus.cc:1240] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:56.107088  5881 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
W20260620 13:56:56.072898  9148 log.cc:927] Time spent T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260620 13:56:55.999505  9128 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
I20260620 13:56:56.114289  8958 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:56.076244  9087 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:56.077661  8971 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:56.106755  9131 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.213s	user 0.001s	sys 0.001s
I20260620 13:56:56.129688  9043 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:56.097891  9142 consensus_queue.cc:1243] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer 2e82c0c231624695ac5a813230bf5038 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260620 13:56:56.079383  9110 raft_consensus.cc:3055] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:56.131712  9110 raft_consensus.cc:740] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:56.132647  9110 consensus_queue.cc:260] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:56.071031  9096 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:56:56.140396  9077 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.119067  9102 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:56.141745  9046 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.143177  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:56.143994  5881 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:56.048022  8943 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:56.086894  9116 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:56.090907  9057 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:56.077692  8997 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:56.094982  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:56.119812  9042 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:56.166244  9043 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260620 13:56:56.153666  9005 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.169932  9057 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:56:56.153518  9110 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:56.120996  9152 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:56.171540  9077 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:56.125720  9052 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:56.174082  5882 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260620 13:56:56.074275  9111 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.170811  5848 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:56.179986  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:56.162007  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:56.153898  9076 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:56.200591  9147 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:56.163703  8943 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.170980  9133 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:56.203744  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:56.317277  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 222396us
W20260620 13:56:56.199872  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 185727us
W20260620 13:56:56.320871  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 158918us
I20260620 13:56:56.220974  9052 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.211738  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:56:56.327351  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 382775us
I20260620 13:56:56.327010  5956 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:56.328591  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:56.329679  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 158945us
I20260620 13:56:56.330224  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:56.330312  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:56.330444  5848 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:56.324585  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:56.331980  9152 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:56.334579  6552 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:56.334599  5848 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:56.336414  5848 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:56.336360  5880 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260620 13:56:56.302914  8379 consensus_meta.cc:287] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.002s
I20260620 13:56:56.333058  9019 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:56.191891  9136 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:56.339576  8379 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.339836  9136 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.340715  9052 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:56.294569  9130 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.342068  9136 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:56.342386  5876 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:56.343884  9130 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:56.343915  8379 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:56.344376  8943 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:56.328823  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:56.352694  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:56.354382  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:56.354887  5954 raft_consensus.cc:3055] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:56.355355  5954 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:56.358121  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:56.298609  9157 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260620 13:56:56.356096  5954 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.367328  5848 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:56.368052  5883 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:56.290886  9155 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:56.368307  9128 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:56.379153  9111 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:56.328423  9024 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:56.300312  9086 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:56.203012  9046 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:56.333587  9043 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:56.269296  9054 raft_consensus.cc:3055] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:56.391986  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:56.388338  8379 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:56.396409  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:56.413844  6584 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:56.397512  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:56.414630  5950 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:56:56.394313  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:56.351795  9050 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:56.352268  9152 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:56.416173  9054 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:56.397187  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:56.417498  6579 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:56.418179  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:56.419715  9096 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:56.420454  9096 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:56.420876  9096 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:56.421219  9096 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:56.415041  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:56.423605  6584 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:56.348511  9147 raft_consensus.cc:697] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:56.424857  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:56.425493  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:56.428277  6580 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:56.370894  8875 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:56.387465  9130 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:56:56.383486  9052 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:56.432531  9111 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:56.396425  9133 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:56.332948  9076 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.310355  9127 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:56.471725  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 119422us
W20260620 13:56:56.485203  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 150688us
I20260620 13:56:56.426487  9043 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:56.396468  9155 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:56.589768  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:56.620473  5881 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260620 13:56:56.620890  5884 raft_consensus.cc:1240] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: []
I20260620 13:56:56.439669  9124 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10.
I20260620 13:56:56.631542  9127 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:56.619915  9162 log.cc:927] Time spent T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260620 13:56:56.475612  9111 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:56.634318  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:56.634403  9111 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:56.636459  9054 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.642526  5959 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260620 13:56:56.643184  5959 pending_rounds.cc:85] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 4
I20260620 13:56:56.643435  5959 pending_rounds.cc:107] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260620 13:56:56.643642  5959 raft_consensus.cc:2889] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:56:56.644997  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 165446us
I20260620 13:56:56.411083  9024 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:56.662679  6579 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:56.695418  6586 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:56.695569  6551 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:56.482661  9005 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:56.707086  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 221113us
I20260620 13:56:56.493512  9043 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:56.433643  8379 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:56.716205  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 233519us
I20260620 13:56:56.491636  9050 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:56.718990  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:56.727447  9101 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:56.625368  8983 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:56.480223  8875 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:56.671329  9042 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:56:56.735066  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:56.643210  9146 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:56:56.627621  8970 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
W20260620 13:56:56.756912  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 72902.3us
W20260620 13:56:56.719704  9157 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260620 13:56:56.759210  5849 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:56.762459  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:56.768784  8943 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260620 13:56:56.769301  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 58458.3us
I20260620 13:56:56.771157  6579 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:56:56.767000  5849 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:56.721053  9125 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:56.772583  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 168560us
W20260620 13:56:56.796792  9169 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260620 13:56:56.729293  9050 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:56.769335  8943 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:56:56.805222  9166 log.cc:927] Time spent T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260620 13:56:56.799579  9042 raft_consensus.cc:697] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:56.774437  9127 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:56.809971  9127 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:56.810343  9127 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:56.810415  9042 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.806990  8970 consensus_queue.cc:1059] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:56:56.809530  8943 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:56:56.774327  8971 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:56.783234  9057 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:56:56.836071  9155 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:56.836575  9057 raft_consensus.cc:697] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:56.837572  9057 consensus_queue.cc:237] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.753324  9111 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:56.840709  9111 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:56.836069  8971 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:56.844322  9175 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260620 13:56:56.826865  6584 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:56.779708  9174 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:56.847476  9174 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:56.849990  9174 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:56.755717  8983 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:56.852083  8983 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:56.852636  8875 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:56.835469  9050 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:56.857996  5849 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:56:56.863715  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 227632us
I20260620 13:56:56.867425  6584 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:56:56.870616  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:56.746246  9147 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:56.819442  9076 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:56.855934  8970 consensus_queue.cc:1243] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Peer 2e82c0c231624695ac5a813230bf5038 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260620 13:56:56.905942  8906 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:56:56.983095  8379 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:56.984112  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:56.986374  5951 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:56:56.987668  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:56.988588  8379 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:56:56.989005  8379 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:56.989363  8379 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:56:56.999821  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:57.041810  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:57.065412  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:57.071225  6584 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6. Ops: []
W20260620 13:56:57.077291  5956 consensus_meta.cc:287] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.744s	user 0.013s	sys 0.000s
I20260620 13:56:57.077857  5956 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:56:57.079525  6551 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:57.001808  9124 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:57.005087  8906 raft_consensus.cc:697] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:56:57.117936  6580 consensus_meta.cc:287] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.687s	user 0.012s	sys 0.000s
I20260620 13:56:57.118486  6580 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:56:57.091554  9038 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:56:57.129717  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:57.132085  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:57.094059  9024 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:57.121379  9096 consensus_meta.cc:287] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.003s
I20260620 13:56:57.133263  9096 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.133711  8906 consensus_queue.cc:237] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.135715  9096 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:57.125245  9188 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:57.136492  9188 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:57.137553  9184 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:57.138181  9184 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.130995  9130 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:57.139969  9180 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260620 13:56:57.139786  9130 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.140636  9184 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:57.141997  9130 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:57.142343  8943 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.122212  9155 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:57.143424  9155 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.130604  5879 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:57.145738  9038 raft_consensus.cc:697] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:57.151281  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:57.151492  8773 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:57.151643  9155 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:57.152165  9038 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.153716  9083 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:57.154348  9127 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.097388  9124 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:57.155344  8943 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:57.160143  9130 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:57.160530  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:57.165043  5951 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:56:57.131982  9146 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:57.139247  5954 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:57.164932  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:57.138589  9188 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:56:57.189023  9177 log.cc:927] Time spent T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260620 13:56:57.193150  9127 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:57.196177  9124 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:57.183533  9130 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:57.199581  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.200039  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.200212  5957 raft_consensus.cc:2376] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8. Re-sending same reply.
I20260620 13:56:57.200706  5958 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:57.200634  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.201429  5950 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:57.201037  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.201556  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:57.202225  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:57.202401  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.202553  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:57.202982  5957 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:57.203402  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:57.204053  6583 raft_consensus.cc:2368] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5.
I20260620 13:56:57.204085  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:57.204733  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:57.204856  6584 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:57.205219  6583 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260620 13:56:57.205377  6582 raft_consensus.cc:2368] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6.
I20260620 13:56:57.205932  6584 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260620 13:56:57.206192  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:57.206223  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:57.206997  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.206804  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:57.209885  8804 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:57.210094  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:57.211565  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:57.213387  6579 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260620 13:56:57.183581  9146 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.226428  6584 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:56:57.210443  8804 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.198843  9130 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:57.405040  6579 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: []
I20260620 13:56:57.378180  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:57.406070  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1645) took 1051 ms. Trace:
I20260620 13:56:57.408283  6586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 794) took 1014 ms. Trace:
I20260620 13:56:57.317963  5951 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:56:57.310537  5954 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:56:57.410573  6586 rpcz_store.cc:276] 0620 13:56:56.393418 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:56.634040 (+240622us) service_pool.cc:224] Handling call
0620 13:56:57.408075 (+774035us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b540043b2d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:57.408210 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69867392}
I20260620 13:56:57.411840  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1644) took 1057 ms. Trace:
I20260620 13:56:57.306730  6025 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260620 13:56:57.410332  5959 rpcz_store.cc:276] 0620 13:56:56.354622 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:56.354781 (+   159us) service_pool.cc:224] Handling call
0620 13:56:56.355049 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:56.644025 (+288976us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:57.405794 (+761769us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54002503d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:57.406004 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659811072}
I20260620 13:56:57.277272  6580 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260620 13:56:57.228328  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:57.356920  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:57.278405  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:57.315518  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.413100  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.383364  5998 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:57.412267  5954 rpcz_store.cc:276] 0620 13:56:56.354336 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:56.354461 (+   125us) service_pool.cc:224] Handling call
0620 13:56:56.354750 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:57.139069 (+784319us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b580069add0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf75848a 00007f0fdf7da827 00007f0fdf7f33c7 00007f0fdf7f4bbe 00007f0fdf7fef29 00007f0fdf7ff7f6 00007f0fdf7fc16f 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34
0620 13:56:57.411593 (+272524us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:57.411789 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772737408}
I20260620 13:56:57.365711  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:57.255626  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:57.419127  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.427527  5959 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:57.429253  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.420426  5958 raft_consensus.cc:2376] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8. Re-sending same reply.
I20260620 13:56:57.430248  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.432014  5951 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:57.433247  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.434361  5880 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: []
I20260620 13:56:57.438898  5924 leader_election.cc:400] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5.
W20260620 13:56:57.439981  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:57.438570  5848 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:57.440878  5924 leader_election.cc:400] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6.
I20260620 13:56:57.441705  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:57.442564  6585 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:57.431293  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:57.444022  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:57.407923  9052 consensus_meta.cc:287] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.931s	user 0.012s	sys 0.000s
I20260620 13:56:57.355450  8983 consensus_queue.cc:1059] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260620 13:56:57.435299  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:57.414569  9083 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:57.236184  9109 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:57.440026  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.472651  5959 raft_consensus.cc:2410] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260620 13:56:57.472977  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:57.447628  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.448383  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.453173  6586 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:57.228984  9124 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:57.454305  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:57.476251  6026 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:57.315712  9191 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:57.477332  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:57.481700  5959 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:57.481992  6579 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:57.445621  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.276485  9186 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:57.444713  6033 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:56:57.455876  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:57.483806  6031 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:57.456387  5997 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:57.459578  5880 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:56:57.486905  6585 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:57.486999  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:57.230832  8379 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.438944  9147 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:56:57.472482  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:57.449144  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:57.455076  8906 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:57.520061  5953 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:56:57.455320  9125 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:57.354955  8966 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.117s
I20260620 13:56:57.526177  5959 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:56:57.480293  9050 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:57.535197  6582 raft_consensus.cc:2368] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:56:57.492739  8970 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:57.450095  9174 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:57.454293  9052 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:57.459599  9127 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:57.229988  9043 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.487710  5880 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:57.454625  9185 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:57.512356  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:57.457612  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:57.478555  9161 raft_consensus.cc:3055] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:57.455092  9188 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:57.383152  8808 consensus_queue.cc:1059] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260620 13:56:57.427383  9096 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:57.521925  6026 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:57.522491  5776 catalog_manager.cc:5696] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:57.503298  9118 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:56:57.538378  6031 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:56:57.577983  5880 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:56:57.479744  9102 consensus_queue.cc:1059] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260620 13:56:57.582181  9102 raft_consensus.cc:3055] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:57.582563  9102 raft_consensus.cc:740] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:57.535053  9125 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.583467  9102 consensus_queue.cc:260] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.584753  9102 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:57.584863  9125 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:57.485252  9124 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.589885  9124 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:57.479925  9109 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.591287  9193 raft_consensus.cc:3055] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:57.591715  9193 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:57.592286  9109 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:57.592366  8971 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:57.592621  9193 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.594118  9193 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:57.556293  9174 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.597592  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:57.597877  9174 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:57.598675  6579 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:57.600965  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:57.489364  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:56:57.571801  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 114245us
I20260620 13:56:57.489395  9186 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:57.608153  9186 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:57.538762  9147 raft_consensus.cc:697] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:57.609606  9147 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.560825  9161 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:56:57.610862  9121 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260620 13:56:57.611857  9161 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.613301  9161 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:57.538244  9057 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:57.616515  9057 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.551717  9129 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:57.479269  9083 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.575251  9188 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.532251  8906 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.558314  5879 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:56:57.603721  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2444) took 1655 ms. Trace:
I20260620 13:56:57.517774  9191 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.622756  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:57.658217  5880 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:57.558143  9127 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:57.639282  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 151338us
W20260620 13:56:57.641121  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:57.651413  5953 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:56:57.548934  9050 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:57.700374  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:57.656194  5882 rpcz_store.cc:276] 0620 13:56:55.948168 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:55.948598 (+   430us) service_pool.cc:224] Handling call
0620 13:56:55.948963 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:56.220275 (+271312us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:57.603383 (+1383108us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54003f2d54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:57.603647 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517212928}
I20260620 13:56:57.705842  5953 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
W20260620 13:56:57.665339  9196 log.cc:927] Time spent T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260620 13:56:57.668979  9191 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:57.670564  9190 log.cc:927] Time spent T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.514s	user 0.003s	sys 0.001s
I20260620 13:56:57.671278  8997 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:57.672859  8906 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:57.678604  9054 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:57.730063  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:57.681142  9188 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:57.651924  9121 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 13:56:57.682332  9195 log.cc:927] Time spent T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260620 13:56:57.683949  9197 log.cc:927] Time spent T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260620 13:56:57.684552  9043 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:57.685063  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1627) took 1994 ms. Trace:
I20260620 13:56:57.685773  9057 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:57.575405  9096 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.687194  9118 consensus_queue.cc:1059] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:57.688163  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:57.699236  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:57.700161  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:57.577049  9052 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:57.578964  8970 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:57.708282  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:57.709507  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:57.710927  6033 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:57.713598  6032 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:56:57.651909  9129 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.724604  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:57.699450  9127 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:57.711675  8875 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:57.730985  6027 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
W20260620 13:56:57.734841  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:57.761400  6029 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:56:57.738816  5952 rpcz_store.cc:276] 0620 13:56:55.690525 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:55.693981 (+  3456us) service_pool.cc:224] Handling call
0620 13:56:55.726119 (+ 32138us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:56.118403 (+392284us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:57.684447 (+1566044us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b5400044054. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:57.684989 (+   542us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900967168}
I20260620 13:56:57.749542  6581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 815) took 2637 ms. Trace:
I20260620 13:56:57.564739  9185 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:57.731537  9198 log.cc:927] Time spent T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260620 13:56:57.785089  5997 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:57.711606  9134 consensus_queue.cc:1059] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260620 13:56:57.788051  5997 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:57.788374  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:57.789331  6026 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:56:57.779984  6030 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
W20260620 13:56:57.791215  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 103380us
I20260620 13:56:57.762980  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:57.793797  6033 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:56:57.801756  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:57.802744  5956 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:56:57.781401  6581 rpcz_store.cc:276] 0620 13:56:55.111875 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:55.112296 (+   421us) service_pool.cc:224] Handling call
0620 13:56:55.593650 (+481354us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b580005fa98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:56:55.593844 (+   194us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:56.117784 (+523940us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:57.749063 (+1631279us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54004a83d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:57.749442 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206500992}
I20260620 13:56:57.808365  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:57.809561  5997 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:57.811074  5997 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:57.820401  6027 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
W20260620 13:56:57.821157  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:57.821306  5883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2439) took 1926 ms. Trace:
I20260620 13:56:57.821691  5883 rpcz_store.cc:276] 0620 13:56:55.895343 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:55.915390 (+ 20047us) service_pool.cc:224] Handling call
0620 13:56:55.918541 (+  3151us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:56.368464 (+449923us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:57.821077 (+1452613us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b540040ef54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:57.821248 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1033353600}
I20260620 13:56:57.823807  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:57.825174  5997 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:57.760733  9052 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:57.734689  8997 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.836344  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:57.836628  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:57.790795  8970 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:57.839960  5997 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:57.840559  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:57.841188  6024 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
W20260620 13:56:57.841969  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 410729us
I20260620 13:56:57.842573  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:57.846135  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:57.850983  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:57.851696  6027 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:56:57.853960  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:57.854303  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:57.854725  6033 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:56:57.855698  5880 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:57.858074  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:57.876914  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:57.811271  9121 raft_consensus.cc:3055] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:57.816169  9109 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:56:57.813817  9077 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:56:57.862988  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:57.823851  9164 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:57.808023  9188 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260620 13:56:57.878412  5883 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260620 13:56:57.875523  5956 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:56:57.843428  9052 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:57.831588  8379 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:57.881407  6029 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:57.808291  8989 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260620 13:56:57.823648  9192 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:57.879452  5849 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:57.875924  5875 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:56:57.846495  8970 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:57.846357  8966 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:56:57.812453  8875 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.845767  9057 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:57.845314  9043 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:57.917888  5849 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:57.823722  9118 consensus_queue.cc:1059] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260620 13:56:57.855504  9024 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:57.859278  9193 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:57.924365  5875 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:56:57.861837  9134 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:56:57.879391  8808 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:56:57.947479  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:57.871526  9133 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:56:57.941946  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 100791us
I20260620 13:56:57.908525  9191 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:57.947351  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:57.878554  9121 raft_consensus.cc:740] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:57.948300  6032 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:56:57.921135  9125 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:58.088888  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:58.094277  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 257756us
I20260620 13:56:57.952584  6029 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:56:57.953820  5849 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:57.908676  9019 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260620 13:56:58.097743  5876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2445) took 2096 ms. Trace:
I20260620 13:56:57.952189  9077 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:56:58.103642  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 149891us
I20260620 13:56:58.100157  5876 rpcz_store.cc:276] 0620 13:56:56.001892 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:56.002204 (+   312us) service_pool.cc:224] Handling call
0620 13:56:56.008601 (+  6397us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:56.342798 (+334197us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:58.097532 (+1754734us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54000c6cd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:58.097689 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767168256}
I20260620 13:56:57.953953  9191 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.149598  5849 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:56:58.160861  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 61670.3us
I20260620 13:56:58.090975  8943 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:57.941937  9043 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.091935  8992 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:58.165197  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:58.099730  9050 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:57.953114  9024 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.947959  9057 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:57.957566  8966 consensus_queue.cc:1059] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.204s
I20260620 13:56:58.175868  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:58.182708  9207 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:58.153728  9125 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:58.189960  6552 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:57.959776  9133 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:58.179364  9102 consensus_meta.cc:287] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.594s	user 0.013s	sys 0.010s
I20260620 13:56:58.168111  8980 consensus_queue.cc:1059] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260620 13:56:58.187664  8992 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.201678  8839 raft_consensus.cc:3055] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:56:58.202006  8997 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:58.203601  9043 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:58.205359  9057 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:58.180052  9121 consensus_queue.cc:260] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:58.223762  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:58.226791  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:58.254330  6552 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:56:58.180922  8943 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:58.243005  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:58.160023  9077 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.245016  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:58.269510  6033 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 9: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:56:58.236701  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 71608.9us
I20260620 13:56:58.185786  9206 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:56:58.233009  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:58.283061  6029 raft_consensus.cc:2393] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 8: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:58.283500  6027 raft_consensus.cc:1240] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: []
I20260620 13:56:58.237710  8839 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:58.270897  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:58.238627  9124 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:58.284420  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:58.294404  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:58.224526  9096 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:58.250546  9102 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:58.275561  9091 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election won for term 10
W20260620 13:56:58.277277  9208 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
W20260620 13:56:58.278018  9211 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260620 13:56:58.280613  9077 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:58.281553  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:58.207574  9194 consensus_queue.cc:1059] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260620 13:56:58.237319  9125 raft_consensus.cc:697] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:58.285094  9121 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:58.237092  9129 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:58.283867  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:58.247743  9188 raft_consensus.cc:3055] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:56:58.273195  9136 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:58.301729  9124 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:58.320227  9136 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:58.320592  9224 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:58.293084  8966 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:58.302906  9206 raft_consensus.cc:697] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:56:58.325134  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 107539us
I20260620 13:56:58.328548  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:58.300101  9185 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:58.330053  8875 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:58.320284  8839 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.332154  9217 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:58.325209  9136 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:58.340299  9217 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:58.332363  9125 consensus_queue.cc:237] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:58.344623  9206 consensus_queue.cc:237] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:58.321169  9188 raft_consensus.cc:740] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:58.333734  9234 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:58.333847  9129 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:58.299459  9042 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260620 13:56:58.338400  6028 consensus_meta.cc:287] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260620 13:56:58.330948  8966 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.339289  9024 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:58.339763  9214 log.cc:927] Time spent T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260620 13:56:58.342785  9217 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:58.320611  9124 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:58.360620  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.304400  9102 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:58.325618  9224 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:58.309528  9096 consensus_queue.cc:1059] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260620 13:56:58.367565  6028 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:56:58.369966  5875 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:58.367333  8875 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:58.367542  9181 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:58.366951  9226 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:58.397616  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.397516  6552 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:58.373692  9229 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:56:58.413210  5849 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:58.413223  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.415854  6552 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:58.381994  8839 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:58.379683  9091 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:58.395718  9224 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:58.367874  9129 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.368393  9234 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.370357  9052 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:56:58.439322  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 43914.4us
I20260620 13:56:58.464223  5998 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:58.465342  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:58.440264  6582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 879) took 1234 ms. Trace:
I20260620 13:56:58.440361  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:58.466255  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:58.441088  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:58.441869  9076 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:58.466959  6582 rpcz_store.cc:276] 0620 13:56:57.205807 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:57.205946 (+   139us) service_pool.cc:224] Handling call
0620 13:56:58.433925 (+1227979us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400470ed4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:58.440195 (+  6270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754790784}
I20260620 13:56:58.467383  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:58.468520  6033 raft_consensus.cc:2410] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260620 13:56:58.444453  9230 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.112s	user 0.002s	sys 0.000s
I20260620 13:56:58.445274  9226 raft_consensus.cc:697] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:58.447427  8943 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:56:58.415140  9117 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:56:58.447790  9129 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:58.453413  9091 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.454588  9204 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:56:58.413031  9188 consensus_queue.cc:260] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:58.410444  9217 consensus_queue.cc:1059] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260620 13:56:58.456261  9161 consensus_meta.cc:287] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.842s	user 0.013s	sys 0.000s
I20260620 13:56:58.458176  5881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1520) took 1588 ms. Trace:
I20260620 13:56:58.459172  9042 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:56:58.459795  9234 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:56:58.460083  9219 log.cc:927] Time spent T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260620 13:56:58.414561  8875 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.434250  8992 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:58.461851  9209 log.cc:927] Time spent T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260620 13:56:58.437335  9229 raft_consensus.cc:697] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:58.511564  9136 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.512138  9229 consensus_queue.cc:237] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.496301  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 792) took 2104 ms. Trace:
I20260620 13:56:58.514247  9121 raft_consensus.cc:3055] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:58.514755  9121 raft_consensus.cc:740] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:58.475230  8997 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:58.484575  9181 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:58.515674  9121 consensus_queue.cc:260] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:58.515875  9181 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.517333  8875 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:58.518116  9181 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:58.514259  6587 rpcz_store.cc:276] 0620 13:56:56.392334 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:56.392441 (+   107us) service_pool.cc:224] Handling call
0620 13:56:56.392788 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:56:56.479019 (+ 86231us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:56.479052 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:56:57.694092 (+1215040us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b2c000fb6b8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fde0f5c71 00007f0fde1055d2 00007f0fdf837de1 00007f0fdf7fc81a 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22
0620 13:56:57.694770 (+   678us) log.cc:844] Serialized 52 byte log entry
0620 13:56:57.910266 (+215496us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:57.910304 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:57.910377 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:58.479655 (+569278us) raft_consensus.cc:1685] finished
0620 13:56:58.479676 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:58.496220 (+ 16544us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":188974,"raft.queue_time_us":86332,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6485,"spinlock_wait_cycles":3523968,"thread_start_us":214798,"threads_started":1,"wal-append.queue_time_us":492675}
I20260620 13:56:58.462021  9133 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:58.500398  5884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2447) took 2397 ms. Trace:
I20260620 13:56:58.526712  5884 rpcz_store.cc:276] 0620 13:56:56.098698 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:56.098824 (+   126us) service_pool.cc:224] Handling call
0620 13:56:56.104951 (+  6127us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:56.626208 (+521257us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:58.496208 (+1870000us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b54000c5dd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:58.496443 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1186161408}
I20260620 13:56:58.501528  5881 rpcz_store.cc:276] 0620 13:56:56.869833 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:56.870030 (+   197us) service_pool.cc:224] Handling call
0620 13:56:56.949964 (+ 79934us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:56.952028 (+  2064us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:56.952070 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:56.956386 (+  4316us) log.cc:844] Serialized 26 byte log entry
0620 13:56:58.098325 (+1141939us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b18003235c0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:56:58.336716 (+238391us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:56:58.336759 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:58.336825 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:58.457765 (+120940us) raft_consensus.cc:1685] finished
0620 13:56:58.457784 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:58.458006 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3415,"raft.queue_time_us":2269,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":16996,"spinlock_wait_cycles":42792320,"thread_start_us":238210,"threads_started":1,"wal-append.queue_time_us":1402321}
W20260620 13:56:58.478035  8970 consensus_meta.cc:287] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.001s
W20260620 13:56:58.477380  9127 consensus_meta.cc:287] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.005s
I20260620 13:56:58.481106  9101 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:58.473026  9192 consensus_queue.cc:1059] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260620 13:56:58.531214  5924 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:58.548105  9227 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:58.550321  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:58.551220  9227 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260620 13:56:58.551646  9226 consensus_queue.cc:237] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:58.556082  9052 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:58.556236  9125 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:58.557060  6586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 882) took 1350 ms. Trace:
I20260620 13:56:58.557482  6586 rpcz_store.cc:276] 0620 13:56:57.206503 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:57.411987 (+205484us) service_pool.cc:224] Handling call
0620 13:56:57.412318 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:57.474366 (+ 62048us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:58.556571 (+1082205us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b540051fc54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:58.556991 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92877696}
I20260620 13:56:58.558902  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.559597  5881 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:56:58.560554  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.561378  5884 raft_consensus.cc:2410] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260620 13:56:58.563194  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 827) took 1121 ms. Trace:
I20260620 13:56:58.564685  9101 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.565073  6579 rpcz_store.cc:276] 0620 13:56:57.441569 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:57.602163 (+160594us) service_pool.cc:224] Handling call
0620 13:56:57.602529 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:57.819910 (+217381us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:57.819938 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:57.819979 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:57.820013 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:58.562850 (+742837us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b540059f954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:58.562919 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:58.563086 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499479424}
I20260620 13:56:58.566874  9101 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:58.482357  5883 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:58.523515  9136 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:58.535725  9216 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:56:58.537006  9240 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260620 13:56:58.576730  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.536825  8970 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.538980  9102 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:58.530619  9188 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:58.539611  9127 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:58.540452  9054 consensus_meta.cc:287] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.000s
W20260620 13:56:58.541817  9202 log.cc:927] Time spent T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.632s	user 0.001s	sys 0.000s
I20260620 13:56:58.526151  8875 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:58.542716  8966 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:58.509085  9204 raft_consensus.cc:697] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:58.584724  8875 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:58.586169  9146 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:58.585824  9204 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.586390  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2063) took 1385 ms. Trace:
I20260620 13:56:58.544828  9077 raft_consensus.cc:3055] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:58.586891  8875 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:58.586826  5950 rpcz_store.cc:276] 0620 13:56:57.200713 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:57.202972 (+  2259us) service_pool.cc:224] Handling call
0620 13:56:57.215923 (+ 12951us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:56:57.411374 (+195451us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:57.411404 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:56:57.431440 (+ 20036us) log.cc:844] Serialized 52 byte log entry
0620 13:56:57.654140 (+222700us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:56:57.887140 (+233000us) log.cc:844] Serialized 14 byte log entry
0620 13:56:57.887563 (+   423us) log.cc:844] Serialized 14 byte log entry
0620 13:56:58.170206 (+282643us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:58.170302 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:58.541085 (+370783us) spinlock_profiling.cc:243] Waited 7.67 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:56:58.586178 (+ 45093us) raft_consensus.cc:1685] finished
0620 13:56:58.586202 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:58.586330 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101221,"prepare.queue_time_us":227503,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":89,"raft.queue_time_us":675284,"raft.run_cpu_time_us":657,"raft.run_wall_time_us":47552,"spinlock_wait_cycles":18264320,"thread_start_us":675571,"threads_started":3,"wal-append.queue_time_us":338942}
I20260620 13:56:58.479350  9228 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:58.580752  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.582909  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.596575  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.599591  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.600432  5875 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:58.600482  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:58.605062  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.606307  5875 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:56:58.608615  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.610021  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:58.612749  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:58.614619  5879 raft_consensus.cc:2410] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260620 13:56:58.547408  9181 consensus_queue.cc:1059] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260620 13:56:58.616945  5877 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6. Ops: []
I20260620 13:56:58.617097  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:58.589818  9077 raft_consensus.cc:740] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:58.587307  9178 consensus_queue.cc:1059] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260620 13:56:58.621028  9178 raft_consensus.cc:3055] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Stepping down as leader of term 7
W20260620 13:56:58.621320  5848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.171s	user 0.020s	sys 0.036s
W20260620 13:56:58.621711  5848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.171s	user 0.020s	sys 0.036s
I20260620 13:56:58.621628  9178 raft_consensus.cc:740] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:56:58.622128  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 1.17147e+06us
I20260620 13:56:58.623404  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:58.623574  8948 raft_consensus.cc:3055] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:56:58.628155  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:58.622859  5848 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:58.639608  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.643790  5848 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:58.646062  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.606079  9228 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:58.655376  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:58.661792  5884 raft_consensus.cc:2393] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:56:58.662405  5924 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.835s (SENT) [suppressed 32 similar messages]
I20260620 13:56:58.557482  9125 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.616722  9227 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260620 13:56:58.666417  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 248968us
I20260620 13:56:58.635061  9118 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:56:58.671486  6024 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260620 13:56:58.667757  5848 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:58.667438  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:58.666808  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:58.643251  9217 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:58.616361  9101 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260620 13:56:58.634449  8948 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:58.652895  8804 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:58.661890  9229 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:58.677471  6552 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:58.677685  5848 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:58.684381  5848 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:58.665472  9133 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election won for term 8
W20260620 13:56:58.665319  9109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.007s	sys 0.008s
I20260620 13:56:58.665185  9227 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:58.671170  9186 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:58.682919  9091 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:58.678639  8808 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:58.695736  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:58.690591  8948 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.691382  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:58.691740  9125 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:58.710137  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:58.721342  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:58.724519  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:58.721040  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:56:58.690321  9127 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:58.634557  9077 consensus_queue.cc:260] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:58.730691  6579 raft_consensus.cc:2393] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:58.682953  9052 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:58.705848  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:58.738045  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:58.622920  9178 consensus_queue.cc:260] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:56:58.739089  5848 connection.cc:256] RPC call timeout handler was delayed by -1.2753670929999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260620 13:56:58.739442  6580 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260620 13:56:58.744540  6026 raft_consensus.cc:2410] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260620 13:56:58.738461  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:58.686115  9109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.008s	sys 0.008s
I20260620 13:56:58.688724  9133 raft_consensus.cc:697] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:56:58.688143  9227 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:56:58.694995  8804 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:56:58.735384  9186 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:58.746651  6582 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:56:58.730991  8808 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:58.687789  9206 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:56:58.723879  9204 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:56:58.725031  9091 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:56:58.772408  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:58.745996  9052 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:58.728991  9181 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:58.777976  9124 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.790299  9091 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:58.747495  6030 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:58.790591  9181 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:58.694073  9136 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260620 13:56:58.792728  9181 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:58.728905  9242 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:58.793457  9242 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.770660  9161 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:56:58.786602  8804 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:56:58.790436  9217 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:56:58.779915  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 117534us
I20260620 13:56:58.774814  9109 raft_consensus.cc:697] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:58.775278  9127 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:58.782204  8948 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:56:58.783125  9186 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:58.803649  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.787259  8808 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:58.796211  9052 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:58.773701  9102 consensus_queue.cc:1059] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260620 13:56:58.795490  9242 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:58.811326  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.797824  9161 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:58.811861  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:58.812790  9250 log.cc:927] Time spent T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260620 13:56:58.817102  9161 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:58.824513  8997 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:58.820119  9205 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:58.831818  9228 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:58.832182  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.832722  6028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 619) took 1124 ms. Trace:
I20260620 13:56:58.833873  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:56:58.822976  9248 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.084s	user 0.001s	sys 0.001s
I20260620 13:56:58.807067  9217 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.867687  8997 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:58.878254  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.807688  9127 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:58.879570  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.880646  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:58.880722  9127 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:58.881330  5881 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:58.873636  6028 rpcz_store.cc:276] 0620 13:56:57.707917 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:57.708038 (+   121us) service_pool.cc:224] Handling call
0620 13:56:58.832533 (+1124495us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b54001c9654. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:56:58.832653 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139338112}
I20260620 13:56:58.884080  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:56:58.964897  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:58.814551  9133 consensus_queue.cc:237] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:58.992858  9246 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:56:58.999502  9235 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:58.992781  9076 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:58.823814  8804 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.000648  8997 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:59.001688  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:59.003319  9255 log.cc:927] Time spent T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260620 13:56:59.008087  6026 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260620 13:56:59.006713  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:58.886924  6578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 872) took 1680 ms. Trace:
W20260620 13:56:59.019541  9224 consensus_meta.cc:287] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.004s
I20260620 13:56:59.021090  9178 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:59.024187  9124 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:59.032274  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 64940.6us
I20260620 13:56:58.987277  9129 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:59.054322  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:59.042544  9235 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.054863  9129 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.056557  9235 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:59.057583  9129 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:59.043237  6030 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:59.053247  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:59.053493  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:59.067883  5957 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:59.068017  5956 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:56:59.044371  8948 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:59.058139  9057 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:56:59.058583  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:59.073155  5997 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:59.074443  9054 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:59.076664  9083 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:59.076836  8948 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.060012  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:59.060735  5848 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:59.078576  6586 raft_consensus.cc:2368] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:56:59.034404  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:58.884259  9109 consensus_queue.cc:237] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.079089  5881 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:59.060843  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:59.080098  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:59.054320  5952 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260620 13:56:59.082674  5952 pending_rounds.cc:85] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 6
I20260620 13:56:59.082929  5952 pending_rounds.cc:107] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260620 13:56:59.083235  5952 raft_consensus.cc:2889] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:59.065624  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:59.054025  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:59.070237  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2138) took 1600 ms. Trace:
I20260620 13:56:59.071043  9181 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:59.080322  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:59.085253  5953 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:56:59.078392  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:59.064796  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:59.038739  9246 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:59.085608  6025 rpcz_store.cc:276] 0620 13:56:57.470330 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:57.470555 (+   225us) service_pool.cc:224] Handling call
0620 13:56:57.484543 (+ 13988us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:57.611868 (+127325us) raft_consensus.cc:1534] Early marking committed up to index 8
0620 13:56:57.612281 (+   413us) log.cc:844] Serialized 14 byte log entry
0620 13:56:58.218548 (+606267us) log.cc:844] Serialized 14 byte log entry
0620 13:56:58.218878 (+   330us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:58.218946 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:56:58.219013 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:58.461228 (+242215us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:56:59.070014 (+608786us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540037c8d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:59.070063 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:59.070174 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4109,"prepare.queue_time_us":184624,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":90,"raft.queue_time_us":13111,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":20453,"spinlock_wait_cycles":318786304,"thread_start_us":593534,"threads_started":2,"wal-append.queue_time_us":564112}
I20260620 13:56:59.094012  9118 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:59.094645  9182 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:59.092314  5878 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:56:59.042335  9076 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.047262  9224 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:59.102890  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:59.093283  9215 log.cc:927] Time spent T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.705s	user 0.008s	sys 0.033s
I20260620 13:56:59.088994  9057 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:56:59.116403  8808 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.118830  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:59.119697  5954 raft_consensus.cc:2393] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:59.120121  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:59.120832  5956 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:56:59.121910  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:59.101567  9182 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:59.123535  6585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 832) took 1449 ms. Trace:
I20260620 13:56:59.096800  9181 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.123947  6585 rpcz_store.cc:276] 0620 13:56:57.674311 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:57.702852 (+ 28541us) service_pool.cc:224] Handling call
0620 13:56:57.715975 (+ 13123us) raft_consensus.cc:1471] Updating replica for 3 ops
0620 13:56:57.729000 (+ 13025us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:57.729042 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0620 13:56:57.733013 (+  3971us) log.cc:844] Serialized 78 byte log entry
0620 13:56:57.943662 (+210649us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:58.095157 (+151495us) log.cc:844] Serialized 14 byte log entry
0620 13:56:58.095538 (+   381us) log.cc:844] Serialized 14 byte log entry
0620 13:56:58.095693 (+   155us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:58.095759 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:59.074998 (+979239us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b24000d4858. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc591614 00007f0fdc58f71b 00007f0fdc74a619 00007f0fdc74a2a5 00007f0fdc7498ed 00007f0fdf37f4ae 00007f0fdf396c2c 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1
0620 13:56:59.123277 (+ 48279us) raft_consensus.cc:1685] finished
0620 13:56:59.123301 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:59.123451 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":223929,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":15208,"raft.run_cpu_time_us":438,"raft.run_wall_time_us":110953,"spinlock_wait_cycles":26570496,"thread_start_us":133751,"threads_started":1,"wal-append.queue_time_us":504859}
I20260620 13:56:59.127317  9181 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:59.123553  9182 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:59.133054  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1658) took 1560 ms. Trace:
I20260620 13:56:59.133577  5959 rpcz_store.cc:276] 0620 13:56:57.573171 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:57.574443 (+  1272us) service_pool.cc:224] Handling call
0620 13:56:57.574894 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:57.619979 (+ 45085us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:57.620023 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:57.620084 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:57.620137 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:59.132779 (+1512642us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b54002508d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:59.132839 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:59.132976 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103074176}
I20260620 13:56:58.503774  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:56:59.098745  9217 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:59.136206  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:59.145066  6030 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:56:59.143826  5776 catalog_manager.cc:5696] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:59.155848  5950 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260620 13:56:59.135555  9235 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:59.154676  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:59.156383  5776 catalog_manager.cc:5696] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 2 to 3, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 3 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:56:59.153043  9188 consensus_meta.cc:287] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.000s
I20260620 13:56:59.165282  5776 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:59.135852  8808 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:59.105036  9118 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:59.168191  6024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2458) took 1079 ms. Trace:
I20260620 13:56:59.183856  5997 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:59.184358  6024 rpcz_store.cc:276] 0620 13:56:58.089054 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:58.094586 (+  5532us) service_pool.cc:224] Handling call
0620 13:56:58.098534 (+  3948us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:58.672106 (+573572us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:59.167826 (+495720us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54001c8754. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:59.168108 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316587904}
I20260620 13:56:59.186951  5997 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:56:59.197459  5776 catalog_manager.cc:5696] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 4 to 6, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 6 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:59.162497  9057 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:56:59.201068  5776 catalog_manager.cc:5696] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:56:59.220147  5778 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56594 (request call id 331) took 14947 ms (client timeout 15000 ms). Trace:
I20260620 13:56:59.220925  5776 catalog_manager.cc:5696] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 4 to 6, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 6 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:59.230147  5997 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:56:59.223078  5776 catalog_manager.cc:5696] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 5, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 5 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:59.232210  8997 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:59.232888  8997 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:56:59.234165  5776 catalog_manager.cc:5696] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 1 to 4, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 4 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:56:59.220611  5778 rpcz_store.cc:269] 0620 13:56:44.243329 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:44.272545 (+ 29216us) service_pool.cc:224] Handling call
0620 13:56:59.186145 (+14913600us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:56:51.364264 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:56:51.476709 (+112445us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:56:51.476770 (+    61us) write_op.cc:435] Acquired schema lock
0620 13:56:51.476804 (+    34us) tablet.cc:662] Decoding operations
0620 13:56:51.477797 (+   993us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:56:51.477921 (+   124us) write_op.cc:641] Partition lock acquired for write op
0620 13:56:51.477950 (+    29us) tablet.cc:685] Acquiring locks for 8 operations
0620 13:56:51.478806 (+   856us) tablet.cc:701] Row locks acquired
0620 13:56:51.478828 (+    22us) write_op.cc:260] PREPARE: finished
0620 13:56:51.479024 (+   196us) write_op.cc:270] Start()
0620 13:56:51.500011 (+ 20987us) write_op.cc:276] Timestamp: P: 1781963811478949 usec, L: 0
0620 13:56:51.500049 (+    38us) op_driver.cc:348] REPLICATION: starting
0620 13:56:51.658062 (+158013us) log.cc:844] Serialized 3218 byte log entry
0620 13:56:52.153288 (+495226us) op_driver.cc:464] REPLICATION: finished
0620 13:56:52.323180 (+169892us) write_op.cc:301] APPLY: starting
0620 13:56:52.332178 (+  8998us) tablet.cc:1367] starting BulkCheckPresence
0620 13:56:52.388304 (+ 56126us) tablet.cc:1370] finished BulkCheckPresence
0620 13:56:52.413867 (+ 25563us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:56:52.486099 (+ 72232us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:56:52.486361 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0620 13:56:52.486444 (+    83us) write_op.cc:312] APPLY: finished
0620 13:56:52.486720 (+   276us) log.cc:844] Serialized 65 byte log entry
0620 13:56:52.486889 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:52.487005 (+   116us) write_op.cc:454] Released schema lock
0620 13:56:52.487049 (+    44us) write_op.cc:341] FINISH: Updating metrics
0620 13:56:52.487478 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:56:52.487514 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":431010,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":141568,"apply.run_cpu_time_us":3865,"apply.run_wall_time_us":175620,"num_ops":8,"prepare.queue_time_us":189417,"prepare.run_cpu_time_us":25296,"prepare.run_wall_time_us":438997,"raft.queue_time_us":287024,"raft.run_cpu_time_us":24851,"raft.run_wall_time_us":107713,"replication_time_us":630958,"thread_start_us":545050,"threads_started":4,"wal-append.queue_time_us":159489,"wal-append.run_cpu_time_us":14071,"wal-append.run_wall_time_us":1702830}]]}
I20260620 13:56:59.157614  9091 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.198813  8808 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:59.200954  9147 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:56:59.253516  8970 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:59.253850  9076 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:59.243330  9057 raft_consensus.cc:697] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:56:59.271505  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 193180us
I20260620 13:56:59.257266  9147 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:56:59.256083  8948 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:59.264487  9246 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:59.284610  9227 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.286860  9227 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:59.289861  9257 log.cc:927] Time spent T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260620 13:56:59.289710  9057 consensus_queue.cc:237] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.296790  9121 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:59.297605  9052 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:59.279189  9260 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260620 13:56:59.296583  9186 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.300710  9224 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:59.301331  9118 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:59.044323  6578 rpcz_store.cc:276] 0620 13:56:57.204085 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:57.230388 (+ 26303us) service_pool.cc:224] Handling call
0620 13:56:57.230803 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:56:57.278771 (+ 47968us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:56:57.288390 (+  9619us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:56:57.312386 (+ 23996us) log.cc:844] Serialized 26 byte log entry
0620 13:56:58.624974 (+1312588us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b18004181e0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:56:58.779092 (+154118us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:58.806979 (+ 27887us) log.cc:844] Serialized 14 byte log entry
0620 13:56:58.818297 (+ 11318us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:58.820219 (+  1922us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:56:58.823577 (+  3358us) raft_consensus.cc:1685] finished
0620 13:56:58.839917 (+ 16340us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:58.884568 (+ 44651us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36598,"prepare.queue_time_us":16870,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1452,"raft.queue_time_us":49096,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":13742,"spinlock_wait_cycles":2537600,"thread_start_us":123904,"threads_started":1,"wal-append.queue_time_us":1493155}
I20260620 13:56:59.276067  9147 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:56:59.307497  9091 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:59.309926  8808 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:59.311849  9161 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.313759  9052 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:59.325016  9186 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:59.358697  5881 raft_consensus.cc:1240] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:56:59.363057  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:59.366909  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:59.370580  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:56:59.390596  5924 leader_election.cc:400] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:56:59.392030  5776 catalog_manager.cc:5696] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 4 to 5, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 5 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:59.407742  5776 catalog_manager.cc:5696] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 3 to 5, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 5 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:59.418287  8808 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:59.425591  9118 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:56:59.426334  9101 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:59.327081  9182 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.429495  9161 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:59.391033  5924 leader_election.cc:403] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260620 13:56:59.436640  9224 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:59.440405  9224 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.444391  9260 consensus_queue.cc:1059] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:56:59.448907  9134 raft_consensus.cc:3055] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Stepping down as leader of term 7
W20260620 13:56:59.456430  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:59.453230  9118 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:56:59.451268  9134 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:56:59.470882  9182 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:56:59.471035  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:56:59.474130  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 83812.6us
I20260620 13:56:59.463550  9260 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:56:59.488881  5951 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260620 13:56:59.491192  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 90947us
I20260620 13:56:59.485699  9134 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.497215  6031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 615) took 1798 ms. Trace:
I20260620 13:56:59.483309  5776 catalog_manager.cc:5696] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 3 to 5, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 5 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:59.455876  8808 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:59.508136  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:56:59.482692  9224 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:59.512606  8808 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:59.497816  6031 rpcz_store.cc:276] 0620 13:56:57.698152 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:57.704975 (+  6823us) service_pool.cc:224] Handling call
0620 13:56:57.705204 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:57.827144 (+121940us) raft_consensus.cc:1534] Early marking committed up to index 7
0620 13:56:57.856015 (+ 28871us) log.cc:844] Serialized 14 byte log entry
0620 13:56:58.095843 (+239828us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:58.095913 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:58.095970 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:59.492516 (+1396546us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b1800340720. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6d8aa6 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19
0620 13:56:59.496458 (+  3942us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540019ee54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:59.496534 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:59.496961 (+   427us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":723,"prepare.queue_time_us":70137,"prepare.run_cpu_time_us":182,"prepare.run_wall_time_us":183,"raft.queue_time_us":858,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":49013,"spinlock_wait_cycles":289029632,"thread_start_us":238560,"threads_started":1,"wal-append.queue_time_us":419224,"wal-append.run_cpu_time_us":1097,"wal-append.run_wall_time_us":1003932}
I20260620 13:56:59.511211  9134 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:59.518726  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:59.504385  5776 catalog_manager.cc:5696] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:59.527033  9102 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:56:59.538843  9091 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:59.539855  9091 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.531759  8808 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:59.556231  9213 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:59.568481  5956 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260620 13:56:59.569034  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:59.566013  5776 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 5 to 9, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 9 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:59.576097  5877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1531) took 1215 ms. Trace:
I20260620 13:56:59.579317  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:59.581496  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:56:59.583034  5829 auto_rebalancer.cc:591] Failed to schedule move for tablet d1b89d9f1eec4bfba2f3b0052c49f040: Illegal state: Replica 2e82c0c231624695ac5a813230bf5038 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:56:59.576750  5877 rpcz_store.cc:276] 0620 13:56:58.360519 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:58.360649 (+   130us) service_pool.cc:224] Handling call
0620 13:56:58.361000 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:58.625481 (+264481us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:59.575396 (+949915us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b5400324954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:59.575856 (+   460us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588187392}
I20260620 13:56:59.585602  9118 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:56:59.586596  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:59.582274  5776 catalog_manager.cc:5696] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 6 to 8, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 8 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:59.590559  6026 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:56:59.572599  9191 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:59.590165  5776 catalog_manager.cc:5696] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 3 to 5, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 5 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:56:59.610044  5957 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:59.611334  8804 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:59.612336  8804 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.615513  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 634) took 1766 ms. Trace:
I20260620 13:56:59.616387  6031 raft_consensus.cc:1275] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260620 13:56:59.617738  9191 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:59.618739  9191 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:59.619724  8804 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:59.620064  6030 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260620 13:56:59.622516  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:59.622970  6578 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:56:59.624687  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:59.625905  6585 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260620 13:56:59.626205  6028 raft_consensus.cc:2393] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:56:59.586510  9118 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:59.628685  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:59.630173  9077 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:56:59.630172  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 122198us
I20260620 13:56:59.632752  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:56:59.577122  9213 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:59.636946  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:59.638732  6028 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:56:59.630867  6585 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
W20260620 13:56:59.648258  9264 log.cc:927] Time spent T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.192s	user 0.004s	sys 0.001s
I20260620 13:56:59.616189  5882 rpcz_store.cc:276] 0620 13:56:57.848890 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:57.852418 (+  3528us) service_pool.cc:224] Handling call
0620 13:56:57.852805 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:56:58.207903 (+355098us) raft_consensus.cc:1534] Early marking committed up to index 7
0620 13:56:58.326359 (+118456us) log.cc:844] Serialized 14 byte log entry
0620 13:56:58.394766 (+ 68407us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:56:58.394836 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:56:58.394957 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:56:59.613481 (+1218524us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b180002ec60. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6d8aa6 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19
0620 13:56:59.615080 (+  1599us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54002b20d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:56:59.615154 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:56:59.615355 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23729,"prepare.queue_time_us":96566,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":46,"raft.queue_time_us":93,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":14377,"spinlock_wait_cycles":822938112,"thread_start_us":141889,"threads_started":2,"wal-append.queue_time_us":196172,"wal-append.run_cpu_time_us":2009,"wal-append.run_wall_time_us":1014904}
I20260620 13:56:59.649528  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:59.626142  8379 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:59.651152  8379 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.651575  9213 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:59.653338  8379 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:59.654448  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:59.654152  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:59.609107  9147 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.655323  5951 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:56:59.556172  8808 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.677094  5952 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
I20260620 13:56:59.661597  9226 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:56:59.606357  5776 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:56:59.682402  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:59.686776  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:59.690858  6028 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:56:59.693723  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:59.700379  8808 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:59.693984  9192 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260620 13:56:59.701920  6031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:56:59.702307  9192 raft_consensus.cc:3055] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:56:59.702719  9192 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:59.702790  6031 raft_consensus.cc:606] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:56:59.681878  9226 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:56:59.700415  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:59.703611  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:59.703807  8966 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:59.704699  9147 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:59.688452  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:59.707561  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:59.682211  6578 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:59.713912  6585 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:56:59.717103  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:59.718163  5876 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:59.710230  9226 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:56:59.731580  5950 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5. Ops: []
I20260620 13:56:59.732401  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:59.725660  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:59.738339  5881 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:59.745117  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:59.746356  5884 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:56:59.748322  5882 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260620 13:56:59.747601  8966 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:59.756417  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:59.757050  9191 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:59.766873  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:59.795552  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:56:59.863710  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 120704us
I20260620 13:56:59.862243  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:56:59.824368  6028 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:59.867607  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:59.866381  5884 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:59.727596  9091 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:56:59.798555  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:59.876315  6579 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:59.797734  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:59.851847  9101 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:56:59.796401  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:59.797729  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:56:59.803723  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:56:59.752027  9192 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.884364  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:59.808799  8966 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:59.888770  5877 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:56:59.889616  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:56:59.864737  8808 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:59.891851  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:56:59.892254  6582 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:56:59.899833  6583 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260620 13:56:59.902354  9121 consensus_meta.cc:287] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.605s	user 0.015s	sys 0.007s
I20260620 13:56:59.902624  9188 raft_consensus.cc:993] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47: : Instructing follower 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:56:59.903160  9188 raft_consensus.cc:1081] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Signalling peer 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:56:59.903672  5955 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260620 13:56:59.904335  5955 pending_rounds.cc:85] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 3
I20260620 13:56:59.903733  8808 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.904721  5955 pending_rounds.cc:107] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260620 13:56:59.904829  9192 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:56:59.905138  5955 raft_consensus.cc:2889] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:59.907384  8808 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:59.802515  9216 consensus_queue.cc:1059] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260620 13:56:59.910055  9216 raft_consensus.cc:3055] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:56:59.911936  5954 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260620 13:56:59.912972  5954 pending_rounds.cc:85] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 8
I20260620 13:56:59.913312  5954 pending_rounds.cc:107] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260620 13:56:59.913901  5954 raft_consensus.cc:2889] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:56:59.893224  9182 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:59.875799  9147 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:56:59.887146  9102 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:56:59.935433  6580 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:56:59.938205  5881 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:56:59.945271  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:59.947333  9147 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:59.948390  5884 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260620 13:56:59.950026  9147 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:56:59.950165  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:56:59.954465  5957 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260620 13:56:59.955497  9102 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:56:59.926483  9216 raft_consensus.cc:740] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:59.962486  5882 raft_consensus.cc:1240] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:56:59.966109  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:59.962594  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:59.971517  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:56:59.925966  9182 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:56:59.961803  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:59.959444  5958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:35986
I20260620 13:56:59.984795  5958 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:56:59.985214  5958 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:56:59.985301  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:56:59.986351  5875 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:56:59.991514  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:00.003350  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:00.003664  9267 consensus_queue.cc:1059] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:57:00.006261  9194 raft_consensus.cc:3055] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:00.006747  9194 raft_consensus.cc:740] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:56:59.992650  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:00.011318  5954 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:00.013326  5877 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:56:59.959071  9102 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:56:59.983132  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:00.018435  5952 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:00.015241  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:00.018726  6026 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:56:59.964447  8966 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:57:00.019304  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 54155.6us
I20260620 13:57:00.024771  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:00.025846  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:00.026075  6587 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
W20260620 13:57:00.026957  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:00.027998  9185 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:00.034875  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:00.035501  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:00.036276  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:00.035769  9194 consensus_queue.cc:260] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:00.040750  5958 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:00.041323  6579 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:00.045657  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:00.047446  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:00.048182  6583 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:00.049715  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:00.049943  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:00.050740  6581 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:00.051044  9276 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:57:00.051438  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:00.053149  6585 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:00.054204  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:00.054672  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:00.057282  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:00.059350  9236 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:57:00.060513  9277 consensus_queue.cc:1048] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:57:00.058804  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:00.061916  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:00.062692  6030 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:00.026840  9188 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260620 13:57:00.062877  6578 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:00.047385  8966 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.069604  9226 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.054886  6585 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:00.073302  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:56:59.960718  9216 consensus_queue.cc:260] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:00.071215  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:00.076460  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:00.063480  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:00.080282  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:00.074613  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:00.085261  5952 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:00.086565  6031 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260620 13:57:00.088760  6028 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260620 13:57:00.089689  6584 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:57:00.089921  6030 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260620 13:57:00.090911  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:00.091862  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:00.092185  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:00.092873  6024 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260620 13:57:00.093030  6586 raft_consensus.cc:2410] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260620 13:57:00.096771  5958 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:00.097592  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:00.098758  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:00.084233  9194 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:00.110538  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:00.111343  5881 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:00.117395  6579 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260620 13:57:00.118933  6580 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:57:00.119303  9236 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:00.119699  9236 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:00.120072  9236 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:00.122097  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:00.120759  5997 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:00.131250  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:00.121162  6578 raft_consensus.cc:2393] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:00.094851  9118 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.142012  5997 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:00.154477  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:00.139550  9077 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:00.150722  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:00.159418  5957 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:00.151801  5848 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:00.162542  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:00.166632  6028 raft_consensus.cc:2393] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:00.162240  9182 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:00.156698  9216 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:00.166007  6026 raft_consensus.cc:2376] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6. Re-sending same reply.
I20260620 13:57:00.162927  9077 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:00.174696  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:00.174813  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 166482us
I20260620 13:57:00.177130  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:00.175884  5849 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:00.178620  6030 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:00.180722  5848 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:00.182297  5848 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:00.183287  5998 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:00.183604  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:00.185097  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:00.186932  6033 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:00.167204  9226 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:00.190464  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 80952.2us
I20260620 13:57:00.191782  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:00.192463  6028 raft_consensus.cc:2393] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:00.193405  6583 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:00.198148  5958 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:57:00.198395  9232 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:00.200181  6585 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:57:00.177462  9077 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:00.188199  9277 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:57:00.176703  9275 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:57:00.168668  8804 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260620 13:57:00.206575  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:00.206390  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:00.211971  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:00.204913  5997 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:00.199688  9191 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 13:57:00.248742  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 57567.4us
I20260620 13:57:00.206027  9277 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:00.254073  5998 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:00.224426  9275 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:00.263200  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:00.263522  9275 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:57:00.264133  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 104256us
I20260620 13:57:00.211076  8966 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:00.254865  6025 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:00.256349  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:00.256546  8997 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:57:00.257304  9118 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:00.257917  9192 consensus_queue.cc:1059] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:57:00.258929  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:00.268442  5998 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:00.271081  6032 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260620 13:57:00.280784  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 104967us
I20260620 13:57:00.283975  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:00.281559  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 99516.9us
W20260620 13:57:00.293004  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 69611.8us
I20260620 13:57:00.266274  9147 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:00.271517  9277 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:00.300729  9287 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:57:00.281481  8997 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:00.300179  8906 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:00.295779  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:00.284904  8875 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:00.285295  8966 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:00.312908  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:00.295627  9226 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:00.308274  8906 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:00.308247  8997 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:00.325547  8906 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:00.327059  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:00.315618  9091 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:00.314769  9232 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:00.337196  9226 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.337203  9232 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:00.317399  9287 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:00.340658  8804 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:57:00.341508  9118 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:00.341938  9236 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.323577  9102 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:00.342746  9232 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:00.331547  9293 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260620 13:57:00.342788  5848 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:00.344035  8821 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:00.343223  9185 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:00.342087  9118 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.345137  9276 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:00.346966  9276 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:00.343528  9191 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260620 13:57:00.348901  9276 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:00.349830  9267 raft_consensus.cc:3055] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:00.350207  9267 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:00.350152  9191 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:57:00.316994  9147 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:00.344750  8821 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.354079  9185 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.354820  9101 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:57:00.356426  9185 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:00.351661  9147 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.357424  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:00.358108  5954 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:00.323495  8875 raft_consensus.cc:697] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:00.360167  8875 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.363801  8997 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:00.364430  9118 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:00.364881  8821 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:00.368536  9182 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:00.369695  9236 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:00.372004  9275 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.372509  9232 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:00.373349  9232 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:00.375521  9232 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:00.377104  9290 log.cc:927] Time spent T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260620 13:57:00.386869  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 92784.1us
I20260620 13:57:00.383433  9091 raft_consensus.cc:697] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:00.389006  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:00.389667  5954 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:00.389379  9091 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.392583  5958 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:57:00.394143  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:00.394903  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:00.396272  5952 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260620 13:57:00.397560  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:00.365671  9287 raft_consensus.cc:697] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:00.400545  9226 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:00.400838  5950 raft_consensus.cc:1275] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260620 13:57:00.402350  9277 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.402171  5959 raft_consensus.cc:2955] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
W20260620 13:57:00.404846  9283 log.cc:927] Time spent T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.297s	user 0.005s	sys 0.000s
I20260620 13:57:00.407125  9267 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:00.382697  8997 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:00.415933  6025 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:00.426287  5954 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:57:00.429653  5997 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:00.438732  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 47418.6us
I20260620 13:57:00.410645  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:00.451241  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 151576us
I20260620 13:57:00.449131  5882 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:00.472118  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:00.472890  5877 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:00.473778  6027 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:57:00.470844  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:00.459733  9185 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:00.435271  9194 consensus_queue.cc:1059] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260620 13:57:00.548954  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:00.549778  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:00.552428  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:00.532979  9267 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:00.561653  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 134111us
I20260620 13:57:00.550660  9185 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:00.469458  9276 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:00.583294  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:00.588232  5876 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:00.589732  5877 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:00.400939  9287 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.572166  9185 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:00.566675  9118 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:00.600088  8821 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:00.612989  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:00.613842  5878 raft_consensus.cc:2393] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:00.616353  8906 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:00.617370  9301 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.052s
I20260620 13:57:00.618484  8906 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:00.587515  9134 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:00.624420  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:00.628286  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:00.628650  9191 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:57:00.634217  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:00.635896  9226 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:00.636301  9226 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:00.636621  9226 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:57:00.638974  9292 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260620 13:57:00.623669  9134 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.639475  9276 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:00.641328  9134 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:00.646972  9118 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:00.648133  9299 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260620 13:57:00.663486  9297 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:00.665230  9298 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:00.684573  8911 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:57:00.686832  9232 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:00.687624  9232 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:00.690853  9232 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:00.691485  6585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:34178
W20260620 13:57:00.691920  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 63772.6us
I20260620 13:57:00.692163  6585 raft_consensus.cc:606] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:00.692600  6585 raft_consensus.cc:614] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:00.694559  9118 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:00.696287  9277 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:00.695986  9077 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.698223  9077 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:00.706779  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 61817us
I20260620 13:57:00.709582  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:00.710285  6032 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:57:00.710696  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:00.701138  6024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:57:00.768674  6024 raft_consensus.cc:606] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:00.769213  6024 raft_consensus.cc:614] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:00.699314  9297 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.694705  9275 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:00.788955  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:00.706676  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:00.790611  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:00.792258  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:00.698707  6028 raft_consensus.cc:3055] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:00.780954  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:00.790946  9305 log.cc:927] Time spent T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.171s	user 0.000s	sys 0.002s
I20260620 13:57:00.694824  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:00.799608  6028 raft_consensus.cc:740] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:57:00.808604  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 358690us
I20260620 13:57:00.811803  6024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:50466
W20260620 13:57:00.813752  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 245344us
I20260620 13:57:00.814473  5959 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:00.815053  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:00.815598  6024 raft_consensus.cc:606] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:00.816128  6024 raft_consensus.cc:614] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260620 13:57:00.818512  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 269171us
W20260620 13:57:00.810456  6551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.004s	sys 0.006s
I20260620 13:57:00.819298  8379 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:00.817589  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:00.820737  5953 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:00.807647  6028 consensus_queue.cc:260] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:00.822114  6028 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:00.818463  5878 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:57:00.832311  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:00.835536  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:00.837234  8379 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.831888  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:00.841043  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:00.834510  5848 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:00.849983  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:00.850597  5876 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 6
I20260620 13:57:00.813035  9224 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:00.855332  9077 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:00.819280  6551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.004s	sys 0.007s
W20260620 13:57:00.867205  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 156626us
W20260620 13:57:00.861964  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:00.868981  8379 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:00.870164  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:00.874441  9275 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260620 13:57:00.866317  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 557440us
W20260620 13:57:00.880676  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 66270.3us
I20260620 13:57:00.884240  6028 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:00.861706  9236 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:00.888057  5997 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:00.893990  9147 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:57:00.894778  9147 raft_consensus.cc:697] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:00.896032  9147 consensus_queue.cc:237] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:00.903333  6024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:57:00.904160  6024 raft_consensus.cc:606] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:00.904595  6024 raft_consensus.cc:614] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:00.904867  9297 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:00.889950  8906 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260620 13:57:00.912194  9226 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.913156  5882 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:00.915095  5882 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:00.854918  9185 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.916594  5879 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:57:00.917325  9185 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:00.918184  6031 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:00.919349  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:00.876133  9077 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:00.924628  6551 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:00.936450  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 241782us
W20260620 13:57:00.933920  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 45114.5us
I20260620 13:57:00.934481  9275 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:57:00.934719  6029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8078a89b618482f8e4978c463747569"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:57:00.942212  5953 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:00.928958  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:00.933295  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 47077.5us
I20260620 13:57:00.977625  5848 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:00.978749  9277 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260620 13:57:00.980199  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 87858.9us
I20260620 13:57:00.981264  6551 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:00.982679  9236 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260620 13:57:00.983450  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 54590.2us
I20260620 13:57:00.955631  9226 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:00.954916  9224 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:01.008432  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:01.023180  9118 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:01.023751  9118 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:01.024204  9118 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:01.045387  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 46126.6us
I20260620 13:57:01.010460  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:01.046588  5876 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
W20260620 13:57:01.044895  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 67382.3us
W20260620 13:57:01.044512  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 95508.1us
I20260620 13:57:01.049340  9304 consensus_queue.cc:1048] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:57:01.050565  9304 consensus_queue.cc:1243] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260620 13:57:01.050834  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:01.053893  8911 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:01.054503  8911 raft_consensus.cc:697] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:01.055578  8911 consensus_queue.cc:237] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:01.058840  6030 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260620 13:57:01.061110  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 79947.8us
I20260620 13:57:01.061444  9118 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.062458  9236 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:57:01.061971  6551 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:01.064142  6551 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:01.068984  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 112340us
I20260620 13:57:01.069900  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:01.073287  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:01.073686  5878 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260620 13:57:01.074900  9309 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.362s	user 0.002s	sys 0.000s
I20260620 13:57:01.076370  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:01.077211  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:01.084509  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:01.085824  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:01.086786  9134 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:01.086225  9101 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:01.090415  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:01.089284  5849 leader_election.cc:336] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.515s (SENT)
I20260620 13:57:01.090816  8379 consensus_queue.cc:1059] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260620 13:57:01.083585  9091 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:57:01.089067  9134 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:01.093891  9101 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.085979  9236 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:01.107510  8379 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:01.098260  9091 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:01.118270  8379 consensus_queue.cc:1059] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:57:01.103364  9118 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:01.107630  9102 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:01.094472  9182 consensus_queue.cc:1059] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260620 13:57:01.100817  9216 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260620 13:57:01.123767  9091 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:01.125567  9077 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:01.140363  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.155222  9101 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:01.155833  6583 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:01.142292  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:01.145418  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.145678  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.138387  9293 consensus_queue.cc:1059] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260620 13:57:01.107683  9314 consensus_queue.cc:1059] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260620 13:57:01.147081  9302 raft_consensus.cc:3055] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:57:01.147480  6584 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:57:01.147970  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.165417  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:01.148432  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.148582  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.136801  9216 consensus_queue.cc:1243] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer 2e82c0c231624695ac5a813230bf5038 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260620 13:57:01.151537  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:01.152190  9277 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:57:01.152958  9307 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:57:01.146661  6582 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260620 13:57:01.166579  6587 raft_consensus.cc:2376] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8. Re-sending same reply.
W20260620 13:57:01.171854  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 65902.9us
I20260620 13:57:01.172713  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.160439  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:01.167904  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 43509us
I20260620 13:57:01.169598  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.173942  6580 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:01.170511  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.156209  9102 raft_consensus.cc:697] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:01.178220  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:01.180088  6579 raft_consensus.cc:2393] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:01.166947  9224 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:01.181913  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.163839  9302 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:01.176550  9320 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:01.192361  6552 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:01.178000  9316 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:01.195430  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:01.200137  8875 raft_consensus.cc:3055] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:01.200577  8875 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:01.201490  8875 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.202795  8875 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:01.203687  9303 log.cc:927] Time spent T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.572s	user 0.000s	sys 0.007s
I20260620 13:57:01.220289  6584 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:01.204953  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.204895  9102 consensus_queue.cc:237] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:01.211637  9302 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.224951  6581 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:01.214145  9091 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.215613  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.218683  8379 raft_consensus.cc:3055] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:01.188067  9232 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260620 13:57:01.232246  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:01.235105  8379 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:01.164139  9306 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260620 13:57:01.193005  9293 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260620 13:57:01.240868  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 54986.8us
I20260620 13:57:01.241695  6552 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:01.237581  9077 raft_consensus.cc:2764] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260620 13:57:01.243378  9314 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:01.243888  9314 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:01.244293  9314 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:01.244578  8804 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:57:01.245040  5998 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:01.245193  8804 raft_consensus.cc:697] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:01.198676  9320 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:01.246160  8804 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.247310  9077 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:01.247735  9077 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:01.248099  9077 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:01.252055  8379 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:01.250382  9287 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.007s	sys 0.011s
I20260620 13:57:01.238065  9302 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:57:01.255220  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 63065.3us
I20260620 13:57:01.256448  9194 raft_consensus.cc:3055] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:01.259665  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:01.260015  9194 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:01.260957  9194 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:01.261471  5849 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:01.262157  9194 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:01.262650  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:01.257987  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:01.264668  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 76422.2us
W20260620 13:57:01.257680  9287 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.007s	sys 0.012s
I20260620 13:57:01.266490  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:01.266701  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:01.263281  9316 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260620 13:57:01.251395  9236 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260620 13:57:01.271493  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:01.257339  9298 raft_consensus.cc:3055] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:01.272425  9298 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:01.273360  9298 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.274899  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:01.275177  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:01.275825  5959 raft_consensus.cc:2393] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:01.276176  9304 raft_consensus.cc:3055] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:01.276604  9304 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:01.279552  9298 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:01.281647  5955 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260620 13:57:01.287285  5998 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:01.266067  9293 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:01.289048  5953 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:01.290252  8379 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:01.294275  6029 raft_consensus.cc:606] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:01.309953  5848 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:01.311972  5848 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:01.313349  5953 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:01.314450  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:01.299616  9316 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:01.316425  9232 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:01.316517  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:01.317122  9232 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.296242  9236 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:01.318585  9320 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:01.315285  6024 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
W20260620 13:57:01.317152  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:01.319900  9232 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:01.321713  9077 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.322866  6025 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260620 13:57:01.313014  9293 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:01.324234  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:01.324960  9232 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:57:01.326261  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 71656.2us
W20260620 13:57:01.316557  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 53126.2us
I20260620 13:57:01.301710  9185 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:01.335402  9316 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:01.335588  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:01.336158  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:01.336860  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:01.337235  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 74673.6us
I20260620 13:57:01.337440  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:01.338011  5848 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:01.338784  6024 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:01.339306  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:01.341920  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:01.345491  9191 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:57:01.342550  9331 consensus_queue.cc:1059] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
W20260620 13:57:01.346367  9328 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260620 13:57:01.347462  9236 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:01.348372  9327 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:01.348812  9327 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:01.349165  9327 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:01.342965  9307 consensus_queue.cc:1059] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260620 13:57:01.352201  5997 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:01.353937  5924 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:01.358537  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:01.359637  5959 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:57:01.360886  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:01.361866  5959 raft_consensus.cc:2393] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:01.357586  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:01.364976  5956 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:01.368083  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:01.369983  5957 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:01.370694  5955 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260620 13:57:01.371057  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:01.373023  9315 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:01.373342  5849 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:01.373574  9226 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:01.373834  9317 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:01.373937  9226 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:01.374449  9226 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:01.375169  9307 raft_consensus.cc:3055] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:01.375555  9307 raft_consensus.cc:740] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:01.376397  9307 consensus_queue.cc:260] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.377645  9307 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:01.357409  9191 raft_consensus.cc:697] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:01.374476  9317 raft_consensus.cc:697] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:01.380079  9191 consensus_queue.cc:237] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.380735  9317 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.384473  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:01.385787  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 49002us
I20260620 13:57:01.387487  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:01.388253  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:01.391698  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:01.398020  9236 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:57:01.401770  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:01.365281  8906 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:01.341120  9287 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260620 13:57:01.407491  5957 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260620 13:57:01.403232  9091 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:01.373075  9077 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:01.388756  9147 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:57:01.393941  9315 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:57:01.392817  9182 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260620 13:57:01.421902  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 50948.1us
I20260620 13:57:01.432322  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:01.428391  6552 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:01.420976  5958 pending_rounds.cc:85] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 3
I20260620 13:57:01.444276  5958 pending_rounds.cc:107] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260620 13:57:01.444574  5958 raft_consensus.cc:2889] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:01.405609  9185 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:01.446259  5959 raft_consensus.cc:1240] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:01.464985  5957 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260620 13:57:01.411478  9293 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:57:01.464258  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.469815  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:01.471139  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 82951.4us
I20260620 13:57:01.472453  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:01.470908  6580 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:57:01.476881  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.477144  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:01.479087  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260620 13:57:01.462657  9077 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:01.496461  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:01.469959  9091 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:01.525208  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:01.525954  6025 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
W20260620 13:57:01.529007  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 68647.7us
I20260620 13:57:01.495294  9315 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260620 13:57:01.579653  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:01.476253  8804 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:01.581140  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 227251us
W20260620 13:57:01.585947  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 70872.5us
I20260620 13:57:01.519256  9091 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:01.606361  5956 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:01.607267  5953 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:01.585356  9320 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:01.638181  6587 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:57:01.641188  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.612529  9091 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:01.656352  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 64785.6us
W20260620 13:57:01.661327  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:01.605280  9216 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260620 13:57:01.631203  9311 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:01.621420  9327 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.652760  9320 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.614737  8804 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.681914  5958 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:01.684198  5956 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 4. Current term is 5. Ops: []
I20260620 13:57:01.668037  9341 raft_consensus.cc:3055] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Stepping down as leader of term 7
W20260620 13:57:01.685002  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 91640.7us
I20260620 13:57:01.688038  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:01.613854  9304 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.708465  5959 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:01.688891  9341 raft_consensus.cc:740] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:01.718029  9341 consensus_queue.cc:260] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:01.719406  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:01.720495  9335 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260620 13:57:01.725821  6587 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:01.726301  5997 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:01.739495  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:01.744681  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.745369  6586 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:01.752650  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:01.736900  9287 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260620 13:57:01.754464  9314 consensus_meta.cc:287] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.004s
I20260620 13:57:01.765355  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.758435  5997 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:01.682811  9311 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.738608  9147 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260620 13:57:01.776026  6587 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:01.765803  9287 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:01.786485  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:01.804095  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 113788us
I20260620 13:57:01.770823  9314 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:01.793457  9287 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:57:01.862349  9346 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260620 13:57:01.958288  9353 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:01.971807  9307 consensus_meta.cc:287] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.594s	user 0.014s	sys 0.004s
I20260620 13:57:01.973413  8804 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:01.974208  9226 consensus_meta.cc:287] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.599s	user 0.007s	sys 0.007s
I20260620 13:57:01.975955  9320 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:01.978943  9311 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:01.979951  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:02.015641  6580 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:01.980376  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:01.980746  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.981761  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:01.982470  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:01.983649  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 175367us
I20260620 13:57:01.775759  9216 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:01.974289  9091 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.010139  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:01.986205  9275 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:02.024178  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:02.021914  6585 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:02.021935  5876 raft_consensus.cc:1240] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:02.022897  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:02.017328  9077 consensus_meta.cc:287] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.503s	user 0.015s	sys 0.002s
I20260620 13:57:02.033944  9356 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:02.040192  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:02.041453  6582 raft_consensus.cc:2368] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8.
I20260620 13:57:02.034533  9356 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:02.064188  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:02.064762  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:02.064965  9091 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:02.028849  9216 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:02.008482  9353 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.077754  5950 raft_consensus.cc:1275] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260620 13:57:02.052858  9314 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:02.053212  9311 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:02.053450  9327 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:02.031967  9275 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.018126  9226 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.037581  9077 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:02.067749  6580 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
W20260620 13:57:02.088774  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 53195.8us
I20260620 13:57:02.099421  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:02.102373  5951 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260620 13:57:02.104835  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:02.110203  5876 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260620 13:57:02.111784  5877 pending_rounds.cc:85] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 6
I20260620 13:57:02.112210  5877 pending_rounds.cc:107] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260620 13:57:02.112541  5877 raft_consensus.cc:2889] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:02.064771  9356 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:02.110814  5876 pending_rounds.cc:85] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 6
I20260620 13:57:02.126456  5876 pending_rounds.cc:107] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260620 13:57:02.126802  5876 raft_consensus.cc:2889] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:02.091464  9311 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:02.118369  6029 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:02.102638  9341 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:02.091421  9185 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:02.129383  5955 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:57:02.116341  9314 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:02.099529  8821 consensus_queue.cc:1059] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260620 13:57:02.171921  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 53452.8us
I20260620 13:57:02.133566  9354 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:02.134032  9311 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:02.178930  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:02.138983  9185 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:02.268005  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:02.206593  5951 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:02.184916  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:02.303684  6026 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260620 13:57:02.213161  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:02.327593  6551 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:02.253541  6032 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:57:02.254081  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:02.344985  6028 raft_consensus.cc:2410] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260620 13:57:02.346370  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:02.347664  6032 raft_consensus.cc:2393] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 9: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:02.324129  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:02.357407  5959 raft_consensus.cc:2393] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:02.362026  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:02.365352  6551 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:02.366182  6029 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:02.365057  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 135574us
I20260620 13:57:02.367547  6551 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:02.368417  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:02.302772  9365 log.cc:927] Time spent T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260620 13:57:02.305647  9364 log.cc:927] Time spent T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260620 13:57:02.211465  9302 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:02.389158  6027 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260620 13:57:02.369869  9091 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:02.211994  9232 consensus_queue.cc:1059] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.194s
I20260620 13:57:02.404589  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:02.352793  9298 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:02.371485  9317 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:02.370146  9341 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:02.210475  9314 consensus_queue.cc:1059] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.192s
I20260620 13:57:02.416028  9226 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:02.400521  9236 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:02.418524  5880 raft_consensus.cc:1275] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260620 13:57:02.361471  9287 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.205495  9216 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.408203  9091 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:57:02.435753  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 68307.1us
I20260620 13:57:02.414499  9134 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:02.425064  9367 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:02.440912  9314 consensus_queue.cc:1243] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer 2e82c0c231624695ac5a813230bf5038 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260620 13:57:02.443387  9091 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.444090  9363 raft_consensus.cc:3055] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:02.444727  9363 raft_consensus.cc:740] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:02.444921  9373 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:02.425781  9327 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:02.188017  9354 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.446491  9327 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.431417  9232 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:02.448764  9232 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:02.449069  9368 log.cc:927] Time spent T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260620 13:57:02.449272  9232 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:02.450158  9362 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:02.450729  9362 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:02.452418  9372 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:02.453063  9372 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:02.454746  9361 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:02.455360  9361 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:02.471692  9287 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:02.471971  6033 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: []
W20260620 13:57:02.472149  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 67781.9us
I20260620 13:57:02.421550  9317 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:02.472983  5924 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:02.473709  8911 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:57:02.474357  9317 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:02.474697  9091 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:02.419920  9341 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:02.476184  8821 consensus_queue.cc:1059] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:02.476734  9341 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:02.477644  9374 consensus_queue.cc:1048] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:57:02.482012  6583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 897) took 1014 ms. Trace:
I20260620 13:57:02.404124  9302 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.482442  6583 rpcz_store.cc:276] 0620 13:57:01.468007 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:01.468202 (+   195us) service_pool.cc:224] Handling call
0620 13:57:01.476981 (+  8779us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:02.062470 (+585489us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:02.062507 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:02.062967 (+   460us) log.cc:844] Serialized 26 byte log entry
0620 13:57:02.170574 (+107607us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:02.170615 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:02.170687 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:02.481791 (+311104us) raft_consensus.cc:1685] finished
0620 13:57:02.481812 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:02.481941 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":584982,"raft.queue_time_us":586128,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":5888,"thread_start_us":107154,"threads_started":1,"wal-append.queue_time_us":165330}
I20260620 13:57:02.490657  6551 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:02.487430  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:02.499173  6028 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260620 13:57:02.499938  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 95743.3us
I20260620 13:57:02.446038  9363 consensus_queue.cc:260] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.415185  9298 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.496543  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:02.505053  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:02.505637  6027 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:02.497133  9314 consensus_queue.cc:1059] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260620 13:57:02.506078  9317 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260620 13:57:02.510578  9298 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:02.515812  6027 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:02.516710  9361 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:02.517833  9314 consensus_queue.cc:1059] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:57:02.504416  9134 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:02.518558  9314 consensus_queue.cc:1243] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260620 13:57:02.518697  8379 raft_consensus.cc:3055] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:02.519145  9314 raft_consensus.cc:3055] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:02.519393  8379 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:02.519629  9314 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:02.520319  8379 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.520545  9314 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.521896  8379 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:02.531210  6551 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:02.495960  8911 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:57:02.541306  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 58795.7us
I20260620 13:57:02.542518  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:02.543637  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:02.568579  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:02.539947  8911 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:02.576195  6582 raft_consensus.cc:2410] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260620 13:57:02.576963  9327 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:02.512252  9378 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:02.577564  8911 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:02.521929  9314 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:02.571081  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:02.579222  6585 raft_consensus.cc:2376] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8. Re-sending same reply.
I20260620 13:57:02.570209  9311 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:02.570516  9236 consensus_queue.cc:1059] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260620 13:57:02.581576  6580 raft_consensus.cc:2393] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:02.537425  9091 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:57:02.583256  9341 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:57:02.539628  9226 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:57:02.584830  9226 raft_consensus.cc:697] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:02.585943  9226 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.543867  8821 consensus_queue.cc:1059] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260620 13:57:02.588101  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:02.588903  8821 raft_consensus.cc:3055] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:02.589407  8821 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:02.590359  8821 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.523373  9362 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:02.592684  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:02.593150  6580 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260620 13:57:02.600325  6580 pending_rounds.cc:85] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 7
I20260620 13:57:02.600603  6580 pending_rounds.cc:107] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260620 13:57:02.600845  6580 raft_consensus.cc:2889] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:02.594424  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:02.602267  5956 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:02.523066  9353 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:02.536443  9363 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:02.597790  6586 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:57:02.593493  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:02.610136  5959 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:02.603963  5997 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:02.600054  5952 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:02.605130  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:02.611925  6582 raft_consensus.cc:2393] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 9: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:02.605568  6580 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260620 13:57:02.612370  6580 pending_rounds.cc:85] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 8
I20260620 13:57:02.612671  6580 pending_rounds.cc:107] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260620 13:57:02.613024  6580 raft_consensus.cc:2889] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:02.595793  6029 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
W20260620 13:57:02.606848  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 195353us
W20260620 13:57:02.570628  9359 log.cc:927] Time spent T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.386s	user 0.002s	sys 0.000s
I20260620 13:57:02.607532  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:02.544924  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:02.618114  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:02.620018  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 75170.8us
I20260620 13:57:02.620814  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:02.621026  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:02.625483  9362 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:02.625653  5924 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:02.626029  9362 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:02.626483  9362 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:02.627290  9275 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:02.627591  8911 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:57:02.627310  9341 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:02.627089  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:02.632436  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:02.592393  9185 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:02.639503  6584 raft_consensus.cc:2393] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:02.642113  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:02.642409  6582 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: [5.7-6.8]
I20260620 13:57:02.642854  6029 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:02.644347  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:02.645114  6024 raft_consensus.cc:2393] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:02.669625  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:02.591904  9367 consensus_queue.cc:1059] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260620 13:57:02.632306  8821 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:02.628130  9302 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:57:02.645466  9353 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:02.694530  9353 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:02.696631  9353 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:02.697702  5957 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:57:02.699059  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:02.699810  9297 raft_consensus.cc:3055] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:57:02.700214  9297 raft_consensus.cc:740] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:02.700567  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:02.701056  9297 consensus_queue.cc:260] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.701695  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:02.702369  9297 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:02.703621  5879 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:02.685272  9372 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:02.707937  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 770) took 1316 ms. Trace:
I20260620 13:57:02.708341  5955 rpcz_store.cc:276] 0620 13:57:01.391858 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:01.401526 (+  9668us) service_pool.cc:224] Handling call
0620 13:57:02.707761 (+1306235us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b540019d2d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:02.707857 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671659776}
I20260620 13:57:02.714610  5876 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260620 13:57:02.682641  5952 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:02.684267  5849 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:02.641360  9341 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260620 13:57:02.685923  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 52629.6us
I20260620 13:57:02.678357  5997 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:02.677768  9191 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:02.720544  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:02.688665  8911 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:02.734915  8911 raft_consensus.cc:697] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:02.735790  5879 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260620 13:57:02.735970  8911 consensus_queue.cc:237] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.669929  9275 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:02.737800  9275 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:02.688892  6030 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260620 13:57:02.689093  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:02.739691  5875 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:02.689646  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:02.740252  9191 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:02.740689  5882 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:02.689828  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:02.741624  5880 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:02.690555  9147 consensus_queue.cc:1048] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:57:02.671393  9327 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:02.692559  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:02.693146  8804 raft_consensus.cc:3055] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:57:02.720861  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:02.722004  6552 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:02.727695  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:02.727912  9134 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:02.728117  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:02.728221  9277 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:02.731408  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:02.733142  9354 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:02.745012  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:02.746629  6581 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260620 13:57:02.747028  5998 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:02.723281  9372 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:02.750854  9275 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:02.845016  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:02.793284  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:02.843380  5997 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:02.846127  8804 raft_consensus.cc:740] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:57:02.847996  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 128868us
I20260620 13:57:02.868976  6580 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:57:02.803597  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:02.867995  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:02.866556  5958 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: []
W20260620 13:57:02.879281  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:02.879809  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:02.802893  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:57:02.824033  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:02.818056  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:02.892208  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:02.742856  9185 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:02.896941  6027 raft_consensus.cc:2410] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260620 13:57:02.898355  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:02.899399  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 153109us
W20260620 13:57:02.899492  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 56217.5us
I20260620 13:57:02.900383  6029 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:02.848762  5952 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
W20260620 13:57:02.817503  9376 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260620 13:57:02.774688  9341 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:02.952934  9341 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:02.955575  9341 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:02.956553  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 254965us
W20260620 13:57:02.964184  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 63042.4us
I20260620 13:57:02.846001  9277 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:02.966529  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 84984us
I20260620 13:57:02.840360  9191 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:02.860065  9311 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:02.804358  8821 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:03.201052  8821 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.052341  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:03.199832  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 241555us
I20260620 13:57:02.948391  9185 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:03.206691  9185 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:02.825508  9232 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.208875  9232 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:03.210486  5953 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
W20260620 13:57:03.065016  9388 log.cc:927] Time spent T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260620 13:57:02.963822  8875 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:02.989292  9298 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:02.997731  9277 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:02.957809  9372 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:03.192085  9362 consensus_meta.cc:287] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.005s
I20260620 13:57:02.773321  9361 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:03.192889  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:02.967809  9374 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:03.194845  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:03.195043  6552 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:03.180518  6586 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.027s	sys 0.037s
W20260620 13:57:03.247327  6586 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.029s	sys 0.037s
I20260620 13:57:02.882993  9373 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:03.199254  6029 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:02.957156  8906 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:03.193397  5922 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.039s	sys 0.011s
W20260620 13:57:03.252256  5922 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.039s	sys 0.012s
I20260620 13:57:03.252465  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:03.226007  6031 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:03.227738  9298 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.248790  6582 raft_consensus.cc:2393] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 5: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:03.220636  9091 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:03.223306  8875 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:03.220785  9354 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:03.230034  9341 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260620 13:57:03.230813  9293 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:03.225304  9147 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:57:03.302420  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 107650us
I20260620 13:57:03.406466  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:03.382191  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:03.379294  6580 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:03.407791  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:03.409401  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 178160us
W20260620 13:57:03.414726  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 219781us
I20260620 13:57:03.417148  6552 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:03.349766  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:03.346160  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:03.422748  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:03.425690  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:03.429540  5876 raft_consensus.cc:2368] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7.
I20260620 13:57:03.254987  9232 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:03.296669  8875 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:03.259711  9302 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:03.258508  9091 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:03.248044  9362 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.303144  9275 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:03.420728  9367 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:03.296304  9374 raft_consensus.cc:697] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:03.460425  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:03.380847  9354 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:03.249970  9361 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.276885  8906 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.258104  9373 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.453476  9191 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:03.486583  5957 raft_consensus.cc:1240] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:03.276962  9182 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:57:03.465274  9312 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:03.464299  9386 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:03.449681  9194 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260620 13:57:03.490293  5998 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:03.455864  9390 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.260s
I20260620 13:57:03.378417  8804 consensus_queue.cc:260] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.500097  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:03.420517  9293 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:03.459133  9232 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:03.518959  9312 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:57:03.511271  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 258862us
I20260620 13:57:03.523236  9232 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:03.524705  9091 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.525857  9091 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:03.527256  9304 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:03.496961  9366 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260620 13:57:03.504649  9077 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:03.528967  9366 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 13:57:03.515458  9363 consensus_meta.cc:287] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.895s	user 0.007s	sys 0.011s
I20260620 13:57:03.522266  9374 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.425242  9147 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:03.475291  9275 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.543499  5880 raft_consensus.cc:2393] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 11: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:03.504745  9191 raft_consensus.cc:697] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:57:03.556686  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 144600us
W20260620 13:57:03.535691  9393 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260620 13:57:03.567261  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:03.535940  8804 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:03.541117  9312 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:03.539757  9353 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:03.532763  8906 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:03.520260  9389 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:03.531035  9362 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:03.569944  5848 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:03.600666  9298 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:03.569027  9277 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:03.569027  9194 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:03.602723  9277 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:03.533850  9373 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:03.608601  9298 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:03.625442  9372 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:03.631940  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:03.664974  9298 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.598730  9353 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.624487  6584 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:03.667004  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:03.667501  9298 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:03.576910  9304 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260620 13:57:03.636227  5957 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260620 13:57:03.667816  5953 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:03.629243  9361 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:03.657625  9147 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:03.610392  8875 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:03.670183  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 100373us
I20260620 13:57:03.636621  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:03.670564  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:03.622603  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:03.671214  5952 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:03.671581  6580 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:03.229808  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260620 13:57:03.613525  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:03.609052  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:03.625291  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 125263us
I20260620 13:57:03.677500  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:03.669096  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:03.679033  5958 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:03.681593  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:03.584547  9396 log.cc:927] Time spent T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
W20260620 13:57:03.692842  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 258652us
I20260620 13:57:03.693660  6552 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:57:03.701844  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:03.702975  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:03.703217  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 271551us
I20260620 13:57:03.608500  9236 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:03.619962  9275 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:03.628288  9354 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:03.775997  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 82432.9us
I20260620 13:57:03.653182  9312 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:03.610788  9394 log.cc:927] Time spent T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260620 13:57:03.690320  9277 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:03.617345  8821 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:03.625032  9293 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:03.600539  9414 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:03.702128  9304 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:03.809137  5879 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
W20260620 13:57:03.810544  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 137181us
I20260620 13:57:03.851938  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:03.852538  6027 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:03.852806  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:03.824129  5777 catalog_manager.cc:5696] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:03.854753  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:03.853390  6026 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
W20260620 13:57:03.827834  5776 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47386 (request call id 233) took 13575 ms (client timeout 15000 ms). Trace:
I20260620 13:57:03.603056  9194 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.839928  9357 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:03.703557  9384 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:03.836635  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:03.864462  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:03.866976  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:03.866870  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 189444us
W20260620 13:57:03.842088  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:03.844581  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 264449us
I20260620 13:57:03.809719  9367 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:04.397539  9367 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:03.857307  5776 rpcz_store.cc:269] 0620 13:56:50.253023 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:50.253423 (+   400us) service_pool.cc:224] Handling call
0620 13:57:03.827714 (+13574291us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:57:00.065161 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:57:00.065954 (+   793us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:57:00.066023 (+    69us) write_op.cc:435] Acquired schema lock
0620 13:57:00.066061 (+    38us) tablet.cc:662] Decoding operations
0620 13:57:00.116341 (+ 50280us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:57:00.116428 (+    87us) write_op.cc:641] Partition lock acquired for write op
0620 13:57:00.116462 (+    34us) tablet.cc:685] Acquiring locks for 17 operations
0620 13:57:00.117938 (+  1476us) tablet.cc:701] Row locks acquired
0620 13:57:00.117975 (+    37us) write_op.cc:260] PREPARE: finished
0620 13:57:00.118177 (+   202us) write_op.cc:270] Start()
0620 13:57:00.118332 (+   155us) write_op.cc:276] Timestamp: P: 1781963820118094 usec, L: 0
0620 13:57:00.118352 (+    20us) op_driver.cc:348] REPLICATION: starting
0620 13:57:00.129312 (+ 10960us) log.cc:844] Serialized 6661 byte log entry
0620 13:57:00.697352 (+568040us) op_driver.cc:464] REPLICATION: finished
0620 13:57:01.055270 (+357918us) spinlock_profiling.cc:243] Waited 99 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdc6ed8ac 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fe3234d70
0620 13:57:01.144869 (+ 89599us) write_op.cc:301] APPLY: starting
0620 13:57:01.144964 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0620 13:57:01.145354 (+   390us) tablet.cc:1370] finished BulkCheckPresence
0620 13:57:01.145396 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:57:01.198010 (+ 52614us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:57:01.217548 (+ 19538us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0620 13:57:01.217608 (+    60us) write_op.cc:312] APPLY: finished
0620 13:57:01.218034 (+   426us) log.cc:844] Serialized 119 byte log entry
0620 13:57:01.218239 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:01.218404 (+   165us) write_op.cc:454] Released schema lock
0620 13:57:01.218477 (+    73us) write_op.cc:341] FINISH: Updating metrics
0620 13:57:01.218921 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:01.218960 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3405132,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":441999,"apply.run_cpu_time_us":4922,"apply.run_wall_time_us":74040,"num_ops":17,"prepare.queue_time_us":153296,"prepare.run_cpu_time_us":23862,"prepare.run_wall_time_us":186194,"raft.queue_time_us":317388,"raft.run_cpu_time_us":24275,"raft.run_wall_time_us":408857,"replication_time_us":578819,"spinlock_wait_cycles":227689728,"thread_start_us":694325,"threads_started":4,"wal-append.queue_time_us":152131,"wal-append.run_cpu_time_us":10735,"wal-append.run_wall_time_us":1923759}]]}
W20260620 13:57:04.399227  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:04.399752  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:04.399945  9367 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:04.400233  9302 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:04.400449  9367 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:04.400727  9413 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:04.401166  9367 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.401310  9413 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.634334  9386 consensus_queue.cc:1059] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.198s
I20260620 13:57:03.830077  9147 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:03.603271  9389 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:03.835577  9418 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:03.828572  9298 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:03.607561  9191 consensus_queue.cc:237] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.404211  9418 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.855631  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:03.858206  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:04.406702  9389 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:04.403513  9413 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:04.407675  6028 raft_consensus.cc:2368] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7.
I20260620 13:57:04.407827  6031 raft_consensus.cc:2368] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8.
I20260620 13:57:03.860102  5777 catalog_manager.cc:5696] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:03.857206  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:03.861132  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:03.849800  9185 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.000s
I20260620 13:57:03.836213  9091 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:04.409350  5777 catalog_manager.cc:5696] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 5 to 7, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 7 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:04.409649  9185 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:04.410096  9091 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.410984  5777 catalog_manager.cc:5696] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 7 to 8, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 8 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:57:04.412220  9091 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:03.836061  9373 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:03.861250  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1730) took 1232 ms. Trace:
I20260620 13:57:04.413646  9373 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.413997  5956 rpcz_store.cc:276] 0620 13:57:02.623343 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:02.623540 (+   197us) service_pool.cc:224] Handling call
0620 13:57:02.623966 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:02.645081 (+ 21115us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:02.645114 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:02.677312 (+ 32198us) log.cc:844] Serialized 26 byte log entry
0620 13:57:02.963498 (+286186us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:02.964369 (+   871us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:02.964449 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:03.855841 (+891392us) raft_consensus.cc:1685] finished
0620 13:57:03.855861 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:03.855988 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13422,"raft.queue_time_us":22320,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":2810,"thread_start_us":175984,"threads_started":1,"wal-append.queue_time_us":318027}
I20260620 13:57:03.844378  8911 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:04.416405  8911 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.418798  8911 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:03.833335  9236 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.421036  9236 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:03.923259  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:03.924437  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:04.422086  6584 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 1.
I20260620 13:57:03.856266  9372 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:04.422952  9372 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.413615  5777 catalog_manager.cc:5696] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 5, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 5 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:03.844743  9354 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:04.425148  9354 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.021836  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:03.857425  9414 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:03.925328  9384 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.427845  9354 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:04.427829  9367 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:04.430433  6578 raft_consensus.cc:2410] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260620 13:57:04.431273  8379 consensus_queue.cc:1059] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:57:04.432281  5777 catalog_manager.cc:5696] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 5, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 5 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:04.434196  5777 catalog_manager.cc:5696] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 4 to 6, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 6 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:04.435248  9413 raft_consensus.cc:3055] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:04.435807  9413 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:04.436241  5777 catalog_manager.cc:5696] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 4 to 5, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 5 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:04.436965  9413 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.438408  9413 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:03.862901  9304 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.441068  9304 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.444907  9414 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:03.868168  9357 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.448343  5777 catalog_manager.cc:5696] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 3 to 6, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 6 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:04.452205  5777 catalog_manager.cc:5696] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 3 to 4, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 4 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:03.849505  9317 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:57:04.382889  9407 log.cc:927] Time spent T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.365s	user 0.012s	sys 0.004s
I20260620 13:57:03.854772  9406 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.252s
I20260620 13:57:04.463838  9317 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.387226  9419 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:04.465778  9419 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:04.349273  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:03.861232  9327 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.254s
I20260620 13:57:04.388584  8821 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:04.388378  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:04.468423  8821 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.391175  9361 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:03.924646  9293 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:03.861912  9077 consensus_queue.cc:1059] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.323s
I20260620 13:57:04.470173  9361 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.473196  9361 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.473728  9386 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:04.395752  9417 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.288s	user 0.000s	sys 0.016s
I20260620 13:57:04.394850  6585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 835) took 1791 ms. Trace:
I20260620 13:57:03.926570  9297 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:04.475322  9416 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:04.406908  9418 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.400753  9302 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.476001  9416 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.475255  6585 rpcz_store.cc:276] 0620 13:57:02.602926 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:02.621782 (+ 18856us) service_pool.cc:224] Handling call
0620 13:57:02.645815 (+ 24033us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:02.722723 (+ 76908us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:02.722755 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:02.733307 (+ 10552us) log.cc:844] Serialized 26 byte log entry
0620 13:57:03.128707 (+395400us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:03.128771 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:03.128875 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:04.394471 (+1265596us) raft_consensus.cc:1685] finished
0620 13:57:04.394508 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:04.394740 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27831,"raft.queue_time_us":32665,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":103,"thread_start_us":394935,"threads_started":1,"wal-append.queue_time_us":514293}
I20260620 13:57:04.477267  9414 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:04.478194  9302 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:03.885596  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:04.479473  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 84307.2us
W20260620 13:57:04.479717  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:04.479768  9147 raft_consensus.cc:3055] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:04.479856  9077 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:04.480468  9147 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:04.481340  9297 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:04.473196  9367 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:04.474838  9386 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.477851  9414 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.478976  9287 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:04.457602  9357 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:03.855258  9366 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:04.482631  5884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1580) took 1508 ms. Trace:
I20260620 13:57:04.508498  5884 rpcz_store.cc:276] 0620 13:57:02.974781 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:02.975337 (+   556us) service_pool.cc:224] Handling call
0620 13:57:02.975795 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:03.221432 (+245637us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:03.221474 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:03.230985 (+  9511us) log.cc:844] Serialized 26 byte log entry
0620 13:57:03.577192 (+346207us) raft_consensus.cc:1645] Marking committed up to 3
0620 13:57:03.577253 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:03.577347 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:04.482386 (+905039us) raft_consensus.cc:1685] finished
0620 13:57:04.482418 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:04.482575 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18660,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":123,"thread_start_us":299285,"threads_started":1,"wal-append.queue_time_us":600251}
W20260620 13:57:04.470817  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 606876us
W20260620 13:57:04.393080  8804 consensus_meta.cc:287] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.798s	user 0.011s	sys 0.009s
I20260620 13:57:04.396150  9353 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:04.484051  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 86503.3us
W20260620 13:57:04.511288  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 654080us
I20260620 13:57:04.511386  8911 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:04.478835  9302 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:04.512511  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:04.512457  9302 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.513103  9372 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:04.513763  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:04.514166  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.514577  9302 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:04.515249  9363 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:04.515375  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.515944  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.516770  9416 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:04.517304  5953 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260620 13:57:04.517763  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.518528  9317 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:04.518726  9232 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:04.519004  9390 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:04.519465  9390 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:04.519639  9419 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.520160  9406 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:04.504655  5777 catalog_manager.cc:5696] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 4 to 6, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 6 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:04.520556  9406 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:04.520955  9406 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:04.521724  9312 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:04.521247  5777 catalog_manager.cc:5696] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 2 to 3, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 3 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:04.501816  9367 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.523201  9194 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.515872  9363 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.523764  9287 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.524879  9367 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:04.525173  9363 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.525977  9287 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:04.506170  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:04.481415  9147 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.528378  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:04.519374  9232 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.481968  9297 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.527325  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.508066  8875 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:04.517388  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.485004  9362 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:04.535446  5924 leader_election.cc:400] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7.
I20260620 13:57:04.519925  9390 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:04.523223  8911 raft_consensus.cc:697] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:04.482241  9293 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.544059  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:04.543339  5997 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:04.538471  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.533326  9411 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:04.527077  9275 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:04.542132  5924 leader_election.cc:403] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:57:04.553746  9275 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.554523  5924 leader_election.cc:400] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8.
I20260620 13:57:04.555053  5924 leader_election.cc:403] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260620 13:57:04.555814  9226 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 7
I20260620 13:57:04.556710  9275 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:04.553160  5997 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:04.558429  9427 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:04.559010  9427 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:04.559351  9389 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:04.563898  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 82478.1us
I20260620 13:57:04.564159  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.559479  9427 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:04.569550  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.570030  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:04.571652  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.576303  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:04.577016  9381 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:04.577085  6584 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:04.577667  9381 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.580229  9381 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:04.569398  5952 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260620 13:57:04.581118  9416 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:04.581257  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:04.581687  9416 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.584193  9416 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:04.584836  9416 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:04.585386  9416 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.587716  5924 leader_election.cc:400] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8.
I20260620 13:57:04.588872  9194 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:04.589516  9194 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.538074  9298 raft_consensus.cc:697] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:04.536618  9317 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260620 13:57:04.592844  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 48857.8us
I20260620 13:57:04.594136  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:04.594486  9317 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:04.603813  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 91598.5us
I20260620 13:57:04.549443  9421 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:04.608485  8379 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:04.616178  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:04.590719  9418 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:04.596331  9236 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:04.595781  8875 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:04.593822  9277 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:04.634853  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:04.634991  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:04.548525  9362 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.627125  5884 raft_consensus.cc:1240] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:04.629194  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.631171  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:04.632647  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:04.628219  9427 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.527611  9366 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.635653  5882 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:57:04.636004  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:04.605086  9317 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:04.624982  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:04.635510  6581 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:04.655781  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.656697  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:04.687842  5884 raft_consensus.cc:2410] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:57:04.688335  9366 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.658475  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:04.691622  5877 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:57:04.686648  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:04.702838  9416 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.649029  9277 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.658107  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:04.707683  9191 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:04.708201  9277 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:04.708412  5875 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 4.
I20260620 13:57:04.708436  9191 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.709534  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.711285  9191 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.615345  9077 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260620 13:57:04.620810  9304 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:04.713222  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:04.723067  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 102967us
I20260620 13:57:04.636363  8875 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:04.688894  9366 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:04.696050  9409 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:04.743983  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:04.744822  5882 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:04.750403  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:04.751358  5954 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:04.750069  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 160382us
I20260620 13:57:04.636559  9418 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.753816  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:04.620749  9298 consensus_queue.cc:237] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.765117  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:04.767203  5881 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:04.733067  9185 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:04.757982  5848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.553s (SENT) [suppressed 23 similar messages]
I20260620 13:57:04.733870  9304 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.742702  9413 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:04.745865  8821 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:04.772985  9226 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7.
I20260620 13:57:04.778712  9362 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.779448  9194 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.779538  9418 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.779775  9317 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.780417  9232 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:04.752804  9366 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.785859  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:04.787163  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:04.721220  8911 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.789067  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:04.789176  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:04.826875  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:04.791014  5951 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:04.798307  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:04.743559  9236 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:04.840770  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.810679  9386 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:04.807590  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:04.807971  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:04.815841  5878 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:57:04.816874  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:04.860809  6029 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:57:04.821132  9389 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8.
I20260620 13:57:04.801486  9413 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:04.916512  9413 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:04.916939  9384 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.822717  9317 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.788187  9414 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:04.825194  6030 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:57:04.743158  8875 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:04.835537  9293 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:04.839828  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.840728  9427 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:04.907310  9147 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:04.832389  6031 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:57:04.832759  9363 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:04.920274  9363 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.923537  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:04.924218  9363 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:04.806466  5950 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260620 13:57:04.857774  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.930241  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.931375  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.932060  5958 raft_consensus.cc:2393] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:04.932749  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.933774  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.934727  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.847941  9232 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:57:04.842015  9236 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.599614  9411 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.821132  9373 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.615921  9421 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:04.756726  9409 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.864748  6586 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260620 13:57:04.878697  9440 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:04.865594  9432 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:57:04.879941  9304 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:04.880100  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:04.966531  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:04.966708  6025 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:04.880558  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:04.881903  9366 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:04.882869  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.884117  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.888613  9406 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:04.890447  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:04.894757  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:04.897753  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:04.899544  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:04.900039  5997 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:04.907249  6552 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:04.915576  9297 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:04.852174  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:05.018217  6026 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:04.975171  6032 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:04.925365  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.942122  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:04.949244  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:05.019995  6582 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:04.951776  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:04.958484  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:04.928448  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:04.959798  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 321408us
I20260620 13:57:05.024623  5954 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:05.024827  5998 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:05.026615  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:04.959272  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:04.962731  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:04.964533  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:05.028911  6587 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:04.965839  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:05.030051  6027 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
W20260620 13:57:04.963171  5849 connection.cc:256] RPC call timeout handler was delayed by -1.0231354169999349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260620 13:57:04.969506  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 211548us
I20260620 13:57:04.961124  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:04.974857  6581 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:05.017201  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:05.044725  5957 raft_consensus.cc:2410] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260620 13:57:05.019266  5883 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:05.059815  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.062335  5879 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:05.063740  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:05.064635  5952 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:05.066358  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:05.067283  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:05.069090  5924 leader_election.cc:400] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7.
I20260620 13:57:05.070616  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:05.067365  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:05.066241  6028 raft_consensus.cc:2393] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:05.070814  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:05.072541  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:04.964592  9432 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:05.079205  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:05.074322  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:05.080861  6029 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260620 13:57:05.074572  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.075302  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:05.085404  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:05.083523  5879 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:05.076161  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:05.076745  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 169650us
I20260620 13:57:05.066947  6032 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:05.087739  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.088202  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:04.974857  9091 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:05.089056  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:05.089943  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:05.090662  5954 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:05.094576  5958 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:05.095959  6552 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:05.097019  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:05.097640  6586 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:05.098335  5953 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:05.100437  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:05.101748  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:05.062024  9147 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:05.106314  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:05.070798  9373 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:05.055423  9442 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:05.103075  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:05.124888  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:05.125329  5875 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:05.109014  5879 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260620 13:57:05.101127  6579 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:05.127048  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:05.127636  6579 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:05.120002  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.078783  9418 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:05.073633  9327 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:05.122236  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:05.084266  8821 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:57:05.136788  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:05.123344  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:05.131196  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:05.114864  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:05.137768  6581 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
W20260620 13:57:05.137848  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 237909us
I20260620 13:57:05.076534  9363 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:05.082006  9389 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:05.132138  5848 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:05.133435  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.125495  6028 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:05.084498  9432 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:57:05.135259  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:05.101661  9367 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:05.146061  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:05.138425  5879 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:57:05.135064  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.143218  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:05.079003  9427 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:05.145326  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:05.148414  5880 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:57:05.149057  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:04.966130  9440 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:05.149394  6579 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:05.107028  9302 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:05.171406  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:05.125947  9373 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:05.173566  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:05.175518  6582 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260620 13:57:05.185086  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:05.175159  6551 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:05.131601  9134 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:05.237126  6582 pending_rounds.cc:85] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 8
I20260620 13:57:05.246635  6582 pending_rounds.cc:107] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260620 13:57:05.193559  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.247013  6582 raft_consensus.cc:2889] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:57:05.237938  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 66263.3us
I20260620 13:57:05.144007  8821 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:05.192669  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.108878  9361 consensus_queue.cc:1059] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260620 13:57:05.248453  6551 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:05.249090  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:05.254189  5958 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
W20260620 13:57:05.260408  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 89131.2us
I20260620 13:57:05.267570  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:05.268512  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:05.261169  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 89637.2us
I20260620 13:57:05.106395  9091 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:05.149238  9317 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:05.283985  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.270975  5997 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:05.287881  8379 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:05.288563  8379 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:05.245877  9373 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:05.272852  5880 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:05.265816  8821 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:05.169204  9414 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:05.283165  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.284844  5884 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:57:05.192605  9302 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:05.299439  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.295243  8379 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:05.300220  5882 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:57:05.300397  8379 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:05.293198  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.302541  8379 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:05.244102  9298 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:57:05.306397  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.245818  9216 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:05.347819  9216 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:05.352607  9448 log.cc:927] Time spent T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260620 13:57:05.354835  9443 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260620 13:57:05.356492  9454 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260620 13:57:05.357795  9446 log.cc:927] Time spent T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260620 13:57:05.248291  9236 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:05.312310  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:05.364584  9304 raft_consensus.cc:3055] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:05.365051  9304 raft_consensus.cc:740] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:05.365854  9304 consensus_queue.cc:260] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:05.367060  9304 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:05.370622  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:05.367184  9373 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:05.376554  9409 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:05.146513  9418 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:05.192646  9427 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:05.149009  9363 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:05.149775  9413 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:05.136956  9442 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:05.311861  9182 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:05.322826  9317 raft_consensus.cc:697] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:05.307832  9414 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:05.379774  9298 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:05.327661  5883 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:05.293586  9445 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:05.380283  5882 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260620 13:57:05.380585  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:05.382462  6580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 914) took 1409 ms (client timeout 1795 ms). Trace:
I20260620 13:57:05.379253  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:05.312384  9374 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:05.427268  5878 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:05.150947  9367 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:05.194912  9191 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:05.293675  9077 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260620 13:57:05.405918  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.444525  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.406018  5849 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:05.445456  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 119066us
I20260620 13:57:05.446945  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:05.450304  5849 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:05.415716  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:05.305675  9302 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:05.428469  5882 pending_rounds.cc:85] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 7
W20260620 13:57:05.428738  6580 rpcz_store.cc:269] 0620 13:57:03.922698 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:03.922867 (+   169us) service_pool.cc:224] Handling call
0620 13:57:05.331989 (+1409122us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54004a83d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:05.332149 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1631777536}
I20260620 13:57:05.431293  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.432945  5951 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:05.436444  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.437434  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:05.438805  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 255104us
I20260620 13:57:05.150111  9327 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:05.391551  9406 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:05.485838  5882 pending_rounds.cc:107] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260620 13:57:05.486373  5882 raft_consensus.cc:2889] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:05.489408  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.489694  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:05.441344  9390 consensus_meta.cc:287] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.851s	user 0.008s	sys 0.004s
I20260620 13:57:05.404884  9182 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:05.520507  9327 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:05.535483  6585 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.009s	sys 0.008s
W20260620 13:57:05.535866  6585 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.009s	sys 0.008s
I20260620 13:57:05.521438  9216 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:05.521947  9304 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:05.523188  9373 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:05.533035  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 357070us
I20260620 13:57:05.421427  9414 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:05.443856  9411 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:05.515887  5881 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:05.425469  9298 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:57:05.530442  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 46292.1us
I20260620 13:57:05.523488  9440 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:05.492741  9277 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:05.490780  9435 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:05.564898  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:05.565475  5954 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:05.523520  5875 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:05.548395  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:05.553336  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 266998us
I20260620 13:57:05.454249  9191 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:05.486755  9293 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:57:05.483482  8821 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:05.532032  9421 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:05.441887  9367 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:05.562870  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:57:05.571753  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:05.560602  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 426078us
I20260620 13:57:05.573810  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:05.573876  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:05.535983  9182 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:05.445079  9445 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:05.577131  5955 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260620 13:57:05.577950  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:05.578770  6585 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260620 13:57:05.531047  9374 raft_consensus.cc:697] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:05.583001  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:05.583623  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:05.615407  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:05.625025  6579 raft_consensus.cc:2393] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:05.625108  6587 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:57:05.617046  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:05.628340  6584 raft_consensus.cc:2368] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9.
I20260620 13:57:05.618106  5956 raft_consensus.cc:2410] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260620 13:57:05.620623  6585 pending_rounds.cc:85] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 6
I20260620 13:57:05.629074  6585 pending_rounds.cc:107] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260620 13:57:05.629338  6585 raft_consensus.cc:2889] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:05.500800  9361 consensus_queue.cc:1059] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260620 13:57:05.584107  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:05.630630  6582 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:05.578552  9386 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:05.623368  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:05.534901  9390 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:05.584904  5997 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:05.631424  6583 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:05.578564  9191 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:57:05.633437  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:05.633709  8379 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:05.641748  8379 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:05.623190  9430 log.cc:927] Time spent T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260620 13:57:05.639616  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:05.691406  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 106563us
I20260620 13:57:05.691450  5954 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:05.694998  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.697913  8379 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:05.615962  9435 raft_consensus.cc:697] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:05.580747  9423 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:05.706429  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:05.627638  9421 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260620 13:57:05.711480  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 80253.8us
I20260620 13:57:05.731768  5952 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
W20260620 13:57:05.731572  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 141045us
I20260620 13:57:05.634196  9386 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:05.562047  9317 consensus_queue.cc:237] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:05.690701  9091 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:05.692679  9442 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:05.629240  9216 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260620 13:57:05.749292  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:05.758960  6583 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:05.720018  9384 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260620 13:57:05.790122  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 167944us
I20260620 13:57:05.866591  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2122) took 1031 ms. Trace:
I20260620 13:57:05.901958  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:05.893819  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.902225  5952 rpcz_store.cc:276] 0620 13:57:04.834746 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:05.075941 (+241195us) service_pool.cc:224] Handling call
0620 13:57:05.866363 (+790422us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54002512d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:05.866513 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481416576}
W20260620 13:57:05.807768  9460 log.cc:927] Time spent T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260620 13:57:05.908006  6025 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:05.909540  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:05.910215  9458 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260620 13:57:05.739342  8875 consensus_meta.cc:287] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.821s	user 0.012s	sys 0.000s
I20260620 13:57:05.911422  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:05.919047  5875 raft_consensus.cc:2410] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260620 13:57:05.803902  9363 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:05.806782  9445 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:05.913041  6551 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:05.913208  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:05.914628  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:05.914933  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:05.916222  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:05.875561  9455 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:05.809855  9451 log.cc:927] Time spent T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
W20260620 13:57:05.772046  9457 log.cc:927] Time spent T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260620 13:57:05.809316  9390 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:05.795821  9413 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:05.812175  9367 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:05.901625  9384 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:05.912081  9386 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:05.923199  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:05.923444  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 174231us
I20260620 13:57:05.982107  6552 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:05.737306  9428 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:05.737414  9147 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:05.938701  5878 consensus_meta.cc:287] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.001s
I20260620 13:57:05.984231  5878 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
W20260620 13:57:05.887907  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 438874us
W20260620 13:57:05.985471  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 64784.3us
I20260620 13:57:05.986268  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:05.987187  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 505604us
I20260620 13:57:05.787428  9427 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:05.808177  8821 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:05.729770  9411 consensus_queue.cc:1059] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.192s
I20260620 13:57:05.994285  9411 raft_consensus.cc:3055] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:05.994735  9411 raft_consensus.cc:740] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:05.992069  9428 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:05.995803  9411 consensus_queue.cc:260] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:05.997361  9411 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:05.997458  9428 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:05.947029  9302 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:05.999804  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:05.917923  9416 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260620 13:57:06.002240  6586 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 9: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:05.987771  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:06.002944  6552 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:05.940845  9467 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:05.814343  9374 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:05.740044  9423 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:05.937865  9091 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:06.004957  5848 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:06.003095  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:05.924458  8875 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:06.007701  6581 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:06.010056  6552 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:05.980820  9384 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:05.867074  9435 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.021651  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2125) took 1186 ms. Trace:
I20260620 13:57:06.011785  5849 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:05.999959  9302 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:06.023267  5849 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:06.018549  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 79182us
I20260620 13:57:06.007373  9421 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:06.022044  5957 rpcz_store.cc:276] 0620 13:57:04.835688 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:05.075427 (+239739us) service_pool.cc:224] Handling call
0620 13:57:05.075683 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:05.099411 (+ 23728us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:05.099454 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:05.106274 (+  6820us) log.cc:844] Serialized 26 byte log entry
0620 13:57:05.377540 (+271266us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:05.377581 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:05.377652 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:06.021425 (+643773us) raft_consensus.cc:1685] finished
0620 13:57:06.021445 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:06.021593 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23331,"raft.queue_time_us":24960,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":17399,"thread_start_us":207984,"threads_started":1,"wal-append.queue_time_us":441694}
I20260620 13:57:06.026551  9456 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:06.026693  9421 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:06.027245  9421 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:06.027634  9421 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:06.018921  5848 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:06.029716  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:06.007419  9467 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:06.011581  9236 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:06.032701  6552 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:05.969915  9455 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.036422  8821 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:05.991928  9147 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.021898  9277 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:06.046838  6552 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:06.048743  5997 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:06.027031  9456 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:06.037871  9467 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:06.036796  9304 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:06.057310  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:06.059695  6025 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:06.060628  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:06.062378  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:06.058028  9413 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:06.067709  9413 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:06.068506  8875 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:06.036648  9471 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:06.068434  9413 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:06.058106  9432 consensus_meta.cc:287] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.885s	user 0.008s	sys 0.004s
I20260620 13:57:06.054023  9468 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:06.045260  9134 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260620 13:57:06.046315  9302 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:06.078832  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:06.093086  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 69955.1us
I20260620 13:57:06.112978  6029 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:06.100646  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:06.101418  6027 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260620 13:57:06.113687  5849 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:06.113852  5876 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:06.101307  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:06.114516  5883 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:06.101831  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:06.115175  6031 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:06.103746  9311 raft_consensus.cc:3055] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:57:06.121908  9311 raft_consensus.cc:740] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:06.106118  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:06.122566  6028 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:06.122823  9311 consensus_queue.cc:260] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.123931  9311 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:06.108294  9191 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.052773  9466 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:57:06.055287  9456 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:06.138718  5876 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:06.099452  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:06.115511  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:06.141172  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:06.141960  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:06.081209  9432 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.116649  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:06.144042  9432 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:06.089119  9147 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:06.116074  9409 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:06.076447  9418 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:06.145624  5959 raft_consensus.cc:1240] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 1. Current term is 2. Ops: []
I20260620 13:57:06.129983  5882 raft_consensus.cc:2393] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:06.147259  6552 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:06.147998  9453 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260620 13:57:06.133086  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 52073.2us
I20260620 13:57:06.149119  5883 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:06.151196  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:06.151799  6581 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:06.157569  9423 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:06.158315  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:06.159386  9423 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:06.160003  9423 raft_consensus.cc:697] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:06.161564  9482 raft_consensus.cc:2764] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260620 13:57:06.161094  9423 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.160245  9413 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.164273  9413 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:06.128756  9191 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:06.131605  9414 consensus_meta.cc:287] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.572s	user 0.002s	sys 0.009s
W20260620 13:57:06.134253  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 85587us
I20260620 13:57:06.177373  9421 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.178222  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:06.134737  9428 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:06.180560  9077 consensus_queue.cc:1059] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:57:06.182246  5955 raft_consensus.cc:2410] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260620 13:57:06.111724  9367 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:06.116256  9302 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:06.095194  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:06.142118  9468 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:06.193971  5950 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:06.108915  9384 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:06.165248  9298 consensus_meta.cc:287] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.003s
I20260620 13:57:06.167773  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:06.168045  9455 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:06.073271  9182 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.173301  9467 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.183874  6031 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
W20260620 13:57:06.188688  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 128119us
I20260620 13:57:06.181805  9428 raft_consensus.cc:3055] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:57:06.166859  6552 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:06.237324  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 70584.8us
I20260620 13:57:06.238054  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:06.132349  6028 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:06.239670  9455 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:57:06.240409  9455 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:06.241055  9455 raft_consensus.cc:697] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:06.245093  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:06.246660  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:06.204909  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 54614.5us
I20260620 13:57:06.247169  9363 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:06.247936  5998 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:06.248502  5778 catalog_manager.cc:5696] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 5 to 6, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 6 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:57:06.205797  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 63912.3us
I20260620 13:57:06.250288  5778 catalog_manager.cc:5696] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 4 to 8, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 8 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:06.251580  5849 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:06.252048  5778 catalog_manager.cc:5696] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:06.253118  5849 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:06.253538  5778 catalog_manager.cc:5696] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 3 to 7, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 7 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:06.254591  9194 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:06.254976  9194 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:06.255340  9194 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:06.256182  5778 catalog_manager.cc:5696] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:57:06.257884  5778 catalog_manager.cc:5696] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 6 to 7, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 7 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:06.192507  9432 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:06.175506  9414 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.220567  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:06.260058  9482 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 13:57:06.225132  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:06.260826  9482 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:06.261193  9482 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:06.261265  9414 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:06.261622  9482 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:06.254208  5849 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:57:06.263322  5777 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56610 (request call id 350) took 15337 ms (client timeout 15000 ms). Trace:
I20260620 13:57:06.264441  9418 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:57:06.264858  9418 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:06.265236  9418 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:06.194032  9302 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:06.271263  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:06.272068  6584 raft_consensus.cc:2393] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 12: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:06.272630  5998 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:06.274133  6552 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:06.276116  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:06.276050  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:06.276531  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:06.278456  5998 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:06.267135  9435 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:06.236495  9428 raft_consensus.cc:740] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:06.276847  6585 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:06.220103  9191 raft_consensus.cc:2764] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260620 13:57:06.242192  9455 consensus_queue.cc:237] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.279891  6578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:06.300170  6578 raft_consensus.cc:606] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:06.300673  6578 raft_consensus.cc:614] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:06.284600  6580 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260620 13:57:06.292258  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:06.259202  5778 catalog_manager.cc:5696] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:57:06.293823  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:06.294114  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:06.303476  6027 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:06.291999  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:06.304500  6581 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:57:06.292943  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:06.298215  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:06.294289  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:06.303512  5778 catalog_manager.cc:5696] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:57:06.307570  5778 catalog_manager.cc:5696] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 5 to 6, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 6 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:06.314059  6025 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:06.278573  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:06.317354  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:06.324307  9077 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:57:06.324812  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 47059.4us
I20260620 13:57:06.288347  9432 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:06.329552  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:06.221787  9298 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.330705  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:06.348985  5882 raft_consensus.cc:2368] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12.
W20260620 13:57:06.280326  9479 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260620 13:57:06.326943  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:06.334893  6027 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:06.288260  9374 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:06.326638  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:06.281623  9467 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:06.329689  5848 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:06.342963  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:06.331146  9363 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:06.280041  9327 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
I20260620 13:57:06.382155  9363 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:06.327822  9367 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260620 13:57:06.383958  9363 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:06.344938  5958 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:06.339529  6030 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:06.345984  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:06.387435  9304 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:06.388450  9304 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:06.390647  9304 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:06.390960  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:06.392481  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 62870.6us
I20260620 13:57:06.357614  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:06.393116  6579 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:06.323576  5778 catalog_manager.cc:5696] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:06.268379  9134 consensus_queue.cc:1059] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260620 13:57:06.347765  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:06.345013  6581 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:06.398658  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:06.399626  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:06.327473  9414 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:06.350996  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:06.400187  5955 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:06.355195  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:06.355888  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:06.326843  9435 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.337744  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:06.357611  5959 raft_consensus.cc:1275] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260620 13:57:06.362982  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:06.511992  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:06.512501  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 176100us
I20260620 13:57:06.379859  9384 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:06.380880  9428 consensus_queue.cc:260] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.519013  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:06.519876  5957 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:06.520040  9428 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:57:06.520865  9298 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:06.523144  6031 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
W20260620 13:57:06.516732  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 122681us
I20260620 13:57:06.395788  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:06.395887  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 44068.1us
I20260620 13:57:06.358616  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:06.396785  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:06.350135  9453 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:06.398021  5951 raft_consensus.cc:1240] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: []
W20260620 13:57:06.263676  5777 rpcz_store.cc:269] 0620 13:56:50.925974 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:50.932540 (+  6566us) service_pool.cc:224] Handling call
0620 13:57:06.263254 (+15330714us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:57:04.817775 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:57:04.823862 (+  6087us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:57:04.823903 (+    41us) write_op.cc:435] Acquired schema lock
0620 13:57:04.823928 (+    25us) tablet.cc:662] Decoding operations
0620 13:57:04.837179 (+ 13251us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:57:04.837266 (+    87us) write_op.cc:641] Partition lock acquired for write op
0620 13:57:04.837308 (+    42us) tablet.cc:685] Acquiring locks for 12 operations
0620 13:57:04.838721 (+  1413us) tablet.cc:701] Row locks acquired
0620 13:57:04.838744 (+    23us) write_op.cc:260] PREPARE: finished
0620 13:57:04.838948 (+   204us) write_op.cc:270] Start()
0620 13:57:04.851342 (+ 12394us) write_op.cc:276] Timestamp: P: 1781963824838880 usec, L: 0
0620 13:57:04.862297 (+ 10955us) op_driver.cc:348] REPLICATION: starting
0620 13:57:04.886684 (+ 24387us) log.cc:844] Serialized 4781 byte log entry
0620 13:57:05.849912 (+963228us) op_driver.cc:464] REPLICATION: finished
0620 13:57:06.005487 (+155575us) write_op.cc:301] APPLY: starting
0620 13:57:06.005604 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0620 13:57:06.005985 (+   381us) tablet.cc:1370] finished BulkCheckPresence
0620 13:57:06.006204 (+   219us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:57:06.027132 (+ 20928us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:57:06.027403 (+   271us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0620 13:57:06.027449 (+    46us) write_op.cc:312] APPLY: finished
0620 13:57:06.027749 (+   300us) log.cc:844] Serialized 89 byte log entry
0620 13:57:06.027963 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:06.034120 (+  6157us) write_op.cc:454] Released schema lock
0620 13:57:06.039243 (+  5123us) write_op.cc:341] FINISH: Updating metrics
0620 13:57:06.045242 (+  5999us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:06.045275 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":335610,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":150362,"apply.run_cpu_time_us":4336,"apply.run_wall_time_us":34172,"num_ops":12,"prepare.queue_time_us":192418,"prepare.run_cpu_time_us":27844,"prepare.run_wall_time_us":276050,"raft.queue_time_us":395761,"raft.run_cpu_time_us":50350,"raft.run_wall_time_us":247436,"replication_time_us":916311,"thread_start_us":669071,"threads_started":4,"wal-append.queue_time_us":254017}]]}
I20260620 13:57:06.399501  5778 catalog_manager.cc:5696] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 3 to 4, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 4 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:57:06.401669  6578 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:06.282282  9366 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:06.401829  9414 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:06.394539  9473 raft_consensus.cc:2764] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260620 13:57:06.384191  9386 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.447189  6580 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 13: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:06.353266  9421 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:06.448002  6584 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260620 13:57:06.501885  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:06.413975  6026 raft_consensus.cc:2368] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12.
I20260620 13:57:06.378123  9182 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:06.513382  5998 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:06.528271  5849 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:06.548014  5950 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:06.691852  6583 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:06.528061  5958 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:06.529393  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:06.558691  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:06.556291  5778 catalog_manager.cc:5696] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 4 to 6, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 6 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:06.693969  5778 catalog_manager.cc:5696] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:06.555485  9366 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:06.646095  9493 log.cc:927] Time spent T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260620 13:57:06.527407  9317 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:06.559823  9414 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:06.646835  9147 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:06.674170  9302 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.675693  9453 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:06.679025  6580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:06.718395  6580 raft_consensus.cc:606] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:06.718878  6580 raft_consensus.cc:614] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:06.681097  8379 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:06.681272  9432 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:06.724179  6582 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: []
W20260620 13:57:06.684137  9456 consensus_meta.cc:287] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260620 13:57:06.684646  5952 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260620 13:57:06.684862  5951 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260620 13:57:06.665859  9327 raft_consensus.cc:3055] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:06.706676  9366 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:06.690222  5955 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:06.696967  6552 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:06.697584  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:06.697919  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 169765us
W20260620 13:57:06.747740  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 50851us
I20260620 13:57:06.401019  9194 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.713161  9311 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:06.695709  5778 catalog_manager.cc:5696] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 6 to 7, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 7 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:06.699146  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:06.702926  5884 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260620 13:57:06.722790  8379 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.743656  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 926) took 1153 ms. Trace:
I20260620 13:57:06.747970  5849 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:06.722280  9147 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:06.698376  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 139747us
I20260620 13:57:06.758113  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:06.758244  9147 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:06.758846  9445 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:57:06.748605  6552 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:06.711968  9411 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:06.720664  9428 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:06.764349  5849 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:06.748492  6551 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:06.754928  6579 rpcz_store.cc:276] 0620 13:57:05.590271 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:05.625553 (+ 35282us) service_pool.cc:224] Handling call
0620 13:57:05.625799 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:06.393472 (+767673us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:06.743267 (+349795us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b540051fc54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:06.743525 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764302592}
I20260620 13:57:06.759528  9452 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:06.765686  6552 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:06.738513  9456 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.740928  9327 raft_consensus.cc:740] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:06.773777  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:06.779973  8379 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:06.763974  9409 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:06.759819  9311 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:06.738245  9432 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.794014  9432 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:06.783744  9236 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:06.765738  9134 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:06.795387  9134 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:06.795301  9363 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:06.795905  9134 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:06.796168  9194 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:06.797585  9363 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:06.798468  9327 consensus_queue.cc:260] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:06.799698  9327 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:06.801677  9386 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:06.765515  9418 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:06.803335  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:06.795089  9236 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:06.804466  9418 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:06.804682  9236 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:06.802934  5953 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:06.808115  5878 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:06.789695  9311 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:06.809367  9456 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:06.813107  9302 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:06.814940  9453 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.771128  9469 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:06.777887  9468 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:06.818658  5878 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:06.769987  9147 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260620 13:57:06.770490  9298 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:06.791712  9435 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:06.773627  9466 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:06.832320  9466 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:06.833129  9466 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:06.808665  6578 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:06.826021  5950 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:06.837807  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:06.840531  6578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:06.841589  6578 raft_consensus.cc:606] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:06.842185  6578 raft_consensus.cc:614] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260620 13:57:06.844851  9482 consensus_meta.cc:287] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.008s
I20260620 13:57:06.845677  9482 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.847520  9366 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.856588  5876 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:06.838189  9469 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:06.843299  9298 raft_consensus.cc:697] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:06.888621  6030 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 2.
I20260620 13:57:06.891983  6028 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:06.881238  9425 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.006s	sys 0.029s
W20260620 13:57:06.903790  9425 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.006s	sys 0.030s
I20260620 13:57:06.906646  5876 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:06.911922  9298 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.875370  9236 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.941497  6578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:06.976888  9373 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:06.979790  9373 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:06.982573  9373 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:06.982033  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 468699us
I20260620 13:57:06.984148  9236 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:07.005107  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:07.010167  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:07.011543  5998 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:07.020120  9373 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:57:06.964287  9469 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:06.993214  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 259697us
I20260620 13:57:07.026535  5998 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:07.036341  9504 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
W20260620 13:57:07.036479  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 254793us
W20260620 13:57:07.037427  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 277797us
I20260620 13:57:07.049708  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:07.037081  9504 raft_consensus.cc:697] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:07.059295  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:07.052691  5997 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:07.053768  9441 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260620 13:57:07.057240  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:07.046727  9482 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:07.059939  5876 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:07.062925  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:07.066105  5924 leader_election.cc:400] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12.
I20260620 13:57:07.067239  6030 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 9: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:07.068751  5924 leader_election.cc:403] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260620 13:57:07.071802  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 307507us
I20260620 13:57:07.073345  5849 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:07.026178  9425 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:57:07.075745  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:07.077121  5849 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:07.076122  9506 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:07.080155  9473 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:07.080430  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:07.069864  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:07.027010  9435 raft_consensus.cc:2764] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260620 13:57:07.095988  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:07.091379  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:07.097203  5950 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:07.092285  6578 raft_consensus.cc:606] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:07.092347  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:07.080176  5955 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:07.097522  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:07.099234  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:07.100193  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:07.101121  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:07.103516  5924 leader_election.cc:400] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9.
I20260620 13:57:07.103825  5924 leader_election.cc:403] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260620 13:57:07.061942  9452 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:57:07.101508  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:07.139575  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:07.143885  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:07.144186  6026 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260620 13:57:07.132319  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:07.143998  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:07.026842  9311 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:07.158074  6582 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:07.159699  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:07.060887  9091 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260620 13:57:07.090456  9502 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election won for term 8
W20260620 13:57:07.147944  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 60073.3us
I20260620 13:57:07.118220  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:07.144213  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:07.108738  9362 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:07.199832  5876 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:07.197665  5875 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:57:07.162591  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:07.218439  6031 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:57:07.233229  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:07.118296  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:07.116601  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:07.105921  9432 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:57:07.233530  6585 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260620 13:57:07.276165  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:07.144667  9456 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:07.107921  9445 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:07.231067  5878 raft_consensus.cc:2393] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 9: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:07.103904  9134 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.083956  9425 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:07.105880  9277 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:07.235774  5876 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:07.105039  9304 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:07.287741  5952 raft_consensus.cc:2393] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 10: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:07.207681  5997 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:07.288739  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 81128.9us
I20260620 13:57:07.184434  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:07.259627  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:07.291978  6587 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:07.094663  9366 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:07.271530  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:07.299818  5953 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:07.271752  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:07.105182  9468 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:07.164042  9390 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9.
I20260620 13:57:07.303930  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:07.305084  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:07.298791  9441 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:07.278115  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:07.287495  9414 consensus_meta.cc:287] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.005s
W20260620 13:57:07.282317  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 178946us
I20260620 13:57:07.144321  9418 consensus_queue.cc:1059] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.127s
I20260620 13:57:07.235072  9362 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:07.319850  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:07.283982  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:07.321120  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:07.314746  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:07.143930  9191 consensus_queue.cc:1059] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260620 13:57:07.233224  9466 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:07.258929  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:07.294816  5879 raft_consensus.cc:2393] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:07.301985  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:07.302217  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:07.303478  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:07.272073  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:07.305778  5876 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:07.306214  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:07.328037  6031 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:07.231585  9504 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:07.332154  6029 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: []
W20260620 13:57:07.344105  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 72105.3us
I20260620 13:57:07.345314  6552 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:07.311558  9441 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:07.346643  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:07.310581  5883 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:07.285668  9425 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:07.311331  6030 raft_consensus.cc:1240] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:07.276846  5881 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:57:07.312741  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:07.313730  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:07.317580  5849 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:07.357259  6583 raft_consensus.cc:2393] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:57:07.357359  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 44867.3us
I20260620 13:57:07.358343  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:07.358448  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:07.105665  9482 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:07.319566  5877 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260620 13:57:07.286453  9432 raft_consensus.cc:697] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:07.327907  5878 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260620 13:57:07.328217  6585 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:07.269320  9502 raft_consensus.cc:697] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:07.330318  6032 raft_consensus.cc:2368] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8.
I20260620 13:57:07.299438  9505 consensus_queue.cc:1059] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260620 13:57:07.326361  9362 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:07.359891  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:07.347209  9471 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:07.347203  9469 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:07.406306  9502 consensus_queue.cc:237] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:07.407305  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:07.408070  9518 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:07.409291  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:07.381108  9327 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:07.410466  9518 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:07.411150  9134 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:07.354707  9441 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:07.415657  9514 log.cc:927] Time spent T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260620 13:57:07.373713  9191 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:07.396484  6029 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260620 13:57:07.367553  9507 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:07.362861  9298 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:07.368198  9293 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260620 13:57:07.402537  9516 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260620 13:57:07.403211  9512 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260620 13:57:07.384389  9236 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:07.389037  9091 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
W20260620 13:57:07.404539  9517 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260620 13:57:07.415767  9373 consensus_queue.cc:1059] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260620 13:57:07.324630  9414 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.379436  5849 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:07.419271  9182 raft_consensus.cc:3055] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:07.424222  6585 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:07.310858  9468 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.433652  9298 raft_consensus.cc:697] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:57:07.435487  5998 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71fbe22bd18849f1b94912bb0bdf5bbe. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:57:07.371177  9363 consensus_queue.cc:1059] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260620 13:57:07.410022  9462 raft_consensus.cc:2764] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260620 13:57:07.422634  9134 consensus_queue.cc:1059] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260620 13:57:07.457983  9134 consensus_queue.cc:1243] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer b0ce39342d8c4a64904b30b98de02b9f log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260620 13:57:07.458635  9134 raft_consensus.cc:3055] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:07.458961  9134 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:07.459842  9134 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.461042  9134 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:07.463056  6579 raft_consensus.cc:2393] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 10: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:57:07.441723  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 62418.6us
I20260620 13:57:07.418157  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:07.426988  9317 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260620 13:57:07.441108  9236 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.453967  9363 raft_consensus.cc:3055] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:57:07.454180  9414 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:07.455061  9525 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:07.456302  9468 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:07.467798  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 49718.2us
I20260620 13:57:07.432401  9311 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:07.476723  6582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:07.480043  6582 raft_consensus.cc:606] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:07.482239  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260620 13:57:07.483351  9462 consensus_queue.cc:1059] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:57:07.484798  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:57:07.487339  5883 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:07.488312  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:57:07.484880  9518 consensus_queue.cc:1059] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:07.505224  5881 raft_consensus.cc:1240] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:07.507426  5883 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:07.519066  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:07.443639  9182 raft_consensus.cc:740] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:07.447300  9367 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:07.447075  9473 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election won for term 7
W20260620 13:57:07.537855  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 51619.6us
I20260620 13:57:07.469442  9293 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:07.602133  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:07.470801  9507 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:07.615943  8379 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:07.471064  9363 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:07.472074  9327 raft_consensus.cc:697] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:57:07.617317  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 188765us
I20260620 13:57:07.616690  8379 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.605949  9466 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:07.650055  8379 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:07.683945  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 209289us
I20260620 13:57:07.610212  9367 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.696836  5998 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:07.615774  9293 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.707538  5849 leader_election.cc:400] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8.
I20260620 13:57:07.708045  5849 leader_election.cc:403] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260620 13:57:07.606328  9432 consensus_queue.cc:237] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.654114  9362 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.751541  5877 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:07.715601  9304 consensus_queue.cc:1059] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260620 13:57:07.753347  9304 raft_consensus.cc:3055] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:07.753917  9362 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:07.756021  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:07.756690  5881 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:07.753883  9304 raft_consensus.cc:740] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:07.709601  9421 consensus_queue.cc:1059] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260620 13:57:07.759930  9304 consensus_queue.cc:260] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.760414  9421 raft_consensus.cc:3055] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:07.760972  9421 raft_consensus.cc:740] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:07.761410  9304 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:07.761929  9421 consensus_queue.cc:260] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.763927  9418 raft_consensus.cc:3055] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:07.764343  9418 raft_consensus.cc:740] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:07.765101  9418 consensus_queue.cc:260] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:07.766235  9418 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:07.771847  9522 log.cc:927] Time spent T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
I20260620 13:57:07.776954  9366 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:07.777429  9366 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:07.778312  9366 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.747608  9327 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.655908  9182 consensus_queue.cc:260] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:07.655946  9298 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.783066  9526 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:07.785248  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:07.715703  9509 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8.
I20260620 13:57:07.791756  5881 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:07.793711  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:07.789551  5849 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:07.748867  9519 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.327s	user 0.000s	sys 0.001s
W20260620 13:57:07.802461  9521 log.cc:927] Time spent T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.202s	user 0.000s	sys 0.005s
I20260620 13:57:07.822185  6027 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260620 13:57:07.823004  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:07.830796  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:07.831904  5955 raft_consensus.cc:2393] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 10: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:07.833070  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:07.834698  5957 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260620 13:57:07.811604  9445 consensus_meta.cc:287] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.000s
I20260620 13:57:07.839164  5953 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:07.821168  9191 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:07.705065  9363 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:07.840698  9366 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:07.853423  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:07.862264  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 264823us
I20260620 13:57:07.841391  9182 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:07.852859  9506 consensus_meta.cc:287] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.747s	user 0.012s	sys 0.000s
I20260620 13:57:07.851466  9421 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:07.891428  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 196845us
I20260620 13:57:07.861922  9445 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:07.853211  9191 raft_consensus.cc:697] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:07.893059  5998 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:07.865566  9236 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:07.905190  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:07.892828  9498 log.cc:927] Time spent T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.906s	user 0.005s	sys 0.003s
I20260620 13:57:07.907608  5998 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:07.889688  9506 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12.
I20260620 13:57:07.912843  5998 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:07.905869  9502 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260620 13:57:07.919060  9425 consensus_meta.cc:287] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.003s
I20260620 13:57:07.919529  9425 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:07.923758  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:07.932402  5884 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260620 13:57:07.938006  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:07.938210  5881 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260620 13:57:07.942277  5924 leader_election.cc:400] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12.
I20260620 13:57:07.921731  9425 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:07.947681  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:07.929955  9504 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:07.932261  9317 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:07.952021  6586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 862) took 1605 ms. Trace:
W20260620 13:57:07.956641  9528 log.cc:927] Time spent T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260620 13:57:07.958639  9534 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260620 13:57:07.943924  9445 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:07.959512  9293 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:07.959591  9445 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:07.892570  9536 raft_consensus.cc:2955] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:57:07.952669  6586 rpcz_store.cc:276] 0620 13:57:06.346411 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:06.386426 (+ 40015us) service_pool.cc:224] Handling call
0620 13:57:06.386742 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:06.514183 (+127441us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:06.514214 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:06.517180 (+  2966us) log.cc:844] Serialized 26 byte log entry
0620 13:57:06.784294 (+267114us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:06.784350 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:06.784438 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:07.719609 (+935171us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:07.948365 (+228756us) raft_consensus.cc:1685] finished
0620 13:57:07.948400 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:07.951921 (+  3521us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":216093,"raft.queue_time_us":67324,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":60311,"spinlock_wait_cycles":3355008,"thread_start_us":152029,"threads_started":1,"wal-append.queue_time_us":395955}
I20260620 13:57:07.945724  9541 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:07.967581  9541 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:07.968700  5998 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:07.969587  9537 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:07.969657  9526 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:07.975613  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:07.977833  6030 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260620 13:57:07.978080  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:07.982648  6032 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:07.945472  9462 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:07.988688  5998 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:57:07.983058  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 116222us
I20260620 13:57:07.949074  9546 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:07.997403  9441 consensus_meta.cc:287] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.000s
I20260620 13:57:07.995800  5848 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:07.999778  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:08.000943  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 57386.4us
I20260620 13:57:08.004522  6028 raft_consensus.cc:2393] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:08.001863  9538 consensus_queue.cc:1048] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260620 13:57:07.982445  9468 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:07.996647  9525 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:07.949221  9191 consensus_queue.cc:237] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.029726  9468 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.032249  9468 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:08.032135  9518 consensus_queue.cc:1059] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:57:08.000509  9504 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:08.036974  5848 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:08.066731  5848 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:08.000653  9462 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:08.034566  9533 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:08.079134  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:08.063972  9421 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:08.084092  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:08.060238  9504 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:08.090494  9504 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:08.091487  9362 raft_consensus.cc:3055] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:57:08.091902  9362 raft_consensus.cc:740] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:08.095469  9545 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election won for term 9
W20260620 13:57:08.095932  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:08.096261  9545 raft_consensus.cc:697] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:08.097136  9545 consensus_queue.cc:237] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:08.012491  9441 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.087342  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:08.083163  9147 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260620 13:57:08.076193  9547 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:08.088179  9421 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:08.084549  5950 raft_consensus.cc:1240] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: []
W20260620 13:57:08.077414  9535 log.cc:927] Time spent T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260620 13:57:08.086024  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:08.008682  9546 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.104190  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:08.077656  9293 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:08.108927  5951 raft_consensus.cc:2368] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12.
I20260620 13:57:08.109652  9533 consensus_queue.cc:1059] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260620 13:57:08.069268  9525 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260620 13:57:08.105309  9542 consensus_queue.cc:1059] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260620 13:57:08.071884  9538 consensus_queue.cc:1059] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260620 13:57:08.105448  9421 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:08.118835  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:08.071552  9390 consensus_queue.cc:1059] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260620 13:57:08.101073  9455 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:08.123471  9531 consensus_queue.cc:1059] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260620 13:57:08.117353  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:08.222852  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:08.224203  6031 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 8: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:08.225503  6032 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: [8.8-11.9]
I20260620 13:57:08.228508  5951 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260620 13:57:08.126376  9538 raft_consensus.cc:3055] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:08.127200  9533 consensus_queue.cc:1243] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 663684cf4ae54c929bf8240ca0b63a47 log is divergent from this leader: its last log entry 8.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260620 13:57:08.120599  9293 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.231858  9455 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:08.232049  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 237721us
I20260620 13:57:08.256081  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:08.307801  6027 raft_consensus.cc:2410] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260620 13:57:08.270653  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:08.233421  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:08.237581  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:08.276981  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:08.318738  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:08.332612  9548 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:08.333249  9548 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.249828  9526 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:08.249347  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:08.265367  9507 consensus_meta.cc:287] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.641s	user 0.002s	sys 0.010s
I20260620 13:57:08.335621  9542 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:08.340785  9455 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:08.354087  9462 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:08.359020  9469 consensus_meta.cc:287] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.953s	user 0.012s	sys 0.002s
I20260620 13:57:08.364255  9469 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:08.365677  9546 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:08.238096  9538 raft_consensus.cc:740] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:57:08.368219  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:08.368011  9538 consensus_queue.cc:260] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:08.369319  9538 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:08.370596  6032 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:08.338681  6030 raft_consensus.cc:2393] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:08.299635  9304 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:08.315790  9182 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:57:08.369341  9553 log.cc:927] Time spent T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260620 13:57:08.523125  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 206251us
I20260620 13:57:08.381090  9507 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:08.568359  9529 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:08.569197  9529 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:08.573383  9552 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260620 13:57:08.579155  5879 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260620 13:57:08.600293  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:08.601279  5956 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
W20260620 13:57:08.518350  9473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.001s	sys 0.012s
I20260620 13:57:08.536278  9509 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:08.623989  5848 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:08.536984  9304 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.630064  5848 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:08.601673  9548 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:08.551910  9182 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.608912  9507 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:08.605093  9441 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:08.661475  5848 leader_election.cc:400] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12.
I20260620 13:57:08.662017  5848 leader_election.cc:403] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260620 13:57:08.660332  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 353037us
I20260620 13:57:08.663938  5998 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:57:08.669625  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:08.609624  9473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.001s	sys 0.012s
I20260620 13:57:08.678032  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:57:08.638199  9533 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:57:08.631219  9547 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:08.622563  9509 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:08.658246  9548 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:08.657743  9469 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:08.674057  9565 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:08.673210  9236 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:08.739367  9236 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.741578  9236 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:08.745976  9536 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.782s	user 0.007s	sys 0.003s
I20260620 13:57:08.725955  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:08.748260  9304 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:08.748816  9293 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:08.675799  9455 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:08.687757  9529 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:08.735435  9556 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:08.736312  9564 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:08.738454  9366 consensus_meta.cc:287] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.876s	user 0.010s	sys 0.000s
I20260620 13:57:08.748871  5881 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:08.677034  9473 raft_consensus.cc:697] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:08.723724  9298 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:08.688817  9537 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260620 13:57:08.742868  9317 consensus_meta.cc:287] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.761s	user 0.008s	sys 0.000s
I20260620 13:57:08.690215  9441 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:08.660941  9507 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:08.672394  9546 consensus_queue.cc:1059] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260620 13:57:08.752636  9502 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:08.713603  9561 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12.
I20260620 13:57:08.757030  9531 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:08.764829  9317 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:57:08.781808  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 101794us
W20260620 13:57:08.762917  9550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.060s	sys 0.098s
I20260620 13:57:08.715463  9547 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.758630  9537 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:08.786039  5848 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:08.787842  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:08.726890  9469 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.778815  9191 raft_consensus.cc:3055] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:08.797277  6026 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:08.758332  9455 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:08.788300  9550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.060s	sys 0.098s
I20260620 13:57:08.763765  9298 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.879005  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:08.794553  9537 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:08.881939  5998 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:08.773769  9441 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:08.883729  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 86904.2us
I20260620 13:57:08.897727  5848 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:08.816797  9533 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:57:08.886068  9569 consensus_queue.cc:1059] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:57:08.783842  9502 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.765223  9565 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:08.905527  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:08.905963  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:08.888556  9507 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:08.796083  9191 raft_consensus.cc:740] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:08.893184  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:08.911304  5881 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:08.883968  9317 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:08.895494  9182 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:08.817008  9236 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:08.897908  6586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:08.885360  9529 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:08.894726  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:08.886488  9509 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:08.760733  9564 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.878423  9366 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:08.842317  9536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46746 (request call id 14) took 9205 ms. Trace:
I20260620 13:57:08.910151  5956 raft_consensus.cc:2410] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260620 13:57:08.765051  9556 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:08.882607  9277 raft_consensus.cc:3055] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:08.921137  6586 raft_consensus.cc:606] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
W20260620 13:57:08.906751  9504 consensus_meta.cc:287] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.816s	user 0.012s	sys 0.000s
I20260620 13:57:08.903680  9546 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:08.914115  9317 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:08.919721  9367 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:08.941412  9574 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:08.789006  9531 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.943840  6586 raft_consensus.cc:614] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260620 13:57:08.914835  9542 consensus_meta.cc:287] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.005s
I20260620 13:57:08.910351  9304 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:08.922411  9569 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:08.945197  9366 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:08.936990  9507 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:08.961254  9507 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:08.962466  9445 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:08.963236  9507 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:08.963953  9506 raft_consensus.cc:3055] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:08.880672  9473 consensus_queue.cc:237] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.968447  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:08.969570  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:08.969494  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:08.964401  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 64023.1us
I20260620 13:57:08.971865  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:08.970599  9506 raft_consensus.cc:740] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:08.957751  9317 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:08.951367  9421 consensus_meta.cc:287] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.720s	user 0.007s	sys 0.004s
I20260620 13:57:09.013321  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:09.014075  6030 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:09.011780  6586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:09.015710  6586 raft_consensus.cc:606] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:09.016120  6586 raft_consensus.cc:614] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:08.990276  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:08.958451  9546 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:08.993517  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:09.044168  6027 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:08.947685  9441 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:08.942116  9236 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.946329  9277 raft_consensus.cc:740] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:08.970788  9574 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.949577  9191 consensus_queue.cc:260] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:09.053002  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 62828.3us
I20260620 13:57:08.995959  9506 consensus_queue.cc:260] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:08.965672  9304 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:08.999629  9445 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:09.004493  5883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2563) took 1486 ms. Trace:
I20260620 13:57:09.058514  5883 rpcz_store.cc:276] 0620 13:57:07.518132 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:07.521262 (+  3130us) service_pool.cc:224] Handling call
0620 13:57:07.977163 (+455901us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:07.977322 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:07.977345 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:07.977382 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:57:07.977410 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:07.977484 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:09.004336 (+1026852us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54000c53d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:09.004424 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1047577984}
I20260620 13:57:09.046207  9546 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:09.068136  8379 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:09.068733  8379 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:09.069617  5882 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260620 13:57:09.006163  9502 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:09.007304  9469 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:09.008275  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2254) took 1212 ms. Trace:
I20260620 13:57:09.007763  9317 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:09.025110  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:08.948570  9298 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:09.036051  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:09.103477  5881 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:09.041344  9561 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:09.103813  6578 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:57:09.104180  9561 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:09.106613  9561 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:09.042016  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:09.107453  9455 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:09.107769  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:09.108400  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:09.108817  9572 log.cc:927] Time spent T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260620 13:57:09.108919  9577 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:09.109565  9577 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:09.110363  9531 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:09.111060  9576 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:09.111690  9577 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:09.043010  6586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:09.112360  6586 raft_consensus.cc:606] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:08.986277  9569 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:08.964255  9565 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:09.123664  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 49657us
I20260620 13:57:08.946637  9504 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:08.988859  9367 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:09.049060  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:09.134802  5881 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
W20260620 13:57:09.135514  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 86532.6us
I20260620 13:57:08.987584  9571 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:09.054958  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:09.054112  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:09.004961  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:09.011854  9547 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:09.062260  9277 consensus_queue.cc:260] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:09.063861  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:09.064946  9236 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:09.066702  9304 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:09.054822  9507 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:09.071614  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:09.046698  9573 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:09.073661  6582 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:09.074463  6025 rpcz_store.cc:276] 0620 13:57:07.795748 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:07.795875 (+   127us) service_pool.cc:224] Handling call
0620 13:57:07.796207 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:07.841225 (+ 45018us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:07.841257 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:07.841302 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:07.841339 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:09.008048 (+1166709us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b54000e60d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:09.008092 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:09.008216 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103016704}
I20260620 13:57:09.014925  9421 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:09.099936  8379 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:57:09.103478  9502 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:09.112754  6586 raft_consensus.cc:614] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:08.965286  9542 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:08.943311  9536 rpcz_store.cc:276] 0620 13:56:59.586950 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:56:59.587130 (+   180us) service_pool.cc:224] Handling call
0620 13:56:59.603083 (+ 15953us) log.cc:844] Serialized 506 byte log entry
0620 13:57:08.791941 (+9188858us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10744,"raft.queue_time_us":29017,"raft.run_cpu_time_us":2700,"raft.run_wall_time_us":2709,"thread_start_us":87615,"threads_started":1,"wal-append.queue_time_us":115933,"wal-append.run_cpu_time_us":2478,"wal-append.run_wall_time_us":1017613}
I20260620 13:57:09.111608  9576 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:09.044760  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:09.126736  6578 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:57:09.138374  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:09.140842  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:09.141393  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:09.141598  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:09.096940  9191 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:09.141909  9565 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:09.142328  9506 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:09.134722  9538 consensus_meta.cc:287] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.765s	user 0.013s	sys 0.000s
I20260620 13:57:09.145396  9469 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:57:09.146103  9470 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:57:09.148262  6031 raft_consensus.cc:2393] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:09.069869  9445 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:09.113076  9091 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260620 13:57:09.149555  5950 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260620 13:57:09.953382  5879 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:09.953836  9435 raft_consensus.cc:3055] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:09.954371  9435 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:09.954523  9504 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:09.179028  9390 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:09.955379  9435 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:09.956130  9390 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:09.956559  5881 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:09.958343  9390 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:09.958429  9573 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:09.985426  9421 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:09.960738  9362 consensus_queue.cc:260] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:09.179013  9367 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:09.962100  9518 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:09.406941  9539 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:10.093650  9539 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.097002  9539 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:09.733574  9580 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:09.963181  9532 raft_consensus.cc:3055] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:10.107335  9532 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:09.963367  9502 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:09.802646  9455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.005s	sys 0.005s
I20260620 13:57:09.965130  9445 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:09.211310  9571 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:09.543635  9543 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:10.142907  9543 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:10.147051  9502 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:10.129503  9455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.005s	sys 0.007s
I20260620 13:57:10.108512  9532 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.149590  9532 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:10.107342  9580 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:09.967931  9565 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
W20260620 13:57:09.811393  6550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.005s	sys 0.005s
I20260620 13:57:09.231294  6033 raft_consensus.cc:1240] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:09.830847  9317 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:09.934136  9546 consensus_meta.cc:287] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.866s	user 0.009s	sys 0.000s
I20260620 13:57:10.124572  9588 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:09.179908  9533 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:09.962489  9574 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:09.458158  9411 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:09.373910  9577 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:09.861033  9537 consensus_meta.cc:287] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.959s	user 0.010s	sys 0.000s
I20260620 13:57:09.972366  6585 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:09.458844  9298 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:09.974327  9576 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:09.975423  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 837076us
I20260620 13:57:09.847501  9569 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:09.520108  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 382411us
I20260620 13:57:09.179813  9561 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:09.955408  9504 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:57:09.959739  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:09.956664  9435 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:09.373682  9134 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:09.230147  9564 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.071877  9425 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:57:10.090610  9362 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:10.092581  9367 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:10.106077  9518 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.192965  9455 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:09.543408  9570 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:09.974833  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:09.225220  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 87551.3us
W20260620 13:57:09.743475  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:10.000694  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 936837us
W20260620 13:57:09.968372  5956 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.003s	sys 0.024s
I20260620 13:57:10.445217  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1817) took 1296 ms. Trace:
I20260620 13:57:10.457108  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2562) took 2199 ms. Trace:
I20260620 13:57:10.405238  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1627) took 1367 ms. Trace:
I20260620 13:57:10.451557  5953 raft_consensus.cc:1275] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260620 13:57:10.508783  6033 rpcz_store.cc:276] 0620 13:57:08.257576 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:08.262704 (+  5128us) service_pool.cc:224] Handling call
0620 13:57:08.262943 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:10.192754 (+1929811us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:10.456334 (+263580us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b540037c3d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:10.456795 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2212995328}
I20260620 13:57:10.515132  9561 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:10.516003  9561 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:10.509249  5882 rpcz_store.cc:276] 0620 13:57:09.037150 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:09.037300 (+   150us) service_pool.cc:224] Handling call
0620 13:57:09.037727 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:09.069996 (+ 32269us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:10.404251 (+1334255us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b540030e8d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:10.404855 (+   604us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72578944}
I20260620 13:57:10.519796  9574 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:10.406334  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:10.424817  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:10.519896  9532 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:10.578616  9533 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:10.274017  6579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.008s	sys 0.007s
W20260620 13:57:10.580039  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:10.580544  6579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.008s	sys 0.023s
I20260620 13:57:10.582222  9543 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:10.515200  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1818) took 1366 ms. Trace:
I20260620 13:57:10.583328  5953 rpcz_store.cc:276] 0620 13:57:09.149217 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:09.149375 (+   158us) service_pool.cc:224] Handling call
0620 13:57:10.429660 (+1280285us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d36ee 000000000036f859 00007f0fe474b8e0 00007f0fe48147c4 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:57:10.430078 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:10.514712 (+ 84634us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:10.515086 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65377792}
I20260620 13:57:10.587045  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:10.584175  9539 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:10.588754  9390 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:10.589258  9539 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:10.589649  9390 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.579752  9532 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.508638  5957 rpcz_store.cc:276] 0620 13:57:09.148953 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:09.149744 (+   791us) service_pool.cc:224] Handling call
0620 13:57:10.443556 (+1293812us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:57:10.444047 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:10.444498 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:10.444553 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:10.444626 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:10.444686 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:10.444794 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:10.444976 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642358528}
I20260620 13:57:10.451918  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1819) took 1302 ms. Trace:
I20260620 13:57:10.582762  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 940) took 1511 ms. Trace:
I20260620 13:57:10.587239  9574 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.514946  9455 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:10.563961  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:10.446925  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1822) took 1296 ms. Trace:
W20260620 13:57:10.441891  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:10.563340  5956 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.003s	sys 0.042s
I20260620 13:57:10.473304  9194 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:10.592017  5952 rpcz_store.cc:276] 0620 13:57:09.149469 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:09.151275 (+  1806us) service_pool.cc:224] Handling call
0620 13:57:10.450282 (+1299007us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:57:10.450742 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:10.451302 (+   560us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:10.451341 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:10.451409 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:57:10.451464 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:10.451527 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:10.451698 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673648384}
I20260620 13:57:10.625298  9194 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:10.626380  9502 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:10.627674  9539 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:10.628407  9194 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:10.628947  9573 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.629767  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1815) took 1481 ms. Trace:
I20260620 13:57:10.630261  5956 rpcz_store.cc:276] 0620 13:57:09.148394 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:09.148636 (+   242us) service_pool.cc:224] Handling call
0620 13:57:09.148913 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:09.149099 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 8
0620 13:57:09.460612 (+311513us) log.cc:844] Serialized 14 byte log entry
0620 13:57:10.629202 (+1168590us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:10.629301 (+    99us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:10.629399 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:10.629479 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:10.629696 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":957900,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":627,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":229,"thread_start_us":1430364,"threads_started":2,"wal-append.queue_time_us":631587}
I20260620 13:57:10.632947  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1825) took 1474 ms. Trace:
I20260620 13:57:10.633656  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1826) took 1475 ms. Trace:
I20260620 13:57:10.634009  9502 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.635492  9425 raft_consensus.cc:697] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:10.636945  9390 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.637226  9425 consensus_queue.cc:237] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.611655  9504 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:10.630475  9577 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.640275  9504 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:10.640658  9577 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.643651  9134 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.650050  9569 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:10.633409  5952 rpcz_store.cc:276] 0620 13:57:09.158446 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:10.631494 (+1473048us) service_pool.cc:224] Handling call
0620 13:57:10.632178 (+   684us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:10.632522 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:10.632554 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:10.632648 (+    94us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:10.632687 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:10.632750 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:10.632862 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:10.652755  9580 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.634124  5956 rpcz_store.cc:276] 0620 13:57:09.158726 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:10.632611 (+1473885us) service_pool.cc:224] Handling call
0620 13:57:10.633034 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:10.633342 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:10.633365 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:10.633421 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:10.633448 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:10.633496 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:10.633585 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:10.651065  9569 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.199636  9546 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.651173  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:10.617400  5959 rpcz_store.cc:276] 0620 13:57:09.150466 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:09.150617 (+   151us) service_pool.cc:224] Handling call
0620 13:57:10.445639 (+1295022us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:57:10.446070 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:10.446454 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:10.446479 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:10.446530 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:10.446555 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:10.446616 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:10.446759 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1625455360}
I20260620 13:57:10.592268  6579 rpcz_store.cc:276] 0620 13:57:09.071367 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:09.071518 (+   151us) service_pool.cc:224] Handling call
0620 13:57:09.072083 (+   565us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:09.072326 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 8
0620 13:57:09.419883 (+347557us) log.cc:844] Serialized 14 byte log entry
0620 13:57:10.581904 (+1162021us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:10.582044 (+   140us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:10.582182 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:10.582313 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:10.582582 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":997432,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":412,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":314,"thread_start_us":1508594,"threads_started":2}
W20260620 13:57:09.704223  5884 consensus_meta.cc:287] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260620 13:57:10.576939  9518 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.679224  5953 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:10.653664  9580 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:10.702656  9580 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.706090  9580 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.699594  5954 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:10.700240  9504 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:10.563961  9411 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.677811  9574 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:10.714922  9194 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:10.658744  9536 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:10.638173  9502 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.717669  5884 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:10.664877  9455 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:10.676033  9593 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:10.214989  9565 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:10.725806  5954 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1823) took 1561 ms (client timeout 1548 ms). Trace:
I20260620 13:57:10.575794  9570 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:10.722522  5953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1827) took 1483 ms (client timeout 1589 ms). Trace:
W20260620 13:57:10.731779  5953 rpcz_store.cc:269] 0620 13:57:09.214994 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:10.586423 (+1371429us) service_pool.cc:224] Handling call
0620 13:57:10.698463 (+112040us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:10.724211  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1828) took 1403 ms. Trace:
I20260620 13:57:10.732630  5957 rpcz_store.cc:276] 0620 13:57:09.318894 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:10.648915 (+1330021us) service_pool.cc:224] Handling call
0620 13:57:10.722399 (+ 73484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:10.219480  9571 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.735311  9194 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.728454  9593 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.715605  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:10.565981  9298 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.728662  9363 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:57:10.729604  5954 rpcz_store.cc:269] 0620 13:57:09.150811 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:09.150947 (+   136us) service_pool.cc:224] Handling call
0620 13:57:10.424254 (+1273307us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:57:10.712205 (+287951us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71977856}
I20260620 13:57:10.742013  6033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:57:10.747891  9503 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:10.706920  9366 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:10.748283  6033 raft_consensus.cc:606] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:10.762465  6033 raft_consensus.cc:614] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:10.519814  9537 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:10.753856  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:10.755336  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:10.756898  9194 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.757074  9540 raft_consensus.cc:3055] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:10.777194  9540 raft_consensus.cc:740] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:10.778026  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:10.757277  6032 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:10.748636  9411 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.779505  6579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:10.764371  9503 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:10.780282  6579 raft_consensus.cc:606] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:10.780836  6579 raft_consensus.cc:614] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:10.781718  9503 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:10.769006  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:10.769336  9533 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.770857  9569 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.772738  9546 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.721534  9536 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:10.786640  9536 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:10.788164  9538 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:10.789109  9567 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:10.788967  9538 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:10.776551  6024 raft_consensus.cc:2393] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 2: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:10.724097  9504 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:10.782723  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260620 13:57:10.764907  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:10.790053  9567 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.778574  9540 consensus_queue.cc:260] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.778999  5950 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
W20260620 13:57:10.801611  5950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1824) took 1648 ms (client timeout 1558 ms). Trace:
I20260620 13:57:10.805116  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1821) took 1562 ms. Trace:
I20260620 13:57:10.807320  6585 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:10.755084  9561 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.806869  5955 rpcz_store.cc:276] 0620 13:57:09.150151 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:09.151619 (+  1468us) service_pool.cc:224] Handling call
0620 13:57:10.434536 (+1282917us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d36ee 000000000036f859 00007f0fe474b8e0 00007f0fe48147c4 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:57:10.434880 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:10.435690 (+   810us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:57:10.436429 (+   739us) log.cc:844] Serialized 14 byte log entry
0620 13:57:10.712017 (+275588us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:10.712102 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:10.712176 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:10.712273 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:10.712457 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":60894,"prepare.run_cpu_time_us":150,"prepare.run_wall_time_us":55163,"raft.queue_time_us":18537,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":14945,"spinlock_wait_cycles":64835456,"thread_start_us":250796,"threads_started":1,"wal-append.queue_time_us":367438}
I20260620 13:57:10.810616  9411 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:10.809705  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1830) took 1389 ms. Trace:
I20260620 13:57:10.812053  5956 rpcz_store.cc:276] 0620 13:57:09.416437 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:10.691789 (+1275352us) service_pool.cc:224] Handling call
0620 13:57:10.729000 (+ 37211us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:10.805737 (+ 76737us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:10.805776 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:10.805827 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:57:10.805932 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:10.806016 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:10.806139 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:10.813620  9411 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:10.804567  5950 rpcz_store.cc:269] 0620 13:57:09.158000 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:09.953220 (+795220us) service_pool.cc:224] Handling call
0620 13:57:10.777666 (+824446us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:57:10.799620 (+ 21954us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984256896}
I20260620 13:57:10.816780  9469 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:10.817548  9469 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.818261  9411 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.818899  6025 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:10.820200  9504 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:10.801716  9546 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:10.820804  9298 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:10.821039  9546 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:10.821923  9567 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.822813  9298 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election won for term 9
W20260620 13:57:10.823073  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 111450us
I20260620 13:57:10.823434  9546 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:10.823841  9298 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:10.825999  9574 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:10.826750  5951 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:10.828459  9425 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:10.828502  9538 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:10.861624  9425 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.861729  9538 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:10.864626  9425 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.864460  9538 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:10.867202  9538 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:10.868085  5884 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1625) took 1843 ms (client timeout 1598 ms). Trace:
I20260620 13:57:10.868539  9538 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:10.868777  5884 rpcz_store.cc:269] 0620 13:57:09.024676 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:09.024831 (+   155us) service_pool.cc:224] Handling call
0620 13:57:10.867761 (+1842930us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540030e3d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:10.867945 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243868544}
I20260620 13:57:10.870162  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:10.871040  6024 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:10.854806  9556 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:10.873486  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1820) took 1723 ms. Trace:
I20260620 13:57:10.874562  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:10.875680  6024 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:10.873956  5958 rpcz_store.cc:276] 0620 13:57:09.149797 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:09.151529 (+  1732us) service_pool.cc:224] Handling call
0620 13:57:10.426886 (+1275357us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:57:10.427436 (+   550us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:10.747630 (+320194us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:10.747664 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:10.747745 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:10.747793 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:10.873105 (+125312us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b5400043dd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:10.873155 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:10.873284 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1358778368}
I20260620 13:57:10.878002  9593 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.878508  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:10.879032  9570 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.804333  9134 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.834131  9507 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:10.836424  9455 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:10.837749  9533 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:57:10.841495  9559 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 2.208s	user 0.013s	sys 0.013s
I20260620 13:57:10.842044  9541 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:10.842516  9569 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:10.900861  6027 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260620 13:57:10.901213  9569 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.904224  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:10.843266  9567 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:10.847131  5997 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.548s (SENT) [suppressed 9 similar messages]
I20260620 13:57:10.847923  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:10.844568  9546 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:10.849246  9277 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:10.905550  6033 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:10.908644  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:10.910087  5951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2160) took 2007 ms (client timeout 1910 ms). Trace:
I20260620 13:57:10.855743  9503 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:57:10.910593  5951 rpcz_store.cc:269] 0620 13:57:08.902714 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:08.902905 (+   191us) service_pool.cc:224] Handling call
0620 13:57:10.909866 (+2006961us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b5400251cd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:10.910015 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4414063872}
I20260620 13:57:10.911516  9503 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:10.856387  9575 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:10.859985  9298 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.879411  6025 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:10.887673  9605 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:10.888521  9414 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:10.888666  9533 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:10.884871  9507 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.891510  9469 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:10.892367  6028 raft_consensus.cc:1240] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:10.892758  5877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 750) took 2983 ms. Trace:
I20260620 13:57:10.893210  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:10.893934  9540 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:10.895795  9561 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.896636  9538 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:10.898546  9537 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:10.899713  9532 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.900005  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:10.957397  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:10.913280  9470 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:10.921877  9546 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:10.999537  9470 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.000685  9538 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:10.964021  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.002518  6024 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:11.002409  9414 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.003937  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:11.004266  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:11.004925  9414 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:11.005085  5956 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:10.964291  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:10.912943  9574 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:11.001763  6032 raft_consensus.cc:2393] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 8: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:11.007517  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:11.007288  9575 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:10.979861  9603 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:10.977926  9569 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:11.009835  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.010022  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:11.010547  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 163642us
I20260620 13:57:11.010910  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:11.011250  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 163484us
I20260620 13:57:11.007169  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1829) took 1600 ms. Trace:
I20260620 13:57:11.001739  9546 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:10.914788  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:10.966828  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:10.965694  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.021843  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:10.912670  6551 connection.cc:256] RPC call timeout handler was delayed by -1.3520301390000213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260620 13:57:11.042057  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:11.067885  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:11.052624  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:10.913736  9524 raft_consensus.cc:3055] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:11.041013  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.120253  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.112649  9537 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:11.122284  5955 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:11.134501  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.135664  5956 raft_consensus.cc:2410] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260620 13:57:11.044286  9277 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:11.116858  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:11.113410  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:57:11.113673  5952 rpcz_store.cc:276] 0620 13:57:09.396309 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:10.697582 (+1301273us) service_pool.cc:224] Handling call
0620 13:57:10.737708 (+ 40126us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:10.787613 (+ 49905us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:10.787649 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:10.787722 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:10.787758 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:10.996211 (+208453us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b5400250dd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:10.996279 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:10.996482 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114045184}
I20260620 13:57:11.001739  9470 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:11.126528  9574 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.127009  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:10.923880  9367 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:11.127422  9605 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.131319  9418 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:11.156008  9418 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.156845  9533 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:10.996728  5877 rpcz_store.cc:276] 0620 13:57:07.909160 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:07.909330 (+   170us) service_pool.cc:224] Handling call
0620 13:57:07.909645 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:08.011569 (+101924us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:08.011616 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:08.012356 (+   740us) log.cc:844] Serialized 26 byte log entry
0620 13:57:08.284935 (+272579us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:08.285249 (+   314us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:08.285733 (+   484us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:10.784325 (+2498592us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b2c0011c038. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fddaa9991 00007f0fddac47ca 00007f0fdf7f588d 00007f0fdf7fd36e 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22
0620 13:57:10.840599 (+ 56274us) spinlock_profiling.cc:243] Waited 6.68 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:10.892280 (+ 51681us) raft_consensus.cc:1685] finished
0620 13:57:10.892313 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:10.892516 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50343,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":988116608,"thread_start_us":321597,"threads_started":2,"wal-append.queue_time_us":494993}
I20260620 13:57:10.950359  9503 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:11.139801  5958 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:11.143342  5957 raft_consensus.cc:2410] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:57:11.040977  9561 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:11.122673  6030 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:11.162171  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.157720  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:11.151480  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:11.152460  9569 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:11.153126  9537 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.154863  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.162684  6027 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260620 13:57:11.165097  6027 pending_rounds.cc:85] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 5
I20260620 13:57:11.165630  6027 pending_rounds.cc:107] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260620 13:57:11.165745  9604 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:11.165987  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0445284420000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
W20260620 13:57:11.166446  5924 connection.cc:256] RPC call timeout handler was delayed by -1.012128442000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
I20260620 13:57:11.166476  9604 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:11.167508  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:11.168264  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.168462  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.169188  9604 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:11.169772  9604 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:11.169839  9532 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:11.170061  5879 raft_consensus.cc:1240] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:11.170459  9604 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.170601  9532 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.146756  9277 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.171563  9568 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:11.169313  5881 raft_consensus.cc:2410] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:57:11.172606  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:11.172873  5877 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:11.173746  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.125290  9524 raft_consensus.cc:740] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:11.169317  5884 raft_consensus.cc:2393] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:10.926179  9567 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.173938  9134 consensus_queue.cc:1059] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:57:11.174465  9545 consensus_queue.cc:1059] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.149s
I20260620 13:57:11.160789  6029 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:11.166013  6027 raft_consensus.cc:2889] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:11.174979  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:11.165126  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:11.163684  6033 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:11.170997  5875 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260620 13:57:11.206166  6028 raft_consensus.cc:2393] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:11.252233  5954 raft_consensus.cc:2393] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:11.243486  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:11.303799  6585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 939) took 2232 ms (client timeout 1853 ms). Trace:
W20260620 13:57:11.223068  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 63313.6us
W20260620 13:57:11.198599  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:11.301065  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.151567  9574 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:11.263509  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:11.329792  6585 rpcz_store.cc:269] 0620 13:57:09.070943 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:09.071306 (+   363us) service_pool.cc:224] Handling call
0620 13:57:11.303475 (+2232169us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b540048f654. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:11.303647 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35450112}
I20260620 13:57:11.343638  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:11.157972  9538 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:11.338532  9595 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:11.358338  5876 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
W20260620 13:57:11.364270  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 242857us
I20260620 13:57:11.362708  5950 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:11.364902  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:11.365195  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 190618us
I20260620 13:57:11.180827  9561 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:11.373731  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.199426  9603 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.385278  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.263458  9593 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260620 13:57:11.390661  9445 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:11.340412  9569 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.396178  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:11.391197  9445 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:11.405524  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.406731  9503 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:57:11.408401  9561 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:11.408618  9604 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:11.409294  5877 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:11.409807  9605 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:11.410692  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.411535  5877 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:11.411084  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:11.413841  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 106359us
I20260620 13:57:11.414022  9445 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:11.414928  5849 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:11.417596  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:11.418063  9595 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:11.418543  9595 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:11.420261  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:11.419868  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.423382  9605 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:11.423559  9603 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:11.423899  9605 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:11.423949  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.424484  9605 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:11.424790  5883 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:11.425482  9277 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:11.425812  5880 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:11.385331  9538 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:11.428049  9538 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:11.429814  9575 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:11.435230  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 120565us
I20260620 13:57:11.443207  9571 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:11.444010  9571 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:11.446473  9571 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:11.445104  5879 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:11.411814  9507 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:11.418777  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:11.445451  9363 raft_consensus.cc:3055] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:11.454654  9537 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:11.452772  5951 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
W20260620 13:57:11.456009  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 72370us
W20260620 13:57:11.466202  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:11.407231  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:57:11.469198  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:11.480629  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:11.481020  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:11.481734  5954 raft_consensus.cc:2410] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260620 13:57:11.492944  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.494139  5881 raft_consensus.cc:2410] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260620 13:57:11.495913  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 77195.7us
I20260620 13:57:11.447849  9418 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:11.460336  9363 raft_consensus.cc:740] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:57:11.504150  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 104431us
I20260620 13:57:11.505618  9537 consensus_queue.cc:1048] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:57:11.506040  9609 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:11.508630  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.510540  5876 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:11.502552  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.520645  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.521679  6028 raft_consensus.cc:2393] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 9: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:11.511443  9541 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260620 13:57:11.517903  5998 leader_election.cc:336] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 1.598s (SENT)
I20260620 13:57:11.511531  9609 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:11.524438  6027 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: []
W20260620 13:57:11.533805  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:11.536079  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.537664  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:11.544039  5883 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:11.537034  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:11.545339  5881 raft_consensus.cc:2393] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:11.528093  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:11.532590  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:11.551370  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.552482  6028 raft_consensus.cc:2410] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260620 13:57:11.551569  5880 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:11.394119  9568 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.527225  9533 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:11.557581  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.559564  6024 raft_consensus.cc:2393] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:11.559520  5876 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:57:11.523478  9532 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:11.565475  5878 raft_consensus.cc:1275] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260620 13:57:11.527891  9569 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:11.523856  9541 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:11.567625  5878 pending_rounds.cc:85] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 2
I20260620 13:57:11.566299  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.533607  9609 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:11.576439  5878 pending_rounds.cc:107] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260620 13:57:11.577346  6586 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: []
W20260620 13:57:11.578439  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:11.575636  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.527808  9363 consensus_queue.cc:260] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:11.575901  9541 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:11.576828  5878 raft_consensus.cc:2889] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:11.577121  9571 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:11.523047  9524 consensus_queue.cc:260] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:11.592495  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 92945.9us
I20260620 13:57:11.593538  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:11.594395  9595 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:11.595199  9363 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:11.596779  9595 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:11.599402  9571 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:11.604727  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.605180  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.606937  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.607805  5879 raft_consensus.cc:2393] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:11.606007  5875 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:11.612545  5883 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:11.614142  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.614331  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:11.615741  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:11.589334  9567 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:11.564774  9545 consensus_queue.cc:1059] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260620 13:57:11.619143  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:11.631033  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.632398  6028 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
I20260620 13:57:11.639459  5883 raft_consensus.cc:1240] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:11.619208  9445 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.640847  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.645767  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.648886  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:11.646664  5875 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:57:11.665997  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.667181  6028 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:11.676512  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.678318  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:11.679319  6580 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:11.679690  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.680728  6584 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:11.683696  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.684659  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.684932  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.685849  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.686784  5882 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:57:11.687005  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.687851  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.687933  5881 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:11.692786  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.655711  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:11.694867  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 53704.9us
I20260620 13:57:11.697090  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.697613  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.697841  9595 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:11.698455  6586 raft_consensus.cc:2393] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:11.699064  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.699553  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.700553  5884 raft_consensus.cc:2410] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260620 13:57:11.703442  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.698377  9595 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:11.707937  9602 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:11.708117  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.708433  9595 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:11.708846  6027 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:11.708649  9602 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.698470  6583 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:57:11.716557  9524 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:11.710955  9602 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:11.705471  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.719077  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.721915  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.719269  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.719278  9575 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260620 13:57:11.721777  9507 raft_consensus.cc:3055] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:11.727867  9507 raft_consensus.cc:740] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:11.729663  6025 raft_consensus.cc:2410] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260620 13:57:11.729120  9507 consensus_queue.cc:260] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:11.730644  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.734256  5876 raft_consensus.cc:2393] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:11.731387  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.736714  5884 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:57:11.731292  6025 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:11.737057  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.739223  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.739449  9541 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:11.741576  9541 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:11.742002  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.743134  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.734160  6033 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:11.743925  5876 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:57:11.741297  6580 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:11.747611  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.748744  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:11.748943  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:11.749557  6033 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 9: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:11.751566  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:11.755834  9533 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:11.756858  9533 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:11.758380  6586 raft_consensus.cc:1240] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:11.730834  9507 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:11.760167  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:11.738220  5875 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:11.764046  5882 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:11.745437  5924 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:11.770118  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.770648  5883 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:11.775362  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.776199  6585 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:11.778553  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:11.780920  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 85117.8us
I20260620 13:57:11.744824  9445 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:11.774075  5880 raft_consensus.cc:2955] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:57:11.780581  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.786721  6586 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:11.784547  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.787559  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.790513  6581 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:11.767710  9569 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:11.799445  9569 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:11.802271  9569 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:11.812191  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:11.814687  5882 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:11.788420  9541 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:11.825234  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.827194  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.831292  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.836548  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.837225  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.838413  5883 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:11.858348  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.858703  5779 catalog_manager.cc:5696] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:11.860608  5779 catalog_manager.cc:5696] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 3 to 6, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 6 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:11.862365  5779 catalog_manager.cc:5696] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:11.879716  6578 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:11.881907  6586 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:57:11.826928  9541 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:11.886133  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.880733  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:11.886848  5883 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:11.887840  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.837782  9545 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260620 13:57:11.887532  9541 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:11.899291  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 174093us
I20260620 13:57:11.894388  5779 catalog_manager.cc:5696] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 3 to 5, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 5 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:11.901772  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.906556  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:11.912228  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:11.914921  9567 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:11.915581  9567 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:11.915305  9561 consensus_queue.cc:1059] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:11.916078  9567 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:11.916857  9561 raft_consensus.cc:3055] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:11.917418  9561 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:11.930500  5849 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:11.944113  5882 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
W20260620 13:57:11.948952  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:11.953409  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:11.941830  5779 catalog_manager.cc:5696] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:11.943924  9445 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:57:11.955817  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 127754us
I20260620 13:57:11.959458  9613 ts_tablet_manager.cc:933] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:11.905821  9533 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:11.960721  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.961397  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.967783  6580 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:11.959308  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.980513  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.981321  6585 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:57:11.983570  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.977820  5779 catalog_manager.cc:5696] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 4 to 6, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 6 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:11.918645  9561 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:11.986253  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:11.991226  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.987458  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:11.970503  9418 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:57:11.994828  5778 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56624 (request call id 344) took 10998 ms. Trace:
W20260620 13:57:11.998311  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:12.001380  5849 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:11.976011  9569 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:12.015640  9569 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.000481  9418 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:11.966056  9593 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260620 13:57:11.990541  9602 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:12.010402  6586 raft_consensus.cc:3055] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:57:11.988844  9532 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:12.011474  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:12.012784  9561 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:12.019615  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.020012  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.053025  6578 raft_consensus.cc:2393] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:12.023926  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:12.034823  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:12.020354  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.039832  6586 raft_consensus.cc:740] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:57:12.054788  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 64495.1us
W20260620 13:57:12.057235  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:12.060186  6581 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:57:12.035609  9546 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260620 13:57:12.060642  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 80453.7us
I20260620 13:57:12.060640  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:12.064002  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:12.019093  9569 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:12.069048  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:12.064148  9363 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:12.035859  9602 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:12.024564  9418 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:57:12.074183  6586 consensus_queue.cc:260] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.060845  9546 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:12.062553  9533 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:12.072309  5779 catalog_manager.cc:5696] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 7 to 8, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 8 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:57:12.072711  9363 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:12.092667  6586 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:12.095685  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.100019  6585 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 2.
I20260620 13:57:12.077934  9602 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:12.106313  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.079094  9445 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:12.096582  5997 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:12.088768  9546 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:12.099293  9363 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:12.107966  9609 consensus_meta.cc:287] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.006s
I20260620 13:57:12.118340  6585 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
W20260620 13:57:12.122244  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:12.079545  9532 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:12.125226  5779 catalog_manager.cc:5696] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 4 to 5, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 5 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:12.143050  6585 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: []
W20260620 13:57:12.139094  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 137802us
W20260620 13:57:12.125212  9605 consensus_meta.cc:287] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.700s	user 0.012s	sys 0.006s
I20260620 13:57:12.119855  9575 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:12.100553  9533 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:12.150697  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 66115.1us
I20260620 13:57:12.125028  9568 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:12.154425  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:12.163507  5997 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:12.164630  5997 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:12.165709  9632 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:12.166162  9632 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:12.166541  9632 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:12.168134  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.168768  6582 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:12.169694  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.171083  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.171260  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.171435  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.171711  6582 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:12.173262  6584 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260620 13:57:12.174557  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.175422  6583 raft_consensus.cc:2393] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:11.998752  5778 rpcz_store.cc:276] 0620 13:57:00.824425 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:00.824699 (+   274us) service_pool.cc:224] Handling call
0620 13:57:01.269368 (+444669us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b540002b7d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf766470 00007f0fdf80531a 00007f0fe55baaac 00007f0fe56b90ae 00007f0fe3b7e4a4 00007f0fe3b7e432 00007f0fe3b7e361 00007f0fe3b7e2dc 00007f0fe3b7d592 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:11.818133 (+10548765us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:57:07.299831 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:57:07.404358 (+104527us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:57:07.404400 (+    42us) write_op.cc:435] Acquired schema lock
0620 13:57:07.404525 (+   125us) tablet.cc:662] Decoding operations
0620 13:57:07.698482 (+293957us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:57:07.705341 (+  6859us) write_op.cc:641] Partition lock acquired for write op
0620 13:57:07.709686 (+  4345us) tablet.cc:685] Acquiring locks for 14 operations
0620 13:57:07.973235 (+263549us) tablet.cc:701] Row locks acquired
0620 13:57:07.973257 (+    22us) write_op.cc:260] PREPARE: finished
0620 13:57:07.973395 (+   138us) write_op.cc:270] Start()
0620 13:57:07.973521 (+   126us) write_op.cc:276] Timestamp: P: 1781963827973350 usec, L: 0
0620 13:57:07.973539 (+    18us) op_driver.cc:348] REPLICATION: starting
0620 13:57:07.974209 (+   670us) log.cc:844] Serialized 5561 byte log entry
0620 13:57:08.937563 (+963354us) op_driver.cc:464] REPLICATION: finished
0620 13:57:09.107336 (+169773us) write_op.cc:301] APPLY: starting
0620 13:57:09.107463 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0620 13:57:09.107899 (+   436us) tablet.cc:1370] finished BulkCheckPresence
0620 13:57:09.108051 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:57:09.109583 (+  1532us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:57:09.109862 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0620 13:57:09.109912 (+    50us) write_op.cc:312] APPLY: finished
0620 13:57:09.110238 (+   326us) log.cc:844] Serialized 101 byte log entry
0620 13:57:09.110402 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:09.110572 (+   170us) write_op.cc:454] Released schema lock
0620 13:57:09.110630 (+    58us) write_op.cc:341] FINISH: Updating metrics
0620 13:57:09.110998 (+   368us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:09.111026 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":106031,"reported_tablets":37,"spinlock_wait_cycles":625206528,"child_traces":[["op",{"apply.queue_time_us":153748,"apply.run_cpu_time_us":3675,"apply.run_wall_time_us":3683,"num_ops":14,"prepare.queue_time_us":352817,"prepare.run_cpu_time_us":19192,"prepare.run_wall_time_us":738143,"raft.queue_time_us":777448,"raft.run_cpu_time_us":34118,"raft.run_wall_time_us":169632,"replication_time_us":934117,"thread_start_us":1083652,"threads_started":4,"wal-append.queue_time_us":42297,"wal-append.run_cpu_time_us":163943,"wal-append.run_wall_time_us":2111970}]]}
I20260620 13:57:12.181815  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:12.124645  9595 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:12.152160  5779 catalog_manager.cc:5696] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 6 to 8, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 8 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:57:12.190793  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:12.119289  9298 consensus_queue.cc:1059] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260620 13:57:12.152163  9569 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:12.148290  9575 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:12.134770  9609 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.201663  6586 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:57:12.219627  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:12.229641  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.231186  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:12.150417  9605 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.237802  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:12.221906  5779 catalog_manager.cc:5696] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 2 to 8, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 8 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:12.222275  9445 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:12.220705  9571 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:12.242364  5879 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 10: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:12.220570  9575 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:12.217854  9569 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:12.241334  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 56344.4us
W20260620 13:57:12.243366  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 78806us
I20260620 13:57:12.243789  5779 catalog_manager.cc:5696] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 4 to 6, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 6 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:12.252765  5779 catalog_manager.cc:5696] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 6 to 7, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 7 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:12.254179  5779 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 5 to 6, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 6 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:12.257530  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:12.258390  6029 raft_consensus.cc:2410] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260620 13:57:12.257795  5779 catalog_manager.cc:5696] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 2 to 8, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 8 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:12.260432  5779 catalog_manager.cc:5696] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 5 to 7, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 7 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:12.241217  9524 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:12.262913  5997 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:12.264056  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:12.264894  5882 raft_consensus.cc:1240] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260620 13:57:12.265942  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.266637  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.267234  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:12.270040  6586 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:12.270437  9532 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:12.271123  9609 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:12.246455  9445 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.273145  9445 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:12.273958  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.274595  6587 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:12.275542  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.276314  9533 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:12.276432  6581 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:12.277091  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.277454  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.278117  6581 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:12.278975  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.279414  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:12.279675  9625 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260620 13:57:12.280251  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:12.255411  9569 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:12.281302  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 43590us
I20260620 13:57:12.282021  9605 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:12.282720  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:12.282845  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:12.245676  9635 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:12.283524  9635 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:12.283914  9635 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:12.284013  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:12.267896  6585 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260620 13:57:12.286319  9619 log.cc:927] Time spent T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.182s	user 0.001s	sys 0.002s
I20260620 13:57:12.286938  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.249766  9134 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:12.288038  9134 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:12.288549  9134 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:12.289570  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:12.294390  6586 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:12.244479  9571 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:12.298667  5779 catalog_manager.cc:5696] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 3 to 7, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 7 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
W20260620 13:57:12.300433  9616 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.290s	user 0.003s	sys 0.000s
I20260620 13:57:12.297906  9445 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:12.304634  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.306804  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.311254  5924 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:12.305491  6582 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:12.303535  9445 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:12.268463  9524 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:12.318316  9445 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:12.318542  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.319326  5950 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:12.307672  9532 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:12.319873  9532 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:12.320237  9532 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:12.318543  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.325361  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.301705  9571 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:12.326236  5957 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 9: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:12.327291  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:12.327639  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.329886  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.330397  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.330612  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:12.331614  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.324649  9541 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.333482  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.334095  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:12.334280  6582 raft_consensus.cc:2376] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7. Re-sending same reply.
I20260620 13:57:12.335346  9418 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:12.337621  9418 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:12.338028  9595 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:12.335716  9541 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:12.343657  5998 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:12.302796  9634 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:12.332203  5959 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:57:12.349879  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:12.346786  9532 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:12.351785  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:12.356084  6030 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:12.322780  9524 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:12.325403  9568 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:57:12.356890  5779 catalog_manager.cc:5696] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 4 to 7, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 7 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:12.358835  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.359699  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:12.366829  6026 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:57:12.395368  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.396101  6578 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:12.396283  9532 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:12.397032  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.397781  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:12.398283  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.355748  9569 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:12.399678  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 56151.6us
I20260620 13:57:12.400671  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:12.401230  9632 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:12.401640  9569 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:12.401734  5998 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:12.403014  9613 tablet_copy_client.cc:323] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.195:41493
I20260620 13:57:12.358776  9546 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.405292  6027 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
W20260620 13:57:12.405941  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:12.349263  9634 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:12.407346  9503 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:12.407277  9537 consensus_queue.cc:1048] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:57:12.407778  9634 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:12.407850  9503 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:12.408345  9503 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:12.410195  9445 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:12.398356  5950 raft_consensus.cc:2376] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8. Re-sending same reply.
I20260620 13:57:12.399049  5959 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:12.417367  9617 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:12.419709  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.419853  6030 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:12.420354  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:12.420552  6586 raft_consensus.cc:2393] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:12.421707  9445 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:12.423206  9617 raft_consensus.cc:697] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:12.423552  9575 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:12.424113  9617 consensus_queue.cc:237] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:12.424817  6029 raft_consensus.cc:1240] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:12.426009  9575 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:12.431423  6026 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:57:12.432958  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.355746  9541 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:12.435599  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:12.440498  5998 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:12.413131  9568 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:12.405355  9546 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:12.446489  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 179012us
I20260620 13:57:12.446532  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.445364  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:12.452425  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.453162  6578 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:12.447659  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:12.457839  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.458774  5950 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:12.439877  9503 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.455922  5849 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:12.437974  9541 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:12.432251  9636 raft_consensus.cc:2764] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260620 13:57:12.428094  9363 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:12.454814  9568 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:57:12.457043  9638 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:12.475729  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.477311  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:12.479554  9617 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:12.459981  9569 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:12.483788  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.484727  5950 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:12.493499  5953 raft_consensus.cc:2393] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 10: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:12.492956  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:12.470270  9507 consensus_meta.cc:287] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.699s	user 0.002s	sys 0.011s
I20260620 13:57:12.471736  9541 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:12.504712  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.506836  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.502276  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.511322  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.515590  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:12.516580  5959 raft_consensus.cc:2368] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9.
W20260620 13:57:12.518225  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:12.518548  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:12.517472  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.519810  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.472328  9546 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:57:12.481866  9537 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:12.523634  5957 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:57:12.525243  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 79964.1us
I20260620 13:57:12.526022  5849 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:12.527360  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:12.531869  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:12.542042  9418 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:12.542129  9503 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:12.543802  9418 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:12.544507  9418 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:12.544530  5998 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:12.546449  9503 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:12.542322  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.542935  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.542279  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.548709  5956 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:12.548133  5953 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:12.547955  5998 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:12.497807  9617 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:12.547011  9503 raft_consensus.cc:697] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:12.551287  5998 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:12.467671  9602 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.557817  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.557230  5957 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:12.559190  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:12.508246  9632 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:12.542634  9537 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:12.523604  9569 raft_consensus.cc:697] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:12.542546  9546 raft_consensus.cc:697] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:12.558857  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.567823  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.498206  9638 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.561290  9575 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:12.560388  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.584781  5953 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:12.586144  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.579018  5957 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:12.557255  9640 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:12.573860  5998 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:12.581174  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:12.556560  9617 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:12.588020  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.593582  5957 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 3.
W20260620 13:57:12.595830  9618 log.cc:927] Time spent T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.652s	user 0.005s	sys 0.032s
I20260620 13:57:12.596238  9634 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:12.597512  6024 raft_consensus.cc:2393] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:12.598531  9634 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:12.569934  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.591514  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.555562  9363 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:12.594892  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.599748  5954 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:12.546451  9571 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.605057  6551 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:12.606034  9571 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:12.606325  9602 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:12.586931  5953 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:12.598939  9503 consensus_queue.cc:237] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:12.608211  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.608806  5953 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:12.609666  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.610566  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.579169  9537 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:12.604013  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.582221  9561 consensus_queue.cc:1059] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260620 13:57:12.617575  5954 raft_consensus.cc:2393] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 10: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:12.587963  9569 consensus_queue.cc:237] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.637964  5955 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
W20260620 13:57:12.611812  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 54877.9us
I20260620 13:57:12.620575  9571 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:12.592242  9640 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:12.623819  9134 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:12.627547  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 53869.8us
I20260620 13:57:12.629531  9637 raft_consensus.cc:3055] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:12.639928  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:12.663743  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:12.664969  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:12.665386  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:12.626479  9418 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:12.593621  9575 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:12.671564  5875 raft_consensus.cc:2393] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 9: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:57:12.675740  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:12.680296  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:12.692948  5878 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:57:12.642377  9571 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:12.699894  5882 raft_consensus.cc:2368] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9.
I20260620 13:57:12.710282  5959 raft_consensus.cc:2393] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:12.660825  9637 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:12.661355  9640 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:12.713557  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.716867  5953 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:12.678509  9575 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:12.685540  9630 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:12.721856  5956 raft_consensus.cc:1240] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:12.715241  5997 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:12.728844  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:12.728848  5997 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:12.729835  5955 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 9: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:12.712323  9571 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:12.729525  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 124571us
I20260620 13:57:12.732893  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:12.733474  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:12.734649  5954 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:12.733971  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:12.735145  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.735471  5959 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:12.740031  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:12.691819  9646 consensus_queue.cc:1059] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260620 13:57:12.756328  5997 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:12.739338  9567 consensus_meta.cc:287] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.823s	user 0.012s	sys 0.005s
I20260620 13:57:12.759838  9637 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.736912  9633 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:12.770484  5955 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260620 13:57:12.739955  9602 raft_consensus.cc:3055] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:12.792965  5957 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:12.797236  5956 raft_consensus.cc:1240] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:12.807675  5998 leader_election.cc:400] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9.
I20260620 13:57:12.808140  5998 leader_election.cc:403] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260620 13:57:12.808945  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:12.810663  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:12.814108  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 54892.6us
I20260620 13:57:12.816530  5956 raft_consensus.cc:1240] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:12.818382  5953 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260620 13:57:12.720839  9546 consensus_queue.cc:237] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:12.762703  9632 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260620 13:57:12.779876  9602 raft_consensus.cc:740] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:12.839833  5954 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:12.845623  5959 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:12.805001  9636 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260620 13:57:12.840004  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 100456us
I20260620 13:57:12.841228  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.847085  5953 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
W20260620 13:57:12.842590  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 86394.4us
I20260620 13:57:12.849028  5997 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:12.849992  9614 log.cc:927] Time spent T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.802s	user 0.005s	sys 0.004s
I20260620 13:57:12.851727  5880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1638) took 1271 ms. Trace:
I20260620 13:57:12.852396  5880 rpcz_store.cc:276] 0620 13:57:11.580061 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:11.580201 (+   140us) service_pool.cc:224] Handling call
0620 13:57:11.588529 (+  8328us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:11.591524 (+  2995us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:11.591555 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:11.592915 (+  1360us) log.cc:844] Serialized 532 byte log entry
0620 13:57:11.760931 (+168016us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:11.906399 (+145468us) log.cc:844] Serialized 14 byte log entry
0620 13:57:12.054461 (+148062us) log.cc:844] Serialized 14 byte log entry
0620 13:57:12.149869 (+ 95408us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:12.149986 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:12.557484 (+407498us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:12.851313 (+293829us) raft_consensus.cc:1685] finished
0620 13:57:12.851369 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:12.851632 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26456,"prepare.queue_time_us":193172,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":80,"raft.queue_time_us":111899,"raft.run_cpu_time_us":629,"raft.run_wall_time_us":72534,"spinlock_wait_cycles":120803584,"thread_start_us":355972,"threads_started":3,"wal-append.queue_time_us":293083}
I20260620 13:57:12.855463  9650 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:12.856355  9657 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:12.859211  9134 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:12.875531  9602 consensus_queue.cc:260] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:12.876397  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.876989  9602 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:12.878082  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:12.879477  9638 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:12.879673  5956 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:12.880808  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:12.881212  6026 raft_consensus.cc:1240] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:12.881575  6029 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 14: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:12.882381  9653 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260620 13:57:12.779521  9524 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:12.777555  9567 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.894845  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:12.894798  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 45796.2us
I20260620 13:57:12.895985  5882 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:57:12.896443  6551 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:12.890642  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 62039.4us
W20260620 13:57:12.847473  9635 consensus_meta.cc:287] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.003s
W20260620 13:57:12.897794  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:12.897106  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 156460us
I20260620 13:57:12.901125  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:12.901712  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:12.902971  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:12.904089  6031 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
I20260620 13:57:12.886937  9646 raft_consensus.cc:3055] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:12.909322  5958 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260620 13:57:12.909554  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:12.847856  9636 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:12.910403  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:12.904166  5997 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:12.903612  5878 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:57:12.915799  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:12.918605  9652 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260620 13:57:12.897353  9541 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.918737  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:12.930891  5877 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:12.919354  9642 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:12.919588  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:12.920437  9656 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:57:12.923367  9637 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:12.909149  9646 raft_consensus.cc:740] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:12.926651  5848 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:12.932338  5876 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:12.933115  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:12.933480  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:12.938038  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:12.938819  6030 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 9: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:12.939188  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:12.939343  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:12.937139  5882 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:12.916810  9636 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:12.942644  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:12.943506  5951 raft_consensus.cc:2393] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:12.942134  6025 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:12.902001  9617 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.952423  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:12.960156  5878 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:12.952160  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:12.953769  5848 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:12.908357  9635 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.964334  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:12.953326  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:12.967715  5882 raft_consensus.cc:2368] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9.
W20260620 13:57:12.971007  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 74653.3us
I20260620 13:57:12.976935  5997 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:12.978186  9663 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:12.979391  9628 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:12.980187  9628 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:12.980538  9628 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:12.981768  9524 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:12.986239  9537 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:12.938499  9653 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260620 13:57:12.987591  9653 consensus_queue.cc:1243] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260620 13:57:12.988166  9567 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:12.989046  9628 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:12.990152  9635 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:12.991451  9632 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:12.979225  9663 consensus_queue.cc:1059] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260620 13:57:12.991915  9632 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:12.992354  9632 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:12.992399  9663 raft_consensus.cc:3055] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:12.992887  9663 raft_consensus.cc:740] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:13.000600  5876 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:13.001613  5877 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:13.005189  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:12.995918  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 48525.4us
I20260620 13:57:13.006459  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:13.007364  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 53641.5us
I20260620 13:57:13.008410  5848 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:13.009259  6033 raft_consensus.cc:2368] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9.
I20260620 13:57:13.010227  6578 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 10: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:57:13.012430  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:13.019532  6032 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:13.017879  5848 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.033316  9533 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:57:13.034334  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:13.034654  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 43526.8us
I20260620 13:57:12.980548  9541 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:12.939472  9568 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:13.089299  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:12.993798  9663 consensus_queue.cc:260] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:13.163125  9642 raft_consensus.cc:697] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:13.287636  5880 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 3. Current term is 4. Ops: []
W20260620 13:57:13.288556  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:13.051276  9651 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:57:13.290616  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:13.291188  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.039078  9659 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:13.041250  9567 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:13.300397  9533 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:13.301462  5878 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:12.951177  9658 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:13.328691  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:13.368453  5950 raft_consensus.cc:2393] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 4: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:57:13.371076  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 80047.9us
W20260620 13:57:13.374737  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 356920us
I20260620 13:57:13.310124  9659 consensus_queue.cc:1243] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260620 13:57:13.371941  6552 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:13.375811  5848 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
W20260620 13:57:13.377125  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 442105us
I20260620 13:57:13.321002  9533 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:13.310109  9605 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:13.317447  9628 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:13.338088  9567 raft_consensus.cc:697] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:13.382426  6551 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:13.390404  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1843) took 1077 ms. Trace:
I20260620 13:57:13.415437  5958 rpcz_store.cc:276] 0620 13:57:12.313258 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:12.316418 (+  3160us) service_pool.cc:224] Handling call
0620 13:57:12.319471 (+  3053us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:12.909884 (+590413us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:13.390102 (+480218us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54002512d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:13.390320 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355860864}
I20260620 13:57:13.379439  9647 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:13.393594  9605 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:13.369320  9658 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:13.417213  9651 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:13.418002  9663 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:13.436147  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 53791us
I20260620 13:57:13.438062  6551 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:13.442000  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:13.425546  9561 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:57:13.381765  9669 consensus_queue.cc:1059] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
W20260620 13:57:13.444633  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 68939us
I20260620 13:57:13.445549  5848 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.430418  9653 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:13.432991  9605 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:13.447999  5848 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:13.450304  6551 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:13.435469  9651 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:13.436053  9537 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:13.453192  5848 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.437433  9617 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:13.459908  6551 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.446513  9541 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260620 13:57:13.450798  9630 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:13.445251  9561 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:13.478408  9675 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:13.479300  9568 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:13.480077  9664 log.cc:927] Time spent T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260620 13:57:13.479302  9675 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:13.455554  9651 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:13.467207  9659 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260620 13:57:13.467691  9637 consensus_meta.cc:287] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.009s
I20260620 13:57:13.467995  9567 consensus_queue.cc:237] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:13.470139  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:13.449254  9546 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:13.455437  9602 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:13.466009  5848 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.430866  9642 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:13.509668  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 43776.3us
I20260620 13:57:13.482319  9561 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:57:13.492945  9657 consensus_meta.cc:287] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.016s
I20260620 13:57:13.495551  9646 consensus_queue.cc:260] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:13.512032  9657 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9.
I20260620 13:57:13.512135  9546 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:13.512331  9646 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:13.514261  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:13.515336  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:13.515512  9568 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:13.515985  9568 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:13.516364  9617 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:13.516944  9617 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:13.518800  9617 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:13.520067  6032 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:57:13.521351  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:13.497318  9675 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:13.502207  6551 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.521970  6032 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:13.523897  9658 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:13.525718  6551 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.527187  6551 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.528107  9637 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:13.529043  9659 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260620 13:57:13.481401  9575 consensus_meta.cc:287] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.744s	user 0.006s	sys 0.018s
I20260620 13:57:13.500082  9636 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:13.491322  9650 consensus_meta.cc:287] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.016s
I20260620 13:57:13.510510  5848 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.493216  5884 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
W20260620 13:57:13.504019  9640 consensus_meta.cc:287] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.009s
I20260620 13:57:13.490586  9666 raft_consensus.cc:3055] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:13.530850  9666 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:13.530534  9640 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:13.531248  5848 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:13.532202  5848 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.533069  6025 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260620 13:57:13.532387  9546 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:13.534237  9546 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:13.534472  9640 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:13.534619  9546 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:13.529100  9637 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:13.505272  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:13.528483  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:13.515926  6031 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:13.535290  9650 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:13.564342  5883 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 10: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:13.516403  9568 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:13.536334  9636 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:13.532207  9666 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
W20260620 13:57:13.566860  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 185702us
W20260620 13:57:13.537839  9649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.010s	sys 0.009s
I20260620 13:57:13.538703  5848 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.508407  9298 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:13.539479  9675 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:13.540549  9575 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:13.540941  5998 leader_election.cc:336] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.548s (SENT)
I20260620 13:57:13.528517  6551 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.547871  9533 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:13.535286  6026 raft_consensus.cc:1240] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:13.509863  9602 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:13.510102  9661 log.cc:927] Time spent T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260620 13:57:13.500420  9632 consensus_meta.cc:287] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.011s
I20260620 13:57:13.502264  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:13.572902  9418 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:13.573406  9541 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:13.568146  5997 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:13.559998  9571 consensus_meta.cc:287] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.796s	user 0.009s	sys 0.011s
W20260620 13:57:13.586586  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 58312.1us
W20260620 13:57:13.651585  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 83489.7us
I20260620 13:57:13.564620  9546 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:13.652609  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:13.652714  5997 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:13.591550  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 219673us
I20260620 13:57:13.593776  9524 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:13.594431  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 53533.8us
I20260620 13:57:13.565320  9674 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:13.558697  6024 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:13.635223  9637 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:13.636168  9569 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260620 13:57:13.638599  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 110155us
W20260620 13:57:13.639180  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 100553us
W20260620 13:57:13.580636  9649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.010s	sys 0.009s
I20260620 13:57:13.645946  6028 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:13.635769  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:13.648500  6030 raft_consensus.cc:2393] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:13.649808  5875 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:13.655190  5998 leader_election.cc:336] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.558s (SENT)
I20260620 13:57:13.669997  5998 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:13.652009  9650 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:13.658885  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.648113  9602 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:13.682070  9655 log.cc:927] Time spent T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.381s	user 0.005s	sys 0.000s
W20260620 13:57:13.684934  5998 leader_election.cc:336] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.589s (SENT)
I20260620 13:57:13.685122  9681 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:13.685788  9681 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:13.686317  9681 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:13.667919  6551 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:13.637910  6031 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:13.666503  9541 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:13.674549  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:13.689329  5998 leader_election.cc:336] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.612s (SENT)
I20260620 13:57:13.657318  9561 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:13.675374  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:13.676339  5950 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260620 13:57:13.677230  5952 raft_consensus.cc:1275] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260620 13:57:13.677805  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:13.651576  9571 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:13.694387  5958 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:13.696069  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:13.665580  9671 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:13.703476  6551 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.703845  6033 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:13.663693  9524 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:13.705801  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 47039.4us
I20260620 13:57:13.701130  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1657) took 1039 ms. Trace:
I20260620 13:57:13.709769  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.656031  9632 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:13.706812  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:13.713261  6029 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:13.715431  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:13.695259  9636 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:13.694869  9650 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:13.707631  5879 rpcz_store.cc:276] 0620 13:57:12.662251 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:12.662528 (+   277us) service_pool.cc:224] Handling call
0620 13:57:12.682090 (+ 19562us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:12.682601 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:12.682645 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:12.700675 (+ 18030us) log.cc:844] Serialized 26 byte log entry
0620 13:57:12.795330 (+ 94655us) raft_consensus.cc:1645] Marking committed up to 2
0620 13:57:12.795383 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:12.795454 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:13.681376 (+885922us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:13.687209 (+  5833us) raft_consensus.cc:1685] finished
0620 13:57:13.687231 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:13.701050 (+ 13819us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8849,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":20035,"spinlock_wait_cycles":31916800,"thread_start_us":63837,"threads_started":1,"wal-append.queue_time_us":291615}
I20260620 13:57:13.712543  9637 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:13.738744  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:57:13.713862  9671 raft_consensus.cc:697] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:13.712808  9663 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:13.745345  5875 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
W20260620 13:57:13.761008  5998 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.941s (SENT)
I20260620 13:57:13.742605  5958 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:13.721657  9646 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:57:13.765641  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 130057us
I20260620 13:57:13.771718  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:13.772431  6580 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:57:13.772593  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 57218.1us
I20260620 13:57:13.772799  9691 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:13.774377  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:13.775990  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:13.776602  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.724002  9541 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:13.724401  9533 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:13.733475  9654 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:13.779253  9654 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:13.779642  9654 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:13.771202  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:13.731393  9680 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:13.778281  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:13.778223  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.736531  9524 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:13.782502  5849 leader_election.cc:336] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.530s (SENT)
I20260620 13:57:13.782512  6582 raft_consensus.cc:2376] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9. Re-sending same reply.
I20260620 13:57:13.782683  6585 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:13.783967  9533 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:13.785123  9533 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:13.785030  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:13.785786  9561 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:13.786247  6031 raft_consensus.cc:1275] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260620 13:57:13.787636  9575 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:13.790132  9533 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:13.784452  9632 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:13.791311  9571 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:13.766768  9630 consensus_queue.cc:1059] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260620 13:57:13.793215  9630 raft_consensus.cc:3055] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:13.793601  9630 raft_consensus.cc:740] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:13.794880  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:13.796092  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.796506  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.796814  6582 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:13.797995  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.797652  9650 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:13.798893  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.800010  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.800463  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:13.800839  9675 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:13.801157  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:13.770514  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:13.803007  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.804327  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:13.804678  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:13.804982  6579 raft_consensus.cc:2376] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7. Re-sending same reply.
I20260620 13:57:13.745344  9637 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:13.806290  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.794381  9630 consensus_queue.cc:260] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:13.813283  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:13.813949  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 45368.6us
I20260620 13:57:13.817171  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:13.817246  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.827528  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.829954  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.830219  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.831110  6587 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:13.831408  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:13.836030  6043 tablet_copy_service.cc:140] P 663684cf4ae54c929bf8240ca0b63a47: Received BeginTabletCopySession request for tablet 71fbe22bd18849f1b94912bb0bdf5bbe from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:46758)
I20260620 13:57:13.838594  6043 tablet_copy_service.cc:161] P 663684cf4ae54c929bf8240ca0b63a47: Beginning new tablet copy session on tablet 71fbe22bd18849f1b94912bb0bdf5bbe from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:46758: session id = b0ce39342d8c4a64904b30b98de02b9f-71fbe22bd18849f1b94912bb0bdf5bbe
I20260620 13:57:13.851564  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:13.839802  6031 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:13.852636  9683 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:57:13.839946  9651 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:13.814471  9637 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:13.841121  9568 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:13.842567  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 96496us
I20260620 13:57:13.804427  9692 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:13.802608  9541 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:13.855311  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:13.914858  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:13.916025  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 60956.6us
I20260620 13:57:13.916414  6032 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 10: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:13.818260  6578 raft_consensus.cc:2393] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:13.918156  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:13.918803  6027 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
W20260620 13:57:13.858218  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 55306.3us
I20260620 13:57:13.868261  5997 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:13.870464  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:13.881814  6033 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:13.887494  6029 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
W20260620 13:57:13.889245  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:13.796010  9605 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:13.819239  6584 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:13.889467  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:13.914853  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:13.913051  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:13.920272  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:13.923074  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:13.926302  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.726572  9418 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260620 13:57:13.846786  9653 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:13.930318  5951 raft_consensus.cc:2393] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:57:13.930557  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 66857.8us
I20260620 13:57:13.927395  6580 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:13.931669  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:13.932299  5954 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:57:13.935209  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:13.936044  5959 raft_consensus.cc:2393] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:13.903573  9691 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:13.940922  5951 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260620 13:57:13.941147  5956 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:13.942001  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:13.944329  5884 raft_consensus.cc:1240] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:13.945739  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:13.949273  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.950877  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.952049  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:13.952541  6551 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:13.953557  5953 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:13.924237  9541 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:13.954397  6579 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 14: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:13.955808  5876 raft_consensus.cc:1240] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:13.930593  9674 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:13.959398  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:13.956761  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 286684us
W20260620 13:57:13.965138  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:13.964986  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.943375  9640 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:13.939188  9630 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:13.958817  5954 pending_rounds.cc:85] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 9
I20260620 13:57:13.944238  9524 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:13.967743  5956 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
W20260620 13:57:13.969291  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 51149.7us
I20260620 13:57:13.936954  9628 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:13.965925  6586 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:13.957176  9647 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:13.939145  9561 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260620 13:57:14.008061  9524 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:13.975248  9673 consensus_queue.cc:1048] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260620 13:57:14.008754  9567 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:57:13.944382  9569 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260620 13:57:13.944041  9691 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:13.978974  5954 pending_rounds.cc:107] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260620 13:57:13.921250  9654 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:13.939406  9653 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.011327  9691 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:14.011420  5954 raft_consensus.cc:2889] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:14.012832  6581 raft_consensus.cc:2393] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:13.957458  9692 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:14.012992  9646 consensus_queue.cc:1059] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:57:13.990768  6028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2595) took 1073 ms. Trace:
I20260620 13:57:13.994144  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:13.992045  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:13.959656  9671 consensus_queue.cc:237] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:14.003001  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:14.007151  6030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:57:14.010455  9524 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:13.990998  9640 raft_consensus.cc:697] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:13.972803  5848 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:14.014601  6028 rpcz_store.cc:276] 0620 13:57:12.905400 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:12.905541 (+   141us) service_pool.cc:224] Handling call
0620 13:57:13.978100 (+1072559us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b5400059bd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:13.978245 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555105152}
I20260620 13:57:14.020392  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2602) took 1066 ms. Trace:
I20260620 13:57:14.022571  6583 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:14.024623  9640 consensus_queue.cc:237] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:14.013827  9646 consensus_queue.cc:1243] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260620 13:57:14.029013  9546 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.031096  5879 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260620 13:57:13.947001  9681 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:14.039196  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 45150.5us
I20260620 13:57:14.040266  5849 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:14.037905  6029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2591) took 1137 ms. Trace:
W20260620 13:57:14.039213  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 66497.1us
I20260620 13:57:14.041608  5848 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:14.020953  6025 rpcz_store.cc:276] 0620 13:57:12.950794 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:12.950913 (+   119us) service_pool.cc:224] Handling call
0620 13:57:12.982788 (+ 31875us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:13.533511 (+550723us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:14.016417 (+482906us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54000596d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:14.016607 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1264888576}
I20260620 13:57:14.041258  6029 rpcz_store.cc:276] 0620 13:57:12.900461 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:12.901514 (+  1053us) service_pool.cc:224] Handling call
0620 13:57:14.037673 (+1136159us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54000d4154. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:14.037819 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1865092864}
W20260620 13:57:14.051625  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 109693us
I20260620 13:57:14.052423  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:14.061422  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:14.065757  5998 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:14.069695  5848 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:14.071056  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:14.072103  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:14.071671  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:14.045583  9561 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:14.121598  5876 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:57:14.121134  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:14.123412  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:14.124185  5878 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:57:14.124631  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:14.054519  9418 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260620 13:57:14.128021  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 171784us
I20260620 13:57:14.130147  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:14.132400  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:14.130686  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:14.061542  9692 raft_consensus.cc:2764] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260620 13:57:14.134014  5951 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:14.146916  5876 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:14.051455  9694 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260620 13:57:14.159649  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:14.071671  9675 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:14.161350  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:14.168823  5955 raft_consensus.cc:2368] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9.
I20260620 13:57:14.163720  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:14.165390  6552 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:14.166564  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:14.169508  5957 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:14.166955  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:14.159332  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:14.127209  9546 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:14.173211  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:14.128746  9642 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:57:14.177784  5959 raft_consensus.cc:2393] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:14.173207  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 103622us
I20260620 13:57:14.175454  5958 raft_consensus.cc:3055] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:57:14.175248  6552 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:14.178959  5958 raft_consensus.cc:740] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:14.175716  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:14.121862  9663 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:14.182977  5878 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:57:14.133802  9418 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:14.201035  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:14.202569  5924 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:14.150595  9688 raft_consensus.cc:2764] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260620 13:57:14.158409  9561 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:14.167754  9650 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:14.173594  9651 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:14.160411  9694 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:14.183768  9654 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:14.223997  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:14.184674  9642 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:14.232085  5957 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:14.233927  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:14.218302  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:14.176645  9524 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:14.136705  9503 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260620 13:57:14.238173  6030 raft_consensus.cc:606] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:14.246045  9647 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:14.184788  9638 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260620 13:57:14.252596  9638 consensus_queue.cc:1059] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:57:14.252803  9703 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:14.253758  9703 raft_consensus.cc:3055] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:14.254128  9703 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:14.254295  9654 raft_consensus.cc:3055] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:14.254762  9654 raft_consensus.cc:740] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:14.213306  9568 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:14.224395  9674 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:14.255379  9703 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.230314  9650 raft_consensus.cc:697] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:14.227362  9561 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:14.257342  9703 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:14.257661  9650 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.222615  9546 raft_consensus.cc:2764] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260620 13:57:14.224877  9298 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:14.260146  9298 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:14.260493  9298 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:14.261013  9696 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260620 13:57:14.255858  9654 consensus_queue.cc:260] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:14.262125  9697 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260620 13:57:14.262393  9654 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:14.227676  9694 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:14.254319  9541 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.265250  9568 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:14.265829  9568 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:14.193765  9418 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:14.267825  9568 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:14.269168  9541 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:14.251974  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:14.220042  5958 consensus_queue.cc:260] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:14.283529  6582 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:14.284734  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:14.274562  5956 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:14.285574  5950 raft_consensus.cc:2393] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 10: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:14.286525  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:14.287778  9681 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:14.289757  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:14.290617  6587 raft_consensus.cc:2393] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:14.292022  5955 raft_consensus.cc:2368] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9.
I20260620 13:57:14.276904  5951 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:14.292871  5958 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:57:14.280838  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:14.299705  9702 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:14.226138  9605 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:14.308951  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:14.271768  9642 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:57:14.258872  9561 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:14.231860  9692 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260620 13:57:14.343904  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 141424us
I20260620 13:57:14.345207  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:14.346037  5951 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:14.348462  5958 raft_consensus.cc:1275] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260620 13:57:14.337858  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 87176.7us
W20260620 13:57:14.337852  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 207751us
I20260620 13:57:14.352330  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:14.355643  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:14.252635  9533 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:14.289795  9666 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:14.363664  5959 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:14.357910  5997 leader_election.cc:400] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9.
I20260620 13:57:14.355974  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:14.364323  5997 leader_election.cc:403] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260620 13:57:14.362308  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:14.360098  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:14.361320  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:14.360656  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:14.287779  9653 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:14.366621  6587 raft_consensus.cc:2368] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8.
I20260620 13:57:14.343727  9605 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:14.367839  5924 leader_election.cc:400] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9.
I20260620 13:57:14.368257  5924 leader_election.cc:403] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260620 13:57:14.365231  9541 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election won for term 9
W20260620 13:57:14.361117  9698 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.058s	user 0.000s	sys 0.006s
I20260620 13:57:14.344237  9692 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:14.370971  5849 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:14.374254  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 420264us
I20260620 13:57:14.377956  9723 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9.
I20260620 13:57:14.359380  9568 raft_consensus.cc:2764] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260620 13:57:14.371994  9524 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:14.391963  5849 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:14.387920  5997 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:14.382340  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:14.373838  9561 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:14.371644  9633 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9.
I20260620 13:57:14.408102  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:14.388015  9692 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:57:14.395190  9605 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:57:14.409583  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:14.407703  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:14.410853  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:14.411798  5880 raft_consensus.cc:1275] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260620 13:57:14.373386  9683 consensus_queue.cc:1059] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260620 13:57:14.405501  9533 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:14.417734  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:14.419726  9724 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:14.420709  9632 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:14.420785  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:14.423372  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:14.449851  5876 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 9: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:14.414314  6551 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:14.414860  9658 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:14.447952  5849 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:14.406302  9503 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:14.452524  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:14.460752  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:14.464733  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:14.465371  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:14.465763  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:14.466320  6582 raft_consensus.cc:2393] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:14.465726  6583 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:14.458307  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:14.443467  9647 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:14.433142  9533 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:57:14.468683  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:14.471365  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:14.472790  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:14.475687  6580 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:57:14.475858  5884 raft_consensus.cc:2368] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9.
I20260620 13:57:14.478288  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:14.416978  9653 consensus_queue.cc:1059] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260620 13:57:14.480836  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:14.482578  5883 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260620 13:57:14.456981  9658 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:14.488615  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:14.489723  6579 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:14.485229  5880 raft_consensus.cc:1240] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:14.468792  9633 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:14.476617  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:14.451578  9681 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260620 13:57:14.454291  9541 raft_consensus.cc:697] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:14.485363  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:14.470100  9605 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election won for term 9
W20260620 13:57:14.487500  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 81196us
I20260620 13:57:14.499208  5876 raft_consensus.cc:2393] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 10: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:14.480967  9533 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:14.500334  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:14.483321  9503 raft_consensus.cc:697] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:14.491582  9683 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:14.486313  9524 raft_consensus.cc:697] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:57:14.498822  9602 consensus_meta.cc:287] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.820s	user 0.012s	sys 0.002s
I20260620 13:57:14.498440  9640 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:14.513526  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:14.496786  9678 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:14.523330  9678 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:14.523831  9678 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:14.503443  9680 consensus_meta.cc:287] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.721s	user 0.016s	sys 0.000s
I20260620 13:57:14.480528  9647 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.527271  9680 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:14.529305  9647 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:14.529990  6585 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:14.530042  6584 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260620 13:57:14.531540  6584 pending_rounds.cc:85] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 7
I20260620 13:57:14.506402  9418 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.534354  9418 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:14.535400  9637 consensus_meta.cc:287] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.614s	user 0.005s	sys 0.007s
I20260620 13:57:14.535846  9637 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.536935  9503 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:14.538499  9709 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260620 13:57:14.539256  9635 raft_consensus.cc:3055] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:14.539649  9635 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:14.539785  6581 raft_consensus.cc:2393] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:14.540642  9298 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.542254  9637 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:14.503834  9691 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.544749  9691 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:14.545900  5953 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:14.546738  9602 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.549237  9602 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:14.453980  9724 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:14.516745  9715 log.cc:927] Time spent T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260620 13:57:14.520035  9714 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:14.503754  9663 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:14.528990  9694 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.531859  6584 pending_rounds.cc:107] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260620 13:57:14.514609  9605 raft_consensus.cc:697] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:14.572899  6584 raft_consensus.cc:2889] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:14.550585  6582 raft_consensus.cc:2368] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9.
I20260620 13:57:14.506803  9561 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:14.493464  9658 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:14.478636  9688 consensus_queue.cc:1059] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260620 13:57:14.570096  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 50316.1us
I20260620 13:57:14.570541  5959 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:14.570796  6579 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
W20260620 13:57:14.571211  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 57777us
I20260620 13:57:14.562870  6585 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:14.574921  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:14.576116  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:14.517501  9683 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:14.582788  5950 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:14.587397  5957 raft_consensus.cc:2393] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:14.588004  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:14.520331  9524 consensus_queue.cc:237] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:14.577587  9602 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:14.629792  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:14.569140  9640 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.635991  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:14.579032  9663 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:14.636114  9561 raft_consensus.cc:697] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:14.578970  9298 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:14.636577  9710 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:14.637022  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:14.656087  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:14.656935  5955 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:14.639617  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:14.640232  9653 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:57:14.645056  9681 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260620 13:57:14.660264  9605 consensus_queue.cc:237] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:14.660890  9653 raft_consensus.cc:3055] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:14.639636  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:14.661252  9683 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:14.661795  6587 raft_consensus.cc:2393] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:57:14.645731  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 57888.6us
I20260620 13:57:14.663476  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:14.664039  6579 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260620 13:57:14.664342  5924 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:14.645123  5957 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:14.643280  9716 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260620 13:57:14.540683  9635 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.659672  6578 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260620 13:57:14.671887  6578 pending_rounds.cc:85] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 8
I20260620 13:57:14.672188  6578 pending_rounds.cc:107] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260620 13:57:14.672444  6578 raft_consensus.cc:2889] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:14.643610  9602 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:14.674856  9418 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:14.651566  9691 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:14.685211  9730 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:57:14.686043  9710 raft_consensus.cc:697] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:14.687415  9710 consensus_queue.cc:237] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:14.688649  9561 consensus_queue.cc:237] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.691496  9730 raft_consensus.cc:697] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:14.692168  9714 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:14.693300  9730 consensus_queue.cc:237] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.696062  9640 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:14.697526  6583 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260620 13:57:14.661302  9653 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:57:14.726107  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:14.668407  9688 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election won for term 10
W20260620 13:57:14.674877  9718 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260620 13:57:14.699034  9533 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.726482  5957 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:14.681777  9602 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:14.692111  9724 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:14.647717  9541 consensus_queue.cc:237] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:14.674029  9675 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260620 13:57:14.729822  9635 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:14.737459  9688 raft_consensus.cc:697] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:14.896432  9653 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:14.925734  9738 log.cc:927] Time spent T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260620 13:57:14.926474  9734 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260620 13:57:14.925904  9533 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:14.927836  9727 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:14.928455  9727 raft_consensus.cc:697] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:14.931257  9688 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.935781  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:14.930120  9727 consensus_queue.cc:237] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:14.941916  9653 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:14.985579  5950 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:14.997087  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:15.028831  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 371809us
I20260620 13:57:14.923925  9692 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.039168  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 781) took 1118 ms. Trace:
I20260620 13:57:15.040329  5879 rpcz_store.cc:276] 0620 13:57:13.920400 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:13.920561 (+   161us) service_pool.cc:224] Handling call
0620 13:57:13.938888 (+ 18327us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:14.031554 (+ 92666us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:15.038870 (+1007316us) spinlock_profiling.cc:243] Waited 91.9 ms on lock 0x7b54001f2cd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:15.039083 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211263360}
I20260620 13:57:14.996553  9663 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:14.970500  9694 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:14.958335  9533 consensus_queue.cc:1059] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260620 13:57:15.025132  9644 raft_consensus.cc:3055] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Stepping down as leader of term 12
W20260620 13:57:15.052327  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 333954us
I20260620 13:57:15.050971  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:15.057462  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:15.060334  5998 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:15.067432  9571 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:15.069698  9730 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:15.071071  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:15.072758  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:15.072604  5998 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:15.056566  9644 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:15.059582  9663 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:15.076788  5924 leader_election.cc:400] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9.
I20260620 13:57:15.086680  5998 leader_election.cc:400] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9.
I20260620 13:57:15.082558  9691 raft_consensus.cc:697] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:15.075973  9694 raft_consensus.cc:3055] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:15.085444  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:15.070993  9670 consensus_queue.cc:1048] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260620 13:57:15.077229  9710 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:15.078559  9730 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:15.104750  5848 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:15.106595  9741 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:15.107327  9741 raft_consensus.cc:697] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:15.107530  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:15.109002  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:15.109397  9742 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260620 13:57:15.110796  9743 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260620 13:57:15.113025  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:15.114562  5848 leader_election.cc:400] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9.
I20260620 13:57:15.114727  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:15.115439  5878 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:15.114971  5848 leader_election.cc:403] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260620 13:57:15.116833  5998 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:15.118026  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:15.118149  9650 consensus_queue.cc:1059] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:57:15.119297  9650 raft_consensus.cc:3055] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:15.119650  9650 raft_consensus.cc:740] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:15.120453  9650 consensus_queue.cc:260] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:15.121749  9650 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:57:15.123309  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:15.127692  9737 log.cc:927] Time spent T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260620 13:57:15.129274  9503 raft_consensus.cc:993] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47: : Instructing follower 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:57:15.129967  9503 raft_consensus.cc:1081] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Signalling peer 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:57:15.085259  9673 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 13:57:15.137276  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:15.132081  9688 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:57:15.152479  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:15.153559  9739 log.cc:927] Time spent T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260620 13:57:15.092388  9694 raft_consensus.cc:740] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:15.170133  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:15.314267  9571 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:15.306507  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:15.450281  6585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46858 (request call id 965) took 1610 ms. Trace:
I20260620 13:57:15.598192  6585 rpcz_store.cc:276] 0620 13:57:13.794426 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:13.794583 (+   157us) service_pool.cc:224] Handling call
0620 13:57:15.404594 (+1610011us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b540042d1d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:15.404729 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1688845056}
W20260620 13:57:15.598958  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 428883us
I20260620 13:57:15.529241  6586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:34178
W20260620 13:57:15.400556  9745 log.cc:927] Time spent T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260620 13:57:15.600082  5924 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:15.601841  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:15.272429  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 137013us
I20260620 13:57:15.388792  6581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 971) took 1041 ms. Trace:
I20260620 13:57:15.222362  9714 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:15.335163  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:15.401978  5770 maintenance_manager.cc:419] P 7635bbf8f82045f99dd7ac0f4a911859: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033361
W20260620 13:57:15.392429  9666 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 1.025s	user 0.010s	sys 0.007s
W20260620 13:57:15.393554  9658 consensus_meta.cc:287] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.805s	user 0.012s	sys 0.002s
I20260620 13:57:15.397310  9692 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:15.389657  6580 raft_consensus.cc:1240] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260620 13:57:15.275025  9646 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:15.315356  5883 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
I20260620 13:57:15.450981  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:15.339530  9691 consensus_queue.cc:237] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:15.270615  9644 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:15.310452  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:15.314505  9653 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:15.641078  6032 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:15.453835  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:15.527694  9673 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:15.102881  9730 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:15.397543  9694 consensus_queue.cc:260] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.158560  9633 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:15.488435  5877 raft_consensus.cc:1240] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:15.108335  9741 consensus_queue.cc:237] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:15.629758  9724 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:15.175642  9605 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9.
I20260620 13:57:15.336687  5876 raft_consensus.cc:1240] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8. Ops: []
W20260620 13:57:15.482463  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:15.674646  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:15.223326  9671 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:15.366786  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:15.684970  5881 raft_consensus.cc:2393] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:15.414855  9298 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:15.483319  6582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46858 (request call id 972) took 1003 ms. Trace:
I20260620 13:57:15.400274  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:15.686331  5884 raft_consensus.cc:2393] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:57:15.155189  9678 consensus_meta.cc:287] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.631s	user 0.004s	sys 0.008s
I20260620 13:57:15.127696  9717 raft_consensus.cc:3055] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:57:15.516187  9723 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:15.269567  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 163530us
I20260620 13:57:15.651629  9636 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:15.311003  9642 consensus_meta.cc:287] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.968s	user 0.014s	sys 0.000s
I20260620 13:57:15.353366  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:15.292924  5878 raft_consensus.cc:1240] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260620 13:57:15.562853  6030 raft_consensus.cc:1240] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8. Ops: []
W20260620 13:57:15.563676  9751 log.cc:927] Time spent T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260620 13:57:15.570731  9740 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.674s	user 0.002s	sys 0.006s
I20260620 13:57:15.572767  9669 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:15.715895  9605 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:15.716348  9756 log.cc:927] Time spent T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.329s	user 0.000s	sys 0.004s
I20260620 13:57:15.716192  9669 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.716543  9605 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:15.712896  9636 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:15.717674  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 939) took 1051 ms. Trace:
I20260620 13:57:15.718336  9669 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:15.641532  9658 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.646701  9646 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.649565  9673 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:15.575583  9569 raft_consensus.cc:3055] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:57:15.584216  6584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 976) took 1102 ms. Trace:
I20260620 13:57:15.583696  9761 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:15.589293  9757 log.cc:927] Time spent T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260620 13:57:15.527691  9628 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:15.479174  9602 consensus_meta.cc:287] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.693s	user 0.011s	sys 0.002s
W20260620 13:57:15.530397  9758 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260620 13:57:15.511466  9702 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:15.314193  9567 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:15.285394  5880 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:15.603186  6581 rpcz_store.cc:276] 0620 13:57:14.347510 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:14.347622 (+   112us) service_pool.cc:224] Handling call
0620 13:57:15.388486 (+1040864us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54005f5fd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:15.388695 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401668608}
I20260620 13:57:15.608145  6551 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:15.624204  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:15.624908  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:15.625826  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:15.642833  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:15.645085  6585 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260620 13:57:15.644253  5924 leader_election.cc:400] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8.
I20260620 13:57:15.651227  5950 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: [12.9-12.10]
I20260620 13:57:15.653107  6587 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:57:15.658991  5959 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:57:15.285364  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:15.619985  9524 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:15.634699  9719 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:15.633620  9675 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:15.671954  5952 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
W20260620 13:57:15.683385  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:15.649677  9730 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:15.646319  9670 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:15.685415  6582 rpcz_store.cc:276] 0620 13:57:14.480346 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:14.480510 (+   164us) service_pool.cc:224] Handling call
0620 13:57:15.483023 (+1002513us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b54005113d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:15.483234 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157892352}
I20260620 13:57:15.600107  9571 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:15.699342  5848 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:15.113947  9663 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.176s
I20260620 13:57:15.642239  9746 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:15.704146  6032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43502 (request call id 2315) took 1254 ms. Trace:
W20260620 13:57:15.676746  9749 log.cc:927] Time spent T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.376s	user 0.000s	sys 0.005s
I20260620 13:57:15.706831  6580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 935) took 1076 ms. Trace:
I20260620 13:57:15.669983  9692 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:15.643249  9714 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.580386  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1875) took 1306 ms. Trace:
I20260620 13:57:15.654667  9653 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.718034  6579 rpcz_store.cc:276] 0620 13:57:14.666164 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:14.666332 (+   168us) service_pool.cc:224] Handling call
0620 13:57:14.703486 (+ 37154us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:14.703956 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:14.703998 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:14.727946 (+ 23948us) log.cc:844] Serialized 26 byte log entry
0620 13:57:15.219753 (+491807us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:15.219827 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:15.219931 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:15.715634 (+495703us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:15.717367 (+  1733us) raft_consensus.cc:1685] finished
0620 13:57:15.717390 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:15.717614 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":429,"raft.queue_time_us":1401,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":54837,"spinlock_wait_cycles":25352064,"thread_start_us":376051,"threads_started":1,"wal-append.queue_time_us":524994}
I20260620 13:57:15.792727  5951 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
W20260620 13:57:15.727850  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 106035us
I20260620 13:57:15.718600  9605 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:15.747924  5955 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260620 13:57:15.767988  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 159911us
I20260620 13:57:15.827281  6551 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:15.827555  9692 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.770197  9569 raft_consensus.cc:740] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:15.828337  9653 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:15.829669  6031 raft_consensus.cc:3055] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:15.830092  9692 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:15.830227  6031 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:15.831401  9638 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260620 13:57:15.765971  9760 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260620 13:57:15.694375  9694 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:15.832533  6580 rpcz_store.cc:276] 0620 13:57:14.630712 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:14.630874 (+   162us) service_pool.cc:224] Handling call
0620 13:57:15.389337 (+758463us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:15.620793 (+231456us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:15.706574 (+ 85781us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54005f5fd0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:15.706742 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1743216896}
W20260620 13:57:15.794567  9750 log.cc:927] Time spent T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.488s	user 0.005s	sys 0.000s
I20260620 13:57:15.833689  9571 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:15.834121  9569 consensus_queue.cc:260] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:15.834833  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 135561us
I20260620 13:57:15.835191  9569 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:15.708389  9298 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.835623  5848 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:15.836344  9688 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:15.837142  9635 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:15.837590  9298 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:15.837842  9635 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.837195  9688 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:15.841302  9761 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.721081  6030 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:57:15.766754  6584 rpcz_store.cc:276] 0620 13:57:14.482062 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:14.483250 (+  1188us) service_pool.cc:224] Handling call
0620 13:57:14.483613 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:14.578162 (+ 94549us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:15.583969 (+1005807us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b5400508054. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:15.584160 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105900928}
I20260620 13:57:15.792878  9702 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:15.791611  9602 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.831210  6031 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.805685  9675 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:15.844724  9719 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:15.854470  9602 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:15.699216  9717 raft_consensus.cc:740] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:15.805379  9567 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:15.855680  9524 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:15.856822  6031 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:15.827311  9714 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:15.857692  9567 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:15.833690  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:15.691182  9630 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:15.856472  9524 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.858441  9630 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.858531  9717 consensus_queue.cc:260] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.859668  9717 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:57:15.860327  9630 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:15.861084  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:15.714920  9642 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.864100  9642 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:15.709103  9713 consensus_queue.cc:1059] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.156s
I20260620 13:57:15.864663  9571 consensus_queue.cc:1059] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:15.865641  9630 raft_consensus.cc:3055] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:15.866228  9630 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:15.867264  9633 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260620 13:57:15.867122  9736 consensus_queue.cc:1059] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:15.869163  9575 raft_consensus.cc:3055] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:15.869568  9575 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:15.869655  5997 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:15.870306  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a4cd17345f80464287c5952767849dbb. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:57:15.767004  5924 leader_election.cc:403] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260620 13:57:15.828938  9653 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:15.845089  5953 rpcz_store.cc:276] 0620 13:57:14.273476 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:14.273609 (+   133us) service_pool.cc:224] Handling call
0620 13:57:14.284311 (+ 10702us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:14.546346 (+262035us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:15.580037 (+1033691us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b5400250dd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:15.580297 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601138560}
I20260620 13:57:15.846112  6027 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260620 13:57:15.847070  6586 raft_consensus.cc:606] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:15.893138  6586 raft_consensus.cc:614] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:15.794888  9673 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:15.792143  5956 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:15.858016  9714 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:15.871642  9658 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:15.845908  6032 rpcz_store.cc:276] 0620 13:57:14.449379 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:14.449575 (+   196us) service_pool.cc:224] Handling call
0620 13:57:15.703899 (+1254324us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000d5f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:15.704070 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2697672960}
I20260620 13:57:15.838306  5848 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:15.872422  9706 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:57:15.708011  9678 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.832028  9638 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:15.806003  9628 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:15.866888  9571 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260620 13:57:15.875785  9675 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:15.844218  5958 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 13: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:15.692482  9671 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:15.880198  5957 raft_consensus.cc:1240] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
I20260620 13:57:15.882527  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:15.881450  6031 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260620 13:57:15.952862  6031 pending_rounds.cc:85] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 8
I20260620 13:57:15.953125  6031 pending_rounds.cc:107] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260620 13:57:15.953342  6031 raft_consensus.cc:2889] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:57:15.889632  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 732215us
I20260620 13:57:15.890662  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:15.891927  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:15.954618  6028 raft_consensus.cc:1240] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: []
W20260620 13:57:15.795902  9754 log.cc:927] Time spent T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.399s	user 0.005s	sys 0.000s
I20260620 13:57:15.718947  9636 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:15.899169  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 71949.6us
I20260620 13:57:15.969967  6551 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:15.900609  5950 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
I20260620 13:57:15.872772  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:15.907584  9706 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:15.911420  9575 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.915336  9646 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:15.922560  9644 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:15.950830  9605 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election won for term 8
W20260620 13:57:15.904064  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 259966us
I20260620 13:57:16.004325  6028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2312) took 1588 ms. Trace:
I20260620 13:57:16.004896  6028 rpcz_store.cc:276] 0620 13:57:14.415766 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:14.415912 (+   146us) service_pool.cc:224] Handling call
0620 13:57:14.448267 (+ 32355us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:15.955366 (+1507099us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:16.004009 (+ 48643us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54001e50d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:16.004259 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3463725952}
W20260620 13:57:15.926461  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 88221.1us
I20260620 13:57:16.006592  5848 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:15.925856  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:15.927652  5849 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:16.008669  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 81079.1us
I20260620 13:57:15.931327  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:15.860327  9524 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:15.711192  9723 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.956264  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:15.958127  6031 raft_consensus.cc:1240] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
W20260620 13:57:16.018252  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 62179.2us
I20260620 13:57:15.902559  9761 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:15.961009  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:15.975669  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.023388  5951 raft_consensus.cc:2393] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:15.976506  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:15.978036  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.024580  6032 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:15.981474  5778 catalog_manager.cc:5696] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 7 to 9, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 9 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:16.026906  5778 catalog_manager.cc:5696] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 6 to 7, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 7 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:15.972209  5955 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:15.925455  9746 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8.
I20260620 13:57:16.031360  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:15.996083  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:16.023030  6027 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:16.024741  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:15.797245  9670 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:15.930256  9714 raft_consensus.cc:697] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:57:15.988408  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 290878us
I20260620 13:57:15.901239  9653 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:15.998723  9713 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:15.923372  9657 consensus_queue.cc:1059] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:57:15.958623  9671 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:15.867304  9630 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.066726  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:16.005338  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:15.930464  9638 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:16.006620  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.088971  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.029695  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:16.030745  6584 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:16.032150  5950 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:15.998406  9706 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:57:16.032091  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:16.035624  5952 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260620 13:57:16.042593  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.102078  5951 raft_consensus.cc:2393] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 9: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:57:16.102347  5779 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56594 (request call id 332) took 14369 ms (client timeout 15000 ms). Trace:
I20260620 13:57:15.993192  9680 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:16.111691  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.043263  5997 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:16.041191  5778 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:15.998924  9717 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:15.994032  9663 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:16.056706  6552 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:16.020768  9418 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260620 13:57:16.116047  5778 catalog_manager.cc:5696] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:16.058202  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:16.059821  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:16.136425  5956 raft_consensus.cc:2393] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:57:16.052860  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:16.054976  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:15.951152  9705 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260620 13:57:16.018926  9675 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:16.067299  5998 leader_election.cc:400] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9.
W20260620 13:57:16.139712  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 72595.2us
I20260620 13:57:16.067689  6027 raft_consensus.cc:1240] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:57:16.016599  9719 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:16.019968  9646 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:16.068460  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:16.069751  5959 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 10: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:16.001183  9571 consensus_queue.cc:1059] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260620 13:57:16.091023  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.032405  9673 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:16.096437  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:16.099007  6582 raft_consensus.cc:2393] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:16.045035  9602 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:57:16.056036  9575 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:16.047014  9761 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:16.094199  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.101945  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:16.160094  6585 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:57:16.051357  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:16.119426  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:16.130229  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:16.163321  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:16.136106  9744 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:16.172207  9666 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:57:16.172828  9744 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:16.173641  9730 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.131376  5950 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
W20260620 13:57:16.102888  5779 rpcz_store.cc:269] 0620 13:57:01.717029 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:01.717386 (+   357us) service_pool.cc:224] Handling call
0620 13:57:16.085993 (+14368607us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:57:12.728595 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:57:12.761180 (+ 32585us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:57:12.761238 (+    58us) write_op.cc:435] Acquired schema lock
0620 13:57:12.761275 (+    37us) tablet.cc:662] Decoding operations
0620 13:57:12.853566 (+ 92291us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:57:12.853670 (+   104us) write_op.cc:641] Partition lock acquired for write op
0620 13:57:12.853702 (+    32us) tablet.cc:685] Acquiring locks for 17 operations
0620 13:57:12.884105 (+ 30403us) tablet.cc:701] Row locks acquired
0620 13:57:12.884121 (+    16us) write_op.cc:260] PREPARE: finished
0620 13:57:12.884311 (+   190us) write_op.cc:270] Start()
0620 13:57:12.884484 (+   173us) write_op.cc:276] Timestamp: P: 1781963832884241 usec, L: 0
0620 13:57:12.884498 (+    14us) op_driver.cc:348] REPLICATION: starting
0620 13:57:12.885174 (+   676us) log.cc:844] Serialized 6677 byte log entry
0620 13:57:13.697281 (+812107us) op_driver.cc:464] REPLICATION: finished
0620 13:57:13.836277 (+138996us) write_op.cc:301] APPLY: starting
0620 13:57:13.836554 (+   277us) tablet.cc:1367] starting BulkCheckPresence
0620 13:57:13.838221 (+  1667us) tablet.cc:1370] finished BulkCheckPresence
0620 13:57:13.838389 (+   168us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:57:14.239960 (+401571us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b540002b7d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7f970a 00007f0fdf77f2f4 00007f0fdf77f2a3 00007f0fdf77f218 00007f0fdf77f1d3 00007f0fdf77e4bc 00007f0fdf7a81f6 00007f0fdf79009b 00007f0fdf77a77d 00007f0fdf77e155
0620 13:57:14.282175 (+ 42215us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:57:14.283985 (+  1810us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0620 13:57:14.284045 (+    60us) write_op.cc:312] APPLY: finished
0620 13:57:14.284567 (+   522us) log.cc:844] Serialized 119 byte log entry
0620 13:57:14.284797 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:14.284985 (+   188us) write_op.cc:454] Released schema lock
0620 13:57:14.285061 (+    76us) write_op.cc:341] FINISH: Updating metrics
0620 13:57:14.285516 (+   455us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:14.285544 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":802696,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":107309,"apply.run_cpu_time_us":9029,"apply.run_wall_time_us":449216,"num_ops":17,"prepare.queue_time_us":246664,"prepare.run_cpu_time_us":33453,"prepare.run_wall_time_us":985196,"raft.queue_time_us":139775,"raft.run_cpu_time_us":11721,"raft.run_wall_time_us":578436,"replication_time_us":812616,"spinlock_wait_cycles":70153088,"thread_start_us":1108060,"threads_started":4,"wal-append.queue_time_us":561317,"wal-append.run_cpu_time_us":10302,"wal-append.run_wall_time_us":1844228}]]}
I20260620 13:57:16.143908  9657 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:16.175364  9657 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:16.175763  9657 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:16.176375  9768 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260620 13:57:16.177654  6583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 943) took 1045 ms. Trace:
W20260620 13:57:16.177917  9767 log.cc:927] Time spent T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.130s	user 0.003s	sys 0.000s
I20260620 13:57:16.178026  6583 rpcz_store.cc:276] 0620 13:57:15.132533 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:15.133241 (+   708us) service_pool.cc:224] Handling call
0620 13:57:15.225195 (+ 91954us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:15.273067 (+ 47872us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:15.273099 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:15.273742 (+   643us) log.cc:844] Serialized 26 byte log entry
0620 13:57:15.684821 (+411079us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b18003e6680. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:57:15.902593 (+217772us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:15.902633 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:15.903272 (+   639us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:16.177340 (+274068us) raft_consensus.cc:1685] finished
0620 13:57:16.177360 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:16.177591 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1407,"raft.queue_time_us":1948,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":17287,"spinlock_wait_cycles":18409728,"thread_start_us":217565,"threads_started":1,"wal-append.queue_time_us":668526}
I20260620 13:57:16.175700  9774 consensus_queue.cc:1059] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.160s
I20260620 13:57:16.154960  9646 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.056349  9688 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260620 13:57:16.151551  5879 raft_consensus.cc:2393] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 4: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:16.063287  9713 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.161378  5881 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:16.168996  9764 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.148s
W20260620 13:57:16.170284  9771 log.cc:927] Time spent T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260620 13:57:16.170599  6043 tablet_copy_source_session.cc:215] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 13:57:16.171862  9736 raft_consensus.cc:3055] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:16.198073  9736 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:16.198833  6043 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:46758 (request call id 738) took 2366 ms. Trace:
I20260620 13:57:16.199247  9736 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.154153  9635 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:16.141065  5778 catalog_manager.cc:5696] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:16.201081  9630 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:16.201706  5778 catalog_manager.cc:5696] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:16.175812  9766 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:16.203387  9766 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.205545  9766 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:16.138823  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.208190  5778 catalog_manager.cc:5696] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 4 to 7, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 7 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:16.210443  5778 catalog_manager.cc:5696] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:16.212318  9670 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:16.212450  5778 catalog_manager.cc:5696] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 6 to 7, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 7 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:16.182516  6580 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:16.199306  6043 rpcz_store.cc:276] 0620 13:57:13.832901 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:13.835754 (+  2853us) service_pool.cc:224] Handling call
0620 13:57:15.917816 (+2082062us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54000d5f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8067d7 00007f0fe479c736 00007f0fe47a613e 00007f0fdc06361b 00007f0fe47a60ba 00007f0fe47a11cc 00007f0fe479c37b 00007f0fe4790fd1 00007f0fe38485d4 00007f0fe3848562
0620 13:57:16.170443 (+252627us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54000d5f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf766470 00007f0fdf80531a 00007f0fe479c8bb 00007f0fe47a613e 00007f0fdc06361b 00007f0fe47a60ba 00007f0fe47a11cc 00007f0fe479c37b 00007f0fe4790fd1 00007f0fe38485d4 00007f0fe3848562
0620 13:57:16.198740 (+ 28297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3955871744}
W20260620 13:57:16.167249  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 144885us
I20260620 13:57:16.219749  5778 catalog_manager.cc:5696] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:16.146136  9675 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:16.161461  9719 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:16.185343  9746 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:16.235049  5778 catalog_manager.cc:5696] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:16.250759  9628 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:16.254024  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.254770  9653 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:16.254287  5778 catalog_manager.cc:5696] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 6 to 8, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 8 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:16.255175  9769 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:16.255781  9769 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.256052  5778 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:16.258255  9769 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:16.257956  5778 catalog_manager.cc:5696] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 5 to 6, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 6 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:16.254702  9730 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:16.136512  9663 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:16.254701  5956 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:16.196321  9602 raft_consensus.cc:697] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:16.242692  6585 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 3.
I20260620 13:57:16.261335  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.271482  5957 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:16.262974  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:16.274021  6551 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:16.264456  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.276226  5956 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:16.131666  9680 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.230887  9744 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:16.237485  9675 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:16.239169  9637 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:16.278584  6551 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:16.293331  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 250127us
I20260620 13:57:16.183153  9761 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.251135  9635 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:16.269450  9605 raft_consensus.cc:697] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:16.304585  5956 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260620 13:57:16.227639  9705 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260620 13:57:16.270257  9678 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:16.292968  9653 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:16.195884  9714 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.299006  9769 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:16.294111  9772 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:16.252157  9719 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:16.327508  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.298424  9774 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:57:16.341097  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 284468us
I20260620 13:57:16.363740  5957 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260620 13:57:16.364503  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:16.331434  9637 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:16.311757  9646 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:16.324983  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:16.314030  9688 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:16.359678  5956 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:16.338152  9772 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:16.328541  9769 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:16.309258  9635 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.271961  9746 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:16.360350  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:16.359335  9298 raft_consensus.cc:3055] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Stepping down as leader of term 3
W20260620 13:57:16.384510  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:16.379575  9717 raft_consensus.cc:697] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:16.359128  9713 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:16.392431  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 67545.8us
W20260620 13:57:16.396413  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:16.396946  6585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:16.368928  9748 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:16.379336  9637 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:16.368754  9630 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:57:16.383630  9569 consensus_meta.cc:287] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.545s	user 0.005s	sys 0.005s
I20260620 13:57:16.402498  6585 raft_consensus.cc:606] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:16.337605  9653 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:16.417135  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 276287us
W20260620 13:57:16.402627  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:16.390280  9769 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:16.383503  9788 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:16.403604  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 383462us
I20260620 13:57:16.391984  9772 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:16.410840  6585 raft_consensus.cc:614] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:16.410557  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:16.398337  9298 raft_consensus.cc:740] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:16.395233  9646 consensus_queue.cc:1059] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260620 13:57:16.411396  9780 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:16.411698  9637 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:16.390802  9688 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:16.408118  9764 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:16.476939  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:16.368198  9774 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.405969  9787 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:16.514149  9787 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:16.514564  9787 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:16.515014  6585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:16.515348  9774 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:16.516438  9783 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:16.517311  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:16.517122  9783 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:16.498149  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 74272.7us
I20260620 13:57:16.519268  9785 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260620 13:57:16.519886  5997 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:16.521504  9787 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:16.522063  9785 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:16.522586  9785 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:16.500860  9630 consensus_queue.cc:1059] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260620 13:57:16.425519  9569 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:16.395561  9602 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:16.498637  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 61204.3us
W20260620 13:57:16.499881  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 67704.9us
I20260620 13:57:16.510166  9628 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:16.512787  9635 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:16.512949  9786 consensus_queue.cc:1059] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.100s
I20260620 13:57:16.523936  9787 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:16.416314  9730 consensus_queue.cc:1059] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260620 13:57:16.539116  9790 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:16.540323  9628 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.402407  9605 consensus_queue.cc:237] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.540359  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.436683  9571 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260620 13:57:16.545516  5998 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:16.477775  9541 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260620 13:57:16.541035  9776 log.cc:927] Time spent T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260620 13:57:16.527874  9775 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260620 13:57:16.569550  5881 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260620 13:57:16.476526  9673 raft_consensus.cc:697] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:16.510246  9650 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:16.572954  5884 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260620 13:57:16.500974  9724 consensus_queue.cc:1059] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260620 13:57:16.523072  9785 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:16.541980  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 148720us
I20260620 13:57:16.573941  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.576303  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:16.577145  6031 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260620 13:57:16.615736  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:16.577195  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.572947  9774 raft_consensus.cc:3055] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:16.578717  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:16.618511  6029 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:16.619450  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:16.619642  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:16.619843  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:16.579933  5924 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.195:41493 timed out after 1.744s (SENT) [suppressed 49 similar messages]
I20260620 13:57:16.536352  9744 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:16.583855  5998 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:16.584748  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.625255  6030 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:16.586987  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:16.588725  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.627688  5881 raft_consensus.cc:1240] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 3. Current term is 4. Ops: []
I20260620 13:57:16.628203  5876 raft_consensus.cc:2393] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 13: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:16.412503  9748 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.570889  6032 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260620 13:57:16.601534  5879 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260620 13:57:16.630131  9748 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:16.604365  6033 raft_consensus.cc:1275] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260620 13:57:16.631934  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.632694  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:16.605365  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.633611  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.634241  6027 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:16.634655  6033 raft_consensus.cc:2393] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 3: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:16.635150  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.572105  9663 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:16.606696  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:16.635811  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:16.606248  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:16.636160  5884 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:16.637076  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.638226  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.610505  9779 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:16.610857  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:16.610203  6583 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260620 13:57:16.625371  9781 log.cc:927] Time spent T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260620 13:57:16.639243  5878 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:16.639132  9779 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.622351  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:16.639770  9635 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:16.640296  9635 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.640739  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:16.641790  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:16.642398  9635 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:16.642501  6579 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:57:16.643407  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:16.643879  6579 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:16.644516  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:16.630157  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.641721  9779 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:16.646214  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.647336  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.648903  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:16.651360  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:16.652630  6579 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:16.655741  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.656644  6033 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:57:16.585958  9541 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:16.661753  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:16.497437  9788 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:16.662051  9541 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:16.585882  9761 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:16.526362  9569 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:16.585173  9710 raft_consensus.cc:3055] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:16.592270  9630 raft_consensus.cc:3055] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:16.666476  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.678046  6033 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:16.502303  9780 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:16.524785  9657 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:16.693601  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:16.685005  5884 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:16.595218  9680 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:16.610219  9650 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:16.686426  6584 raft_consensus.cc:1240] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:57:16.691557  5955 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:16.582687  9524 consensus_queue.cc:1059] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.081s
I20260620 13:57:16.703449  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:16.700163  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 116355us
I20260620 13:57:16.708607  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:16.710285  5884 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:16.662158  9628 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:16.611120  9777 consensus_queue.cc:1059] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.156s
I20260620 13:57:16.624490  9774 raft_consensus.cc:740] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:16.760497  6030 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:16.761389  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:16.559782  9717 consensus_queue.cc:237] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.663669  9646 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:57:16.736950  5877 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:16.537667  9764 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:16.714929  6584 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:57:16.664295  9786 raft_consensus.cc:3055] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:16.739293  5875 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:16.741528  5883 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:16.623837  9633 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:16.654623  9635 consensus_queue.cc:1059] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260620 13:57:16.744591  5881 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260620 13:57:16.687019  9630 raft_consensus.cc:740] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:16.689479  9710 raft_consensus.cc:740] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:16.771186  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:16.796957  5878 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
W20260620 13:57:16.775524  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 69103.9us
I20260620 13:57:16.580621  9298 consensus_queue.cc:260] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:16.805573  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:16.782959  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:16.803174  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 162888us
W20260620 13:57:16.803253  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 223329us
I20260620 13:57:16.806916  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:16.808332  5881 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 9: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:16.810166  6552 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:16.810530  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:16.748799  9748 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:57:16.750773  9719 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:16.820554  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:16.822928  5880 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260620 13:57:16.825253  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.813657  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:16.816541  6029 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:16.822742  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.814217  6552 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:16.765569  5876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:58456
I20260620 13:57:16.826506  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:16.960824  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:16.868072  6026 raft_consensus.cc:1275] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260620 13:57:16.574460  9790 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:17.005465  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:16.826814  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.967929  5875 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:16.872677  6579 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260620 13:57:17.001061  5876 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
W20260620 13:57:16.998860  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 172443us
I20260620 13:57:17.008317  5876 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:17.009981  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:16.782032  9786 raft_consensus.cc:740] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:16.783466  9628 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:16.967898  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:17.025388  5878 raft_consensus.cc:2393] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:17.026816  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1904) took 1088 ms. Trace:
I20260620 13:57:17.026945  5950 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260620 13:57:16.802798  9575 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:17.028544  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:16.812441  9727 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:17.031081  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:17.027468  5953 rpcz_store.cc:276] 0620 13:57:15.938046 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:15.938225 (+   179us) service_pool.cc:224] Handling call
0620 13:57:15.938718 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:15.939239 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:15.939276 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:15.939874 (+   598us) log.cc:844] Serialized 26 byte log entry
0620 13:57:16.067713 (+127839us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:57:16.067755 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:16.067829 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:17.026549 (+958720us) raft_consensus.cc:1685] finished
0620 13:57:17.026579 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:17.026745 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2863,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":8971,"thread_start_us":126310,"threads_started":1,"wal-append.queue_time_us":299269}
I20260620 13:57:17.046216  5881 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:16.819283  9761 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:17.053038  9786 consensus_queue.cc:260] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:17.055673  9786 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:17.038373  9568 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260620 13:57:16.998162  9803 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:17.058629  9568 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:57:17.059216  9796 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:17.007436  9747 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260620 13:57:17.042510  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 228451us
I20260620 13:57:17.018234  9783 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:16.813794  9633 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:17.127841  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:17.129994  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:17.131366  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:17.065204  6552 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:17.067057  9638 consensus_meta.cc:287] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.945s	user 0.012s	sys 0.000s
W20260620 13:57:17.138896  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 117835us
I20260620 13:57:17.022567  9741 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.103s
I20260620 13:57:17.143268  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:17.143805  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:17.145987  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 80885.1us
I20260620 13:57:17.147289  9790 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:17.051362  9680 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:17.157543  6552 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:17.123777  9702 consensus_meta.cc:287] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 1.226s	user 0.011s	sys 0.001s
I20260620 13:57:16.979174  9673 consensus_queue.cc:237] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:17.043623  9789 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:17.022868  9719 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.093s
I20260620 13:57:17.152762  5876 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:17.071380  9800 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:17.059971  9796 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:17.162447  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:17.050616  9688 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:17.000329  9774 consensus_queue.cc:260] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:17.039740  9628 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:17.115830  9780 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:17.269040  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:17.137943  9748 raft_consensus.cc:697] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:57:17.201315  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:17.155822  9783 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:17.170195  9788 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:17.231519  9789 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:17.065330  9575 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:17.259717  5881 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260620 13:57:17.275024  5884 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:57:17.033221  9710 consensus_queue.cc:260] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:17.063443  9630 consensus_queue.cc:260] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:17.058954  9803 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:17.161211  9730 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.101s
I20260620 13:57:17.266916  9816 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:17.163858  9702 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:17.289669  5876 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:17.290681  9613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fbe22bd18849f1b94912bb0bdf5bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:57:17.231281  9815 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:17.124439  9727 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:17.292991  6582 consensus_meta.cc:287] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.673s	user 0.008s	sys 0.003s
I20260620 13:57:17.395885  6582 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:17.158979  9638 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:17.297462  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 154262us
I20260620 13:57:17.265796  9761 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:57:17.304556  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:17.266361  9569 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:17.259025  9644 consensus_meta.cc:287] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 1.256s	user 0.009s	sys 0.003s
I20260620 13:57:17.299222  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:17.234365  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 76906us
I20260620 13:57:17.430805  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:17.432287  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:17.352085  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:17.295567  9789 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:17.376223  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:17.275962  9724 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260620 13:57:17.397696  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:17.404140  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:17.438640  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:17.307624  9774 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:17.372187  9802 log.cc:927] Time spent T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.558s	user 0.000s	sys 0.001s
I20260620 13:57:17.405138  5958 raft_consensus.cc:2393] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:57:17.373876  9804 log.cc:927] Time spent T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.418s	user 0.000s	sys 0.001s
I20260620 13:57:17.445714  5957 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260620 13:57:17.444624  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 145519us
I20260620 13:57:17.370501  9816 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:17.266687  9800 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:17.459193  6582 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260620 13:57:17.459373  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:17.448973  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:17.844112  6582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 990) took 1044 ms. Trace:
W20260620 13:57:17.588833  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:17.844580  6582 rpcz_store.cc:276] 0620 13:57:16.799523 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:17.439562 (+640039us) service_pool.cc:224] Handling call
0620 13:57:17.439826 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:17.843729 (+403903us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:17.843951 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:17.461076  6587 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 9: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:17.459841  6025 raft_consensus.cc:2410] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260620 13:57:17.860733  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:17.830384  6028 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.010s	sys 0.007s
W20260620 13:57:17.873973  6028 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.092s	user 0.010s	sys 0.007s
W20260620 13:57:17.593593  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:17.877422  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:17.878532  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:17.372272  9788 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:17.659649  9637 consensus_meta.cc:287] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.131s	user 0.012s	sys 0.000s
W20260620 13:57:17.521751  9541 consensus_meta.cc:287] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.840s	user 0.008s	sys 0.000s
I20260620 13:57:17.474479  9790 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260620 13:57:17.658217  9675 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 1.355s	user 0.010s	sys 0.003s
W20260620 13:57:17.560201  9814 log.cc:927] Time spent T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260620 13:57:17.473542  9569 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:17.911098  6585 raft_consensus.cc:606] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:17.497094  9809 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
W20260620 13:57:17.627979  9706 consensus_meta.cc:287] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 1.479s	user 0.012s	sys 0.000s
I20260620 13:57:17.478065  9680 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:17.523824  9638 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:17.850194  9793 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:17.786453  9785 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 1.176s	user 0.005s	sys 0.005s
I20260620 13:57:17.435456  9710 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:17.917683  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 520076us
W20260620 13:57:17.897533  9799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.011s	sys 0.011s
I20260620 13:57:17.494488  9575 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:17.848196  9816 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:17.480898  9780 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:17.851521  9761 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:17.933147  5999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.009s	sys 0.014s
I20260620 13:57:17.477404  9633 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:17.877439  9764 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:17.886693  9770 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:17.402901  9815 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:17.956332  9820 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.455s	user 0.001s	sys 0.000s
I20260620 13:57:17.951593  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:17.950209  9727 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:17.947878  9796 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:17.499765  9748 consensus_queue.cc:237] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:17.912796  9790 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:17.983328  6031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2329) took 1388 ms. Trace:
I20260620 13:57:17.985253  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1689) took 1246 ms. Trace:
I20260620 13:57:17.988603  6029 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260620 13:57:17.922533  9541 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:17.958762  5999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.009s	sys 0.015s
I20260620 13:57:17.908465  9783 consensus_queue.cc:1059] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260620 13:57:17.934881  9680 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:17.954763  9671 consensus_meta.cc:287] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 1.844s	user 0.010s	sys 0.005s
I20260620 13:57:18.009205  9671 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:18.009913  9786 consensus_meta.cc:287] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.953s	user 0.007s	sys 0.004s
W20260620 13:57:17.953270  9799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.014s	sys 0.011s
I20260620 13:57:17.966208  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:17.923621  9803 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:18.015484  9723 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:17.955178  9605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.008s	sys 0.016s
W20260620 13:57:18.016146  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:17.948778  5878 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.000s	sys 0.029s
W20260620 13:57:18.016551  5878 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.000s	sys 0.029s
W20260620 13:57:17.938056  9747 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.005s	sys 0.019s
W20260620 13:57:18.016961  9747 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.005s	sys 0.020s
I20260620 13:57:17.914453  9637 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:17.975041  9567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.006s	sys 0.027s
W20260620 13:57:18.017572  9567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.006s	sys 0.027s
W20260620 13:57:17.991438  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:17.952199  9569 consensus_queue.cc:1059] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260620 13:57:17.953693  6033 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.250s	user 0.015s	sys 0.020s
I20260620 13:57:18.018846  9637 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:17.893226  9788 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:18.019284  6033 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.315s	user 0.015s	sys 0.020s
I20260620 13:57:17.931609  9706 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:18.020033  9605 raft_consensus.cc:3055] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:18.020475  9605 raft_consensus.cc:740] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:18.021018  9788 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:17.983796  6031 rpcz_store.cc:276] 0620 13:57:16.594892 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.615902 (+ 21010us) service_pool.cc:224] Handling call
0620 13:57:16.616234 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:16.617319 (+  1085us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:16.617350 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:16.665491 (+ 48141us) log.cc:844] Serialized 26 byte log entry
0620 13:57:17.014586 (+349095us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:17.014640 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:17.014720 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:17.983093 (+968373us) raft_consensus.cc:1685] finished
0620 13:57:17.983133 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:17.983269 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80408,"raft.queue_time_us":7134,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":28753,"thread_start_us":265312,"threads_started":1,"wal-append.queue_time_us":417141}
I20260620 13:57:18.021405  9706 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:18.012648  6024 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:18.015641  9680 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:18.023069  9650 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:18.023773  9824 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260620 13:57:18.025012  6028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2326) took 1449 ms. Trace:
I20260620 13:57:18.008545  9828 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:18.025524  6028 rpcz_store.cc:276] 0620 13:57:16.575506 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.575996 (+   490us) service_pool.cc:224] Handling call
0620 13:57:16.600154 (+ 24158us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:16.612570 (+ 12416us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:16.612600 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:16.684446 (+ 71846us) log.cc:844] Serialized 26 byte log entry
0620 13:57:17.874655 (+1190209us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:17.874717 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:17.874824 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:18.024678 (+149854us) raft_consensus.cc:1685] finished
0620 13:57:18.024711 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:18.024927 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18173,"raft.queue_time_us":12530,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":68803,"thread_start_us":1092853,"threads_started":1,"wal-append.queue_time_us":1171966}
I20260620 13:57:18.014667  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:17.985695  5882 rpcz_store.cc:276] 0620 13:57:16.738832 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.739314 (+   482us) service_pool.cc:224] Handling call
0620 13:57:16.739769 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:16.769545 (+ 29776us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:16.769598 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:16.815315 (+ 45717us) log.cc:844] Serialized 26 byte log entry
0620 13:57:17.136405 (+321090us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:57:17.399154 (+262749us) log.cc:844] Serialized 14 byte log entry
0620 13:57:17.399458 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:17.399546 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:17.985039 (+585493us) raft_consensus.cc:1685] finished
0620 13:57:17.985058 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:17.985193 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190861,"prepare.queue_time_us":363625,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":53,"raft.queue_time_us":211078,"raft.run_cpu_time_us":418,"raft.run_wall_time_us":77810,"thread_start_us":380709,"threads_started":2,"wal-append.queue_time_us":308671}
I20260620 13:57:17.964021  9702 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:18.029640  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:18.037722  5882 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:17.926913  9675 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:18.050340  5952 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260620 13:57:17.948133  9785 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:18.027472  9828 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:18.052639  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 172328us
I20260620 13:57:17.961477  9780 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:18.034282  9773 log.cc:927] Time spent T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 1.739s	user 0.006s	sys 0.014s
I20260620 13:57:17.999131  9790 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:18.060596  5883 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:18.005131  9727 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:17.949106  9793 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:17.964869  9761 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:17.968284  9770 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.068583  5878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1696) took 1006 ms. Trace:
W20260620 13:57:18.060328  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 170896us
I20260620 13:57:18.054380  5849 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:18.097772  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:18.096843  5878 rpcz_store.cc:276] 0620 13:57:17.061947 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:17.062276 (+   329us) service_pool.cc:224] Handling call
0620 13:57:17.069930 (+  7654us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:17.126504 (+ 56574us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:17.126534 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:17.151235 (+ 24701us) log.cc:844] Serialized 26 byte log entry
0620 13:57:17.275212 (+123977us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:18.016915 (+741703us) log.cc:844] Serialized 14 byte log entry
0620 13:57:18.017156 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:18.017232 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:18.068291 (+ 51059us) raft_consensus.cc:1685] finished
0620 13:57:18.068320 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:18.068515 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56106,"prepare.queue_time_us":317566,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":4704,"raft.queue_time_us":57217,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":18576,"thread_start_us":822036,"threads_started":2,"wal-append.queue_time_us":210992}
I20260620 13:57:18.120868  5849 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:18.097891  9727 raft_consensus.cc:697] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:18.152365  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:18.155821  9815 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:18.156880  9761 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:18.157909  9788 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:18.168963  9825 log.cc:927] Time spent T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260620 13:57:18.110626  9567 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:18.021281  9605 consensus_queue.cc:260] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:18.171942  9769 consensus_meta.cc:287] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.694s	user 0.011s	sys 0.003s
I20260620 13:57:18.173400  9780 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:18.123178  9783 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260620 13:57:18.174714  9772 consensus_meta.cc:287] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.677s	user 0.014s	sys 0.000s
I20260620 13:57:18.111933  9670 raft_consensus.cc:3055] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:18.098867  9671 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:18.178086  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2332) took 1560 ms. Trace:
I20260620 13:57:18.177299  5849 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:18.185415  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 80398.3us
I20260620 13:57:18.146432  9800 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:18.176065  9705 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:18.207034  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:18.207690  6028 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:18.186398  9736 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:18.190282  9642 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:18.203743  6033 rpcz_store.cc:276] 0620 13:57:16.617750 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.694695 (+ 76945us) service_pool.cc:224] Handling call
0620 13:57:16.695015 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:16.695242 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 9
0620 13:57:18.019668 (+1324426us) log.cc:844] Serialized 14 byte log entry
0620 13:57:18.176665 (+156997us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:18.176720 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:18.176774 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:18.176843 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:18.178032 (+  1189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1364713,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":86,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":7308,"thread_start_us":1472247,"threads_started":2}
I20260620 13:57:18.191812  9567 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:18.212045  9605 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:18.213990  9828 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:18.206856  9705 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:18.215436  9705 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:18.215849  9653 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:18.217381  6580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 950) took 1639 ms. Trace:
I20260620 13:57:18.219550  9642 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:18.217741  6580 rpcz_store.cc:276] 0620 13:57:16.578254 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.579326 (+  1072us) service_pool.cc:224] Handling call
0620 13:57:16.579683 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:17.045693 (+466010us) raft_consensus.cc:1534] Early marking committed up to index 8
0620 13:57:17.294390 (+248697us) log.cc:844] Serialized 14 byte log entry
0620 13:57:17.722418 (+428028us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:17.722495 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:17.722564 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:18.217150 (+494586us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b540013c4d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:18.217195 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:18.217321 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":427983,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":21021,"raft.queue_time_us":123,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":46371,"spinlock_wait_cycles":1087360000,"thread_start_us":674876,"threads_started":2,"wal-append.queue_time_us":362726}
I20260620 13:57:18.208159  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:18.225831  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:18.228514  6580 raft_consensus.cc:2393] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:18.200668  9783 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:18.235917  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:18.238534  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:18.191798  9788 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.206830  9637 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:18.203465  9670 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:18.223943  9567 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:18.235442  9828 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:18.249655  9727 consensus_queue.cc:237] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:18.221377  9796 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:18.201751  9769 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.251825  9642 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:18.256987  9766 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:18.263376  9788 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:18.264142  9832 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260620 13:57:18.264856  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:18.265538  9710 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:18.262524  9670 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.266716  9836 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:18.240969  9783 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:18.307955  9789 consensus_meta.cc:287] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.834s	user 0.007s	sys 0.007s
I20260620 13:57:18.308072  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2218) took 1487 ms. Trace:
I20260620 13:57:18.308478  5957 rpcz_store.cc:276] 0620 13:57:16.820707 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.820973 (+   266us) service_pool.cc:224] Handling call
0620 13:57:16.821296 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:17.843182 (+1021886us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:18.307810 (+464628us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54002526d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:18.308010 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434683136}
I20260620 13:57:18.308485  9789 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.310189  6027 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
W20260620 13:57:18.310416  5884 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42748 (request call id 802) took 1572 ms (client timeout 2042 ms). Trace:
W20260620 13:57:18.274857  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:18.310810  5884 rpcz_store.cc:269] 0620 13:57:16.737753 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.761094 (+ 23341us) service_pool.cc:224] Handling call
0620 13:57:18.310244 (+1549150us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54003f2354. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:18.310364 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179576704}
W20260620 13:57:18.311478  6027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 761) took 1676 ms (client timeout 1934 ms). Trace:
W20260620 13:57:18.311833  6027 rpcz_store.cc:269] 0620 13:57:16.634655 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.634868 (+   213us) service_pool.cc:224] Handling call
0620 13:57:18.311329 (+1676461us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54000591d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:18.311429 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3850871040}
I20260620 13:57:18.312985  9769 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:18.205161  9772 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.260175  9796 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:18.314388  9789 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:18.314610  9796 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:18.279750  9774 consensus_meta.cc:287] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.800s	user 0.011s	sys 0.001s
I20260620 13:57:18.294706  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:18.306912  9670 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:18.276628  9787 raft_consensus.cc:3055] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:18.314042  9790 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.298115  9723 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:18.327040  6586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 995) took 1525 ms. Trace:
W20260620 13:57:18.315860  6024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 762) took 1680 ms (client timeout 2209 ms). Trace:
I20260620 13:57:18.254899  9637 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.327950  6586 rpcz_store.cc:276] 0620 13:57:16.801886 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:18.325922 (+1524036us) service_pool.cc:224] Handling call
0620 13:57:18.326317 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:18.326569 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:18.326608 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:18.326671 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:18.326718 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:18.326812 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:18.326961 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:18.295499  9675 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:18.295763  9766 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:18.329138  6024 rpcz_store.cc:269] 0620 13:57:16.635468 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.637994 (+  2526us) service_pool.cc:224] Handling call
0620 13:57:18.315694 (+1677700us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54001c9b54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:18.315810 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3158693120}
W20260620 13:57:18.285820  9822 log.cc:927] Time spent T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.763s	user 0.000s	sys 0.019s
W20260620 13:57:18.315936  9808 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 1.043s	user 0.008s	sys 0.005s
I20260620 13:57:18.370078  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:18.372915  6027 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 10
I20260620 13:57:18.260378  9828 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:18.374704  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 118344us
I20260620 13:57:18.326084  9788 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:18.326622  9785 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:18.326098  9787 raft_consensus.cc:740] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:18.423411  6032 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:18.424401  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:18.429731  6028 raft_consensus.cc:2410] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260620 13:57:18.425442  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:18.375789  9766 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:18.305122  9710 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.315896  9836 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:18.433913  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:18.408437  9723 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:18.442101  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:18.371619  9770 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:18.440152  6578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 978) took 1819 ms. Trace:
I20260620 13:57:18.443336  6578 rpcz_store.cc:276] 0620 13:57:16.620478 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.620582 (+   104us) service_pool.cc:224] Handling call
0620 13:57:16.620906 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:16.621157 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 7
0620 13:57:16.621182 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:16.621614 (+   432us) log.cc:844] Serialized 26 byte log entry
0620 13:57:16.874831 (+253217us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:16.874883 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:16.874957 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:18.315316 (+1440359us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:18.439776 (+124460us) raft_consensus.cc:1685] finished
0620 13:57:18.439801 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:18.440092 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21774720,"thread_start_us":160840,"threads_started":1,"wal-append.queue_time_us":462602}
I20260620 13:57:18.430744  6026 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:18.433569  9772 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:18.447356  5884 raft_consensus.cc:1240] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:18.477710  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:18.479077  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:18.480692  5884 raft_consensus.cc:1240] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:18.459019  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:18.463413  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:18.472972  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:18.475229  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:18.485940  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:18.490686  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:18.491428  5878 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:18.493183  5875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2630) took 1365 ms. Trace:
I20260620 13:57:18.495362  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:18.442466  9803 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:18.493602  5875 rpcz_store.cc:276] 0620 13:57:17.127733 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:17.127872 (+   139us) service_pool.cc:224] Handling call
0620 13:57:17.128212 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:17.128452 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:17.128480 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:17.164247 (+ 35767us) log.cc:844] Serialized 26 byte log entry
0620 13:57:17.372630 (+208383us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:57:17.372684 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:17.372780 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:18.285191 (+912411us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:18.488582 (+203391us) raft_consensus.cc:1685] finished
0620 13:57:18.488604 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:18.493123 (+  4519us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73020288,"thread_start_us":99706,"threads_started":1,"wal-append.queue_time_us":289141}
I20260620 13:57:18.482899  9764 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:18.497933  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:18.498081  9764 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.498593  6028 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:18.489560  9780 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260620 13:57:18.473397  9727 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:18.477955  9675 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:18.532392  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:18.489389  9774 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:18.428179  9788 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:18.544486  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 249881us
I20260620 13:57:18.550652  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:18.537607  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:18.545157  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:18.500694  9764 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:18.428023  9816 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:18.552371  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:18.494132  9710 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:18.529688  9680 consensus_meta.cc:287] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260620 13:57:18.560052  6028 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:57:18.565404  6580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 993) took 1764 ms. Trace:
I20260620 13:57:18.524473  9790 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:18.513763  9637 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:18.526223  9828 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:18.530820  9567 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:18.493639  9769 consensus_queue.cc:1059] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260620 13:57:18.570149  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:18.573364  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 187919us
I20260620 13:57:18.577899  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:18.567377  9774 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:18.569494  9710 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:18.522526  9705 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:18.569862  9770 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:18.535148  9803 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.600239  9783 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.584559  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:18.548674  9675 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.550431  9787 consensus_queue.cc:260] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.603156  9787 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:18.569722  9680 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.605351  9680 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:18.605232  9568 consensus_queue.cc:1059] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:57:18.589766  9816 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:18.596323  6028 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:57:18.535372  9727 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:18.607642  9852 consensus_queue.cc:1175] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b0ce39342d8c4a64904b30b98de02b9f" responder_term: 7 status { last_received { term: 7 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 7 index: 8 } }
I20260620 13:57:18.587424  9710 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:18.615938  9710 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:18.616683  9727 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:18.606245  9568 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260620 13:57:18.623799  9788 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:18.625486  9766 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.591221  9836 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:18.628283  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:18.629520  9567 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:18.630246  5880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2624) took 2057 ms. Trace:
I20260620 13:57:18.630622  5880 rpcz_store.cc:276] 0620 13:57:16.572687 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.572824 (+   137us) service_pool.cc:224] Handling call
0620 13:57:16.604888 (+ 32064us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:16.823356 (+218468us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:18.630015 (+1806659us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54000c62d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:18.630193 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500630912}
I20260620 13:57:18.614166  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:18.609956  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:18.607753  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:18.635749  6024 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:18.584786  9774 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:18.636787  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:18.582523  9828 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:18.635666  6027 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
W20260620 13:57:18.633183  9823 log.cc:927] Time spent T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.844s	user 0.004s	sys 0.000s
I20260620 13:57:18.642059  6024 raft_consensus.cc:2368] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11.
I20260620 13:57:18.641744  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:18.642660  9567 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:18.650620  9567 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:18.643201  9828 raft_consensus.cc:697] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:18.651149  9561 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:18.644767  9642 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:18.651696  9561 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:18.652128  9561 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:18.652324  9642 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.652371  9828 consensus_queue.cc:237] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:18.655761  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:18.656823  6027 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:18.655813  6028 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:18.650178  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:18.660971  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 981) took 2038 ms. Trace:
I20260620 13:57:18.661384  5849 leader_election.cc:400] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11.
I20260620 13:57:18.661957  5849 leader_election.cc:403] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260620 13:57:18.661531  6579 rpcz_store.cc:276] 0620 13:57:16.622479 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.653313 (+ 30834us) service_pool.cc:224] Handling call
0620 13:57:16.653714 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:17.007861 (+354147us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:18.660726 (+1652865us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b540051fc54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:18.660911 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502394240}
I20260620 13:57:18.663057  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:18.664256  9569 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:18.641528  9774 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:18.652395  9567 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:18.643101  9675 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:18.715768  9796 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:18.768997  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:18.839632  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 255679us
I20260620 13:57:18.841617  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:18.848703  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:18.850255  6586 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:19.116393  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:18.802920  6028 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:19.110363  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:19.140717  5880 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:19.014863  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:19.014873  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:19.145764  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:19.147004  9783 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:19.042867  9613 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
I20260620 13:57:18.962617  9714 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:19.006497  9727 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:19.150293  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 334406us
I20260620 13:57:19.200555  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:19.191879  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 343267us
I20260620 13:57:18.809304  9746 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:19.071025  9642 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:19.042995  9796 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:19.009840  9855 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election won for term 8
W20260620 13:57:19.201128  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:19.167241  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:19.204944  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:19.211959  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:19.214819  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:19.215090  5878 raft_consensus.cc:1240] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260620 13:57:19.215451  5881 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:19.215899  9628 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:19.204252  6027 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:57:19.217350  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:18.853178  9710 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.218597  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:19.219154  6027 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:19.219471  9744 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:19.220140  9744 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:19.221968  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:19.222352  5881 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:19.222577  6583 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:57:19.222865  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:19.223592  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:19.224674  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:19.226222  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:19.217602  5883 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1700) took 1949 ms (client timeout 1527 ms). Trace:
I20260620 13:57:19.229897  5880 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:19.229820  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:19.228204  5883 rpcz_store.cc:269] 0620 13:57:17.268551 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:17.268777 (+   226us) service_pool.cc:224] Handling call
0620 13:57:19.217446 (+1948669us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b54002b39d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:19.217538 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818712832}
W20260620 13:57:19.233220  5848 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.562s (SENT)
I20260620 13:57:19.233726  5848 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:19.232475  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:19.207140  9787 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260620 13:57:19.247035  6027 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:19.247061  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:19.248214  6028 raft_consensus.cc:2393] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:19.247416  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:19.250394  5878 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:19.252326  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:19.253005  5880 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:19.236218  9855 raft_consensus.cc:697] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:19.254601  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:19.240592  9783 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:19.203758  9714 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.256122  5849 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:19.258904  9675 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:57:19.258972  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:19.259585  9675 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:19.259420  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:19.241199  9828 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.012s	sys 0.038s
I20260620 13:57:19.243688  9766 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:19.260628  9766 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:19.256757  6027 raft_consensus.cc:2376] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14. Re-sending same reply.
I20260620 13:57:19.261009  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:19.261556  6028 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:19.261801  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:19.207834  9746 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260620 13:57:19.260105  9675 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:57:19.254741  9774 consensus_meta.cc:287] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.585s	user 0.005s	sys 0.007s
I20260620 13:57:19.258384  9710 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:19.264595  9828 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.012s	sys 0.038s
I20260620 13:57:19.259410  9691 raft_consensus.cc:3055] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:57:19.272693  6579 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:19.276522  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:19.288858  6028 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:19.289749  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:19.290798  5878 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:19.290846  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:19.274200  9691 raft_consensus.cc:740] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:19.271163  9774 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.281152  9613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46858 (request call id 935) took 7711 ms. Trace:
W20260620 13:57:19.307541  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 71846.6us
I20260620 13:57:19.309127  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:19.309725  6028 raft_consensus.cc:2376] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10. Re-sending same reply.
I20260620 13:57:19.309903  5848 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:19.314487  5848 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:19.316628  5848 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:19.305246  9613 rpcz_store.cc:276] 0620 13:57:11.563311 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:11.567125 (+  3814us) service_pool.cc:224] Handling call
0620 13:57:11.959840 (+392715us) ts_tablet_manager.cc:934] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
0620 13:57:12.288788 (+328948us) spinlock_profiling.cc:243] Waited 80 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdc6ed8ac 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc7074aa 00007f0fdc7073d2 00007f0fe4770831
0620 13:57:16.868402 (+4579614us) tablet_copy_client.cc:368] Tablet copy session begun
0620 13:57:18.267498 (+1399096us) tablet_metadata.cc:665] Metadata flushed
0620 13:57:18.272912 (+  5414us) tablet_copy_client.cc:497] Wrote new tablet metadata
0620 13:57:19.205775 (+932863us) tablet_copy_client.cc:418] Wrote new consensus metadata
0620 13:57:19.248507 (+ 42732us) tablet_replica.cc:206] Creating consensus instance
0620 13:57:19.266923 (+ 18416us) ts_tablet_manager.cc:989] Replica registered.
0620 13:57:19.274220 (+  7297us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":54622,"spinlock_wait_cycles":183886080,"tablet-copy.queue_time_us":320679,"thread_start_us":610782,"threads_started":2}
I20260620 13:57:19.323297  9694 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:19.323855  9628 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:19.324506  6583 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:19.331241  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:19.327411  9691 consensus_queue.cc:260] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.332937  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:19.327948  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:19.333622  5878 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:19.325042  9774 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:19.332051  6027 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
W20260620 13:57:19.330236  9561 consensus_meta.cc:287] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.678s	user 0.013s	sys 0.000s
I20260620 13:57:19.335562  9788 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:19.335533  9561 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:19.336784  9569 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.671s	user 0.007s	sys 0.003s
I20260620 13:57:19.336880  9613 tablet_copy_client.cc:806] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:57:19.337203  9569 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11.
I20260620 13:57:19.337764  9613 tablet_copy_client.cc:670] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:57:19.340528  9727 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:19.337757  9561 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:19.323376  9857 log.cc:927] Time spent T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260620 13:57:19.347270  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 122232us
I20260620 13:57:19.364576  5953 raft_consensus.cc:1240] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:19.365145  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:19.365679  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:19.366006  5959 raft_consensus.cc:2410] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260620 13:57:19.366305  5953 raft_consensus.cc:3055] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:19.366890  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:19.367539  5959 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:19.367612  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:19.367663  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:19.368324  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:19.368726  5956 raft_consensus.cc:2393] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 13: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:19.369016  5959 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 10: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:19.369486  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:19.369757  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:19.361200  5877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1686) took 2651 ms. Trace:
W20260620 13:57:19.370244  9567 consensus_meta.cc:287] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.699s	user 0.009s	sys 0.000s
W20260620 13:57:19.359730  5955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1914) took 2786 ms (client timeout 1959 ms). Trace:
I20260620 13:57:19.365752  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:19.370836  5955 rpcz_store.cc:269] 0620 13:57:16.573571 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.573698 (+   127us) service_pool.cc:224] Handling call
0620 13:57:19.359423 (+2785725us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b5400306954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:19.359599 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175544704}
I20260620 13:57:19.371284  5950 raft_consensus.cc:2410] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260620 13:57:19.371727  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 772) took 1126 ms. Trace:
I20260620 13:57:19.371918  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:19.372088  5956 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:57:19.367846  9727 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:19.372748  5955 raft_consensus.cc:2410] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260620 13:57:19.312186  9855 consensus_queue.cc:237] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.361388  9714 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:19.369679  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:19.370381  5877 rpcz_store.cc:276] 0620 13:57:16.709507 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.709862 (+   355us) service_pool.cc:224] Handling call
0620 13:57:16.710192 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:16.771513 (+ 61321us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:19.360860 (+2589347us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b540030e8d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:19.361120 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60680064}
I20260620 13:57:19.374094  5880 raft_consensus.cc:2410] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260620 13:57:19.374485  5959 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 4.
I20260620 13:57:19.372982  9727 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.374773  9779 raft_consensus.cc:3055] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:19.372113  6033 rpcz_store.cc:276] 0620 13:57:18.245441 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:18.247801 (+  2360us) service_pool.cc:224] Handling call
0620 13:57:18.248124 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:18.524662 (+276538us) raft_consensus.cc:1534] Early marking committed up to index 7
0620 13:57:18.524710 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:18.524771 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:18.524818 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:19.371520 (+846702us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54001c6e54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:19.371561 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:19.371678 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":521,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"spinlock_wait_cycles":634879232}
I20260620 13:57:19.376256  9770 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:19.376410  9727 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:19.377279  6029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2624) took 1426 ms. Trace:
I20260620 13:57:19.379509  9691 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:57:19.377274  9774 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:19.380292  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1685) took 2671 ms. Trace:
I20260620 13:57:19.386755  5878 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:19.368741  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:19.398804  5951 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
W20260620 13:57:19.354591  6025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2605) took 4243 ms (client timeout 1744 ms). Trace:
W20260620 13:57:19.399910  6025 rpcz_store.cc:269] 0620 13:57:15.111317 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:15.112715 (+  1398us) service_pool.cc:224] Handling call
0620 13:57:19.354199 (+4241484us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b54000d4b54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:19.354448 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5363022208}
I20260620 13:57:19.366640  5953 raft_consensus.cc:740] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:19.389267  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:19.402390  6028 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:19.390700  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:19.390364  6029 rpcz_store.cc:276] 0620 13:57:17.950703 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:17.950918 (+   215us) service_pool.cc:224] Handling call
0620 13:57:17.951308 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:17.989308 (+ 38000us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:19.376975 (+1387667us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b54000596d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:19.377213 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84720384}
I20260620 13:57:19.404320  6033 raft_consensus.cc:2410] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260620 13:57:19.395349  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 78798us
I20260620 13:57:19.406114  5848 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:19.407281  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:19.407866  6027 raft_consensus.cc:3055] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:19.408200  6027 raft_consensus.cc:740] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:19.409201  6027 consensus_queue.cc:260] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:19.398855  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:19.396621  5879 rpcz_store.cc:276] 0620 13:57:16.709165 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.712263 (+  3098us) service_pool.cc:224] Handling call
0620 13:57:18.312928 (+1600665us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:18.313116 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 8
0620 13:57:18.313407 (+   291us) log.cc:844] Serialized 14 byte log entry
0620 13:57:18.426778 (+113371us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:18.426834 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:18.426880 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:18.426941 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:19.380076 (+953135us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54003f2350. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:19.380213 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":806,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":104,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":8452,"spinlock_wait_cycles":3538782080,"thread_start_us":113047,"threads_started":1,"wal-append.queue_time_us":130092}
I20260620 13:57:19.410708  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:19.413445  6027 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 10
I20260620 13:57:19.413363  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:19.401641  5953 consensus_queue.cc:260] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:19.414297  6028 raft_consensus.cc:2410] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260620 13:57:19.414441  5953 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:19.414737  6028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43502 (request call id 2335) took 1002 ms. Trace:
I20260620 13:57:19.415087  6028 rpcz_store.cc:276] 0620 13:57:18.412036 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:19.413123 (+1001087us) service_pool.cc:224] Handling call
0620 13:57:19.414685 (+  1562us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:19.417071  6033 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: []
I20260620 13:57:19.383849  9779 raft_consensus.cc:740] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:19.390331  9770 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:19.396721  9783 raft_consensus.cc:697] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:57:19.419021  5848 connection.cc:256] RPC call timeout handler was delayed by -1.205025237999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260620 13:57:19.423512  5848 connection.cc:256] RPC call timeout handler was delayed by -1.1807252379999227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260620 13:57:19.424010  5848 connection.cc:256] RPC call timeout handler was delayed by -1.1033252380000249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
I20260620 13:57:19.421669  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:19.424817  5848 connection.cc:256] RPC call timeout handler was delayed by -1.0511252379999405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
W20260620 13:57:19.427579  5848 connection.cc:256] RPC call timeout handler was delayed by -1.0205252380000047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
I20260620 13:57:19.370682  9567 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.412878  9694 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:19.411628  9561 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260620 13:57:19.418826  9761 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:19.422700  9780 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:19.419708  9796 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:19.439808  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:19.418116  9569 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260620 13:57:19.442140  9780 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.445559  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:19.445981  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:19.454299  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:19.446306  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:19.446724  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:19.455022  5951 raft_consensus.cc:2393] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:19.455227  5955 raft_consensus.cc:2376] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7. Re-sending same reply.
I20260620 13:57:19.409909  9675 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.448459  9567 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:19.469151  9855 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:57:19.469462  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:19.470561  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:19.471625  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:19.472553  9710 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:19.473078  9710 raft_consensus.cc:697] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:19.473968  9710 consensus_queue.cc:237] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:19.450320  5953 raft_consensus.cc:2410] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260620 13:57:19.450428  9657 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:19.475821  9746 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:19.476253  9746 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:19.476611  9746 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:19.477373  9770 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.448333  9783 consensus_queue.cc:237] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.479441  9828 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:19.479966  9828 raft_consensus.cc:697] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:19.480778  9828 consensus_queue.cc:237] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:19.413807  9774 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.481705  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:19.459276  9780 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:19.456234  9524 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:19.456524  9761 raft_consensus.cc:697] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:19.483604  9774 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:19.450829  6027 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:19.470528  9855 consensus_queue.cc:1059] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:57:19.486677  6027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43502 (request call id 2340) took 1045 ms. Trace:
I20260620 13:57:19.467507  9779 consensus_queue.cc:260] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.487908  6027 rpcz_store.cc:276] 0620 13:57:18.440998 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:19.363028 (+922030us) service_pool.cc:224] Handling call
0620 13:57:19.486626 (+123598us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:19.494745  5848 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:19.498365  5848 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:19.500696  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:19.501853  5953 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 10: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:19.484483  9761 consensus_queue.cc:237] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.504725  5882 raft_consensus.cc:1240] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:19.509999  6030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2330) took 2907 ms. Trace:
I20260620 13:57:19.513162  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:19.514017  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:19.515039  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:19.504732  5848 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:19.515894  6028 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:19.520068  5883 raft_consensus.cc:2393] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 13: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:19.513173  6030 rpcz_store.cc:276] 0620 13:57:16.602214 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.626222 (+ 24008us) service_pool.cc:224] Handling call
0620 13:57:16.626628 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:16.761002 (+134374us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:19.509731 (+2748729us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54000b72d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:19.509923 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307222784}
I20260620 13:57:19.525453  5848 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:19.507038  9298 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:57:19.522578  9779 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:19.509450  9628 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:19.506695  9567 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:19.529644  9567 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:19.530128  9567 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:19.531260  9788 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:57:19.534614  5883 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260620 13:57:19.545151  5882 raft_consensus.cc:1240] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:19.545727  6027 raft_consensus.cc:1240] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:19.531685  9788 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:19.566248  5848 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:19.544799  9628 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:19.552094  9788 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:57:19.545019  9694 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260620 13:57:19.560714  9770 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:19.569864  9628 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:19.522583  9780 consensus_queue.cc:1175] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "192c750f597c43858e1ad09e8d805685" responder_term: 8 status { last_received { term: 7 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260620 13:57:19.580127  9628 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:57:19.582333  9844 log.cc:927] Time spent T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 1.089s	user 0.001s	sys 0.013s
I20260620 13:57:19.584295  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:19.567209  9744 consensus_queue.cc:1059] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260620 13:57:19.571827  9855 consensus_queue.cc:1059] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260620 13:57:19.603986  9803 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:19.604740  9803 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:19.605234  9803 raft_consensus.cc:697] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:57:19.615708  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:19.606251  9779 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:19.596325  9524 consensus_queue.cc:1059] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260620 13:57:19.620168  9779 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:19.620362  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2217) took 2800 ms. Trace:
I20260620 13:57:19.621160  5954 rpcz_store.cc:276] 0620 13:57:16.820081 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.952713 (+132632us) service_pool.cc:224] Handling call
0620 13:57:19.362119 (+2409406us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:19.362313 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:19.362338 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:19.362392 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:57:19.362430 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:19.362486 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:19.620130 (+257644us) spinlock_profiling.cc:243] Waited 2.36 s on lock 0x7b5400306950. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:19.620270 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5434788736}
I20260620 13:57:19.622256  9779 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:19.608860  9878 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:19.623340  9878 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.608932  9744 raft_consensus.cc:3055] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Stepping down as leader of term 9
W20260620 13:57:19.627913  6587 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 976) took 3008 ms (client timeout 1689 ms). Trace:
I20260620 13:57:19.609843  9855 raft_consensus.cc:3055] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Stepping down as leader of term 4
W20260620 13:57:19.628625  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:19.634775  6032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 756) took 2997 ms (client timeout 2228 ms). Trace:
W20260620 13:57:19.634984  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:19.630863  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:19.628135  6582 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260620 13:57:19.635291  6032 rpcz_store.cc:269] 0620 13:57:16.629310 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.648694 (+ 19384us) service_pool.cc:224] Handling call
0620 13:57:19.626122 (+2977428us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54001c8754. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:19.626238 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4079014272}
W20260620 13:57:19.630965  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 62178.9us
I20260620 13:57:19.634555  9855 raft_consensus.cc:740] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:19.648209  9855 consensus_queue.cc:260] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.649511  9855 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
W20260620 13:57:19.629845  6587 rpcz_store.cc:269] 0620 13:57:16.619949 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.620390 (+   441us) service_pool.cc:224] Handling call
0620 13:57:19.627680 (+3007290us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b5400508054. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:19.627844 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763104512}
W20260620 13:57:19.649935  5998 connection.cc:256] RPC call timeout handler was delayed by -2.2537341929999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260620 13:57:19.651085  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:19.651237  5998 connection.cc:256] RPC call timeout handler was delayed by -2.097134192999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
W20260620 13:57:19.652065  5998 connection.cc:256] RPC call timeout handler was delayed by -2.0665341929999386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
W20260620 13:57:19.652941  5998 connection.cc:256] RPC call timeout handler was delayed by -1.9423341929999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260620 13:57:19.654893  5998 connection.cc:256] RPC call timeout handler was delayed by -1.8937341930000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
I20260620 13:57:19.655036  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:19.655803  5998 connection.cc:256] RPC call timeout handler was delayed by -1.5679341929999282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2278s for a response
W20260620 13:57:19.656605  5998 connection.cc:256] RPC call timeout handler was delayed by -1.4647284600000603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260620 13:57:19.657152  5998 connection.cc:256] RPC call timeout handler was delayed by -1.2091284599999881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260620 13:57:19.657588  5998 connection.cc:256] RPC call timeout handler was delayed by -1.2091284599999881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260620 13:57:19.658209  5998 connection.cc:256] RPC call timeout handler was delayed by -1.07592846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
I20260620 13:57:19.606148  9803 consensus_queue.cc:237] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:19.661478  6552 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:19.660741  5998 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:19.664057  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:19.662225  9635 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:19.667846  6552 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:19.670172  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:19.674077  9878 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:19.629631  9744 raft_consensus.cc:740] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:19.659423  9856 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:19.666754  9761 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:19.660192  9636 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:19.702526  9636 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.698928  6552 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:19.662155  9298 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:19.700562  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:19.705410  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 44928.1us
W20260620 13:57:19.705729  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:19.705814  5879 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 9: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:19.707309  9865 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:19.709113  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:19.709167  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:19.710958  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:19.711199  9613 tablet_copy_client.cc:538] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:57:19.711973  9714 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:57:19.714381  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:19.716055  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:19.716687  6024 pending_rounds.cc:85] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 7
I20260620 13:57:19.716995  6024 pending_rounds.cc:107] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260620 13:57:19.717219  6024 raft_consensus.cc:2889] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:19.718081  6583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 965) took 1078 ms. Trace:
I20260620 13:57:19.675796  9770 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:19.719552  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:19.720018  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:19.720925  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:19.718628  6583 rpcz_store.cc:276] 0620 13:57:18.639791 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:19.225997 (+586206us) service_pool.cc:224] Handling call
0620 13:57:19.717818 (+491821us) spinlock_profiling.cc:243] Waited 97.6 ms on lock 0x7b540042d1d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:19.718001 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224494976}
I20260620 13:57:19.683984  9783 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:19.683754  9635 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:19.735926  6581 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 4.
I20260620 13:57:19.737351  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:19.738320  5878 raft_consensus.cc:2368] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10.
I20260620 13:57:19.664520  9746 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:19.742735  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:19.743158  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:19.748714  5998 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:19.752503  6031 raft_consensus.cc:1240] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 2. Current term is 3. Ops: []
I20260620 13:57:19.752463  9748 consensus_queue.cc:1059] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260620 13:57:19.755424  9748 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:19.755916  5998 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:57:19.757007  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:19.757685  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:19.758240  9748 raft_consensus.cc:3055] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:19.758903  9748 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:19.760465  9748 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.677042  9567 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:19.770499  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:19.771759  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 959) took 1185 ms. Trace:
I20260620 13:57:19.771951  9744 consensus_queue.cc:260] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:19.772528  9636 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:19.773048  9744 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:19.773121  9636 raft_consensus.cc:2764] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260620 13:57:19.773245  5879 raft_consensus.cc:2410] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260620 13:57:19.717883  9298 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:19.774370  9298 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:19.722877  9669 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:19.775277  9669 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:19.776104  9669 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:19.777515  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 211344us
I20260620 13:57:19.704480  9774 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:19.778795  5848 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:19.772223  6587 rpcz_store.cc:276] 0620 13:57:18.586260 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:19.770123 (+1183863us) service_pool.cc:224] Handling call
0620 13:57:19.771678 (+  1555us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:19.722323  9761 raft_consensus.cc:697] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:19.774458  9636 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:19.723660  9714 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:19.730139  9575 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:19.729732  9881 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:19.796729  5876 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:19.736832  9835 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:19.764214  9748 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:19.737157  9885 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:19.779564  9779 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:19.727309  9642 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
W20260620 13:57:19.792841  9861 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260620 13:57:19.825627  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:19.778008  9635 raft_consensus.cc:697] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:19.700994  9856 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:19.814535  9879 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.217s	user 0.002s	sys 0.001s
I20260620 13:57:19.743470  9783 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.798601  9628 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:19.819741  9835 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.825956  9568 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:19.817620  9636 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260620 13:57:19.844990  9891 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:19.993705  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:19.811789  9714 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:19.966034  9828 raft_consensus.cc:3055] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:19.919147  9774 raft_consensus.cc:697] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:19.823603  9885 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:19.986140  9888 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.170s	user 0.006s	sys 0.003s
W20260620 13:57:19.985956  9877 log.cc:927] Time spent T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.369s	user 0.005s	sys 0.004s
W20260620 13:57:20.033094  9879 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260620 13:57:20.044516  9861 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260620 13:57:20.045738  9864 log.cc:927] Time spent T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260620 13:57:19.986539  9892 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:19.818097  9881 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:20.010670  9875 log.cc:927] Time spent T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.393s	user 0.001s	sys 0.000s
I20260620 13:57:20.054338  9894 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:20.087379  9770 raft_consensus.cc:697] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:20.051031  9793 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:20.085642  9828 raft_consensus.cc:740] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:20.014446  9568 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:20.013767  9761 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:20.134893  9884 log.cc:927] Time spent T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.327s	user 0.002s	sys 0.000s
I20260620 13:57:20.048520  9891 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:20.140878  9770 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:20.119271  9892 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:20.143136  9714 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:20.144152  9895 log.cc:927] Time spent T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260620 13:57:20.127841  9894 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:20.145294  9892 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:20.104535  9635 consensus_queue.cc:237] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:20.146996  9894 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:20.139825  9828 consensus_queue.cc:260] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:20.148147  9783 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:20.149003  9856 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:20.155162  9746 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:20.148025  9881 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:20.158116  9788 consensus_meta.cc:287] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.580s	user 0.006s	sys 0.005s
I20260620 13:57:20.148252  9828 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:20.163285  9628 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:20.164714  9885 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:20.139820  9890 log.cc:927] Time spent T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.264s	user 0.000s	sys 0.000s
I20260620 13:57:20.146278  9669 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:20.174605  9669 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:20.158617  9788 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:20.175055  9613 tablet_bootstrap.cc:492] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:57:20.176890  9788 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:20.168648  9568 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:20.189476  9855 consensus_meta.cc:287] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.003s
I20260620 13:57:20.191485  9865 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:20.154726  9298 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:20.142141  9774 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:20.206763  9891 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:20.214129  6579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 966) took 1574 ms (client timeout 2044 ms). Trace:
W20260620 13:57:20.216393  6579 rpcz_store.cc:269] 0620 13:57:18.640099 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:19.145140 (+505041us) service_pool.cc:224] Handling call
0620 13:57:20.213821 (+1068681us) spinlock_profiling.cc:243] Waited 79.3 ms on lock 0x7b54003b74d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:20.214031 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182366976}
I20260620 13:57:20.218307  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:20.220271  6579 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 9: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:20.222263  9298 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:20.223591  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 991) took 1008 ms. Trace:
I20260620 13:57:20.231390  6579 rpcz_store.cc:276] 0620 13:57:19.214760 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.217102 (+1002342us) service_pool.cc:224] Handling call
0620 13:57:20.223466 (+  6364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:20.245265  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:20.255468  9541 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:20.259312  6579 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:20.264029  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 995) took 1040 ms. Trace:
I20260620 13:57:20.272341  6587 rpcz_store.cc:276] 0620 13:57:19.223673 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:19.811545 (+587872us) service_pool.cc:224] Handling call
0620 13:57:20.263804 (+452259us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54004a83d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:20.263960 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":908620672}
I20260620 13:57:20.274326  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:20.274370  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:20.275424  9541 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:20.276120  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:20.276435  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 953) took 1692 ms. Trace:
I20260620 13:57:20.277098  9541 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:20.277724  6587 rpcz_store.cc:276] 0620 13:57:18.584346 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.274083 (+1689737us) service_pool.cc:224] Handling call
0620 13:57:20.276364 (+  2281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:20.278860  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:20.279508  6587 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:20.280645  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 990) took 1066 ms. Trace:
I20260620 13:57:20.281028  6587 rpcz_store.cc:276] 0620 13:57:19.214200 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.278574 (+1064374us) service_pool.cc:224] Handling call
0620 13:57:20.280591 (+  2017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:20.282084  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:20.283571  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:20.284293  6587 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:20.284914  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 993) took 1068 ms. Trace:
I20260620 13:57:20.285286  6587 rpcz_store.cc:276] 0620 13:57:19.216642 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.283287 (+1066645us) service_pool.cc:224] Handling call
0620 13:57:20.284860 (+  1573us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:20.286350  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:20.279436  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:20.280107  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 992) took 1064 ms. Trace:
I20260620 13:57:20.287400  6579 rpcz_store.cc:276] 0620 13:57:19.215357 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.233201 (+1017844us) service_pool.cc:224] Handling call
0620 13:57:20.280036 (+ 46835us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:20.288476  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:20.289659  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:20.290797  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:20.291463  6579 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:20.292217  9828 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:20.292464  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:20.292860  9828 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:20.291728  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:20.293242  9828 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:20.293229  6579 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:20.306044  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:20.306438  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:20.308095  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:20.313472  6579 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:20.314108  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 989) took 1100 ms. Trace:
I20260620 13:57:20.314445  6579 rpcz_store.cc:276] 0620 13:57:19.213570 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.292176 (+1078606us) service_pool.cc:224] Handling call
0620 13:57:20.314046 (+ 21870us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:20.315397  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:20.318866  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:20.319535  6587 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:20.320252  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:20.321136  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:20.322484  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:20.323432  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:20.324084  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 962) took 1737 ms. Trace:
I20260620 13:57:20.325433  6579 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:57:20.325807  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1913) took 3791 ms. Trace:
I20260620 13:57:20.326164  5952 rpcz_store.cc:276] 0620 13:57:16.534238 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.534457 (+   219us) service_pool.cc:224] Handling call
0620 13:57:16.534872 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:18.053125 (+1518253us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:20.325553 (+2272428us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400305f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:20.325736 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3484522240}
I20260620 13:57:20.329196  9828 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:20.324378  6587 rpcz_store.cc:276] 0620 13:57:18.587071 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.323239 (+1736168us) service_pool.cc:224] Handling call
0620 13:57:20.324027 (+   788us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:20.331535  9828 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:20.332069  6587 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260620 13:57:20.332860  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 955) took 1748 ms. Trace:
I20260620 13:57:20.333274  6587 rpcz_store.cc:276] 0620 13:57:18.584943 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.330590 (+1745647us) service_pool.cc:224] Handling call
0620 13:57:20.330932 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:20.332580 (+  1648us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:20.332806 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:20.335162  6587 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:20.335929  9705 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:20.335927  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 956) took 1750 ms. Trace:
I20260620 13:57:20.337272  6587 rpcz_store.cc:276] 0620 13:57:18.585215 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.334628 (+1749413us) service_pool.cc:224] Handling call
0620 13:57:20.334930 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:20.335614 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:20.335867 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:20.338799  6587 raft_consensus.cc:1240] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260620 13:57:20.339533  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 961) took 1752 ms. Trace:
I20260620 13:57:20.339905  6587 rpcz_store.cc:276] 0620 13:57:18.586707 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.338147 (+1751440us) service_pool.cc:224] Handling call
0620 13:57:20.338536 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:20.339279 (+   743us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:20.339484 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260620 13:57:20.341723  5958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 879) took 4300 ms (client timeout 1896 ms). Trace:
I20260620 13:57:20.361635  6582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 991) took 3561 ms. Trace:
I20260620 13:57:20.362687  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 963) took 1775 ms. Trace:
W20260620 13:57:20.347524  5958 rpcz_store.cc:269] 0620 13:57:16.041590 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.111391 (+ 69801us) service_pool.cc:224] Handling call
0620 13:57:20.341399 (+4230008us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400251cd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:20.341597 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2972295552}
I20260620 13:57:20.369668  9630 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:20.372468  9835 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:20.362272  6582 rpcz_store.cc:276] 0620 13:57:16.799921 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:17.881131 (+1081210us) service_pool.cc:224] Handling call
0620 13:57:19.627821 (+1746690us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:19.636129 (+  8308us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:20.361267 (+725138us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b5400508050. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:20.361514 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4016109312}
I20260620 13:57:20.375586  6582 raft_consensus.cc:1240] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:20.376528  6582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 968) took 1119 ms. Trace:
I20260620 13:57:20.367928  9567 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:20.379278  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:20.383909  6583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 964) took 1791 ms. Trace:
I20260620 13:57:20.396494  9541 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:20.396077  6583 rpcz_store.cc:276] 0620 13:57:18.592816 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.346526 (+1753710us) service_pool.cc:224] Handling call
0620 13:57:20.347009 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:20.383388 (+ 36379us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:20.383430 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:20.383494 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:20.383549 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:20.383633 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:20.383825 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:20.397275  9541 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:20.399204  9902 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:20.393963  9828 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:20.399252  6582 rpcz_store.cc:276] 0620 13:57:19.257340 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.374584 (+1117244us) service_pool.cc:224] Handling call
0620 13:57:20.375325 (+   741us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:20.376205 (+   880us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:20.376455 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:20.400303  9828 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:20.401026  9541 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:20.363164  6587 rpcz_store.cc:276] 0620 13:57:18.587355 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.340737 (+1753382us) service_pool.cc:224] Handling call
0620 13:57:20.341215 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:20.341605 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:20.341637 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:20.342109 (+   472us) log.cc:844] Serialized 26 byte log entry
0620 13:57:20.352218 (+ 10109us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:20.360851 (+  8633us) log.cc:844] Serialized 14 byte log entry
0620 13:57:20.362347 (+  1496us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:20.362443 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:20.362488 (+    45us) raft_consensus.cc:1685] finished
0620 13:57:20.362501 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:20.362627 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21436,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":149,"thread_start_us":17918,"threads_started":2,"wal-append.queue_time_us":7718}
I20260620 13:57:20.402462  9828 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:20.394106  9710 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:20.403199  9710 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:20.405524  9710 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:20.398898  6583 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:20.399748  9902 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:20.415072  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:20.420907  9657 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.007s	sys 0.008s
W20260620 13:57:20.432312  9657 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.007s	sys 0.008s
I20260620 13:57:20.422101  6029 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260620 13:57:20.431351  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:20.433339  6029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2337) took 2010 ms. Trace:
I20260620 13:57:20.426229  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 954) took 1841 ms. Trace:
I20260620 13:57:20.429694  9902 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:20.434005  6029 rpcz_store.cc:276] 0620 13:57:18.423050 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:19.403543 (+980493us) service_pool.cc:224] Handling call
0620 13:57:20.421503 (+1017960us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b5800034e98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:57:20.421729 (+   226us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:20.433050 (+ 11321us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:20.433284 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8206592}
I20260620 13:57:20.436904  6579 rpcz_store.cc:276] 0620 13:57:18.584602 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.326134 (+1741532us) service_pool.cc:224] Handling call
0620 13:57:20.326415 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:20.326612 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 9
0620 13:57:20.424312 (+ 97700us) log.cc:844] Serialized 14 byte log entry
0620 13:57:20.425779 (+  1467us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:20.425835 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:20.425877 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:20.425982 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:20.426169 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33814,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":102,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":1920,"thread_start_us":98090,"threads_started":2,"wal-append.queue_time_us":1059}
I20260620 13:57:20.445981  6586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 998) took 2191 ms. Trace:
I20260620 13:57:20.446568  6586 rpcz_store.cc:276] 0620 13:57:18.254439 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:18.403716 (+149277us) service_pool.cc:224] Handling call
0620 13:57:18.404102 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:19.154162 (+750060us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:20.445644 (+1291482us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54005113d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:20.445896 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937261440}
I20260620 13:57:20.451781  9675 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:20.461141  5996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.015s	sys 0.020s
W20260620 13:57:20.461562  5996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.015s	sys 0.020s
W20260620 13:57:20.462517  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:20.468641  6029 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:20.471046  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:20.471692  6025 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:20.474184  6029 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:20.475363  9719 consensus_queue.cc:1059] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:57:20.476042  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:20.476466  9719 raft_consensus.cc:3055] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:20.476874  9719 raft_consensus.cc:740] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:20.477419  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:20.477653  9719 consensus_queue.cc:260] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:20.478499  6029 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:20.479300  6025 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:20.480057  9902 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:57:20.483523  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:20.484665  9852 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:20.485368  9852 raft_consensus.cc:697] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:20.486322  9852 consensus_queue.cc:237] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:20.490245  5923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.003s	sys 0.007s
W20260620 13:57:20.490751  5923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.004s	sys 0.008s
I20260620 13:57:20.492671  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:20.493323  5954 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:20.501201  5954 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
W20260620 13:57:20.535776  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:20.536808  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:20.538089  9675 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:20.538846  9675 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:20.539592  5876 raft_consensus.cc:1240] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260620 13:57:20.548866  6585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34178 (request call id 12) took 4034 ms. Trace:
I20260620 13:57:20.549489  6585 rpcz_store.cc:276] 0620 13:57:16.514708 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.514875 (+   167us) service_pool.cc:224] Handling call
0620 13:57:20.548664 (+4033789us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540048f654. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7f6c33 00007f0fe47c4d0a 00007f0fddd48934 00007f0fddd488c2 00007f0fddd487f1 00007f0fddd4876c 00007f0fddd47a22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:20.548779 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3209227008}
I20260620 13:57:20.567844  5954 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260620 13:57:20.568053  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:20.568946  5952 raft_consensus.cc:2410] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260620 13:57:20.570343  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:20.571463  5952 raft_consensus.cc:2410] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260620 13:57:20.572049  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:20.573645  6054 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
I20260620 13:57:20.575474  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:20.576344  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:20.577031  5959 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 7
I20260620 13:57:20.577068  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:20.578356  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:20.579170  5952 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 13: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:20.579439  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:20.580008  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:20.580224  5955 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:57:20.580518  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:20.581178  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:20.582512  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:20.583292  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:20.583313  5952 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:20.585453  9675 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:20.586005  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:20.586817  5956 raft_consensus.cc:2393] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 9: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:20.589058  9675 consensus_queue.cc:1059] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:57:20.590183  9675 raft_consensus.cc:3055] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:20.590523  9675 raft_consensus.cc:740] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:20.479048  9719 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:20.591056  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2636) took 1082 ms. Trace:
I20260620 13:57:20.598085  5950 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:20.594470  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:20.600416  5881 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:20.595985  5876 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260620 13:57:20.601684  5876 pending_rounds.cc:85] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 6
I20260620 13:57:20.601956  5876 pending_rounds.cc:107] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260620 13:57:20.602243  5876 raft_consensus.cc:2889] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:57:20.602928  6551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.009s	sys 0.026s
I20260620 13:57:20.604327  5959 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:20.605307  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:20.606611  5959 raft_consensus.cc:1240] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:20.597260  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:20.608014  5956 raft_consensus.cc:2393] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 7: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:20.609108  5956 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260620 13:57:20.592775  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:20.611121  6032 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 14: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:20.610922  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:20.612152  5877 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:20.610224  5958 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 10. Ops: []
I20260620 13:57:20.613646  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:20.614311  5881 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:20.614866  6578 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
W20260620 13:57:20.591979  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:20.621965  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:20.623603  5876 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:20.597700  6033 rpcz_store.cc:276] 0620 13:57:19.508587 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:19.510455 (+  1868us) service_pool.cc:224] Handling call
0620 13:57:19.510845 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:19.511245 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:19.511278 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:19.511757 (+   479us) log.cc:844] Serialized 26 byte log entry
0620 13:57:19.560306 (+ 48549us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:57:19.560376 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:19.560471 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:20.590822 (+1030351us) raft_consensus.cc:1685] finished
0620 13:57:20.590842 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:20.590992 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1266,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":1970,"thread_start_us":48067,"threads_started":1,"wal-append.queue_time_us":82233}
W20260620 13:57:20.630852  6550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.028s	sys 0.029s
W20260620 13:57:20.631359  6550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.030s	sys 0.029s
I20260620 13:57:20.632189  9901 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:20.632886  9901 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:20.635710  9866 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:20.636153  9901 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:20.636310  9866 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:20.644961  9901 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:20.645684  9901 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:20.648172  9901 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:20.648896  9706 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:20.689815  9706 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:20.649153  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:20.691648  9787 raft_consensus.cc:3055] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:20.692148  9787 raft_consensus.cc:740] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:20.693029  9787 consensus_queue.cc:260] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:20.693675  9706 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:20.610277  5848 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:20.651805  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:20.653425  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:20.695964  6028 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:20.696725  9702 consensus_queue.cc:1059] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:57:20.697634  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:20.698549  9702 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:20.698902  9702 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:18.566329  6580 rpcz_store.cc:276] 0620 13:57:16.800567 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:18.249229 (+1448662us) service_pool.cc:224] Handling call
0620 13:57:18.253191 (+  3962us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:18.253467 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 8
0620 13:57:18.372738 (+119271us) log.cc:844] Serialized 14 byte log entry
0620 13:57:18.565056 (+192318us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:18.565107 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:18.565154 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:18.565220 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:18.565345 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2978,"prepare.queue_time_us":240356,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":53,"raft.queue_time_us":4617,"thread_start_us":288863,"threads_started":2}
I20260620 13:57:20.699330  9702 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:20.646894  9866 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:20.706300  6028 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
W20260620 13:57:20.717131  6552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.044s	sys 0.016s
W20260620 13:57:21.187641  6552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.318s	user 0.045s	sys 0.016s
I20260620 13:57:20.627668  9675 consensus_queue.cc:260] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:21.252306  9675 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:21.257079  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 229881us
I20260620 13:57:20.721102  9702 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:21.262499  9702 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:20.700811  9780 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:21.267889  9780 raft_consensus.cc:697] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:21.269088  9780 consensus_queue.cc:237] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:20.715158  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 91985.4us
I20260620 13:57:20.749459  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 1000) took 1187 ms. Trace:
I20260620 13:57:20.824981  9906 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260620 13:57:21.273360  6587 rpcz_store.cc:276] 0620 13:57:19.561718 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.402248 (+840530us) service_pool.cc:224] Handling call
0620 13:57:20.402580 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:20.413100 (+ 10520us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:20.413130 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:20.722148 (+309018us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b2c000fb6b8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fde0f5c71 00007f0fde1055d2 00007f0fdf837de1 00007f0fdf7fc81a 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22
0620 13:57:20.722722 (+   574us) log.cc:844] Serialized 26 byte log entry
0620 13:57:20.744409 (+ 21687us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:57:20.744455 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:20.744553 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:20.749098 (+  4545us) raft_consensus.cc:1685] finished
0620 13:57:20.749124 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:20.749380 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9834,"raft.queue_time_us":9950,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":12425472,"thread_start_us":21055,"threads_started":1,"wal-append.queue_time_us":24420}
W20260620 13:57:20.864001  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:21.277664  9633 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:21.278326  9633 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:20.881539  9905 consensus_queue.cc:1059] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:57:21.280820  9633 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:21.283672  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:21.284651  6025 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:21.286013  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:21.286831  6027 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:20.882545  5997 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:21.292027  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 409935us
W20260620 13:57:20.889528  6578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 952) took 2305 ms (client timeout 1731 ms). Trace:
W20260620 13:57:20.891805  6581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 977) took 4271 ms (client timeout 1596 ms). Trace:
W20260620 13:57:21.300757  6578 rpcz_store.cc:269] 0620 13:57:18.583861 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:18.584259 (+   398us) service_pool.cc:224] Handling call
0620 13:57:20.888848 (+2304589us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54005366d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:20.889127 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4630802304}
W20260620 13:57:21.300891  6581 rpcz_store.cc:269] 0620 13:57:16.620226 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:16.620653 (+   427us) service_pool.cc:224] Handling call
0620 13:57:20.891089 (+4270436us) spinlock_profiling.cc:243] Waited 2.96 s on lock 0x7b540028cb54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:20.891538 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6817191168}
I20260620 13:57:21.303337  6581 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:20.954308  9567 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:21.027283  6024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 786) took 1311 ms. Trace:
W20260620 13:57:21.041045  5998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.246s	user 0.037s	sys 0.024s
W20260620 13:57:21.305444  5998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.511s	user 0.038s	sys 0.025s
W20260620 13:57:20.700729  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 90534.6us
W20260620 13:57:20.968581  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:20.699008  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:21.580255  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 881198us
I20260620 13:57:21.581458  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:21.582355  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:20.685290  5951 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:21.584896  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2253) took 1016 ms. Trace:
I20260620 13:57:21.585304  5951 rpcz_store.cc:276] 0620 13:57:20.568551 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.571370 (+  2819us) service_pool.cc:224] Handling call
0620 13:57:21.584657 (+1013287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:21.586683  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:20.836009  5952 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:21.745260  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1928) took 1167 ms. Trace:
I20260620 13:57:21.745709  5952 rpcz_store.cc:276] 0620 13:57:20.578196 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.582282 (+  4086us) service_pool.cc:224] Handling call
0620 13:57:21.745150 (+1162868us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:20.873636  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:21.748103  5953 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:20.710683  5955 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:57:21.754235  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2256) took 1184 ms. Trace:
I20260620 13:57:21.754667  5955 rpcz_store.cc:276] 0620 13:57:20.569407 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.579200 (+  9793us) service_pool.cc:224] Handling call
0620 13:57:21.754043 (+1174843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:21.755788  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:20.708317  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:21.759569  5956 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:21.760156  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1934) took 1068 ms. Trace:
I20260620 13:57:21.760485  5956 rpcz_store.cc:276] 0620 13:57:20.691729 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.708020 (+ 16291us) service_pool.cc:224] Handling call
0620 13:57:21.760083 (+1052063us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:20.821580  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:21.762458  5954 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:20.724866  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:21.769114  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1936) took 1076 ms. Trace:
I20260620 13:57:21.769521  5959 rpcz_store.cc:276] 0620 13:57:20.692253 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.724499 (+ 32246us) service_pool.cc:224] Handling call
0620 13:57:21.768915 (+1044416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:20.855893  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:21.771554  5878 raft_consensus.cc:2393] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 9: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:21.772660  5878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58452 (request call id 2654) took 1189 ms. Trace:
I20260620 13:57:21.773046  5878 rpcz_store.cc:276] 0620 13:57:20.582677 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.854888 (+272211us) service_pool.cc:224] Handling call
0620 13:57:21.772178 (+917290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:21.038612  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2239) took 1667 ms. Trace:
I20260620 13:57:21.777377  5950 rpcz_store.cc:276] 0620 13:57:19.371361 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:19.371791 (+   430us) service_pool.cc:224] Handling call
0620 13:57:20.597831 (+1226040us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:20.598709 (+   878us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:21.038145 (+439436us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400251cd0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:21.038422 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2818981120}
I20260620 13:57:21.030200  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:21.780200  5883 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
W20260620 13:57:21.780866  5883 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58452 (request call id 2653) took 1198 ms (client timeout 1580 ms). Trace:
W20260620 13:57:21.781960  5883 rpcz_store.cc:269] 0620 13:57:20.582417 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:21.029687 (+447270us) service_pool.cc:224] Handling call
0620 13:57:21.780797 (+751110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260620 13:57:20.936837  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:21.316498  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 1.52172e+06us
I20260620 13:57:21.802203  9887 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:21.802819  9887 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:21.323211  5997 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:21.812358  9887 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:21.813146  9898 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:57:21.813366  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 519618us
I20260620 13:57:21.304420  6024 rpcz_store.cc:276] 0620 13:57:19.715841 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:19.716136 (+   295us) service_pool.cc:224] Handling call
0620 13:57:19.716498 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:19.717746 (+  1248us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:19.717773 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:20.894589 (+1176816us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b2c000c06c8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fde0f5c71 00007f0fde1055d2 00007f0fdf837de1 00007f0fdf7fc81a 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22
0620 13:57:20.895368 (+   779us) log.cc:844] Serialized 26 byte log entry
0620 13:57:20.935551 (+ 40183us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:20.935640 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:20.935789 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:21.026619 (+ 90830us) raft_consensus.cc:1685] finished
0620 13:57:21.026641 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:21.026979 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9880832,"thread_start_us":39646,"threads_started":1,"wal-append.queue_time_us":112269}
I20260620 13:57:21.814991  5998 leader_election.cc:400] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10.
I20260620 13:57:21.322603  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:21.321928  6028 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260620 13:57:21.326004  6033 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:21.821313  5953 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:21.239013  6031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2627) took 3274 ms. Trace:
I20260620 13:57:21.822158  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 892) took 1022 ms. Trace:
I20260620 13:57:21.211623  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:21.207130  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:21.824003  6580 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:21.212975  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:21.214613  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:21.828022  6583 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:21.302677  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:21.829432  6578 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:21.210063  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:21.209931  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:21.211174  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:21.842404  6585 raft_consensus.cc:2393] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 9: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:21.275849  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:21.304589  9567 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:21.194351  9613 tablet_bootstrap.cc:492] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:57:21.305047  9670 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election won for term 10
W20260620 13:57:21.130568  9719 consensus_meta.cc:287] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.537s	user 0.013s	sys 0.008s
I20260620 13:57:21.136888  9787 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:21.317648  9852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.020s	sys 0.028s
I20260620 13:57:21.315223  9905 raft_consensus.cc:3055] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:21.862903  5957 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:21.863133  9905 raft_consensus.cc:740] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:21.865628  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2252) took 1297 ms. Trace:
W20260620 13:57:21.477388  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:21.526015  6027 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:21.535058  5769 maintenance_manager.cc:643] P 7635bbf8f82045f99dd7ac0f4a911859: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 5.782s	user 0.210s	sys 0.058s Metrics: {"bytes_written":30069,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":8877,"dirs.run_cpu_time_us":521,"dirs.run_wall_time_us":1373,"drs_written":1,"lbm_read_time_us":1273,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":52164,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":66218,"threads_started":2,"update_count":14,"wal-append.queue_time_us":7261}
I20260620 13:57:21.373778  5849 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:21.868741  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 510447us
I20260620 13:57:21.869824  5849 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:21.544607  9828 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:21.870904  9780 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:21.874243  5770 maintenance_manager.cc:419] P 7635bbf8f82045f99dd7ac0f4a911859: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11100 bytes on disk
I20260620 13:57:21.577831  9541 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:21.592085  5951 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:21.594590  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:21.875588  5879 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:21.875320  9541 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:21.877594  9541 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:21.590811  5876 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260620 13:57:21.595067  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:21.879184  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:21.879866  9780 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:21.880503  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:21.880439  9780 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:21.597947  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:21.612455  5884 raft_consensus.cc:3055] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:21.881635  5884 raft_consensus.cc:740] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:21.882817  5951 raft_consensus.cc:2410] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260620 13:57:21.623934  6029 raft_consensus.cc:3055] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:21.883282  6029 raft_consensus.cc:740] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:21.883387  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 889) took 1084 ms. Trace:
I20260620 13:57:21.883723  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:21.883795  5951 rpcz_store.cc:276] 0620 13:57:20.798586 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:21.586358 (+787772us) service_pool.cc:224] Handling call
0620 13:57:21.883312 (+296954us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:21.884192  6029 consensus_queue.cc:260] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:21.885571  5924 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:21.885843  9723 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:21.886350  9730 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:21.886526  9723 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:21.887167  9730 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:21.889147  9723 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:21.889770  9730 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:21.641291  6030 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:57:21.657387  9902 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:21.656399  9741 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:21.675961  9635 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:21.871006  9828 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:21.696691  6608 debug-util.cc:398] Leaking SignalData structure 0x7b0800295fc0 after lost signal to thread 4722
I20260620 13:57:21.728245  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1931) took 1149 ms. Trace:
I20260620 13:57:21.891081  9741 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:21.893087  9741 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:21.096387  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2648) took 1455 ms. Trace:
W20260620 13:57:21.892499  6608 debug-util.cc:398] Leaking SignalData structure 0x7b080030ee00 after lost signal to thread 5815
W20260620 13:57:21.895715  6608 debug-util.cc:398] Leaking SignalData structure 0x7b0800324b20 after lost signal to thread 5829
I20260620 13:57:21.891501  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:21.896667  5951 raft_consensus.cc:2393] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 5: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:57:21.897029  6608 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9460 after lost signal to thread 5908
W20260620 13:57:21.791045  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 285162us
I20260620 13:57:21.897200  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 905) took 1092 ms. Trace:
I20260620 13:57:21.898182  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:21.899905  9638 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:21.900374  9638 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:21.900807  9638 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:21.901722  5769 maintenance_manager.cc:643] P 7635bbf8f82045f99dd7ac0f4a911859: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.004s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":348,"lbm_reads_lt_1ms":4}
W20260620 13:57:21.071074  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:21.805358  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:21.905731  5875 raft_consensus.cc:2393] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 9: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:21.891489  9635 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:21.907739  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:21.908703  5875 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:21.909749  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:21.910585  9635 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:21.806315  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:21.910779  9901 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:21.892637  5958 rpcz_store.cc:276] 0620 13:57:20.578936 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.614129 (+ 35193us) service_pool.cc:224] Handling call
0620 13:57:20.614401 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:21.617599 (+1003198us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:21.617651 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:21.617696 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:21.617741 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:21.727780 (+110039us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400043dd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:21.727827 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:21.728065 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2306285312}
I20260620 13:57:21.912330  9901 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:21.807507  5880 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1710) took 2087 ms (client timeout 2250 ms). Trace:
I20260620 13:57:21.912470  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:21.912925  9901 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:21.913726  5958 raft_consensus.cc:2410] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260620 13:57:21.912391  5877 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:21.914577  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 894) took 1114 ms. Trace:
I20260620 13:57:21.915231  9901 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:21.882674  5884 consensus_queue.cc:260] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:21.917140  5884 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:21.917224  5877 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260620 13:57:21.912895  5880 rpcz_store.cc:269] 0620 13:57:19.719477 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:19.719593 (+   116us) service_pool.cc:224] Handling call
0620 13:57:21.806982 (+2087389us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54000c71d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:21.807308 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4188443520}
I20260620 13:57:21.885888  6029 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:21.923413  5876 raft_consensus.cc:2393] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 5: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:21.807621  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:21.926079  5958 rpcz_store.cc:276] 0620 13:57:20.800362 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:21.912207 (+1111845us) service_pool.cc:224] Handling call
0620 13:57:21.914420 (+  2213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:21.809727  5954 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:57:21.810446  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:21.816969  5998 leader_election.cc:403] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260620 13:57:21.321475  6026 raft_consensus.cc:3055] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:21.936772  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 891) took 1137 ms. Trace:
I20260620 13:57:21.936936  6026 raft_consensus.cc:740] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:21.937199  5956 rpcz_store.cc:276] 0620 13:57:20.799326 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:21.761264 (+961938us) service_pool.cc:224] Handling call
0620 13:57:21.936683 (+175419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:21.935990  5878 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:21.937798  6026 consensus_queue.cc:260] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:21.938771  9898 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:21.936954  9723 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:21.822490  6031 rpcz_store.cc:276] 0620 13:57:17.964281 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:18.021890 (+ 57609us) service_pool.cc:224] Handling call
0620 13:57:18.022181 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:19.754760 (+1732579us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:21.238569 (+1483809us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54000e6fd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:21.238832 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3978862848}
I20260620 13:57:21.832899  6579 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:21.833542  5953 rpcz_store.cc:276] 0620 13:57:20.799668 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.872506 (+ 72838us) service_pool.cc:224] Handling call
0620 13:57:21.822095 (+949589us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:21.834476  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:21.835258  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:21.943059  6608 debug-util.cc:398] Leaking SignalData structure 0x7b08002da2a0 after lost signal to thread 5983
I20260620 13:57:21.844105  6587 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:57:21.844769  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:21.847783  9567 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:21.943497  6608 debug-util.cc:398] Leaking SignalData structure 0x7b08002da280 after lost signal to thread 5984
I20260620 13:57:21.943977  9567 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:21.944376  9567 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:21.944736  9567 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:21.946036  6026 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:21.947556  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 899) took 1145 ms. Trace:
I20260620 13:57:21.947902  5950 rpcz_store.cc:276] 0620 13:57:20.801958 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:21.778740 (+976782us) service_pool.cc:224] Handling call
0620 13:57:21.839769 (+ 61029us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:57:21.947494 (+107725us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12112128}
I20260620 13:57:21.948652  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:21.949672  5959 raft_consensus.cc:2393] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:21.893273  9828 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:21.950135  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 897) took 1148 ms. Trace:
I20260620 13:57:21.850072  9613 tablet_bootstrap.cc:492] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:57:21.850986  9670 raft_consensus.cc:697] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:21.939628  9898 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:21.865101  9905 consensus_queue.cc:260] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:21.963291  9905 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:21.963693  5777 catalog_manager.cc:5696] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:21.939884  5878 raft_consensus.cc:3055] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:21.967432  5878 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:21.967916  9780 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:21.968493  5878 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:21.600427  5881 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260620 13:57:21.890604  9902 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:21.979278  9902 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:21.980669  5878 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:21.784057  9885 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:57:21.791595  6551 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.015s	sys 0.000s
W20260620 13:57:21.987296  6551 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.016s	sys 0.000s
W20260620 13:57:21.987687  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 715592us
W20260620 13:57:21.988617  6551 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.684s (SENT) [suppressed 32 similar messages]
I20260620 13:57:21.988920  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:21.902660  9835 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:21.989584  5956 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:21.990077  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1939) took 1103 ms. Trace:
I20260620 13:57:21.990505  9835 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:21.991127  9835 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:21.992121  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:21.992759  5953 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:21.993222  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 903) took 1189 ms. Trace:
I20260620 13:57:21.893668  5882 rpcz_store.cc:276] 0620 13:57:19.640685 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:19.641212 (+   527us) service_pool.cc:224] Handling call
0620 13:57:19.641637 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:20.649872 (+1008235us) raft_consensus.cc:1534] Early marking committed up to index 8
0620 13:57:20.796434 (+146562us) log.cc:844] Serialized 14 byte log entry
0620 13:57:20.859502 (+ 63068us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:20.859612 (+   110us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:20.859737 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:21.095713 (+235976us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540040ea54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:21.095773 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:21.096079 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":89388,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":36682,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":303,"spinlock_wait_cycles":2318171392,"thread_start_us":207049,"threads_started":2,"wal-append.queue_time_us":75462,"wal-append.run_cpu_time_us":8189,"wal-append.run_wall_time_us":1002168}
I20260620 13:57:21.808874  5883 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:21.993551  5953 rpcz_store.cc:276] 0620 13:57:20.804006 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:21.991014 (+1187008us) service_pool.cc:224] Handling call
0620 13:57:21.993167 (+  2153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:21.994719  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:21.995903  9885 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:21.996448  9885 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:21.997804  9835 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:21.927491  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 95612.1us
I20260620 13:57:21.927656  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 893) took 1127 ms. Trace:
I20260620 13:57:21.998636  9885 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:21.995504  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 888) took 1197 ms. Trace:
I20260620 13:57:21.998973  5954 rpcz_store.cc:276] 0620 13:57:20.800026 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.819680 (+ 19654us) service_pool.cc:224] Handling call
0620 13:57:21.927045 (+1107365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:21.999384  5953 rpcz_store.cc:276] 0620 13:57:20.798180 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:21.994439 (+1196259us) service_pool.cc:224] Handling call
0620 13:57:21.995452 (+  1013us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:22.000095  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.000329  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.000897  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 904) took 1196 ms. Trace:
I20260620 13:57:22.001195  5954 rpcz_store.cc:276] 0620 13:57:20.804355 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:21.999774 (+1195419us) service_pool.cc:224] Handling call
0620 13:57:22.000835 (+  1061us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:22.002115  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.002825  5950 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:22.002117  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.004786  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 900) took 1202 ms. Trace:
I20260620 13:57:22.005106  5954 rpcz_store.cc:276] 0620 13:57:20.802251 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:22.001757 (+1199506us) service_pool.cc:224] Handling call
0620 13:57:22.004728 (+  2971us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39040}
I20260620 13:57:21.990370  5956 rpcz_store.cc:276] 0620 13:57:20.886373 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:21.988615 (+1102242us) service_pool.cc:224] Handling call
0620 13:57:21.990025 (+  1410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:21.918982  5877 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260620 13:57:21.932622  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:22.009804  9902 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.010695  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 890) took 1211 ms. Trace:
I20260620 13:57:22.011226  5952 rpcz_store.cc:276] 0620 13:57:20.798982 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:21.797823 (+998841us) service_pool.cc:224] Handling call
0620 13:57:21.932421 (+134598us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:57:22.010641 (+ 78220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27754368}
I20260620 13:57:22.011674  5953 raft_consensus.cc:2368] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10.
I20260620 13:57:21.866120  5957 rpcz_store.cc:276] 0620 13:57:20.568283 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:20.575202 (+  6919us) service_pool.cc:224] Handling call
0620 13:57:21.865347 (+1290145us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54002a80d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:21.865529 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2959004928}
I20260620 13:57:21.935985  9906 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:57:21.936395  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 51028us
I20260620 13:57:21.940335  5880 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:57:22.013314  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 901) took 1210 ms. Trace:
I20260620 13:57:21.954126  9670 consensus_queue.cc:237] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:21.953147  5959 rpcz_store.cc:276] 0620 13:57:20.801340 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:21.770243 (+968903us) service_pool.cc:224] Handling call
0620 13:57:21.948476 (+178233us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:57:21.950076 (+  1600us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29294976}
W20260620 13:57:21.862147  9852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.372s	user 0.022s	sys 0.029s
I20260620 13:57:21.956203  9613 ts_tablet_manager.cc:1403] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 1.781s	user 0.041s	sys 0.015s
I20260620 13:57:21.870301  9887 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:22.016332  9887 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:21.970691  9898 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:21.972709  9567 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:21.977123  6024 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260620 13:57:21.664698  9702 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:21.984025  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:21.966728  6608 debug-util.cc:398] Leaking SignalData structure 0x7b08003ad4c0 after lost signal to thread 6057
I20260620 13:57:22.032367  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:21.985514  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 52953.7us
I20260620 13:57:22.005177  5997 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:21.897560  5951 rpcz_store.cc:276] 0620 13:57:20.804732 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:21.891183 (+1086451us) service_pool.cc:224] Handling call
0620 13:57:21.897114 (+  5931us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:22.014110  5953 rpcz_store.cc:276] 0620 13:57:20.802565 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:22.000077 (+1197512us) service_pool.cc:224] Handling call
0620 13:57:22.012843 (+ 12766us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5400262fd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:22.013079 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24161536}
I20260620 13:57:22.030360  6024 pending_rounds.cc:85] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 4
I20260620 13:57:22.035063  6026 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260620 13:57:22.036233  9898 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10.
I20260620 13:57:22.036494  9852 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260620 13:57:22.037595  6608 debug-util.cc:398] Leaking SignalData structure 0x7b08003dd300 after lost signal to thread 6611
W20260620 13:57:22.038002  6608 debug-util.cc:398] Leaking SignalData structure 0x7b08003afc20 after lost signal to thread 6612
W20260620 13:57:22.038344  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:22.010489  5879 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
W20260620 13:57:22.034641  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 219935us
I20260620 13:57:22.022452  5875 raft_consensus.cc:2410] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260620 13:57:22.021354  6029 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260620 13:57:22.036638  9702 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.040967  9635 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:22.041563  9635 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.042821  9702 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:22.035178  6024 pending_rounds.cc:107] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260620 13:57:22.035523  6026 pending_rounds.cc:85] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 7
I20260620 13:57:22.044107  6026 pending_rounds.cc:107] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260620 13:57:22.044057  6024 raft_consensus.cc:2889] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:22.044685  6026 raft_consensus.cc:2889] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:22.047837  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:22.048913  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 60310.4us
I20260620 13:57:22.011739  9741 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:21.966604  9638 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.056806  5958 raft_consensus.cc:2368] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8.
I20260620 13:57:22.037056  9852 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:22.060432  6552 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:22.043653  9635 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:57:22.067242  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 895) took 1261 ms. Trace:
I20260620 13:57:22.066144  5998 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:22.067996  5958 rpcz_store.cc:276] 0620 13:57:20.800663 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:21.983624 (+1182961us) service_pool.cc:224] Handling call
0620 13:57:22.062451 (+ 78827us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:22.070307  5950 raft_consensus.cc:2410] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260620 13:57:22.072829  5951 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:57:22.075676  5955 raft_consensus.cc:2368] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9.
I20260620 13:57:22.080647  9835 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:22.081139  9835 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:22.081679  9702 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:22.082404  9702 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.083343  5957 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260620 13:57:22.084170  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1938) took 1391 ms. Trace:
I20260620 13:57:22.084595  9702 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:22.063252  9852 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:22.084683  5957 rpcz_store.cc:276] 0620 13:57:20.796681 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:22.061917 (+1265236us) service_pool.cc:224] Handling call
0620 13:57:22.082866 (+ 20949us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:22.083806 (+   940us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:22.084072 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:22.086764  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 896) took 1273 ms. Trace:
I20260620 13:57:22.110469  5951 rpcz_store.cc:276] 0620 13:57:20.801010 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:22.047612 (+1246602us) service_pool.cc:224] Handling call
0620 13:57:22.070409 (+ 22797us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:22.073685 (+  3276us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:22.074198 (+   513us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:22.092758  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 886) took 1279 ms. Trace:
W20260620 13:57:22.091724  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 221951us
I20260620 13:57:22.095839  9613 raft_consensus.cc:359] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:22.096835  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 887) took 1299 ms. Trace:
I20260620 13:57:22.097857  5956 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:22.082422  9567 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:22.099337  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 898) took 1297 ms. Trace:
I20260620 13:57:22.099725  5777 catalog_manager.cc:5696] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 5, term changed from 7 to 9, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to <none>, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 9 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:57:22.116560  5955 rpcz_store.cc:276] 0620 13:57:20.801669 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:21.798195 (+996526us) service_pool.cc:224] Handling call
0620 13:57:21.834328 (+ 36133us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:57:22.099153 (+264825us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54001969d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:22.099279 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321358464}
I20260620 13:57:22.081594  9835 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:22.104552  9638 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:22.107640  5952 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10. Ops: []
W20260620 13:57:22.107976  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 85636.2us
I20260620 13:57:22.108542  9741 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:22.111693  5950 rpcz_store.cc:276] 0620 13:57:20.797414 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:22.018177 (+1220763us) service_pool.cc:224] Handling call
0620 13:57:22.076377 (+ 58200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:22.101856  9887 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:22.125208  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1933) took 1432 ms. Trace:
I20260620 13:57:22.125676  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1937) took 1431 ms. Trace:
I20260620 13:57:22.126369  5952 rpcz_store.cc:276] 0620 13:57:20.692506 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:22.060260 (+1367754us) service_pool.cc:224] Handling call
0620 13:57:22.092487 (+ 32227us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:22.124075 (+ 31588us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:22.124240 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920}
I20260620 13:57:22.127221  5878 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260620 13:57:22.126036  5956 rpcz_store.cc:276] 0620 13:57:20.691450 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:22.060170 (+1368720us) service_pool.cc:224] Handling call
0620 13:57:22.097675 (+ 37505us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:22.123443 (+ 25768us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:22.123683 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:22.115640  5959 rpcz_store.cc:276] 0620 13:57:20.797758 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:22.086153 (+1288395us) service_pool.cc:224] Handling call
0620 13:57:22.086530 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:22.096445 (+  9915us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:22.096477 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:22.096524 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:22.096567 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:22.096637 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:22.096752 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9718,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131}
I20260620 13:57:22.130743  5924 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:22.130757  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:22.132146  9787 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:22.132181  6026 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:22.132467  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.132788  9787 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:22.134501  5924 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:22.123759  9613 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:57:22.136112  6024 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: []
W20260620 13:57:22.136104  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 82520.4us
I20260620 13:57:22.073242  9955 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:22.127619  5878 pending_rounds.cc:85] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 8
I20260620 13:57:22.137814  9898 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:22.131263  9906 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:22.138602  9898 raft_consensus.cc:697] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:22.139668  5848 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:22.137879  9613 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:22.137485  5878 pending_rounds.cc:107] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260620 13:57:22.142163  5878 raft_consensus.cc:2889] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:22.139705  9898 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:22.143378  9675 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:22.143584  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:22.138666  9906 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:22.144847  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 47390.2us
I20260620 13:57:22.145596  5997 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:22.146169  9906 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:22.127487  6551 connection.cc:256] RPC call timeout handler was delayed by -1.3947199440001441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.44980000000000003s for a response
I20260620 13:57:22.137864  9885 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:57:22.148422  9675 raft_consensus.cc:697] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:22.128306  9702 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:22.149885  9741 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:22.150686  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:22.130831  9902 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:22.151161  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:22.151295  5950 raft_consensus.cc:2376] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14. Re-sending same reply.
I20260620 13:57:22.151619  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:22.151327  9954 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:22.152469  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:22.152858  9954 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:22.153095  6030 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:22.153275  9954 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:22.152310  9905 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260620 13:57:22.149555  9702 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:22.155407  9887 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:22.155767  5998 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:22.156033  9887 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.156946  9905 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:22.156560  9702 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:22.156422  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:22.162024  6031 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:22.158504  9642 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:22.135003  9787 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:22.152220  6024 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:22.163146  9642 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.165167  9613 ts_tablet_manager.cc:1434] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.133s	user 0.005s	sys 0.003s
I20260620 13:57:22.165863  9642 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:22.150314  9741 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:22.166685  9741 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:22.142374  9955 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:22.167586  9955 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:22.169165  6026 raft_consensus.cc:2410] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260620 13:57:22.171408  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.171999  5951 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:22.149559  9675 consensus_queue.cc:237] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:22.173182  9852 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.174224  5954 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:22.175947  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:22.177564  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:22.178913  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 309246us
I20260620 13:57:22.156040  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:22.180009  6029 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:22.123659  9638 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:22.183627  9901 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260620 13:57:22.185061  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:22.185886  6029 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:22.185113  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:22.186800  6032 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:22.187674  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 53317.2us
I20260620 13:57:22.187146  9638 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.188602  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:22.189596  9906 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:22.190632  9906 raft_consensus.cc:697] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:22.191056  9887 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:22.178488  9642 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:22.184218  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.193665  5955 raft_consensus.cc:2410] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260620 13:57:22.191642  9906 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.192090  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:22.196043  5958 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260620 13:57:22.196806  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1935) took 1504 ms. Trace:
I20260620 13:57:22.199796  5954 rpcz_store.cc:276] 0620 13:57:20.691968 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:22.086975 (+1395007us) service_pool.cc:224] Handling call
0620 13:57:22.094417 (+  7442us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:22.175254 (+ 80837us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:22.196570 (+ 21316us) spinlock_profiling.cc:243] Waited 79.6 ms on lock 0x7b54002517d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:22.196747 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183107968}
I20260620 13:57:22.202037  6029 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:22.207146  6552 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:22.182924  9670 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:22.211295  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.214449  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.214550  5954 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 3.
I20260620 13:57:22.204367  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:22.216847  6029 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:22.217233  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:22.218232  5955 raft_consensus.cc:2376] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10. Re-sending same reply.
I20260620 13:57:22.219246  9642 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:57:22.223453  5956 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8. Ops: []
W20260620 13:57:22.224174  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 43768.4us
W20260620 13:57:22.214500  6551 leader_election.cc:336] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.896s (SENT)
I20260620 13:57:22.213325  9638 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:22.226118  6551 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:22.236006  6024 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:22.235369  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.220360  9787 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:22.237056  9635 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:22.246282  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.248019  5849 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:22.241488  9953 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:22.247388  9787 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.257877  9865 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:57:22.259505  9787 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:22.259346  9774 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
W20260620 13:57:22.260943  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:22.241438  9903 consensus_queue.cc:1059] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.115s
I20260620 13:57:22.245834  9635 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:22.263430  9903 raft_consensus.cc:3055] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:22.263530  9635 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:22.263888  9903 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:22.264932  9903 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.266312  9903 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:22.254488  9670 consensus_queue.cc:1059] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260620 13:57:22.256891  9702 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:22.267418  9951 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:22.267724  9702 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:22.268023  9951 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:22.269989  9702 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:22.270190  9951 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:22.254423  9852 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:22.263445  9887 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:22.271070  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 79097.3us
I20260620 13:57:22.271447  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.271950  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:22.274719  9787 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:22.257042  9901 consensus_queue.cc:1059] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260620 13:57:22.275776  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:22.275465  9787 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:22.276405  5956 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:57:22.274880  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:22.277382  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:22.277979  5954 raft_consensus.cc:2368] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14.
I20260620 13:57:22.276165  9774 raft_consensus.cc:3055] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:22.249327  9691 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:22.262487  9835 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.278879  9774 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:22.276211  9954 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.240626  6024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:57:22.295639  6024 raft_consensus.cc:606] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:22.282961  5955 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:57:22.288262  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.291973  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.255808  9638 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:22.503618  9638 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:22.504307  9638 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.506513  9638 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:22.425148  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:22.433578  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:22.340768  6587 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260620 13:57:22.385358  6026 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260620 13:57:22.339885  5778 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47386 (request call id 234) took 8607 ms. Trace:
W20260620 13:57:22.382593  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 92385.7us
I20260620 13:57:22.513077  6027 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 9: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:22.289309  9898 consensus_queue.cc:1059] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260620 13:57:22.450420  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:22.340883  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.338984  9635 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.366108  5959 raft_consensus.cc:2368] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10.
I20260620 13:57:22.384701  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:22.338501  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:22.515973  5952 raft_consensus.cc:2376] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11. Re-sending same reply.
I20260620 13:57:22.371908  9787 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.293399  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:22.425294  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:22.381827  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:22.478453  5951 raft_consensus.cc:2410] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260620 13:57:22.339183  9691 raft_consensus.cc:697] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:22.446864  6043 tablet_copy_service.cc:342] P 663684cf4ae54c929bf8240ca0b63a47: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-71fbe22bd18849f1b94912bb0bdf5bbe received from {username='slave'} at 127.0.0.1:46758
I20260620 13:57:22.262502  9955 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:22.291580  9901 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260620 13:57:22.283710  9953 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:22.340198  9774 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.341982  9885 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:22.442700  5956 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:57:22.341974  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:22.460093  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 247077us
W20260620 13:57:22.354768  9958 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260620 13:57:22.364319  5980 debug-util.cc:398] Leaking SignalData structure 0x7b080016b320 after lost signal to thread 4722
I20260620 13:57:22.344071  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260620 13:57:22.536895  5980 debug-util.cc:398] Leaking SignalData structure 0x7b080018a660 after lost signal to thread 5815
I20260620 13:57:22.343508  9905 raft_consensus.cc:3055] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:22.341210  9741 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.550048  9905 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:22.294085  9702 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260620 13:57:22.550999  9905 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:22.403721  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 195363us
I20260620 13:57:22.552264  9905 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:22.552667  6551 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.922s (SENT)
I20260620 13:57:22.553089  6551 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:22.353359  9835 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:22.355268  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:22.555703  9835 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:22.556104  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:22.556665  9955 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:22.347150  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:22.558174  5958 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 10: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:22.558352  5849 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:22.559698  9675 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:22.559854  9702 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:22.560683  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:22.561247  9741 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:22.561327  5878 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:22.562541  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:22.563315  5875 raft_consensus.cc:2393] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 9: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:22.459231  9954 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:22.566812  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:22.567976  5980 debug-util.cc:398] Leaking SignalData structure 0x7b08002287c0 after lost signal to thread 5829
I20260620 13:57:22.567916  9903 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:22.568485  5980 debug-util.cc:398] Leaking SignalData structure 0x7b080016b400 after lost signal to thread 5835
I20260620 13:57:22.568619  9903 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.477010  9902 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:22.569972  9902 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:22.570391  9902 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:22.570815  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:22.570981  9903 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:22.571573  6579 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:57:22.432754  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:22.528792  6043 tablet_copy_service.cc:434] P 663684cf4ae54c929bf8240ca0b63a47: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-71fbe22bd18849f1b94912bb0bdf5bbe on tablet 71fbe22bd18849f1b94912bb0bdf5bbe with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:22.531599  9953 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:22.532373  9635 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:22.532775  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:22.537478  9638 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:22.547268  9885 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:22.548656  9642 raft_consensus.cc:3055] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:22.549330  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:57:22.560847  9691 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.445284  9887 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:57:22.512022  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 256610us
W20260620 13:57:22.587616  5980 debug-util.cc:398] Leaking SignalData structure 0x7b080010a100 after lost signal to thread 5908
I20260620 13:57:22.605351  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:22.570415  9865 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:22.591535  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 244551us
W20260620 13:57:22.592971  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:22.600744  9638 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:22.600868  9670 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:22.602649  9885 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:22.599305  9642 raft_consensus.cc:740] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:57:22.600786  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 68042.4us
I20260620 13:57:22.603962  5957 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
W20260620 13:57:22.606675  5980 debug-util.cc:398] Leaking SignalData structure 0x7b080015ece0 after lost signal to thread 5983
W20260620 13:57:22.618467  5980 debug-util.cc:398] Leaking SignalData structure 0x7b080015ed40 after lost signal to thread 5984
W20260620 13:57:22.588199  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 206479us
I20260620 13:57:22.612648  6587 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:57:22.610769  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:22.615480  9901 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:22.615828  5997 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:22.617071  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:57:22.616871  9954 consensus_queue.cc:1059] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260620 13:57:22.620813  5980 debug-util.cc:398] Leaking SignalData structure 0x7b08003c0580 after lost signal to thread 6057
I20260620 13:57:22.617496  9675 consensus_queue.cc:1059] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
W20260620 13:57:22.623030  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:22.628163  5980 debug-util.cc:398] Leaking SignalData structure 0x7b08000d6d60 after lost signal to thread 6611
W20260620 13:57:22.628484  5980 debug-util.cc:398] Leaking SignalData structure 0x7b080026aee0 after lost signal to thread 6612
I20260620 13:57:22.623340  9630 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260620 13:57:22.623458  9865 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.633715  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:22.632171  6551 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:22.642344  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:22.512560  5778 rpcz_store.cc:276] 0620 13:57:13.732348 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:13.748407 (+ 16059us) service_pool.cc:224] Handling call
0620 13:57:22.339657 (+8591250us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:57:16.511181 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:57:16.962829 (+451648us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:57:16.971551 (+  8722us) write_op.cc:435] Acquired schema lock
0620 13:57:16.980092 (+  8541us) tablet.cc:662] Decoding operations
0620 13:57:17.299993 (+319901us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:57:17.300075 (+    82us) write_op.cc:641] Partition lock acquired for write op
0620 13:57:17.300102 (+    27us) tablet.cc:685] Acquiring locks for 14 operations
0620 13:57:17.301440 (+  1338us) tablet.cc:701] Row locks acquired
0620 13:57:17.301457 (+    17us) write_op.cc:260] PREPARE: finished
0620 13:57:17.301611 (+   154us) write_op.cc:270] Start()
0620 13:57:17.301723 (+   112us) write_op.cc:276] Timestamp: P: 1781963837301559 usec, L: 0
0620 13:57:17.301743 (+    20us) op_driver.cc:348] REPLICATION: starting
0620 13:57:17.302602 (+   859us) log.cc:844] Serialized 5516 byte log entry
0620 13:57:18.242722 (+940120us) op_driver.cc:464] REPLICATION: finished
0620 13:57:18.244246 (+  1524us) write_op.cc:301] APPLY: starting
0620 13:57:18.245692 (+  1446us) tablet.cc:1367] starting BulkCheckPresence
0620 13:57:18.246852 (+  1160us) tablet.cc:1370] finished BulkCheckPresence
0620 13:57:18.246969 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:57:18.583382 (+336413us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:57:18.597149 (+ 13767us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0620 13:57:18.597218 (+    69us) write_op.cc:312] APPLY: finished
0620 13:57:18.597833 (+   615us) log.cc:844] Serialized 101 byte log entry
0620 13:57:18.598029 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:18.598193 (+   164us) write_op.cc:454] Released schema lock
0620 13:57:18.598249 (+    56us) write_op.cc:341] FINISH: Updating metrics
0620 13:57:18.598620 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:18.598654 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":125475,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":1246,"apply.run_cpu_time_us":7295,"apply.run_wall_time_us":354362,"num_ops":14,"prepare.queue_time_us":144339,"prepare.run_cpu_time_us":30288,"prepare.run_wall_time_us":1502518,"raft.queue_time_us":30072,"raft.run_cpu_time_us":1556,"raft.run_wall_time_us":1558,"replication_time_us":940802,"thread_start_us":861429,"threads_started":4,"wal-append.queue_time_us":678908,"wal-append.run_cpu_time_us":27382,"wal-append.run_wall_time_us":1607170}]]}
I20260620 13:57:22.645833  9642 consensus_queue.cc:260] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:22.647347  9642 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:22.648468  9630 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260620 13:57:22.651368  9901 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.653052  6585 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:22.655651  9951 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:22.656499  9951 raft_consensus.cc:697] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:22.657790  9951 consensus_queue.cc:237] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:22.659247  9885 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:22.660001  9885 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:22.659680  9638 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.662143  9885 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:22.623968  9903 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
W20260620 13:57:22.667565  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 51813.7us
I20260620 13:57:22.626567  9774 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:22.651517  9835 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:22.673828  5997 leader_election.cc:400] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14.
I20260620 13:57:22.675551  5997 leader_election.cc:403] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260620 13:57:22.677007  9865 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:22.678395  6587 raft_consensus.cc:2410] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260620 13:57:22.641240  9964 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:22.683280  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:22.684118  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 71319.5us
I20260620 13:57:22.671041  9955 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:57:22.690364  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 56707.1us
I20260620 13:57:22.675799  9901 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:22.679888  9887 raft_consensus.cc:3055] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Stepping down as leader of term 4
I20260620 13:57:22.698501  9887 raft_consensus.cc:740] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:57:22.695089  9974 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260620 13:57:22.684170  9865 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:22.704300  5997 leader_election.cc:400] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10.
I20260620 13:57:22.704842  5997 leader_election.cc:403] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:57:22.695663  9955 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14.
I20260620 13:57:22.699417  9887 consensus_queue.cc:260] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:22.691092  9885 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:22.706015  9954 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10.
I20260620 13:57:22.706336  9887 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:57:22.707394  9780 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:57:22.708248  9675 raft_consensus.cc:3055] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:22.708626  9675 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:22.709594  9675 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.701212  6579 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:57:22.715613  6033 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
W20260620 13:57:22.699430  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 79604.8us
I20260620 13:57:22.684713  9903 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:22.718008  6551 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:22.713066  9670 raft_consensus.cc:3055] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:22.718732  9670 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:22.720446  6551 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:22.721311  9901 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:22.719590  5997 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:22.728048  9670 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.740392  9670 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:22.730091  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 59476.5us
W20260620 13:57:22.736533  5998 connection.cc:256] RPC call timeout handler was delayed by -1.048633384000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.225s for a response
I20260620 13:57:22.721143  9902 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.711001  9675 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:22.742141  9903 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:22.742492  9964 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:57:22.742605  6551 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:22.743423  5997 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:22.748231  9953 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:22.748638  9953 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:22.748962  9953 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:22.716549  9865 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:22.756610  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:22.756992  9865 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:22.757095  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:22.757871  5959 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:22.758715  6551 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:22.747253  9964 raft_consensus.cc:697] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:22.765955  9964 consensus_queue.cc:237] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:22.758729  9901 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:22.760972  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:22.763217  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:22.770664  5959 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:22.772219  5956 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:22.775388  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:22.770576  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 53539.3us
I20260620 13:57:22.776986  9691 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260620 13:57:22.764564  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:22.777199  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:22.777551  9691 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:22.777999  9691 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:22.778100  9787 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260620 13:57:22.746573  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 111739us
I20260620 13:57:22.779276  5958 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:22.779589  5997 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:22.777359  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:22.781569  9903 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 13:57:22.787282  9955 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:22.787706  9955 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:22.788053  9955 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:22.791994  5959 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:22.791311  9885 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:22.779119  9787 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:22.796106  9787 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:22.796911  9902 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:22.798293  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:22.799302  6551 leader_election.cc:400] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10.
I20260620 13:57:22.799615  6551 leader_election.cc:403] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:57:22.802382  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:22.802374  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:22.804010  5880 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:22.804949  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:22.814347  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:22.835371  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:22.835592  9980 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:22.836028  5879 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:22.837388  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:22.840605  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:22.811594  9903 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:22.838155  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:22.842629  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:22.843513  5877 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 9: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:22.844429  5878 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:57:22.836095  9980 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:22.833885  9902 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:22.837602  9865 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 10
I20260620 13:57:22.838508  9774 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:22.859014  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:22.863956  6025 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 9: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:22.852715  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:22.866984  5848 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:22.871361  5849 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:22.877240  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:22.878294  6028 raft_consensus.cc:2393] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:22.847975  9638 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:22.853310  9980 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:22.884929  9567 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260620 13:57:22.885113  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 93102.6us
I20260620 13:57:22.891028  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:22.891965  6032 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:22.864490  9774 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:22.899072  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:22.899505  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 106404us
I20260620 13:57:22.900130  6025 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:22.902293  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:22.876958  9951 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:57:22.907886  9988 consensus_queue.cc:1059] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:22.908687  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:22.909466  5882 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
W20260620 13:57:22.913229  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 73725.6us
I20260620 13:57:22.914217  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:22.913306  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:22.915565  6026 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:22.863415  9741 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260620 13:57:22.916882  5997 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:22.859521  9906 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260620 13:57:22.919852  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:22.917722  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:22.909355  9642 raft_consensus.cc:3055] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:22.945480  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:22.948263  5879 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:57:22.905572  9903 raft_consensus.cc:697] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:22.903910  9774 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:22.951414  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 89035.1us
I20260620 13:57:22.948271  5881 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:22.948741  5848 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:22.954478  5877 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:57:22.959012  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:22.959671  6579 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:57:22.960243  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:22.964134  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:22.964972  6587 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 3.
I20260620 13:57:22.967959  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:22.949808  9642 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:22.958398  9905 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:22.983292  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:22.946576  9964 consensus_queue.cc:1059] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260620 13:57:22.949518  9567 consensus_queue.cc:1059] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260620 13:57:22.973975  9902 raft_consensus.cc:697] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:57:23.001600  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 43717.6us
I20260620 13:57:22.958636  9953 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:23.004321  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 68149.5us
W20260620 13:57:23.006340  9982 log.cc:927] Time spent T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260620 13:57:23.006695  9902 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.010984  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:23.011711  5877 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
W20260620 13:57:23.047267  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 130482us
W20260620 13:57:23.050632  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 99387.2us
I20260620 13:57:23.063063  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:23.047526  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 79658.6us
I20260620 13:57:23.069845  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:23.070760  5881 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:23.072983  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:23.073932  5878 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:23.077530  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:23.078236  5879 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:23.082391  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:23.083366  6585 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:22.998215  9691 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:23.084695  5924 connection.cc:256] RPC call timeout handler was delayed by -1.1399597149999181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260620 13:57:23.091416  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:23.100960  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:23.102921  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:23.125331  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:23.120364  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:23.129225  6024 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:23.066382  9951 raft_consensus.cc:697] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:57:23.133271  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 232341us
I20260620 13:57:23.137877  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:23.092689  9964 raft_consensus.cc:3055] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:23.125195  5884 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:57:23.120890  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:23.125763  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:23.092490  9567 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:23.124398  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:23.141491  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 104382us
I20260620 13:57:23.139194  6587 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:23.144882  6578 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:57:23.145048  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:23.145695  9635 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:23.146128  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:23.138724 10008 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260620 13:57:23.147320  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:23.149499  9992 log.cc:927] Time spent T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260620 13:57:23.152951  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:23.156910  9953 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:23.162581  9951 consensus_queue.cc:237] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.164183  9835 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:23.213860  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:23.214495  5882 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:23.164297  9691 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:23.164829  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:23.048710  9642 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.174853  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:23.187701  5880 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:23.188594  6585 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:23.189754  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:23.193202  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:23.048032  9903 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.143843  9964 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:23.199493  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:23.186743  9635 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:23.199724  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:23.200721  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:23.199501  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:23.202222  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:23.209163  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:23.260576  6580 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:23.209316  6579 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
W20260620 13:57:23.211194  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 63969.7us
I20260620 13:57:23.212561  6551 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:23.218425  5879 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:23.219717  6581 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:57:23.222610  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:23.262769  6029 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:23.186971  9567 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:23.223592  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:23.272738  6587 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:23.259472  6584 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:23.259492  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:23.258472  6030 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:23.265060  6552 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:23.269711  9905 raft_consensus.cc:697] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:23.223587  9630 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260620 13:57:23.296783  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 154757us
I20260620 13:57:23.298578  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:23.268931  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:23.229499  9780 raft_consensus.cc:2764] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260620 13:57:23.302161  6026 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:23.302778  6551 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:23.281718  6552 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:23.263258  9635 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:23.277601  9567 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:23.326154  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 125525us
I20260620 13:57:23.282637  9906 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260620 13:57:23.327296  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:23.330165  6030 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:23.334271  5958 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260620 13:57:23.313073  9638 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:23.335920  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:23.286649  9630 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:23.324729  5959 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:23.352027  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:23.363940  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 82296.1us
I20260620 13:57:23.284103  9955 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:23.367616  6587 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
W20260620 13:57:23.351366  9670 consensus_meta.cc:287] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.610s	user 0.004s	sys 0.009s
W20260620 13:57:23.371395  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 68733.2us
I20260620 13:57:23.336753  9906 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:23.335186  9902 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260620 13:57:23.391043  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 216263us
I20260620 13:57:23.377797  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:23.391965  6033 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:23.394706  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:23.395705  5924 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:23.396589  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:23.359828  9630 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:23.329561  9691 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260620 13:57:23.412935  6032 raft_consensus.cc:2393] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:23.415586  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:23.418534  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:23.424037  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:23.392607  9906 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:23.392182  9852 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:23.402156 10005 raft_consensus.cc:3055] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:23.411223  9702 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260620 13:57:23.415076  9787 consensus_meta.cc:287] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.618s	user 0.012s	sys 0.001s
I20260620 13:57:23.414533  9898 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:23.534978  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:23.540555  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:23.549908  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:23.566133  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 169606us
I20260620 13:57:23.567409  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:23.359661  9964 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:23.572293  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 221743us
I20260620 13:57:23.436920  9852 raft_consensus.cc:697] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:23.578666  5997 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:23.471581  9702 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:23.440459 10005 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:23.542948  9994 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:23.613765  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:23.617893  9996 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:23.624017  9996 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:23.623896 10013 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.187s
I20260620 13:57:23.624502  9996 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:23.625643 10011 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:23.627903 10006 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:23.628518 10006 raft_consensus.cc:697] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:23.629439 10006 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.631690 10004 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:23.632318 10004 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:23.632936 10004 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:23.543498  9898 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:23.635356  9989 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:57:23.636075  9989 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:23.636404  9989 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:23.637409  9898 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:23.644089 10019 log.cc:927] Time spent T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260620 13:57:23.645112  9996 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.600970  9702 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:23.662853  5881 consensus_meta.cc:287] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.591s	user 0.006s	sys 0.005s
I20260620 13:57:23.492162  9787 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.676160  5881 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:23.441066  9905 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
W20260620 13:57:23.703583  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 138255us
I20260620 13:57:23.702090  9691 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:23.704561  9898 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:23.702145 10024 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:23.759778  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 192472us
I20260620 13:57:23.726888  9953 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election won for term 10
W20260620 13:57:23.737434 10015 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260620 13:57:23.734369  9996 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:23.738659 10017 log.cc:927] Time spent T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260620 13:57:23.739571 10020 log.cc:927] Time spent T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260620 13:57:23.740073 10005 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.745077  9787 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:23.751878  9865 consensus_meta.cc:287] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.883s	user 0.012s	sys 0.000s
W20260620 13:57:23.839674  9835 consensus_meta.cc:287] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.626s	user 0.012s	sys 0.000s
I20260620 13:57:23.840260  9835 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:57:23.840340 10009 log.cc:927] Time spent T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.435s	user 0.001s	sys 0.001s
W20260620 13:57:23.827503  9980 consensus_meta.cc:287] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.926s	user 0.008s	sys 0.006s
I20260620 13:57:23.842325  9980 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.843562 10005 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:23.844601  9980 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:23.753520  9997 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:23.846047  6031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 814) took 1034 ms. Trace:
I20260620 13:57:23.846266  9567 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.626205 10011 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:23.848830 10011 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:23.736687 10028 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:23.849502 10028 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:23.763543  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 184947us
I20260620 13:57:23.753379  9638 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:23.863937  9997 raft_consensus.cc:697] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:23.766685  6580 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:23.763911  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:23.865782 10028 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:23.731828  9691 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:23.866402  9691 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:23.863799  5954 raft_consensus.cc:1275] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260620 13:57:23.868331 10030 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:23.864802  9997 consensus_queue.cc:237] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.868971 10030 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:23.824961  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:23.825184  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 92546.9us
I20260620 13:57:23.759505  9902 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:23.871408  9902 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.871861 10039 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:23.872473 10039 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:23.873566  9902 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:23.874468 10039 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:23.875207  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 111365us
I20260620 13:57:23.763867 10024 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.875793  5849 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:23.876271  9993 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:23.876822  9993 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.877599 10024 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:23.835074  9774 consensus_meta.cc:287] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.875s	user 0.007s	sys 0.003s
I20260620 13:57:23.839610  9865 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10.
W20260620 13:57:23.853948  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:23.767843  5848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.018s	sys 0.029s
W20260620 13:57:23.881731  6584 consensus_meta.cc:287] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.001s
I20260620 13:57:23.882290  6584 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:23.875849  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:23.860504  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:23.861625  5959 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 14. Current term is 15. Ops: []
I20260620 13:57:23.755515  9852 consensus_queue.cc:237] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:23.829061  9953 raft_consensus.cc:697] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:23.863752  9996 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:23.759238  9898 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.864799  9638 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:23.881808  5848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.019s	sys 0.029s
I20260620 13:57:23.860018 10027 consensus_queue.cc:1059] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:23.884349  5924 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
W20260620 13:57:23.895138  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 831015us
I20260620 13:57:23.898216  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:23.898506  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:23.846450  6031 rpcz_store.cc:276] 0620 13:57:22.811412 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:22.811545 (+   133us) service_pool.cc:224] Handling call
0620 13:57:22.837151 (+ 25606us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:22.841223 (+  4072us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:22.841255 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:22.843253 (+  1998us) log.cc:844] Serialized 26 byte log entry
0620 13:57:22.880486 (+ 37233us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b1800347fe0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:57:23.046384 (+165898us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:23.046442 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:23.046541 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:23.845736 (+799195us) raft_consensus.cc:1685] finished
0620 13:57:23.845756 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:23.845986 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":437,"raft.queue_time_us":5863,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":7117,"spinlock_wait_cycles":13334272,"thread_start_us":165588,"threads_started":1,"wal-append.queue_time_us":340149}
I20260620 13:57:23.896747  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:23.895787  5954 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260620 13:57:23.898250  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:23.899360  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:23.879282  9787 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260620 13:57:23.906370  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:23.891566  9780 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:23.892365 10039 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:23.879056  9993 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:23.894191  9964 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:23.920425  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:23.895872  9885 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:23.899966 10030 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:23.902654  9741 raft_consensus.cc:2764] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260620 13:57:23.880033  9774 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.929231  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:23.932718 10038 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:57:23.908836  9787 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:23.942513  5956 raft_consensus.cc:2393] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:23.944416  5952 raft_consensus.cc:1240] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: []
W20260620 13:57:23.944634  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 578407us
I20260620 13:57:23.946098  5953 raft_consensus.cc:1275] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260620 13:57:23.950330  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:23.896389  9996 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.922950  9835 raft_consensus.cc:3055] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:23.963027  6552 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:23.964512  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:23.961889  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 570593us
I20260620 13:57:23.940477 10030 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:23.940234 10039 raft_consensus.cc:697] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:23.968678  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:23.920914  9989 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:23.970603  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:23.945214  9787 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:23.967762  9835 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:23.937568  9885 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:23.973794 10032 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:24.023540 10032 raft_consensus.cc:697] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:23.992208  6551 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:24.024458 10032 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.026280  6551 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:24.027261 10008 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:24.027963 10008 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:57:23.990800  9567 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:24.028959  9898 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:23.992726  9996 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:24.029491  6586 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:23.982903  9955 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:24.031610  6551 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:24.034324  9906 consensus_meta.cc:287] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
I20260620 13:57:24.035676  6551 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:24.015892  9887 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:24.039564  9903 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:24.040030  9903 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:23.992865  9630 consensus_meta.cc:287] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.557s	user 0.006s	sys 0.005s
I20260620 13:57:23.993165 10030 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.000149  9691 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:23.940981 10004 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:23.960825 10028 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:24.011540  5951 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 4. Current term is 5. Ops: []
I20260620 13:57:23.983542  9985 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:23.984043 10022 consensus_queue.cc:1059] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260620 13:57:23.962448  9953 consensus_queue.cc:237] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:23.951416 10013 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260620 13:57:23.929200 10006 consensus_queue.cc:1059] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260620 13:57:24.015738  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 45237.6us
I20260620 13:57:24.125764  5959 raft_consensus.cc:2393] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:24.126642  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:24.128474  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:24.128937  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:24.015738  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:24.019207  9741 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:57:24.020150  9774 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:57:24.020907 10039 consensus_queue.cc:237] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.022611  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:24.022949  9885 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:24.015134  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 104175us
I20260620 13:57:24.040412  9903 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:24.148854  6031 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:24.070770  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:24.034804  9906 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.129585  5956 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
W20260620 13:57:24.132190  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 96649.4us
I20260620 13:57:24.157353  6025 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 9: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:24.158715  6551 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:24.045552  9702 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:24.056519  9630 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.145231 10005 raft_consensus.cc:3055] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:24.142819  9741 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:24.189563  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:24.190199  5881 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
W20260620 13:57:24.186142  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 287886us
I20260620 13:57:24.191533 10046 raft_consensus.cc:2764] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260620 13:57:24.073148 10028 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.206583  5953 raft_consensus.cc:1240] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:24.160594  9996 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:24.219280  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:24.220317  5884 raft_consensus.cc:2368] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10.
W20260620 13:57:24.220595  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:24.239364 10037 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:24.240360  9635 consensus_meta.cc:287] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.893s	user 0.013s	sys 0.000s
I20260620 13:57:24.240976  9635 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.214999  9996 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:24.243659  9996 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:24.246374  9787 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:24.180193 10005 raft_consensus.cc:740] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:24.195013  9741 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:57:24.251775  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 93174.7us
I20260620 13:57:24.193214  9902 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:24.240062 10037 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.191721 10041 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.242s
I20260620 13:57:24.273240  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:24.261670  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 133257us
I20260620 13:57:24.281145  9991 consensus_queue.cc:1059] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.247s
I20260620 13:57:24.282789  9902 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:24.218137  9955 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:24.214840  9993 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:24.280658 10003 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 13:57:24.214432 10006 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:24.214432  9670 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:24.288810  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:24.296903  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:24.256486  9567 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:24.299957  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:24.307902  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 154262us
I20260620 13:57:24.310098  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:24.311947  6031 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:24.313170  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:24.313659  9635 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:24.312075  6028 raft_consensus.cc:2376] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7. Re-sending same reply.
I20260620 13:57:24.321925  6586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 1017) took 1234 ms. Trace:
I20260620 13:57:24.320662  5924 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:24.322322  6586 rpcz_store.cc:276] 0620 13:57:23.082196 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:23.082321 (+   125us) service_pool.cc:224] Handling call
0620 13:57:24.316269 (+1233948us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b540043bf54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:24.316381 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739010944}
I20260620 13:57:24.327138  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:24.309008 10003 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:24.292169 10041 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260620 13:57:24.330531  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:24.331260  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:24.331728  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:24.324806 10032 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:24.328095  9691 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:24.332525 10004 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:24.332928 10062 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:24.334229  9906 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:24.339562  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:24.340176  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:24.359344  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:24.359421  6583 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:24.317423  9991 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:24.324687  9635 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:24.339310 10010 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:24.307003  9955 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:24.321750  9567 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.347810  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:24.348454  6586 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:24.348783 10023 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:24.315683 10006 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:24.384624  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:24.385277  6584 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:24.386075 10006 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:24.349684 10042 log.cc:927] Time spent T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260620 13:57:24.386700  9955 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:24.353245  9630 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:24.347014  9852 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:24.388535  9852 raft_consensus.cc:697] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:24.389447  9835 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.392239  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:24.392944  5879 raft_consensus.cc:2368] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:57:24.393298  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:24.393877  5877 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:24.354434  9702 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:24.404103  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:24.320111  9670 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:24.355189 10033 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:24.334981 10016 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:24.331586 10003 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 3 FOLLOWER]: Advancing to term 4
W20260620 13:57:24.355811 10031 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260620 13:57:24.356175 10044 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:24.433565  5883 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:24.320699 10005 consensus_queue.cc:260] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.347654 10037 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:24.367455  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:24.439824  5880 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260620 13:57:24.369239 10028 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:24.367668  6582 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:24.327838 10030 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:24.364126  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:24.379731  6026 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:24.437386  5878 pending_rounds.cc:85] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 4
I20260620 13:57:24.390856  9835 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:24.404850  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:24.412571  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:24.376588  9635 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:24.428426  6031 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:24.429912  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:24.430770  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:24.442230  6586 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260620 13:57:24.434361  6583 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:24.436275  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:24.448695  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:24.432001  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 69566.9us
I20260620 13:57:24.438025  6029 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:24.378988  6032 raft_consensus.cc:2376] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10. Re-sending same reply.
I20260620 13:57:24.440310  6028 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
W20260620 13:57:24.434509  5849 connection.cc:256] RPC call timeout handler was delayed by -1.4063121969999202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260620 13:57:24.440346  5880 pending_rounds.cc:85] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 7
I20260620 13:57:24.442148  6587 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:24.450860  5880 pending_rounds.cc:107] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260620 13:57:24.451259  5880 raft_consensus.cc:2889] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:24.441726  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:24.422020 10033 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:57:24.450606  5849 connection.cc:256] RPC call timeout handler was delayed by -1.0166121969999722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
I20260620 13:57:24.441870  5878 pending_rounds.cc:107] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260620 13:57:24.456666  5878 raft_consensus.cc:2889] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:24.458071  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:24.458526  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:24.389467  9852 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.464013  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:24.464691  5875 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:24.466255  9567 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:24.467196  6587 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:24.468257  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:24.469463  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:24.469928 10048 log.cc:927] Time spent T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.255s	user 0.000s	sys 0.004s
I20260620 13:57:24.470688  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:24.381322  9991 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.475317  9991 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:24.476944  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:24.480535  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:24.481344  5876 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:24.483789  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:24.483887  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:24.484659  5875 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:24.378268 10010 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:24.491003  6587 raft_consensus.cc:2410] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260620 13:57:24.439978 10006 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:24.446645  6578 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
W20260620 13:57:24.508420  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 136087us
I20260620 13:57:24.444276 10032 raft_consensus.cc:697] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:24.452316  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:24.493960  6580 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:24.408623  9630 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:24.501384  5877 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:24.523172  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:24.522998  6027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2672) took 1185 ms. Trace:
I20260620 13:57:24.524003  6027 rpcz_store.cc:276] 0620 13:57:23.337288 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:23.337431 (+   143us) service_pool.cc:224] Handling call
0620 13:57:23.364361 (+ 26930us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:23.364589 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:23.364617 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:23.380120 (+ 15503us) log.cc:844] Serialized 26 byte log entry
0620 13:57:23.600651 (+220531us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:57:23.600690 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:23.600773 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:24.522721 (+921948us) raft_consensus.cc:1685] finished
0620 13:57:24.522752 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:24.522918 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":166292,"threads_started":1,"wal-append.queue_time_us":317065}
I20260620 13:57:24.526155  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:24.460333 10033 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:24.509068  6029 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:24.509611  5875 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:24.449353  9635 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:24.517534  6582 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:24.517980  6583 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEARNER]: Advancing to term 11
I20260620 13:57:24.519883  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:24.507028  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 56105.5us
I20260620 13:57:24.529804  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:24.528908  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:24.536747  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:24.535231  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:24.556493  5883 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:24.556658  5955 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:24.524006  6033 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:24.551527  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:24.559265  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:24.555644  6578 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:24.548985  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:24.560801  5875 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
W20260620 13:57:24.561424  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:24.527058  6027 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:24.542033  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:24.548776  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:24.563484  5951 raft_consensus.cc:2410] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260620 13:57:24.563310  9903 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.564186  5954 raft_consensus.cc:1240] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260620 13:57:24.565757  9903 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:24.455338  9741 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.591464  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:24.599078  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:24.599552  5959 raft_consensus.cc:2368] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6.
I20260620 13:57:24.599709  5880 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:24.592072  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:24.593276  6578 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 8. Ops: []
I20260620 13:57:24.595388  6579 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
W20260620 13:57:24.601179  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 81416.2us
I20260620 13:57:24.595778  6551 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:24.598223  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:24.603605  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:24.605973  5956 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:57:24.606055  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:24.434063 10016 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.606740  5875 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:24.606693  6551 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:24.439529 10044 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.613417  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:24.519385 10006 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:24.619030  5952 raft_consensus.cc:1240] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 3. Current term is 4. Ops: []
I20260620 13:57:24.618956  5875 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:24.621016  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:24.533116  9630 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.622316  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:24.627774  6032 raft_consensus.cc:2410] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260620 13:57:24.627934  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:24.632510  6030 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:24.632613  6033 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:24.605046 10062 raft_consensus.cc:697] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:24.623435  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:24.620858  5848 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:24.625087  9997 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:24.608929  9885 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:24.577427 10032 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.610414  9951 consensus_queue.cc:1059] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260620 13:57:24.622676  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:24.643515  5880 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:24.646277  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:24.635980  6027 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:24.648459  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:24.637609  5879 raft_consensus.cc:2410] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260620 13:57:24.649114  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:24.649595  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:24.650127  5875 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 8
I20260620 13:57:24.613236 10038 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:24.634198  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:24.652504 10069 log.cc:927] Time spent T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260620 13:57:24.653301  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 46676.5us
I20260620 13:57:24.655584 10006 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:24.639405 10054 log.cc:927] Time spent T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260620 13:57:24.655859  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:24.657624  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:24.658147  6033 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:24.639740  9885 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:24.659428  9885 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:24.660418 10044 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:24.661062  9670 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:24.660959  9997 consensus_queue.cc:1059] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:57:24.662012  9997 raft_consensus.cc:3055] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:24.642719 10052 consensus_queue.cc:1048] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260620 13:57:24.663625 10010 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:24.667785  9885 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:24.662634  9997 raft_consensus.cc:740] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:24.673448  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:24.659370  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:24.674456  6027 raft_consensus.cc:2393] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:24.673895  9997 consensus_queue.cc:260] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.675489  9997 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:24.668901  6551 leader_election.cc:400] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6.
I20260620 13:57:24.179433  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:57:24.691303  6578 raft_consensus.cc:2393] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:24.683583  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:24.693624  6027 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:24.674957  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:24.682299  6551 leader_election.cc:403] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:57:24.694482  5959 raft_consensus.cc:2410] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260620 13:57:24.697868  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 50075.2us
I20260620 13:57:24.690062  5875 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:24.679080  9902 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:24.683636 10076 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260620 13:57:24.648962  9642 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:24.647519  9702 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:24.729125  5875 raft_consensus.cc:1240] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:24.731606  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:24.662598 10038 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:24.680488  9741 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:24.739815 10057 raft_consensus.cc:2764] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260620 13:57:24.679726 10062 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.717139 10004 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:24.742694 10004 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:24.743073 10004 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:24.736644 10008 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:24.804574  9898 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:57:24.805084  9898 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:24.805987  9898 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.811636  5875 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 8. Ops: []
I20260620 13:57:24.718371  9989 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:24.849100  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:24.663669  9996 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.915004  9903 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:24.917696 10073 log.cc:927] Time spent T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260620 13:57:24.922640  5880 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260620 13:57:24.738760 10038 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:24.942483  9903 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:24.807063  9898 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:24.939450  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:24.986938  6025 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
W20260620 13:57:25.002053  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 328690us
W20260620 13:57:25.003219  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 382395us
I20260620 13:57:25.005671  6030 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:25.010700  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:25.011153  5998 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:25.010807  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 355657us
I20260620 13:57:25.012601  6583 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260620 13:57:25.014616  6582 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:25.033869  9885 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:25.035029 10010 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:25.036841  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:25.037576  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:25.037617  6583 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:25.039819  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:25.040405  6583 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:25.017928  5883 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:24.984463  9989 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:25.029951  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:25.051260  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.049484  6033 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:25.076897  5883 raft_consensus.cc:2393] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:57:25.077713  5955 consensus_meta.cc:287] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.516s	user 0.028s	sys 0.032s
I20260620 13:57:25.078163  5955 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:25.038256  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:25.049336  6027 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
W20260620 13:57:25.077193  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 47284.7us
I20260620 13:57:25.079648  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:25.068650  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:25.080619  5955 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:25.081477  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:25.100690  6026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2671) took 1772 ms (client timeout 1635 ms). Trace:
W20260620 13:57:25.101293  6026 rpcz_store.cc:269] 0620 13:57:23.328597 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:23.328759 (+   162us) service_pool.cc:224] Handling call
0620 13:57:25.100475 (+1771716us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001e69d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:25.100623 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2332840192}
I20260620 13:57:25.024766 10063 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:25.106339  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:25.115296  6033 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:25.109174  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:25.116120  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:25.114094  6583 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:25.117005  6582 raft_consensus.cc:2368] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8.
I20260620 13:57:25.043443  9702 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:25.117846  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:25.119485  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:25.124154  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:25.125149  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:25.098685  9670 raft_consensus.cc:2764] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260620 13:57:25.126984  5777 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56610 (request call id 351) took 13439 ms (client timeout 15000 ms). Trace:
I20260620 13:57:25.099256  9691 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:25.128314  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:25.132086  5876 consensus_meta.cc:287] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.650s	user 0.012s	sys 0.049s
I20260620 13:57:25.132505  5876 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:25.132447  5883 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:25.133528  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:25.130450  5954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.017s	sys 0.043s
I20260620 13:57:25.042905  9902 consensus_queue.cc:1059] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
W20260620 13:57:25.134807  5954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.018s	sys 0.043s
I20260620 13:57:25.142999  9902 raft_consensus.cc:3055] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:25.143481  9902 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:57:25.131270  5777 rpcz_store.cc:269] 0620 13:57:11.687676 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:11.709727 (+ 22051us) service_pool.cc:224] Handling call
0620 13:57:25.126923 (+13417196us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:57:22.487013 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:57:22.487850 (+   837us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:57:22.493104 (+  5254us) write_op.cc:435] Acquired schema lock
0620 13:57:22.493157 (+    53us) tablet.cc:662] Decoding operations
0620 13:57:22.493751 (+   594us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:57:22.493866 (+   115us) write_op.cc:641] Partition lock acquired for write op
0620 13:57:22.493909 (+    43us) tablet.cc:685] Acquiring locks for 2 operations
0620 13:57:22.494389 (+   480us) tablet.cc:701] Row locks acquired
0620 13:57:22.494431 (+    42us) write_op.cc:260] PREPARE: finished
0620 13:57:22.494659 (+   228us) write_op.cc:270] Start()
0620 13:57:22.494839 (+   180us) write_op.cc:276] Timestamp: P: 1781963842494585 usec, L: 0
0620 13:57:22.494887 (+    48us) op_driver.cc:348] REPLICATION: starting
0620 13:57:22.495875 (+   988us) log.cc:844] Serialized 953 byte log entry
0620 13:57:22.549343 (+ 53468us) op_driver.cc:464] REPLICATION: finished
0620 13:57:22.704820 (+155477us) write_op.cc:301] APPLY: starting
0620 13:57:22.707290 (+  2470us) tablet.cc:1367] starting BulkCheckPresence
0620 13:57:22.838865 (+131575us) tablet.cc:1370] finished BulkCheckPresence
0620 13:57:22.847655 (+  8790us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:57:23.157594 (+309939us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:57:23.157937 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0620 13:57:23.157987 (+    50us) write_op.cc:312] APPLY: finished
0620 13:57:23.158328 (+   341us) log.cc:844] Serialized 33 byte log entry
0620 13:57:23.158561 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:23.158653 (+    92us) write_op.cc:454] Released schema lock
0620 13:57:23.158712 (+    59us) write_op.cc:341] FINISH: Updating metrics
0620 13:57:23.159212 (+   500us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:23.159247 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":371433,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":126809,"apply.run_cpu_time_us":14272,"apply.run_wall_time_us":467279,"cfile_cache_hit":6,"cfile_cache_hit_bytes":6276,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":2,"lbm_read_time_us":26543,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":10,"num_ops":2,"prepare.queue_time_us":244355,"prepare.run_cpu_time_us":4257,"prepare.run_wall_time_us":27257,"replication_time_us":54232,"thread_start_us":256126,"threads_started":2}]]}
I20260620 13:57:25.144392  9902 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.145633  5876 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260620 13:57:25.148142  5956 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 14. Current term is 15. Ops: []
I20260620 13:57:25.149930  6030 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260620 13:57:25.150804  5876 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260620 13:57:25.152508 10038 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.154573 10038 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:25.132277  9691 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:25.155722  5878 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:25.155862  9691 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:25.158447  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.159024  5875 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
W20260620 13:57:25.165407  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:25.121376  9702 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:25.165452  6026 raft_consensus.cc:1240] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:25.173796  5883 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:25.164139  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:25.165664  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:25.177561  5959 raft_consensus.cc:2393] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:25.166281  6033 raft_consensus.cc:1275] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260620 13:57:25.099659  9989 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:25.184198  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:25.185071  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:25.185496  9691 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:25.188251  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:25.188580  9691 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:25.188980  5957 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:25.190003  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:25.185155  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:25.191258  5878 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:25.195390  6028 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:25.196576  6032 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260620 13:57:25.197340  6028 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260620 13:57:25.197868  6032 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:57:25.199124  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:25.199995  5883 raft_consensus.cc:2368] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
I20260620 13:57:25.200791  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.201951  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:25.206468 10008 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6.
I20260620 13:57:25.209574 10004 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:25.210261  5878 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:57:25.210453  9903 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:25.210784  5958 raft_consensus.cc:1240] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260620 13:57:25.211338  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:25.211447  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.211897  6033 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:25.212944  9635 consensus_meta.cc:287] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.614s	user 0.004s	sys 0.004s
I20260620 13:57:25.213339  9635 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.214560  6578 raft_consensus.cc:2368] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11.
I20260620 13:57:25.212962  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.216568  5956 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:25.216982  5878 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:25.184360  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:25.218071  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.218837  5878 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 10: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:25.219746  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:25.145709  9902 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:25.222586  6033 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:25.226430  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.167356  9630 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:25.239609  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.233894  9635 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:25.210282 10003 consensus_meta.cc:287] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.758s	user 0.000s	sys 0.006s
I20260620 13:57:25.235589  9996 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:25.235994  5876 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260620 13:57:25.178797  9702 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:25.233027  9670 consensus_queue.cc:1059] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:57:25.240625  5878 raft_consensus.cc:2393] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 9: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:25.241492  5997 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:25.223263 10033 consensus_meta.cc:287] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.643s	user 0.007s	sys 0.002s
I20260620 13:57:25.245498  5956 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:57:25.248085  6024 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:25.178910  9951 consensus_queue.cc:1059] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260620 13:57:25.255600  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:25.256524  5876 raft_consensus.cc:2376] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14. Re-sending same reply.
I20260620 13:57:25.263254  6032 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:25.268093  6025 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 15.
I20260620 13:57:25.257318  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:25.268453  5849 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.731s (SENT)
I20260620 13:57:25.268906  5878 raft_consensus.cc:2376] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14. Re-sending same reply.
I20260620 13:57:25.269582  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.244417 10003 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.275791  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.277011  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.278087  5877 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:25.278385  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:25.278942  6026 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:25.279906  5876 raft_consensus.cc:2368] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
I20260620 13:57:25.281852  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:25.280838  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:25.287176  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.288659  5878 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 10: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:25.294414  5878 raft_consensus.cc:1275] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260620 13:57:25.296384  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:25.297441  5876 raft_consensus.cc:2393] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:25.298949  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.272043 10038 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:25.301613  6586 raft_consensus.cc:1240] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 3. Current term is 4. Ops: []
I20260620 13:57:25.303710  5878 raft_consensus.cc:1240] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:25.280406  9951 consensus_queue.cc:1243] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260620 13:57:25.323729  6032 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260620 13:57:25.330926  5878 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260620 13:57:25.334126  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.335316  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.348181  5876 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:25.355998  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:25.356853  5878 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:25.263079 10033 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.388044  5876 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:57:25.424911  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:25.303992 10038 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:25.292243  9670 consensus_queue.cc:1059] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260620 13:57:25.444062  5950 raft_consensus.cc:2393] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:25.336726 10004 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:25.448573  6585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:25.449958  6585 raft_consensus.cc:606] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:25.450402  6585 raft_consensus.cc:614] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:25.426242 10074 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:25.432317 10038 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:25.467945  5882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.015s	sys 0.010s
W20260620 13:57:25.472426  5882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.016s	sys 0.010s
I20260620 13:57:25.359834 10010 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.106s
I20260620 13:57:25.449364 10052 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:25.429060  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 160593us
I20260620 13:57:25.498488  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58452 (request call id 2692) took 1065 ms. Trace:
I20260620 13:57:25.499589  5880 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260620 13:57:25.500276  5880 pending_rounds.cc:85] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 5
I20260620 13:57:25.500578  5880 pending_rounds.cc:107] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260620 13:57:25.500887  5880 raft_consensus.cc:2889] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:25.499413  5879 rpcz_store.cc:276] 0620 13:57:24.433284 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:24.437244 (+  3960us) service_pool.cc:224] Handling call
0620 13:57:25.498173 (+1060929us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400324454. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:25.498396 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425049984}
W20260620 13:57:25.506107 10081 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260620 13:57:25.478188 10035 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:25.524248 10035 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:25.526153  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:25.527242  9989 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:25.528137  5955 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:25.528888 10003 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:25.508354 10005 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:25.531268  9670 raft_consensus.cc:3055] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:25.531745  9670 raft_consensus.cc:740] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:25.532779  9670 consensus_queue.cc:260] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.533421 10016 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:25.534418  9670 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:25.535447 10016 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:25.536535  6585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:25.536302 10016 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.537346  6585 raft_consensus.cc:606] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:25.501699 10052 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.541921 10052 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:25.542217 10016 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:25.543455 10082 log.cc:927] Time spent T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260620 13:57:25.479529 10074 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.545085 10033 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:25.530772 10083 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260620 13:57:25.567127  6585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:25.568229  6585 raft_consensus.cc:606] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:25.546728 10079 log.cc:927] Time spent T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260620 13:57:25.579964  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:25.580773 10080 log.cc:927] Time spent T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260620 13:57:25.593833 10044 raft_consensus.cc:3055] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:25.594465 10044 raft_consensus.cc:740] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:25.598577  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1974) took 1573 ms. Trace:
I20260620 13:57:25.599155  5952 rpcz_store.cc:276] 0620 13:57:24.024733 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:24.027225 (+  2492us) service_pool.cc:224] Handling call
0620 13:57:24.027537 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:24.619898 (+592361us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:25.598249 (+978351us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b5400261bd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:25.598498 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354825472}
I20260620 13:57:25.601064  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 1014) took 1139 ms. Trace:
I20260620 13:57:25.601480  6579 rpcz_store.cc:276] 0620 13:57:24.461275 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:24.467218 (+  5943us) service_pool.cc:224] Handling call
0620 13:57:24.467577 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:24.601623 (+134046us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:25.600736 (+999113us) spinlock_profiling.cc:243] Waited 99.6 ms on lock 0x7b540059f954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:25.600960 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229187328}
W20260620 13:57:25.604362  6024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2667) took 2394 ms (client timeout 1749 ms). Trace:
W20260620 13:57:25.605103  6024 rpcz_store.cc:269] 0620 13:57:23.210163 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:23.210438 (+   275us) service_pool.cc:224] Handling call
0620 13:57:25.603903 (+2393465us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54004006d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:25.604252 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4513833216}
I20260620 13:57:25.607924  6578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 978) took 1044 ms. Trace:
I20260620 13:57:25.608441  6578 rpcz_store.cc:276] 0620 13:57:24.563704 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:24.716968 (+153264us) service_pool.cc:224] Handling call
0620 13:57:25.607654 (+890686us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54005d0f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:25.607854 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095570176}
I20260620 13:57:25.554972 10074 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:25.611773  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:25.612619  6027 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:25.624004  6026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4cd17345f80464287c5952767849dbb"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:57:25.624835  6026 raft_consensus.cc:606] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:25.626631  6026 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:25.631904  6586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 1015) took 1170 ms. Trace:
I20260620 13:57:25.632468  6586 rpcz_store.cc:276] 0620 13:57:24.461594 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:24.520112 (+ 58518us) service_pool.cc:224] Handling call
0620 13:57:24.547422 (+ 27310us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:25.302116 (+754694us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:25.631632 (+329516us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54005d0054. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:25.631833 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1733916928}
I20260620 13:57:25.635255  9787 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:25.637329  6586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:25.638118  6586 raft_consensus.cc:606] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:25.638499  6586 raft_consensus.cc:614] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:25.639575  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2678) took 1245 ms. Trace:
I20260620 13:57:25.639992  6025 rpcz_store.cc:276] 0620 13:57:24.393700 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:25.011037 (+617337us) service_pool.cc:224] Handling call
0620 13:57:25.591075 (+580038us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54001c8c54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:25.639519 (+ 48444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454376320}
I20260620 13:57:25.640954 10057 raft_consensus.cc:3055] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:25.641507 10057 raft_consensus.cc:740] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:25.595521 10044 consensus_queue.cc:260] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:25.642666 10044 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:25.607019  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:25.647739  9741 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:25.648316  9741 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.648674  5779 catalog_manager.cc:5696] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 5 to 6, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 6 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:25.650390  9741 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:25.650480  5779 catalog_manager.cc:5696] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 5 to 9, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 9 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:57:25.660836  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:25.661507  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 626611us
I20260620 13:57:25.660984  5779 catalog_manager.cc:5696] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 7 to 8, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 8 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:25.661931 10027 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:57:25.662536 10027 consensus_queue.cc:1243] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260620 13:57:25.662461  5779 catalog_manager.cc:5696] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 7 to 9, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 9 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:25.663997  6551 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:25.664951  9635 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:25.667514  6581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 1010) took 1260 ms. Trace:
I20260620 13:57:25.642623 10057 consensus_queue.cc:260] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:25.670493  6584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 1033) took 1238 ms. Trace:
I20260620 13:57:25.670642 10057 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:25.673660  5951 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:57:25.670907  6584 rpcz_store.cc:276] 0620 13:57:24.432100 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:24.453079 (+ 20979us) service_pool.cc:224] Handling call
0620 13:57:24.515951 (+ 62872us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:24.650649 (+134698us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:24.650678 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:24.726970 (+ 76292us) log.cc:844] Serialized 26 byte log entry
0620 13:57:25.100081 (+373111us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:25.124010 (+ 23929us) log.cc:844] Serialized 14 byte log entry
0620 13:57:25.669321 (+545311us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:25.670115 (+   794us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54003b74d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:25.670158 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:25.670205 (+    47us) raft_consensus.cc:1685] finished
0620 13:57:25.670300 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:25.670433 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":547612,"prepare.queue_time_us":23507,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":548034,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":11969,"spinlock_wait_cycles":302788992,"thread_start_us":300187,"threads_started":1,"wal-append.queue_time_us":599427}
I20260620 13:57:25.674875  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:25.676160  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:25.677385  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:25.678102  5952 raft_consensus.cc:2393] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 4: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:25.680248  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:25.680980  6586 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:25.681604 10035 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:25.681989  9635 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:25.685312  6586 raft_consensus.cc:1240] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:25.686542 10051 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:25.687244 10051 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.688778  5952 pending_rounds.cc:85] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 8
I20260620 13:57:25.689127  5779 catalog_manager.cc:5696] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 8 to 10, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 10 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:25.685041  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:25.690328  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260620 13:57:25.691290  9901 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:25.691814  9901 raft_consensus.cc:697] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:25.692329  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:57:25.693053  6579 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:25.692900  9901 consensus_queue.cc:237] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.689172  5952 pending_rounds.cc:107] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260620 13:57:25.694212  5952 raft_consensus.cc:2889] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:25.694509  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:25.696393  6579 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260620 13:57:25.668073  6581 rpcz_store.cc:276] 0620 13:57:24.407070 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:24.407209 (+   139us) service_pool.cc:224] Handling call
0620 13:57:24.433210 (+ 26001us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:24.445695 (+ 12485us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:24.445714 (+    19us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:24.491722 (+ 46008us) log.cc:844] Serialized 52 byte log entry
0620 13:57:24.723880 (+232158us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:57:24.897798 (+173918us) log.cc:844] Serialized 14 byte log entry
0620 13:57:25.659499 (+761701us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b18001f8a00. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc68540a 00007f0fe5dca5d9 00007f0fdc70d240 00007f0fdc707ce4 00007f0fdc707c55 00007f0fdf7f4440 00007f0fdf806af6 00007f0fdf817667 00007f0fdf8175e8
0620 13:57:25.660247 (+   748us) log.cc:844] Serialized 14 byte log entry
0620 13:57:25.662422 (+  2175us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:25.667157 (+  4735us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:25.667285 (+   128us) raft_consensus.cc:1685] finished
0620 13:57:25.667304 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:25.667444 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17688,"prepare.queue_time_us":173843,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":100,"raft.queue_time_us":764229,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":3376,"spinlock_wait_cycles":9568512,"thread_start_us":231696,"threads_started":1,"wal-append.queue_time_us":451822}
I20260620 13:57:25.693102  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:57:25.700162  9903 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:25.702932  9997 consensus_queue.cc:1059] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:25.703688  6552 leader_election.cc:400] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10.
I20260620 13:57:25.704191  6552 leader_election.cc:403] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260620 13:57:25.705257 10063 raft_consensus.cc:3055] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:25.705446  9997 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10.
I20260620 13:57:25.705780 10063 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:25.706879 10063 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.707896  5958 raft_consensus.cc:3055] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:57:25.708405  5958 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:25.708844 10051 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:25.709630  5958 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.711506  5958 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:25.712890  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:25.711367 10063 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:25.681979  6027 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
W20260620 13:57:25.719877  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:25.719921  5881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.013s	sys 0.050s
I20260620 13:57:25.722515  9903 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:25.724514  9903 raft_consensus.cc:697] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:25.725721  9903 consensus_queue.cc:237] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:25.727882  5998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.029s	sys 0.041s
W20260620 13:57:25.728353  5998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.029s	sys 0.041s
W20260620 13:57:25.728832  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:25.729252  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:25.485389  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 310029us
I20260620 13:57:25.707193  5779 catalog_manager.cc:5696] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 8 to 9, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 9 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:25.731855  5779 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:25.735742  5884 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260620 13:57:25.722839  5881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.014s	sys 0.051s
I20260620 13:57:25.737522  6552 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:25.734053  5779 catalog_manager.cc:5696] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 6 to 7, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 7 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:57:25.737725  5881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2684) took 1345 ms. Trace:
I20260620 13:57:25.747953  5878 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:25.748440  5884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1714) took 1197 ms. Trace:
I20260620 13:57:25.755614  6552 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:25.744135  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2685) took 1351 ms. Trace:
I20260620 13:57:25.743369  5881 rpcz_store.cc:276] 0620 13:57:24.392408 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:24.393673 (+  1265us) service_pool.cc:224] Handling call
0620 13:57:24.393990 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:24.440898 (+ 46908us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:24.440924 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:24.458109 (+ 17185us) log.cc:844] Serialized 26 byte log entry
0620 13:57:24.576301 (+118192us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b48000d0a58. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe47261a1 00007f0fe471d237 00007f0fe471d0ca 00007f0fe481496f 00007f0fe4814637 00007f0fe4828c5c 00007f0fe4828c08 00007f0fe4828b88 00007f0fe4828b43 00007f0fe4827dec 00007f0fe3754f76
0620 13:57:25.155749 (+579448us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b1800436720. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:57:25.737399 (+581650us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:25.737437 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:25.737501 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:25.737544 (+    43us) raft_consensus.cc:1685] finished
0620 13:57:25.737556 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:25.737669 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46528,"raft.queue_time_us":47723,"raft.run_cpu_time_us":3480,"raft.run_wall_time_us":130562,"spinlock_wait_cycles":47176704,"thread_start_us":581452,"threads_started":1,"wal-append.queue_time_us":1245057}
I20260620 13:57:25.748980  5884 rpcz_store.cc:276] 0620 13:57:24.551171 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:24.717893 (+166722us) service_pool.cc:224] Handling call
0620 13:57:25.735309 (+1017416us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:25.736357 (+  1048us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:25.748080 (+ 11723us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54000c58d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:25.748356 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2293286144}
I20260620 13:57:25.757791  5882 rpcz_store.cc:276] 0620 13:57:24.392679 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:24.395029 (+  2350us) service_pool.cc:224] Handling call
0620 13:57:24.427514 (+ 32485us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:24.445316 (+ 17802us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:24.445350 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:24.475642 (+ 30292us) log.cc:844] Serialized 26 byte log entry
0620 13:57:24.874913 (+399271us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b1800436900. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:57:25.474197 (+599284us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:57:25.474254 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:25.474347 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:25.734924 (+260577us) raft_consensus.cc:1685] finished
0620 13:57:25.734950 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:25.744066 (+  9116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6928,"raft.queue_time_us":8273,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":12945,"spinlock_wait_cycles":17077120,"thread_start_us":599001,"threads_started":1,"wal-append.queue_time_us":1257656}
I20260620 13:57:25.741456  5779 catalog_manager.cc:5696] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 6 to 8, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 8 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
W20260620 13:57:25.741004 10062 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.021s	sys 0.029s
I20260620 13:57:25.799399  5924 leader_election.cc:400] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:57:25.804554  5924 leader_election.cc:403] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260620 13:57:25.805374  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 49895.5us
I20260620 13:57:25.807894  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:25.735160 10051 raft_consensus.cc:993] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: : Instructing follower 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:57:25.795744  5779 catalog_manager.cc:5696] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:25.814056  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:25.816182  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:25.801524  5958 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260620 13:57:25.757498 10049 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:25.804461 10062 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.021s	sys 0.029s
I20260620 13:57:25.760596  9638 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:25.814360  5779 catalog_manager.cc:5696] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 7 to 9, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 9 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:25.835187  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:25.750591  9630 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.067s
W20260620 13:57:25.847508  6029 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.035s	sys 0.034s
I20260620 13:57:25.816138  9993 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election won for term 11
W20260620 13:57:25.849102  6030 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.010s	sys 0.060s
I20260620 13:57:25.857084  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:25.814250 10003 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:25.852460  5779 catalog_manager.cc:5696] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 5 to 10, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 10 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:25.861349 10003 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:25.857299  6030 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.010s	sys 0.060s
W20260620 13:57:25.851253  6029 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.035s	sys 0.034s
I20260620 13:57:25.817129  5958 pending_rounds.cc:85] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 11
I20260620 13:57:25.862795 10003 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:25.844985  9702 consensus_meta.cc:287] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.594s	user 0.007s	sys 0.005s
I20260620 13:57:25.863607  6578 raft_consensus.cc:2393] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 4: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:25.863837  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:25.864331  6586 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260620 13:57:25.826381  9996 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:25.827124  9691 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election won for term 11
W20260620 13:57:25.844393  9902 consensus_meta.cc:287] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.613s	user 0.013s	sys 0.000s
I20260620 13:57:25.874550  6584 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260620 13:57:25.863643  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:25.880980  6579 raft_consensus.cc:2410] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260620 13:57:25.865340  5958 pending_rounds.cc:107] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260620 13:57:25.863056  5779 catalog_manager.cc:5696] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 7 to 8, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 8 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:25.850085  9774 raft_consensus.cc:1081] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Signalling peer 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:57:25.813407 10008 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260620 13:57:25.815934  9989 consensus_queue.cc:1059] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260620 13:57:25.819315 10004 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260620 13:57:25.895509  5958 raft_consensus.cc:2889] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:25.895931  5779 catalog_manager.cc:5696] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 7 to 9, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 9 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:57:25.897974  6025 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260620 13:57:25.884727  9993 raft_consensus.cc:697] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:25.922987  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:25.924010  6579 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260620 13:57:25.927062  5779 catalog_manager.cc:5696] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:25.930002  5882 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:25.843932 10049 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.875651  9702 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:25.930811  5779 catalog_manager.cc:5696] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 7 to 11, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 11 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:25.933799  5779 catalog_manager.cc:5696] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 6 to 9, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 9 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:25.899363  9996 raft_consensus.cc:697] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:57:25.869470  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 373889us
I20260620 13:57:25.937748  5849 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:25.947243  5884 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260620 13:57:25.902452  9691 raft_consensus.cc:697] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:25.951985  9951 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:25.952757  9951 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.955317  9951 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:25.949683  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:25.956878 10085 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:25.960086 10085 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:25.960124  9691 consensus_queue.cc:237] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:25.962754 10085 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:25.964522  9702 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:25.966216  9993 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:25.968314 10049 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:25.969260  9996 consensus_queue.cc:237] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:25.973652  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 243257us
I20260620 13:57:25.976899  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:25.977933  6580 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:57:25.976899  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:25.946316  6585 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
I20260620 13:57:25.983798  6028 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:25.993219  6552 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:25.994531  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:25.998181  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:25.929210  9638 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260620 13:57:25.948475  9985 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:26.013564  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:26.024325 10090 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:26.027613  5998 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:26.045871  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:26.047459  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 109790us
I20260620 13:57:26.048870  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:26.049526  9898 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:26.049644 10016 consensus_queue.cc:1059] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:57:26.000460  9951 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:26.050621 10016 raft_consensus.cc:3055] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Stepping down as leader of term 3
W20260620 13:57:26.049960  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a4cd17345f80464287c5952767849dbb. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:57:26.048913 10038 consensus_meta.cc:287] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.000s
I20260620 13:57:26.052122  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:26.050185  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:26.071624  5997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.018s	sys 0.015s
W20260620 13:57:26.072732  5997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.018s	sys 0.015s
I20260620 13:57:26.014703 10049 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:57:26.071135  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:26.015244 10085 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:26.064208 10089 log.cc:927] Time spent T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260620 13:57:26.078913  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:26.084201  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:26.058295 10074 raft_consensus.cc:3055] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:26.051070 10035 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:26.036156 10033 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:57:26.093684  5957 raft_consensus.cc:1240] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:26.051139 10016 raft_consensus.cc:740] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:26.030390  9635 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260620 13:57:26.072933  9951 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:57:26.106593  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 56472.7us
I20260620 13:57:26.117427  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:26.118450  5849 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:26.036448  9642 consensus_queue.cc:1059] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260620 13:57:26.027027  9985 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.078188 10027 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:26.073326 10038 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:26.108767 10094 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.265s	user 0.003s	sys 0.002s
I20260620 13:57:26.103546  9898 raft_consensus.cc:2764] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260620 13:57:26.127383  5849 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:26.121276 10008 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260620 13:57:26.150736  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:26.151595  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:26.095170 10074 raft_consensus.cc:740] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:26.152246 10035 raft_consensus.cc:2764] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260620 13:57:26.153120 10035 raft_consensus.cc:2764] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260620 13:57:26.152747 10074 consensus_queue.cc:260] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:26.154129 10074 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:26.108912  5882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:42748
I20260620 13:57:26.155544  5882 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:57:26.155938  5882 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:26.134209  9951 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260620 13:57:26.134848  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:26.135601  6031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2674) took 1746 ms. Trace:
I20260620 13:57:26.160633  9951 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:26.161109  9951 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:26.139281 10005 consensus_meta.cc:287] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
W20260620 13:57:26.161607 10104 log.cc:927] Time spent T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260620 13:57:26.160939  6031 rpcz_store.cc:276] 0620 13:57:24.389156 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:25.186325 (+797169us) service_pool.cc:224] Handling call
0620 13:57:25.186817 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:25.224578 (+ 37761us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:25.224625 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:25.229690 (+  5065us) log.cc:844] Serialized 26 byte log entry
0620 13:57:25.481017 (+251327us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:25.481059 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:25.481129 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:26.054816 (+573687us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:26.135190 (+ 80374us) raft_consensus.cc:1685] finished
0620 13:57:26.135224 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:26.135520 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37353,"raft.queue_time_us":38819,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4933,"spinlock_wait_cycles":4200704,"thread_start_us":224947,"threads_started":1,"wal-append.queue_time_us":551190}
W20260620 13:57:26.167768 10105 log.cc:927] Time spent T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260620 13:57:26.172461 10052 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:26.173281 10052 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.179382 10027 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.180794  5882 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.182143 10027 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:26.184324  9985 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:26.185482 10049 raft_consensus.cc:993] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: : Instructing follower 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:57:26.186030 10049 raft_consensus.cc:1081] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Signalling peer 2e82c0c231624695ac5a813230bf5038 to start an election
I20260620 13:57:26.191571  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:26.193138  5849 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:26.145237  9670 consensus_meta.cc:287] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.610s	user 0.012s	sys 0.001s
I20260620 13:57:26.094463 10085 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.146209  9630 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:26.147503  9774 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:26.148288  6032 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:26.149147 10038 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:26.154160 10016 consensus_queue.cc:260] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.195685 10005 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election won for term 10
W20260620 13:57:26.196190 10103 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260620 13:57:26.199375  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:26.182922  5882 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:26.205235 10016 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:57:26.209769 10005 raft_consensus.cc:697] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:57:26.210348  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:26.212679  6027 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:26.198802 10035 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:26.203733  9774 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:26.218961  9774 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:26.258176 10063 consensus_meta.cc:287] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.003s
I20260620 13:57:26.260556 10085 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:26.230108 10003 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.263978 10003 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:26.266752 10057 consensus_meta.cc:287] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.595s	user 0.005s	sys 0.005s
I20260620 13:57:26.267736 10057 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:26.268970 10057 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:26.269611 10057 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:57:26.277855  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:26.205879  9630 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.242874  6024 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:57:26.331303  6030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2673) took 1942 ms. Trace:
I20260620 13:57:26.333220  6030 rpcz_store.cc:276] 0620 13:57:24.388200 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:25.166803 (+778603us) service_pool.cc:224] Handling call
0620 13:57:25.224878 (+ 58075us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:25.225068 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 7
0620 13:57:25.863862 (+638794us) log.cc:844] Serialized 14 byte log entry
0620 13:57:26.079383 (+215521us) log.cc:844] Serialized 14 byte log entry
0620 13:57:26.171588 (+ 92205us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x7b18003b73a0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc70abf3 00007f0fdc70cfc1 00007f0fdc70cf79 00007f0fdc70cf09 00007f0fdc70ced1 00007f0fdc70c1cd 0000000000389354 0000000000389199 00007f0fdc6ee03a
0620 13:57:26.329684 (+158096us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:26.329745 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:26.329806 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:26.329876 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:26.330008 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18370,"prepare.queue_time_us":493472,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":86,"raft.queue_time_us":76008,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":275,"spinlock_wait_cycles":18757888,"thread_start_us":1041582,"threads_started":3,"wal-append.queue_time_us":376108}
I20260620 13:57:26.338009  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1987) took 1012 ms. Trace:
I20260620 13:57:26.343040  5956 rpcz_store.cc:276] 0620 13:57:25.325348 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:25.325540 (+   192us) service_pool.cc:224] Handling call
0620 13:57:25.387767 (+ 62227us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:25.388034 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 5
0620 13:57:25.950717 (+562683us) log.cc:844] Serialized 14 byte log entry
0620 13:57:26.337455 (+386738us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:26.337530 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:57:26.337597 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:26.337765 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:26.337931 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":338642,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":120,"thread_start_us":885561,"threads_started":2}
I20260620 13:57:26.270754 10057 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.352133  6024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 832) took 1025 ms. Trace:
I20260620 13:57:26.352578  6024 rpcz_store.cc:276] 0620 13:57:25.326545 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:25.606650 (+280105us) service_pool.cc:224] Handling call
0620 13:57:26.351950 (+745300us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54001c8254. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:26.352074 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263108480}
I20260620 13:57:26.348073 10005 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.365989  6029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2675) took 1976 ms. Trace:
I20260620 13:57:26.366586  6029 rpcz_store.cc:276] 0620 13:57:24.389791 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:25.188594 (+798803us) service_pool.cc:224] Handling call
0620 13:57:25.188910 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:25.864674 (+675764us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:25.864716 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:25.865242 (+   526us) log.cc:844] Serialized 26 byte log entry
0620 13:57:26.283961 (+418719us) raft_consensus.cc:1645] Marking committed up to 4
0620 13:57:26.284018 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:26.284116 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:26.365691 (+ 81575us) raft_consensus.cc:1685] finished
0620 13:57:26.365719 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:26.365910 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35777,"raft.queue_time_us":43616,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":68,"thread_start_us":1023721,"threads_started":2,"wal-append.queue_time_us":454596}
I20260620 13:57:26.367700  9951 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:26.386575  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 269205us
I20260620 13:57:26.392045  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:26.392788  6024 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:26.372255  5997 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:26.397040  5924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.007s	sys 0.007s
W20260620 13:57:26.397483  5924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.007s	sys 0.007s
W20260620 13:57:26.397807  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 580376us
I20260620 13:57:26.398623  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:26.411417  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:26.416764  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:26.417025  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:26.420265  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 287830us
I20260620 13:57:26.424248  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:26.425323  6030 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 15: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:26.426811  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:26.428745  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:26.430819  5884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25"
dest_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:42748
I20260620 13:57:26.431466  5884 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:57:26.431849  5884 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:26.431659  5924 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:26.446767  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:26.447248  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:26.443637  5956 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 15: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:26.448002  5880 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:26.415277  9691 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election won for term 8
W20260620 13:57:26.463531  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 45237.5us
W20260620 13:57:26.469439  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 274222us
I20260620 13:57:26.464614  5998 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:26.430445 10074 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:26.411803 10119 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:26.422729 10121 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:26.421249 10123 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:26.434429  9989 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:26.468817  9902 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:57:26.432554 10044 consensus_queue.cc:1059] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260620 13:57:26.485004  5998 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:26.451965  9996 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:26.477483  9993 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:26.480829  9985 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:26.489951 10005 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:57:26.491374  9670 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:26.459246  9951 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:26.435233 10033 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.042s
I20260620 13:57:26.458520 10035 raft_consensus.cc:697] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:26.527273  5880 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:26.530241  5884 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.478737  9691 raft_consensus.cc:697] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:57:26.540382  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 108709us
I20260620 13:57:26.471247  9642 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260620 13:57:26.483388  9901 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:26.552965  5884 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:26.477319 10090 consensus_queue.cc:1059] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260620 13:57:26.553993  9691 consensus_queue.cc:237] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:26.557302  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 63596.3us
I20260620 13:57:26.590070  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:26.560446 10125 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260620 13:57:26.567883 10112 log.cc:927] Time spent T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260620 13:57:26.532696 10074 raft_consensus.cc:697] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:26.536412  9993 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.488458 10123 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.577394 10132 consensus_queue.cc:1059] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:26.526139  9996 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:26.524858  9989 raft_consensus.cc:697] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:26.539237  9985 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.486373 10121 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:26.585902  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 96412.1us
I20260620 13:57:26.590780  6552 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:57:26.595498  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 110567us
I20260620 13:57:26.689998  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:26.690223  5849 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:57:26.624681  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:26.618263  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:26.652740 10137 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:26.648666 10090 raft_consensus.cc:3055] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:26.654695 10035 consensus_queue.cc:237] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.650597 10122 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:26.606287 10003 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:26.664454 10115 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260620 13:57:26.669957 10123 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:26.670862 10132 raft_consensus.cc:3055] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:26.671375  9996 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:26.692622  5998 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:26.690032  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 99329.2us
I20260620 13:57:26.607380 10126 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260620 13:57:26.697918 10090 raft_consensus.cc:740] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:26.698308 10137 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:26.699144  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:26.612104 10004 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:26.658551  9774 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:26.706571  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:26.726966  5998 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:26.723618  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:26.671936  9630 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:26.744359  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 45342us
W20260620 13:57:26.745282  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 127115us
I20260620 13:57:26.702311  9642 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:26.747051  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:26.704277 10122 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.748867  5849 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:26.751636  5849 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:26.702247 10027 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:26.687886  9902 raft_consensus.cc:697] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:26.752526  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:26.704679 10057 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:26.720702 10132 raft_consensus.cc:740] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:26.746513 10128 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:26.607530  9901 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.748019 10131 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:26.767429 10131 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:26.767854 10131 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:26.773090  9997 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:26.773890  9997 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.753934 10052 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:26.762569  5849 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:26.702194 10136 consensus_queue.cc:1059] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260620 13:57:26.719614 10140 consensus_queue.cc:1048] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260620 13:57:26.766635  9901 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:26.753074  9951 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:26.750198  9642 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:26.758450 10062 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:26.803530 10062 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:26.803987 10062 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:26.804180 10130 log.cc:927] Time spent T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260620 13:57:26.752218  9638 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:26.754482 10027 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:26.719928 10003 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.756124  9630 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:26.756340 10085 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:26.777796  6029 raft_consensus.cc:3055] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:26.758286 10005 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:26.791209  6027 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:57:26.835630  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:26.837107  6027 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
W20260620 13:57:26.797955  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:26.777321 10142 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:26.799762 10152 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:57:26.771610 10123 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:26.801659  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:26.771191 10074 consensus_queue.cc:237] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:26.816566  5848 leader_election.cc:336] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.806s (SENT)
I20260620 13:57:26.820091  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:26.828083  6029 raft_consensus.cc:740] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:26.794821 10052 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:26.840094  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:26.853999  6030 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:26.839672  6032 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:26.843837  5848 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:26.854758  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 53161.5us
I20260620 13:57:26.843389  6029 consensus_queue.cc:260] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.845206  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:26.856415  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:26.873196  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:26.877907  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:26.878602  6552 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:26.828907 10027 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:26.818158  9642 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:26.874686 10057 raft_consensus.cc:697] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:26.839893 10123 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:26.785110 10004 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260620 13:57:26.835754 10151 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260620 13:57:26.781139 10090 consensus_queue.cc:260] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:26.917025  5998 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 1.638s (SENT)
I20260620 13:57:26.777714  9989 consensus_queue.cc:237] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:26.954080  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 191592us
I20260620 13:57:26.984731  5849 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:26.858805  9630 raft_consensus.cc:697] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:26.877202  9951 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:26.945466 10085 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:26.983803 10123 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:26.828832  9902 consensus_queue.cc:237] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.853665 10052 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:26.908797 10120 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:26.909240 10049 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:26.995460  5849 leader_election.cc:400] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8.
I20260620 13:57:26.967013 10126 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election won for term 15
W20260620 13:57:26.990155  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 73202.7us
W20260620 13:57:27.018118  5998 leader_election.cc:336] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 1.643s (SENT)
W20260620 13:57:27.019611  5998 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 1.804s (SENT) [suppressed 23 similar messages]
I20260620 13:57:26.986133 10090 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:26.989099 10161 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:26.839329 10142 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.000154  9985 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:27.029517 10131 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:26.954072 10156 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.031917 10156 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:27.035883 10003 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:27.036482 10131 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.046351 10156 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.012024  5849 leader_election.cc:403] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:57:26.909246 10032 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260620 13:57:26.966467 10154 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:27.000375 10127 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:26.999476  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 120987us
I20260620 13:57:27.026966 10057 consensus_queue.cc:237] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:27.048003 10117 log.cc:927] Time spent T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260620 13:57:27.006620 10052 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:26.882603 10141 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.114s
I20260620 13:57:26.872565 10132 consensus_queue.cc:260] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:27.071964  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 76964.7us
I20260620 13:57:27.081274  5849 leader_election.cc:400] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11.
W20260620 13:57:27.072336  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 216025us
I20260620 13:57:27.021435 10049 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:27.025534 10121 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.025938 10126 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:27.086169  9997 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.082552 10127 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.089123  6551 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:27.089736  9774 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:27.093752 10162 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.217s	user 0.003s	sys 0.000s
I20260620 13:57:27.069794 10100 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.103482  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:27.109808  5882 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:27.110451  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:57:27.076828 10156 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8.
I20260620 13:57:27.106630  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:27.003626 10085 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.115979  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:27.122342  5883 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260620 13:57:27.133884  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:27.128520  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:27.137320  6031 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:27.127444  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:27.139539  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:27.140338  6027 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:27.140486  6583 raft_consensus.cc:2376] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10. Re-sending same reply.
I20260620 13:57:27.089803 10154 raft_consensus.cc:697] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:27.097473 10049 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:27.146299  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:27.154840  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:27.154855  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:27.146519  6583 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:27.146993  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:27.148084  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:27.157859  5881 raft_consensus.cc:2410] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260620 13:57:27.122466  9702 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.021247 10120 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.150017  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:27.160363  5884 raft_consensus.cc:1275] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260620 13:57:27.100778 10008 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.163172  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:27.176258  6031 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:27.158381  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:27.167383  6027 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
W20260620 13:57:27.177778  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:27.174628  5882 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:27.112053 10164 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:27.184129  6581 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260620 13:57:27.154573  9774 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.185488  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:27.187199  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:27.100263 10161 consensus_queue.cc:1059] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
W20260620 13:57:27.197857  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:27.166254 10152 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:27.168846  9951 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:27.200671  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 88859.3us
I20260620 13:57:27.154608 10121 consensus_queue.cc:1059] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260620 13:57:27.103015  9630 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.205860  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:27.225764  6581 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:27.206180  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:27.121987 10158 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260620 13:57:27.134389 10100 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.207870  5998 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:27.227799  6026 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:27.176403  9702 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.236435  5998 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:27.247036  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:27.253547  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:27.253974 10158 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.254532 10158 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:27.254961  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:27.255651  6026 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:27.256866  9702 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.236717 10035 consensus_queue.cc:1059] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260620 13:57:27.222484 10126 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.257169 10131 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:27.260370  6581 raft_consensus.cc:2368] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6.
I20260620 13:57:27.200443  9774 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.181617 10008 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.288285  6579 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:27.209105 10090 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260620 13:57:27.209077 10152 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:27.224005  9951 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:27.295274  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:27.296244  6579 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
W20260620 13:57:27.305812  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 69512.2us
W20260620 13:57:27.306270  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:27.306090  6552 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:57:27.308158  5924 connection.cc:256] RPC call timeout handler was delayed by -1.2891089069998998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
I20260620 13:57:27.309587  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:27.326825  5924 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:27.324705  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:27.291518 10165 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:57:27.322607  9996 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.002s
I20260620 13:57:27.296036 10166 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:27.299232  9638 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:27.324466 10141 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:27.352551  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:27.354303  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:27.323916 10150 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:27.321506 10119 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:27.290078 10131 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.363746  6582 raft_consensus.cc:3055] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:57:27.352860  5849 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:27.355343 10062 consensus_meta.cc:287] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.551s	user 0.005s	sys 0.008s
I20260620 13:57:27.373175  6582 raft_consensus.cc:740] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:27.348965 10158 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.383985  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:27.393522  6579 raft_consensus.cc:3055] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:27.393880  6579 raft_consensus.cc:740] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:27.394965  5849 leader_election.cc:400] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6.
I20260620 13:57:27.396489  5849 leader_election.cc:403] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260620 13:57:27.399428  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:27.390790  6582 consensus_queue.cc:260] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.324687  9903 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260620 13:57:27.400437  6582 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:27.394569  6579 consensus_queue.cc:260] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.244343 10154 consensus_queue.cc:237] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:27.343989  9702 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260620 13:57:27.363057 10141 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:27.389313 10085 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.391881 10121 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260620 13:57:27.411600  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:27.429001  5849 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:27.431027 10174 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:27.431757 10174 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.434147 10174 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.434739 10160 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:57:27.435212 10160 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:27.435503  9774 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:27.436561 10008 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:27.437839 10016 consensus_meta.cc:287] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 1.220s	user 0.012s	sys 0.002s
I20260620 13:57:27.355466  9996 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:27.440761  9996 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.441419  5958 raft_consensus.cc:1240] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:27.443905 10152 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.444550 10152 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:27.444904 10152 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:27.445243 10152 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:27.448499 10131 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.449745 10182 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.419845 10121 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:27.450372 10121 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:27.450290 10182 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.452502 10182 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.453567 10100 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.411378 10032 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 13:57:27.455690  9951 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.350252 10165 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.457695 10165 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:27.459741 10167 log.cc:927] Time spent T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260620 13:57:27.395895 10062 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.462692 10062 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.463433  5955 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 10: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:27.466006  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:27.466640  6586 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:27.467504  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:27.468452  6029 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 8
I20260620 13:57:27.468559  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:27.470082 10175 ts_tablet_manager.cc:933] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.471735  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:27.435563 10160 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:27.407675 10158 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6.
I20260620 13:57:27.484383 10122 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.488202  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:27.489738  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:27.490592  5880 raft_consensus.cc:2368] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
I20260620 13:57:27.491139 10052 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.492183 10164 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:27.492452  5876 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: []
W20260620 13:57:27.493309 10181 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260620 13:57:27.493602 10052 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.494426 10123 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.495266  6586 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:57:27.496742 10123 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.497267  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:27.498018  5876 raft_consensus.cc:2393] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 9: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:27.498816  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:27.500499 10120 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.500057  5876 raft_consensus.cc:2410] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260620 13:57:27.415731 10184 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260620 13:57:27.475692 10085 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:27.498857 10049 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.506992  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:27.514555  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:27.517992  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:27.546564  6586 raft_consensus.cc:2410] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260620 13:57:27.518293  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:27.518558  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:27.510298  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:27.510650  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:27.548998  5951 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:27.527530  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:27.529564  6585 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:27.552181  6029 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260620 13:57:27.529661  6580 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:27.530140  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:27.554080  5884 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:27.417426 10141 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:27.497285  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:27.518370  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:27.525413  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:27.541472  6578 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:27.549180  6582 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:27.563519  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:27.563694  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:27.564975  6582 raft_consensus.cc:2410] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260620 13:57:27.567232  5876 raft_consensus.cc:2368] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10.
I20260620 13:57:27.571085  5884 raft_consensus.cc:2393] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:27.524199  5950 raft_consensus.cc:2955] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:57:27.573803  5876 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260620 13:57:27.574751  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:27.575555  6586 raft_consensus.cc:2376] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5. Re-sending same reply.
W20260620 13:57:27.526571 10027 consensus_meta.cc:287] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.003s
I20260620 13:57:27.581799  6583 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 6. Current term is 8. Ops: []
I20260620 13:57:27.584067  5880 raft_consensus.cc:1240] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:27.579057  6551 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:27.585968  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:27.586885 10163 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:27.587494 10163 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:27.587682  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:27.588011 10163 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:27.588426  6029 raft_consensus.cc:2376] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10. Re-sending same reply.
I20260620 13:57:27.589570  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:27.590410  6029 raft_consensus.cc:2393] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:57:27.528189  9642 consensus_meta.cc:287] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.539s	user 0.005s	sys 0.006s
I20260620 13:57:27.475837  9638 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:27.518090 10005 raft_consensus.cc:3055] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:27.498961  9993 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:27.566565  9898 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260620 13:57:27.599356  6582 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:57:27.600510  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:27.624383  9642 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.625679  5879 raft_consensus.cc:2393] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:27.507560 10140 raft_consensus.cc:3055] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:27.630578 10140 raft_consensus.cc:740] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:27.608165 10173 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.599226 10165 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.611124 10008 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:27.531178 10049 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.623147 10005 raft_consensus.cc:740] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:27.627682  6024 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:27.540546 10137 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.517210 10051 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:27.557092 10184 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.637715  6586 raft_consensus.cc:1240] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260620 13:57:27.527842 10085 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.643002  5881 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260620 13:57:27.650452  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 220558us
I20260620 13:57:27.659539  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:27.636914 10158 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.652168  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:27.653573  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:27.662767 10122 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election won for term 6
W20260620 13:57:27.656424  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:27.664651  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:27.667718  6025 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:27.669940  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:27.672622  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:27.602157 10027 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:27.658181 10057 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.003s	sys 0.010s
I20260620 13:57:27.632993  9638 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.648164 10123 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.663789 10044 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.640017 10121 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:27.684122 10057 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.003s	sys 0.011s
I20260620 13:57:27.688020  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:27.715131  6587 raft_consensus.cc:2393] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:27.641215 10165 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.664605 10187 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:27.717973  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 365485us
I20260620 13:57:27.681221 10122 raft_consensus.cc:697] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:27.728910  6025 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:27.658182 10051 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.734287  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:27.665469 10158 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:27.735579  6552 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:27.715906  9951 raft_consensus.cc:2764] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260620 13:57:27.737538  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:27.639241 10173 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:27.664245 10184 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.718807  9642 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.649524 10140 consensus_queue.cc:260] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.740360  6025 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:27.665337 10005 consensus_queue.cc:260] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:27.742523  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 54561.3us
I20260620 13:57:27.751161 10186 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:27.751351 10122 consensus_queue.cc:237] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.727561 10175 tablet_copy_client.cc:323] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Beginning tablet copy session from remote peer at address 127.4.155.195:41493
I20260620 13:57:27.720376 10044 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.756767  5998 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:27.716769 10123 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.780093 10140 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:27.781298 10123 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:57:27.782599  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:27.739521 10008 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:27.740317 10187 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:27.778573 10044 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.782673  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:27.790496  6586 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:27.791323  6029 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
W20260620 13:57:27.778079 10191 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260620 13:57:27.785912  5998 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:27.787662  6043 tablet_copy_service.cc:140] P 663684cf4ae54c929bf8240ca0b63a47: Received BeginTabletCopySession request for tablet a4cd17345f80464287c5952767849dbb from peer b0ce39342d8c4a64904b30b98de02b9f ({username='slave'} at 127.0.0.1:46758)
I20260620 13:57:27.788429  9642 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:27.789120 10008 raft_consensus.cc:697] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:27.792660  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:27.784158  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:27.824800  6025 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:27.744635 10057 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:27.798203  5998 leader_election.cc:400] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
I20260620 13:57:27.800227 10121 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.803301 10163 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.804714 10158 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.792335 10186 raft_consensus.cc:697] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:27.807673  9638 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:27.813639 10173 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.791127 10187 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:27.815023 10044 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:27.745085 10052 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.856980 10052 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:27.793519  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 76469.5us
I20260620 13:57:27.859756  6582 raft_consensus.cc:2368] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10.
W20260620 13:57:27.860443  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:27.826488  6586 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:27.824960  5957 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:57:27.836741  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:27.853556 10163 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:27.862095  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:27.863566  5997 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:27.865705  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:27.868211  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:27.867564  5998 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:27.873109  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:27.833530 10057 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:27.879397  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:27.880297  5882 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:27.839802 10005 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:27.877735  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:27.884712  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:27.895864  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:27.860662  6043 tablet_copy_service.cc:161] P 663684cf4ae54c929bf8240ca0b63a47: Beginning new tablet copy session on tablet a4cd17345f80464287c5952767849dbb from peer b0ce39342d8c4a64904b30b98de02b9f at {username='slave'} at 127.0.0.1:46758: session id = b0ce39342d8c4a64904b30b98de02b9f-a4cd17345f80464287c5952767849dbb
I20260620 13:57:27.909044  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:27.875753 10187 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 13:57:27.910912 10187 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:27.911554 10187 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:57:27.883759 10057 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:27.916407 10207 log.cc:927] Time spent T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260620 13:57:27.918452 10165 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.875386 10189 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:27.919603  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:27.920202  6025 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:27.883059 10158 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:27.899012  5998 leader_election.cc:400] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10.
I20260620 13:57:27.917896 10008 consensus_queue.cc:237] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.920233  6586 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:27.921952  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:27.883385 10120 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:27.923177  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:27.923656  5998 leader_election.cc:403] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260620 13:57:27.928169  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:27.929472  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:27.906035 10085 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.926582 10120 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:27.934666 10196 log.cc:927] Time spent T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260620 13:57:27.935333 10120 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:27.938647 10127 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.939288 10051 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.940765 10052 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:27.941022  9642 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:27.923470 10184 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:27.944757  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 46707.7us
I20260620 13:57:27.946655  5998 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:27.947894  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:27.948887  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:27.949525  6026 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:27.865310 10186 consensus_queue.cc:237] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.943187 10189 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10.
I20260620 13:57:27.932238 10165 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:27.931759 10027 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:27.924489 10158 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:27.967705  6586 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:27.968782  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:27.959619  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:27.970582  9670 raft_consensus.cc:993] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: : Instructing follower 192c750f597c43858e1ad09e8d805685 to start an election
I20260620 13:57:27.971323  9670 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:27.971959  9670 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:27.972347  9670 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:27.975543 10100 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.012s
I20260620 13:57:27.977406 10100 raft_consensus.cc:1081] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Signalling peer 192c750f597c43858e1ad09e8d805685 to start an election
W20260620 13:57:27.978480  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:27.958817  9898 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.979588  9898 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:27.979787  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:27.980434  6032 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:27.981360  9898 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:27.981308  6586 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260620 13:57:27.982044  6586 pending_rounds.cc:85] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 8
I20260620 13:57:27.982347  6586 pending_rounds.cc:107] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260620 13:57:27.982973  6586 raft_consensus.cc:2889] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:27.984398  6579 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:27.981308  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:27.988044 10160 consensus_meta.cc:287] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.504s	user 0.012s	sys 0.000s
W20260620 13:57:27.957337 10152 consensus_meta.cc:287] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.512s	user 0.014s	sys 0.000s
I20260620 13:57:27.996978  6586 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:57:27.997859  6032 raft_consensus.cc:2410] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260620 13:57:28.001770  5998 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:27.957484  9642 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:28.005371  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:28.014600  6026 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:28.016232  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:28.017107  6026 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:28.017665  6579 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:28.022820  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:28.024737  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:28.026392  6026 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:28.033660  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:28.034019  6026 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:28.035593  5849 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:28.005610 10189 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:28.034942  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:28.006815 10085 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:27.989426 10165 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.039819  6029 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:28.042593  5849 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:28.042953  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:28.044183  6029 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:28.045439  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:28.046545  6029 raft_consensus.cc:2410] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260620 13:57:28.010644 10038 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:28.050364  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:27.978320 10100 raft_consensus.cc:2955] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:57:28.004082 10160 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.005813 10152 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.034937  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:28.061887  6026 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:28.040694 10005 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:28.051738 10211 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260620 13:57:28.075912  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:28.065783 10005 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:28.048521 10085 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.053980 10038 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:28.069952 10211 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:28.087872 10211 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:28.091639 10158 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:28.095933  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:28.096974 10085 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:28.087138  6028 raft_consensus.cc:1275] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260620 13:57:28.104547  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:28.112725  6028 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260620 13:57:28.114049  6028 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
W20260620 13:57:28.118448 10188 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.635s	user 0.001s	sys 0.001s
I20260620 13:57:28.120970 10161 raft_consensus.cc:3055] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:28.121464 10161 raft_consensus.cc:740] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:57:28.122800 10141 consensus_meta.cc:287] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.000s
W20260620 13:57:28.129169  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 394865us
I20260620 13:57:28.122349 10161 consensus_queue.cc:260] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:28.141844  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.136713  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:28.130681 10204 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
W20260620 13:57:28.139443  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:28.081873 10005 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:28.134703 10208 log.cc:927] Time spent T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260620 13:57:28.125495 10160 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:28.130304 10187 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.141026  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.128695 10038 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:28.154189  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:28.140235  5998 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:28.156270  5957 raft_consensus.cc:2393] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:28.156440  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:28.157510  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.158164  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:28.128794 10157 log.cc:927] Time spent T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 1.252s	user 0.005s	sys 0.000s
I20260620 13:57:28.174178  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:28.165927  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:28.166384 10149 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 1.421s	user 0.005s	sys 0.000s
I20260620 13:57:28.176642  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:28.172530  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.177624  5876 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:28.173382  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.164016  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.175750  5959 raft_consensus.cc:2410] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260620 13:57:28.166568  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.178942  5881 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:28.179464  5998 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:28.179725  5924 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:28.180495  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:28.161286 10156 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 13:57:28.187705  6552 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:57:28.188411  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:28.188931  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:28.185834 10204 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:28.196802 10052 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:28.197096 10204 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:57:28.197221 10173 consensus_queue.cc:1059] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:57:28.197388 10052 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.198560 10137 raft_consensus.cc:3055] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:28.198906 10137 raft_consensus.cc:740] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:28.199257 10121 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:28.199692 10052 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:28.200503  5881 raft_consensus.cc:1240] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:28.200524  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:28.199702 10137 consensus_queue.cc:260] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.201656  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.201903  9996 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260620 13:57:28.202564 10204 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:28.202220 10137 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:28.199726 10121 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:28.203364  9996 consensus_queue.cc:1059] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:57:28.203090 10204 raft_consensus.cc:697] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:28.204121  9996 consensus_queue.cc:1243] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer b0ce39342d8c4a64904b30b98de02b9f log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260620 13:57:28.204728  9996 raft_consensus.cc:3055] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:28.205211  9996 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:28.205340 10121 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:28.206024  9996 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.204730  5959 raft_consensus.cc:1240] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:28.208413  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.204792 10204 consensus_queue.cc:237] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.183348 10171 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:57:28.210829 10171 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:28.211464 10171 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:28.191401 10033 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260620 13:57:28.183601  9642 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:28.177129 10161 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:28.215173  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:28.195528  9635 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:28.216010  9635 raft_consensus.cc:697] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:28.216274  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.184274 10189 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:28.217365  9635 consensus_queue.cc:237] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.208950  5959 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:28.160250 10141 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.221405  5950 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: [10.4-10.4]
I20260620 13:57:28.181547 10160 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:28.217374  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.222620  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:28.223589  5876 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260620 13:57:28.202889  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.216066  6024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 858) took 1372 ms. Trace:
I20260620 13:57:28.229652  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.235450  5881 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:28.235351  6024 rpcz_store.cc:276] 0620 13:57:26.844085 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:26.844325 (+   240us) service_pool.cc:224] Handling call
0620 13:57:26.882821 (+ 38496us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:27.641247 (+758426us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:28.215877 (+574630us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54000e5bd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:28.216016 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712617856}
I20260620 13:57:28.184899 10038 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:28.226356  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:28.221987  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.232030  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:28.238554  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.239212  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.239626  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:28.240170  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.243829  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.244400  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:28.245368  6552 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:28.251917  6030 raft_consensus.cc:1240] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:28.255550  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.256470  5881 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:28.257632  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.258440  5881 raft_consensus.cc:2393] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:28.260623  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:28.261793  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:28.267803 10189 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 13:57:28.268663  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.269538  5881 raft_consensus.cc:2393] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:28.270962  5849 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:28.270821  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.272024  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.274523  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.274394  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.275583  5876 raft_consensus.cc:2393] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 10: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:28.276130  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:28.276322  5849 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:28.276362  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:28.279301  6581 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260620 13:57:28.280249  5954 raft_consensus.cc:2393] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:28.284058  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.284822  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:28.285420  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:28.285733  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:28.286012  6583 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:28.230855 10027 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:28.281986  5998 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:28.285444  6579 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 4.
I20260620 13:57:28.288118  5848 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:28.228252 10156 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:28.290004 10211 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:28.244812 10038 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:28.274451 10118 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:28.309664 10211 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:28.291119  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:28.279876 10049 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:28.310941 10049 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:28.297538 10057 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:28.311352 10049 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:28.311861  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:28.312520  6026 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:28.312708 10057 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:28.313463  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:28.314162  6026 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:28.274371 10136 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260620 13:57:28.314644 10052 consensus_queue.cc:1059] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:57:28.314854 10156 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.314184 10141 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:28.315440  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.316211 10187 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:28.279512 10121 consensus_queue.cc:1059] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260620 13:57:28.316706  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:28.232182  9670 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.317831  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:28.317982  5955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 1993) took 1445 ms (client timeout 1923 ms). Trace:
I20260620 13:57:28.318745  6032 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:28.318373  5955 rpcz_store.cc:269] 0620 13:57:26.872359 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:26.872537 (+   178us) service_pool.cc:224] Handling call
0620 13:57:28.317803 (+1445266us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54003cfd54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:28.317935 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354398464}
I20260620 13:57:28.320499  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.293414  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:28.329583  6584 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:28.227530  9996 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:28.293874 10008 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:28.331279  6581 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:57:28.292037 10186 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election won for term 8
W20260620 13:57:28.295722 10217 log.cc:927] Time spent T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260620 13:57:28.300901  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:28.333640  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.333904  6580 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:28.302561  6586 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260620 13:57:28.289219  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:28.335220  5957 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:28.298573  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.301579 10027 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:28.322623  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:28.323695  6585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 1044) took 1218 ms. Trace:
I20260620 13:57:28.341114  5880 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 10
I20260620 13:57:28.324138 10038 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:28.301563  9642 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:28.292826  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:28.343950  6587 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:28.238018 10120 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:28.325650  6578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46858 (request call id 1027) took 1187 ms. Trace:
I20260620 13:57:28.296303 10158 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:28.318930  9670 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:28.348531  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.341038  6585 rpcz_store.cc:276] 0620 13:57:27.105669 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:27.120870 (+ 15201us) service_pool.cc:224] Handling call
0620 13:57:27.121234 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:27.552521 (+431287us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:28.323481 (+770960us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54005af0d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:28.323639 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938675584}
I20260620 13:57:28.344722  6578 rpcz_store.cc:276] 0620 13:57:27.138309 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:27.138542 (+   233us) service_pool.cc:224] Handling call
0620 13:57:28.325477 (+1186935us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400508054. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:28.325589 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450900736}
I20260620 13:57:28.333226  5955 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 10: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:28.308975 10118 raft_consensus.cc:697] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:28.344923  5879 raft_consensus.cc:2955] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:57:28.353757  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.358194  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.343578 10027 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:28.361670  6027 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260620 13:57:28.361997 10140 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:57:28.365837  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 66933.3us
I20260620 13:57:28.375170  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.348416 10008 raft_consensus.cc:697] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:28.406944  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:28.407927  5955 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:57:28.409122  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:28.357513 10161 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260620 13:57:28.415809 10120 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:28.379978 10158 raft_consensus.cc:697] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:28.419905 10142 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:28.379760 10186 raft_consensus.cc:697] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:28.421595 10186 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.424173  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:28.418859  6030 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:57:28.379621 10057 raft_consensus.cc:3055] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:57:28.459161 10057 raft_consensus.cc:740] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:28.460024 10057 consensus_queue.cc:260] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.400501  6551 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:28.471120  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:28.471800  5881 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260620 13:57:28.415858  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:28.395310  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:28.412613 10211 raft_consensus.cc:3055] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:28.438671  6028 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260620 13:57:28.441442 10008 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.445199  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.446837  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.450263  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.404886 10160 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:28.451858  6027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2704) took 1004 ms. Trace:
I20260620 13:57:28.510982  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:28.453665  6031 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260620 13:57:28.368044  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.512984  5876 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:28.405166  6585 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260620 13:57:28.513592  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:28.473924  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 73514.1us
I20260620 13:57:28.517704  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:28.474215  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:28.364645  5880 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:28.381680  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:28.479051  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 83871.9us
I20260620 13:57:28.510313  6027 rpcz_store.cc:276] 0620 13:57:27.447646 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:28.105631 (+657985us) service_pool.cc:224] Handling call
0620 13:57:28.106053 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:28.386371 (+280318us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:28.451521 (+ 65150us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54001e64d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:28.451781 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587305216}
I20260620 13:57:28.359612 10218 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260620 13:57:28.521116  5998 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:28.475190 10211 raft_consensus.cc:740] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:28.525729  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.529995  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:28.530781  6585 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 4 FOLLOWER]: Advancing to term 5
I20260620 13:57:28.531589  5952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4cd17345f80464287c5952767849dbb"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:35986
I20260620 13:57:28.532157  5952 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:57:28.532487  5952 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:28.535611  5950 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:28.538113  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:28.511679  6580 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
W20260620 13:57:28.527542  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 145965us
I20260620 13:57:28.540396  6552 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:28.475924 10179 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:28.542896  5955 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:57:28.545352  5998 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:28.509438  9642 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:28.503278  9901 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:28.564039  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:28.516242  9670 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:28.568053  6028 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:28.579622  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:28.569896  5997 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:28.573211  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:28.543094 10141 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:28.602414  6028 raft_consensus.cc:1275] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260620 13:57:28.586602 10122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.011s	sys 0.019s
I20260620 13:57:28.427089 10118 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.564038 10161 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:28.566113 10119 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:28.535015  9951 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260620 13:57:28.523643 10160 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:28.613606 10122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.012s	sys 0.020s
I20260620 13:57:28.601912 10141 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:28.585563 10187 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:28.635394  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 867) took 1039 ms. Trace:
I20260620 13:57:28.635885  6025 rpcz_store.cc:276] 0620 13:57:27.596052 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:27.825949 (+229897us) service_pool.cc:224] Handling call
0620 13:57:28.635157 (+809208us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b54001c6954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:28.635334 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87121792}
I20260620 13:57:28.638016  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 1997) took 1692 ms. Trace:
I20260620 13:57:28.638551  5958 rpcz_store.cc:276] 0620 13:57:26.946190 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:26.946337 (+   147us) service_pool.cc:224] Handling call
0620 13:57:26.946656 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:27.441834 (+495178us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:28.637690 (+1195856us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b5400262ad4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:28.637944 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137453952}
I20260620 13:57:28.574107  9670 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:28.585000  9898 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 13:57:28.620671  6028 raft_consensus.cc:1240] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:28.643389  5884 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:28.584048  9642 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.635682 10141 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:28.575333 10158 consensus_queue.cc:237] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.650292 10156 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:28.653990  9898 raft_consensus.cc:697] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:28.646643  9670 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:28.678068  9898 consensus_queue.cc:237] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.652853 10187 raft_consensus.cc:697] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:57:28.700825 10226 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260620 13:57:28.703060 10225 log.cc:927] Time spent T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260620 13:57:28.742697  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 454608us
I20260620 13:57:28.743263  6029 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:28.759738  6028 raft_consensus.cc:1275] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260620 13:57:28.762008  5848 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:28.767738  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 179390us
W20260620 13:57:28.764806  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 200916us
I20260620 13:57:28.789806  5848 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:28.791209  6585 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 5.
I20260620 13:57:28.793354  6028 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260620 13:57:28.792896 10122 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:28.799300  9642 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:28.808696 10219 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.498s	user 0.002s	sys 0.000s
I20260620 13:57:28.807080 10161 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:57:28.813040 10049 consensus_meta.cc:287] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.501s	user 0.019s	sys 0.016s
I20260620 13:57:28.813530 10049 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.757050 10127 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:28.816176 10160 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:28.818642  5876 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:28.822301  5957 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
W20260620 13:57:28.824023 10005 consensus_meta.cc:287] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.652s	user 0.016s	sys 0.013s
I20260620 13:57:28.824422 10038 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.824534 10005 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:28.825687  6024 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:28.825977  5877 raft_consensus.cc:2393] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 9: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:28.758499 10132 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:28.707926 10187 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.841490  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:28.849852  5884 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:28.851420  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:28.855491  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:28.862990  5878 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260620 13:57:28.865742  5878 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:28.880483  5878 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:57:28.831408 10220 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:28.888212  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1759) took 1018 ms. Trace:
I20260620 13:57:28.829936 10038 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:28.891289  5882 rpcz_store.cc:276] 0620 13:57:27.869581 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:27.903968 (+ 34387us) service_pool.cc:224] Handling call
0620 13:57:27.921336 (+ 17368us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:27.921672 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:27.921690 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:27.923466 (+  1776us) log.cc:844] Serialized 26 byte log entry
0620 13:57:28.459802 (+536336us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b18001da3a0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:57:28.587518 (+127716us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:28.857767 (+270249us) log.cc:844] Serialized 14 byte log entry
0620 13:57:28.859026 (+  1259us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:28.859146 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:28.859332 (+   186us) raft_consensus.cc:1685] finished
0620 13:57:28.887897 (+ 28565us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:28.888126 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6421,"raft.queue_time_us":2131,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":22645,"spinlock_wait_cycles":4095872,"thread_start_us":361896,"threads_started":2,"wal-append.queue_time_us":749434}
I20260620 13:57:28.827055 10005 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:28.905100  5848 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:28.906351 10161 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:28.890545  9642 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:28.907634  6031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 865) took 1342 ms. Trace:
I20260620 13:57:28.908170  6031 rpcz_store.cc:276] 0620 13:57:27.565368 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:28.218965 (+653597us) service_pool.cc:224] Handling call
0620 13:57:28.453279 (+234314us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:28.512435 (+ 59156us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:28.907418 (+394983us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54001e5ad0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:28.907569 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533930880}
I20260620 13:57:28.909235  5878 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:28.912339  6578 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260620 13:57:28.907037 10100 consensus_meta.cc:287] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.791s	user 0.015s	sys 0.008s
W20260620 13:57:28.860595 10166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.458s	user 0.002s	sys 0.017s
I20260620 13:57:28.916915  5884 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
W20260620 13:57:28.914716 10171 consensus_meta.cc:287] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.703s	user 0.021s	sys 0.000s
W20260620 13:57:28.922482  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 131495us
W20260620 13:57:28.917810 10166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.518s	user 0.002s	sys 0.018s
I20260620 13:57:28.921720  5952 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:28.917781 10049 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:28.912714  9642 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.927644 10166 raft_consensus.cc:697] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:57:28.936257 10230 log.cc:927] Time spent T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260620 13:57:28.942369  9670 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:28.944890 10027 consensus_meta.cc:287] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.014s
I20260620 13:57:28.948508 10027 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.945508  5952 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:28.954300  5883 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:28.955184 10027 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:28.922178 10171 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.961458  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:28.938328 10211 consensus_queue.cc:260] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.953727 10166 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.966552 10211 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:28.976488  9642 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:28.978626  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:28.979632  6585 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:28.981174 10085 raft_consensus.cc:1064] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:57:28.981120  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:28.982738 10165 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:28.985703 10187 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:28.986351 10141 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:28.934150 10236 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.025s
I20260620 13:57:28.990813  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:28.994132  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:28.995249  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:28.995834  6031 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:28.995993  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:28.991282 10187 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:28.996850 10187 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:29.001045  6025 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 15. Current term is 16. Ops: []
I20260620 13:57:29.017242  6031 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:29.020295  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:29.020962  6026 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:29.026820  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 115154us
W20260620 13:57:29.034255  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:29.034826  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:29.038175  6585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:29.038796  6585 raft_consensus.cc:606] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:29.040390 10165 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:29.019429 10118 raft_consensus.cc:3055] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Stepping down as leader of term 11
W20260620 13:57:29.078663  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:29.054142 10141 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:57:29.060401 10246 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:29.097561  5952 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 14. Current term is 15. Ops: []
I20260620 13:57:29.068632  9670 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:29.070911 10085 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.072934  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:29.036971 10132 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:29.074846  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:29.125187  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:29.125571  6585 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:29.125703  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:29.076432 10171 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:29.078362  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:29.078728 10118 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:29.040948 10165 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.079872 10152 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:29.082559  5881 raft_consensus.cc:1240] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: []
W20260620 13:57:29.082837 10137 consensus_meta.cc:287] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.879s	user 0.015s	sys 0.005s
I20260620 13:57:29.084259  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:29.090968  5956 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:57:29.092474  6026 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:29.029069 10236 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:29.097289  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:29.101424  6587 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260620 13:57:29.104691  6581 raft_consensus.cc:1240] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260620 13:57:29.154831  6583 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:29.116850  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:29.103785  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:29.111831  6582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 1002) took 1332 ms. Trace:
I20260620 13:57:29.103267  6580 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260620 13:57:29.105744  6579 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:29.123447  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:29.122961  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 129294us
I20260620 13:57:29.115187  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:29.126740  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:29.132737  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:29.126929 10204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.009s	sys 0.052s
I20260620 13:57:29.159377  6578 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:29.160058  5952 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:29.160234  5950 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260620 13:57:29.175810  5950 pending_rounds.cc:85] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 8
I20260620 13:57:29.176152  5950 pending_rounds.cc:107] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260620 13:57:29.176443  5950 raft_consensus.cc:2889] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:57:29.161510  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 77362.2us
I20260620 13:57:29.178960  5998 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:29.156468  6582 rpcz_store.cc:276] 0620 13:57:27.779848 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:27.782328 (+  2480us) service_pool.cc:224] Handling call
0620 13:57:29.111552 (+1329224us) spinlock_profiling.cc:243] Waited 76.2 ms on lock 0x7b540048f654. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:29.111736 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175198592}
I20260620 13:57:29.095521  9989 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:29.162634 10100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46746 (request call id 15) took 16467 ms. Trace:
I20260620 13:57:29.163389 10236 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.184590  5998 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:29.169957 10118 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.185499  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:29.186609  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:29.187476  6031 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:29.165598  6029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2399) took 1813 ms. Trace:
I20260620 13:57:29.188760  6029 rpcz_store.cc:276] 0620 13:57:27.352683 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:28.071852 (+719169us) service_pool.cc:224] Handling call
0620 13:57:28.635332 (+563480us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:28.743743 (+108411us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:29.165349 (+421606us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54001c6950. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:29.165517 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287187712}
I20260620 13:57:29.167320 10165 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:29.167825  6584 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260620 13:57:29.174427 10204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.009s	sys 0.053s
W20260620 13:57:29.201900  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:29.172793  6552 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:29.127091 10246 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.158576  5997 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:29.191936  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:29.205641  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:29.205935  5998 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:29.202852  6578 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:57:29.207791  6026 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:29.209116  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:29.209820  6026 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:29.175917 10171 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:29.194474  6583 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:29.137393 10184 consensus_queue.cc:1059] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260620 13:57:29.173334  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:29.139202 10132 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:29.212512  6582 raft_consensus.cc:1240] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:29.213101  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:29.236318  6025 raft_consensus.cc:2410] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260620 13:57:29.177546 10173 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:29.185930 10118 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:29.195250  9642 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:29.221558  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:29.245225  5956 raft_consensus.cc:2410] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260620 13:57:29.222174  6026 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
W20260620 13:57:29.229017  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 70565.4us
I20260620 13:57:29.243609 10204 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:57:29.247531  5997 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:29.178185  9635 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260620 13:57:29.231770  6032 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: []
W20260620 13:57:29.233939  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 60698.1us
I20260620 13:57:29.250679  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:29.223145  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:29.219277  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:29.204447 10003 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:29.243649  6578 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260620 13:57:29.203006 10189 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:29.243949  6584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:29.230515  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:29.258788  5849 leader_election.cc:400] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10.
I20260620 13:57:29.242776 10165 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:29.260236  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:29.261693  6584 raft_consensus.cc:606] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:29.191418  9989 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.275326  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:29.276197  9996 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:29.276607  9996 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:29.276953  9996 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:29.277529  9989 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:29.249897  9642 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:29.278589  9642 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:29.264575 10035 consensus_queue.cc:1059] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260620 13:57:29.264855  6584 raft_consensus.cc:614] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:29.261509 10189 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:29.283241 10189 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:29.285085  9996 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:29.287303  9996 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:29.289220  9989 consensus_queue.cc:1059] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:29.290126 10168 consensus_queue.cc:1059] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:57:29.290512 10160 raft_consensus.cc:3055] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:29.291591  6030 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260620 13:57:29.260967 10240 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:29.266340 10204 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:29.293695  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 899) took 1002 ms. Trace:
I20260620 13:57:29.272812 10137 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:57:29.273168 10141 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:29.183737 10100 rpcz_store.cc:276] 0620 13:57:12.695373 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:12.697326 (+  1953us) service_pool.cc:224] Handling call
0620 13:57:13.557863 (+860537us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b58007f01d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf75848a 00007f0fdf7da827 00007f0fdf7f7aea 00007f0fdf7f8b4a 00007f0fdf7f7cfb 00007f0fdf80341c 00007f0fdf802a93 00007f0fe47c3429 00007f0fddd3f334 00007f0fddd3f2c2
0620 13:57:13.822850 (+264987us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b4c00253380. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fddac6120 00007f0fddad7129 00007f0fdda9cd44 00007f0fddac462d 00007f0fddac4293 00007f0fdf75558f 00007f0fdf75531e 00007f0fdf7dac68 00007f0fdf7f7b3c 00007f0fdf7f8b4a 00007f0fdf7f7cfb
0620 13:57:13.825403 (+  2553us) log.cc:844] Serialized 506 byte log entry
0620 13:57:15.038031 (+1212628us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b2c000c06c8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fde0f5c71 00007f0fde104c6a 00007f0fde1048f3 00007f0fde104891 00007f0fdf838f32 00007f0fdf8390d5 00007f0fdf775a71 00007f0fdf75628a 00007f0fdf75d133 00007f0fdf75d0b9 00007f0fdf75d049
0620 13:57:29.162525 (+14124494us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5676,"raft.run_cpu_time_us":8742,"raft.run_wall_time_us":1061378,"spinlock_wait_cycles":1514212224,"thread_start_us":62722,"threads_started":1,"wal-append.queue_time_us":131191,"wal-append.run_cpu_time_us":6322,"wal-append.run_wall_time_us":1225949}
I20260620 13:57:29.242120 10120 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:29.269595  6031 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:29.262327  5849 leader_election.cc:403] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260620 13:57:29.291287  9630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.787s	user 0.032s	sys 0.031s
W20260620 13:57:29.306501  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 48122.5us
I20260620 13:57:29.265499 10173 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:29.263726 10184 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260620 13:57:29.317914  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:29.360090  6584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:29.394763  6584 raft_consensus.cc:606] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:29.358422  9630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.854s	user 0.032s	sys 0.032s
I20260620 13:57:29.291052 10160 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:29.306478 10171 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:29.305001 10141 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:29.291546 10236 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:29.391957  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:29.291405 10168 raft_consensus.cc:3055] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:29.247937 10049 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260620 13:57:29.395332  6584 raft_consensus.cc:614] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:29.362489 10186 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10.
I20260620 13:57:29.399477  5849 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:29.361771 10240 raft_consensus.cc:697] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:29.414947 10152 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:29.314968  9996 consensus_queue.cc:1048] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260620 13:57:29.291478 10211 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260620 13:57:29.263833 10156 consensus_queue.cc:1059] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260620 13:57:29.295398  9989 consensus_queue.cc:1059] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260620 13:57:29.387501 10173 raft_consensus.cc:697] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:29.427539 10049 consensus_queue.cc:1243] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260620 13:57:29.436635  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 189193us
I20260620 13:57:29.441612  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:29.395633 10184 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:29.426688 10165 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:29.424722 10141 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:29.427836 10171 raft_consensus.cc:697] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:29.401675 10189 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:29.432729 10224 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:29.432466 10246 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:29.427698 10168 raft_consensus.cc:740] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:29.453491 10165 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.459462 10005 raft_consensus.cc:3055] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:29.451241 10184 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:29.461468  9642 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:29.448437 10003 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
W20260620 13:57:29.471693  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:29.442878 10052 consensus_queue.cc:1059] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260620 13:57:29.421217 10035 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260620 13:57:29.438467 10152 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:29.464212 10100 raft_consensus.cc:3055] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:57:29.443503 10193 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.049s
W20260620 13:57:29.507474  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 284442us
I20260620 13:57:29.529745  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:29.508491  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 216493us
I20260620 13:57:29.532522  6584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:34178
W20260620 13:57:29.510295  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 279871us
I20260620 13:57:29.533676  6584 raft_consensus.cc:606] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:29.534190  6584 raft_consensus.cc:614] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:29.511318  5954 pending_rounds.cc:85] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 8
I20260620 13:57:29.525110  5950 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260620 13:57:29.535560  5998 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:29.449296 10160 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.513576 10005 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:29.513499 10132 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:29.540671  5954 pending_rounds.cc:107] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260620 13:57:29.542933  5954 raft_consensus.cc:2889] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:29.515774 10224 raft_consensus.cc:697] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:29.545630  6552 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:29.546814  5950 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260620 13:57:29.538506 10187 consensus_meta.cc:287] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.004s
I20260620 13:57:29.527040 10100 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:29.560045  6584 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260620 13:57:29.566977  6552 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:29.568779  6552 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:29.539892 10038 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:29.584021  6552 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:29.559041 10132 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:29.600778  6552 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:29.539841 10204 consensus_queue.cc:1059] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260620 13:57:29.509615 10240 consensus_queue.cc:237] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:29.567531 10160 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:29.573534 10008 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:29.573441 10255 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:29.617295 10224 consensus_queue.cc:237] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.563652 10120 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260620 13:57:29.559587 10265 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:29.529466 10173 consensus_queue.cc:237] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:29.612813  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 67289.1us
I20260620 13:57:29.574796  9635 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:29.624121  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:29.626567  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:29.639230  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:29.606848 10003 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:29.562723 10262 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260620 13:57:29.762082  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 132355us
I20260620 13:57:29.544749 10171 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.606105 10038 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:29.566251 10187 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.597023 10100 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:29.764576  6024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2709) took 1501 ms. Trace:
W20260620 13:57:29.770800  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 205008us
W20260620 13:57:29.772022  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:29.598579 10049 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260620 13:57:29.789433  6024 rpcz_store.cc:276] 0620 13:57:28.263273 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:28.443567 (+180294us) service_pool.cc:224] Handling call
0620 13:57:28.444003 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:28.826082 (+382079us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:29.764037 (+937955us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54001e69d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:29.764321 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877323648}
I20260620 13:57:29.790990  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:29.801852  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:29.760977 10254 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:29.819893 10266 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:29.820624 10266 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:29.561832 10168 consensus_queue.cc:260] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:29.823478 10224 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:29.823939 10168 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:29.823683  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 56588us
I20260620 13:57:29.825003 10272 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:29.824410 10224 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.825595 10272 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.606977 10264 consensus_queue.cc:1048] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.207s
I20260620 13:57:29.763949 10263 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:29.765393 10003 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:29.764691 10193 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:29.829917  6028 raft_consensus.cc:1240] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:29.771004 10166 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:29.612341 10132 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.605436 10005 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.832501 10224 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:29.831465 10269 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:29.823019 10266 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:29.806701  9989 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260620 13:57:29.838464 10003 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:29.807767 10038 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:29.852516 10254 raft_consensus.cc:697] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:57:29.896885  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:29.859458 10120 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:29.863567 10189 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:29.865741 10152 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:29.869246 10270 consensus_queue.cc:1059] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260620 13:57:29.841279 10166 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:29.915983  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 315302us
I20260620 13:57:29.867938  9642 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:29.918105 10204 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:29.846493 10263 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.883818 10273 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:29.940261  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:29.961877  6028 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:57:29.870285 10267 consensus_queue.cc:1059] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260620 13:57:29.941327  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:29.973366  5880 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:57:29.942997  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:29.944346  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:29.948563  6552 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:29.949373 10165 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:29.953548 10118 consensus_queue.cc:1059] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:29.956362  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:29.987612 10165 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:29.940950  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:29.939604 10244 log.cc:927] Time spent T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 1.000s	user 0.005s	sys 0.001s
I20260620 13:57:29.921693 10284 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:29.866057 10269 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:29.989130  6031 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:29.970561  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:29.931006 10152 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:29.993363  6579 raft_consensus.cc:2410] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260620 13:57:30.002538  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 376064us
I20260620 13:57:30.003454  5998 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:29.966610  9951 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:30.008263  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:30.008915  5880 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:30.009627  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 207955us
I20260620 13:57:30.008931  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:30.012193  5882 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:30.013055  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:30.014487  5878 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:57:30.015790  6580 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:57:30.020154  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:30.025856  6580 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:30.032840  6587 raft_consensus.cc:1240] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260620 13:57:30.007228  9642 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:57:30.034202  5880 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:30.037966  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:30.038528  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:30.043627  5882 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:30.007495 10127 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:57:30.044989 10277 log.cc:927] Time spent T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260620 13:57:30.013906 10120 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:30.016620 10272 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:30.030669 10270 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:30.007414 10189 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260620 13:57:30.005429 10152 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.069962 10173 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:30.074327 10289 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:30.053056 10281 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:30.048928 10266 consensus_queue.cc:1059] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260620 13:57:30.053303 10127 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:30.074993  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:30.075420 10283 consensus_queue.cc:1059] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:57:29.999679 10284 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.039436 10187 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:30.129563 10281 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.135519 10187 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260620 13:57:30.137568 10152 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:30.072069 10193 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:30.138504 10193 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.139725 10166 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:30.140591 10193 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:30.142740 10160 consensus_meta.cc:287] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.003s
I20260620 13:57:29.992681 10254 consensus_queue.cc:237] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.079777 10268 consensus_queue.cc:1059] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:57:30.148272  5957 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260620 13:57:30.148738  5957 pending_rounds.cc:85] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 8
I20260620 13:57:30.148980  5957 pending_rounds.cc:107] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260620 13:57:30.149221  5957 raft_consensus.cc:2889] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:30.081676  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:30.130892  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 184782us
I20260620 13:57:30.076648 10282 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:30.132491 10289 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:30.155069 10274 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Stepping down as leader of term 15
I20260620 13:57:30.155601 10274 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:30.156499 10274 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.157333 10289 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:30.157779 10274 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:30.013088  9951 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:30.150838  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:30.083693 10132 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:30.151425 10282 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:30.152942 10259 log.cc:927] Time spent T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.661s	user 0.002s	sys 0.000s
I20260620 13:57:30.071544 10120 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:30.143882  5877 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
W20260620 13:57:30.187214  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:30.162046 10141 consensus_meta.cc:287] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.678s	user 0.011s	sys 0.002s
W20260620 13:57:30.194042  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 159192us
W20260620 13:57:30.194283  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 112675us
I20260620 13:57:30.194747  5876 raft_consensus.cc:2410] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260620 13:57:30.206840  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 220762us
I20260620 13:57:30.167608 10038 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:30.186256 10152 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:30.190142 10132 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:30.097895 10279 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.126s
I20260620 13:57:30.216773  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:30.217084  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:30.197224  9996 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 13:57:30.222673  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:30.219687  5998 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:30.235569  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:30.223878  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:30.226015  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:30.230789  5848 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:30.196866 10263 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:30.236649  5880 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:30.240167  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:30.243849 10186 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:30.247970  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:30.251025  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:30.197263 10141 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.258148  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:30.258404  5924 connection.cc:256] RPC call timeout handler was delayed by -1.7753763120000485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
I20260620 13:57:30.240854  9642 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:30.261556  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:30.227001 10173 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:30.266571  6028 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:30.277379 10173 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.280261 10173 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:30.281018 10173 consensus_queue.cc:1059] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:30.240969 10038 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 13:57:30.247917 10272 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:30.215236 10152 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.235785 10283 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260620 13:57:30.305107  6584 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:30.217687 10132 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.240790 10266 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:30.235988 10278 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:30.237927 10268 consensus_queue.cc:1059] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.066s
I20260620 13:57:29.294497  5879 rpcz_store.cc:276] 0620 13:57:28.296125 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:28.890570 (+594445us) service_pool.cc:224] Handling call
0620 13:57:29.113084 (+222514us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b5800000f98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:57:29.113432 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:29.113698 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 9
0620 13:57:29.114076 (+   378us) log.cc:844] Serialized 14 byte log entry
0620 13:57:29.293212 (+179136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:29.293276 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:29.293347 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:29.293471 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:29.293624 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30088,"prepare.queue_time_us":10989,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":58,"raft.queue_time_us":32392,"spinlock_wait_cycles":43923712,"thread_start_us":148580,"threads_started":1}
I20260620 13:57:30.316649  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:30.317350  5879 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:30.320623  6029 raft_consensus.cc:1240] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260620 13:57:30.322242  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 100518us
I20260620 13:57:30.324043  6026 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: [9.4-11.5]
I20260620 13:57:30.335703  5879 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 15.
I20260620 13:57:30.336722  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:30.303767 10284 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:30.343544  5875 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:57:30.337425  5880 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
W20260620 13:57:30.314293 10184 consensus_meta.cc:287] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.788s	user 0.010s	sys 0.003s
I20260620 13:57:30.306697 10269 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:30.345471  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:30.265532 10285 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.099s
W20260620 13:57:30.347359  5883 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1767) took 2184 ms (client timeout 2844 ms). Trace:
I20260620 13:57:30.313764 10027 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election won for term 11
W20260620 13:57:30.350008  5883 rpcz_store.cc:269] 0620 13:57:28.158660 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:28.173209 (+ 14549us) service_pool.cc:224] Handling call
0620 13:57:30.342754 (+2169545us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b54003f2854. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:30.342866 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1783574784}
I20260620 13:57:30.351552  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:30.352319  5883 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
W20260620 13:57:30.352671  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 121957us
I20260620 13:57:30.353598  5848 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:30.353438  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:30.327509 10278 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:30.356551  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:30.340677 10268 consensus_queue.cc:1243] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer 2e82c0c231624695ac5a813230bf5038 log is divergent from this leader: its last log entry 10.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260620 13:57:30.338279 10272 raft_consensus.cc:697] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:30.358217  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:30.313782 10266 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:30.364640  5883 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:30.365880  5883 raft_consensus.cc:1240] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
W20260620 13:57:30.360947  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 94313us
I20260620 13:57:30.370850  6024 raft_consensus.cc:1240] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260620 13:57:30.369336  6029 raft_consensus.cc:1240] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:30.371151  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:30.379426  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:30.360586 10289 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:30.404551  5879 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:30.411718  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:30.329099  9642 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.349510 10184 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.425436  6029 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:30.363051 10269 consensus_queue.cc:1059] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260620 13:57:30.381695 10264 raft_consensus.cc:2764] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260620 13:57:30.436462 10290 log.cc:927] Time spent T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260620 13:57:30.437986 10305 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:30.438591 10305 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:30.440442  5884 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:30.440796 10305 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:30.442342  6028 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:30.443747 10269 raft_consensus.cc:3055] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:30.444271 10269 raft_consensus.cc:740] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:30.445071 10269 consensus_queue.cc:260] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:30.424674 10282 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:30.404551  9996 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260620 13:57:30.446419 10268 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:30.459196 10027 raft_consensus.cc:697] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:30.463389 10141 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:30.471916 10305 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:30.479666 10269 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:30.488526 10304 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:30.458031 10285 consensus_queue.cc:1059] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260620 13:57:30.457193 10272 consensus_queue.cc:237] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:30.523973 10298 log.cc:927] Time spent T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260620 13:57:30.526081 10301 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260620 13:57:30.526428 10156 raft_consensus.cc:3055] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:30.521922 10304 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.530576 10270 raft_consensus.cc:3055] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:30.531458 10270 raft_consensus.cc:740] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:57:30.537851 10003 consensus_meta.cc:287] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.000s
I20260620 13:57:30.538702 10057 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:30.526844 10156 raft_consensus.cc:740] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:30.509325 10152 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:30.555887  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 132617us
I20260620 13:57:30.448993 10278 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.558441  5924 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:30.520877 10132 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:30.530659 10304 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:30.488404 10311 consensus_queue.cc:1059] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260620 13:57:30.563865  9898 raft_consensus.cc:1027] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: attempt to promote peer b0ce39342d8c4a64904b30b98de02b9f: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260620 13:57:30.518337 10305 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.532835 10270 consensus_queue.cc:260] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.554653 10003 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.563789 10027 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.574527 10266 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:30.580654  9989 raft_consensus.cc:3055] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:30.577986 10264 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:57:30.593166  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:30.593578  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:30.594617  5956 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:30.606161  5958 raft_consensus.cc:2376] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10. Re-sending same reply.
I20260620 13:57:30.594828  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:30.598635  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:30.599918  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:30.607275  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:30.600355  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:30.606789  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:30.616470  5956 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:30.620262  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:30.620301  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:30.625809 10296 log.cc:927] Time spent T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260620 13:57:30.591964 10184 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:30.633934 10302 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.204s	user 0.002s	sys 0.000s
I20260620 13:57:30.620692 10266 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:30.581799 10156 consensus_queue.cc:260] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.645903  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:30.595590  9989 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:30.647261  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:30.647275  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:30.650077  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:30.663746  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:30.669986  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:30.671674 10160 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:30.672366 10160 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:30.674489  6583 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260620 13:57:30.674991 10193 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:30.675565 10193 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.651124 10264 raft_consensus.cc:697] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:57:30.650588 10319 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260620 13:57:30.661989  5952 raft_consensus.cc:2393] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 15: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:57:30.687247 10127 consensus_meta.cc:287] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.547s	user 0.012s	sys 0.000s
I20260620 13:57:30.687790 10127 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.690346 10305 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:30.691704 10127 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:30.692705 10281 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:30.679991  9989 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:30.696899  5848 leader_election.cc:336] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.544s (SENT)
W20260620 13:57:30.699205 10171 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.003s	sys 0.012s
I20260620 13:57:30.695787  9989 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:30.711418  6032 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260620 13:57:30.703125  6552 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:30.704876  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:30.717537  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:30.660079 10266 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:30.740229  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:30.699625 10171 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.003s	sys 0.012s
I20260620 13:57:30.677956 10264 consensus_queue.cc:237] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:30.762828  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 44165.9us
I20260620 13:57:30.697285 10280 raft_consensus.cc:3055] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:30.762732  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:30.770259  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:30.777088 10137 raft_consensus.cc:3055] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:30.782852  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:30.784322 10293 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:30.782774 10003 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:30.776904 10273 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:30.780702 10329 log.cc:927] Time spent T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.002s
W20260620 13:57:30.801265  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 98257.5us
I20260620 13:57:30.805898 10051 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:30.806298 10051 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:30.806632 10051 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:30.803514  5848 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:30.804996 10275 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260620 13:57:30.804903 10273 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:30.807045  6552 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:30.812572 10160 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:30.799485 10137 raft_consensus.cc:740] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:30.814071 10137 consensus_queue.cc:260] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.816726  5881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2723) took 2561 ms. Trace:
I20260620 13:57:30.817142  5881 rpcz_store.cc:276] 0620 13:57:28.254935 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:28.473493 (+218558us) service_pool.cc:224] Handling call
0620 13:57:29.082345 (+608852us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:29.154022 (+ 71677us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:30.816491 (+1662469us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54003fb6d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:30.816646 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399519104}
I20260620 13:57:30.818930 10051 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.820173  5880 raft_consensus.cc:1240] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260620 13:57:30.821521 10051 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:30.822444  5880 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260620 13:57:30.825039 10269 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:30.826154 10269 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:30.825696 10323 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:30.826937  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:30.809425 10293 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:30.828421  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:30.818746  5881 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260620 13:57:30.838943  6025 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:30.839828  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:30.840605  5881 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:30.832288  6029 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:30.832841  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:30.834285  6582 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:30.834738  6030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2419) took 1635 ms. Trace:
I20260620 13:57:30.846030  6030 rpcz_store.cc:276] 0620 13:57:29.199569 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:29.199755 (+   186us) service_pool.cc:224] Handling call
0620 13:57:29.200154 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:29.292074 (+ 91920us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:30.834511 (+1542437us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b54000d3c54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:30.834677 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209277184}
I20260620 13:57:30.830159  6031 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260620 13:57:30.828327  6032 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:30.855749  6024 raft_consensus.cc:2393] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:30.822902 10100 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:30.794987 10280 raft_consensus.cc:740] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:30.778043 10057 consensus_queue.cc:1059] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260620 13:57:30.862063  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:30.868566  6552 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:30.870898  5848 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:30.872712  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:30.877067  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:30.827379 10269 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:30.830001 10279 raft_consensus.cc:3055] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:30.832085 10293 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:30.885378  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:30.888149  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:30.897092 10261 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:30.897295 10273 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:30.826988 10323 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260620 13:57:30.898026  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:30.917469  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:30.928738  6584 raft_consensus.cc:1217] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[5.7-7.8]   Dedup: 7.8->[]
I20260620 13:57:30.930469  6584 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260620 13:57:30.931363  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:30.880162 10165 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:30.884524 10152 raft_consensus.cc:3055] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:30.929464  6583 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260620 13:57:30.935400  6028 raft_consensus.cc:1240] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:30.932343  5880 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:30.941236  6587 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:30.888799 10003 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:30.897915 10261 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:30.882485 10038 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:30.878419 10320 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260620 13:57:30.884356 10267 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:30.885161 10279 raft_consensus.cc:740] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:30.926757 10275 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:30.921523 10057 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:30.938489 10152 raft_consensus.cc:740] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:57:30.949250  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:30.937978 10236 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:30.931712 10193 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:30.959631 10236 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:30.959903 10325 log.cc:927] Time spent T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260620 13:57:30.943778 10280 consensus_queue.cc:260] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:30.960309 10313 consensus_queue.cc:1059] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260620 13:57:30.960095 10236 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:30.960759 10280 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:30.961606 10336 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260620 13:57:30.930251 10330 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260620 13:57:30.962932 10306 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:30.963581 10306 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.966193 10306 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:30.870553 10158 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
W20260620 13:57:30.960071  6033 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2705) took 3512 ms (client timeout 1501 ms). Trace:
W20260620 13:57:30.967363  6033 rpcz_store.cc:269] 0620 13:57:27.447943 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:27.496967 (+ 49024us) service_pool.cc:224] Handling call
0620 13:57:30.959833 (+3462866us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54001c8754. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:30.959995 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4147506944}
I20260620 13:57:30.967886 10266 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:30.948485 10261 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:30.970733  9996 raft_consensus.cc:3055] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:30.971225  9996 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:30.972055  9996 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.973232  9996 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:30.973948  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:30.951295 10038 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:30.988022 10038 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:30.989073 10279 consensus_queue.cc:260] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:30.990291 10279 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:30.990485  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:30.958176 10057 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:31.000870 10236 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:31.001886 10276 log.cc:927] Time spent T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.866s	user 0.002s	sys 0.010s
I20260620 13:57:31.003747  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 978) took 1493 ms. Trace:
I20260620 13:57:31.003476 10057 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:31.006337 10152 consensus_queue.cc:260] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:31.008111 10152 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:31.004181  5954 rpcz_store.cc:276] 0620 13:57:29.510123 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:29.510512 (+   389us) service_pool.cc:224] Handling call
0620 13:57:29.511005 (+   493us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:29.624553 (+113548us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:29.624582 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:29.625145 (+   563us) log.cc:844] Serialized 52 byte log entry
0620 13:57:29.937759 (+312614us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:29.937814 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:29.937896 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:31.001198 (+1063302us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:31.003440 (+  2242us) raft_consensus.cc:1685] finished
0620 13:57:31.003466 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:31.003686 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87050,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":40908,"spinlock_wait_cycles":23165696,"thread_start_us":393149,"threads_started":2,"wal-append.queue_time_us":432484}
W20260620 13:57:31.013316  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.018055 10270 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
W20260620 13:57:31.031390  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.037075 10262 raft_consensus.cc:3055] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:31.037739 10262 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:31.054968 10211 raft_consensus.cc:3055] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:31.055680 10211 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:31.056502 10211 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.057685 10211 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:31.069443  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.086172  6032 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260620 13:57:31.090975  6025 raft_consensus.cc:1240] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260620 13:57:31.061977 10137 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:31.093472  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:31.109938  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:31.109977 10236 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:31.121393  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:31.124140  5956 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260620 13:57:31.124939  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 253998us
I20260620 13:57:31.125794  6024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:57:31.127463  6024 raft_consensus.cc:606] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:31.127924  6024 raft_consensus.cc:614] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:31.131332  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:31.133339  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:31.100740 10272 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:31.050956 10120 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:31.101086 10187 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:31.135902  9951 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:31.139514 10284 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:31.103544 10262 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.146950 10322 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:31.149384 10187 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.162384 10284 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.147713 10272 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:31.165191 10322 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.178278 10284 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:31.220598  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.221971  5877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42748 (request call id 905) took 1279 ms. Trace:
I20260620 13:57:30.951331  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:31.222759  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:31.232636  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.222677  5877 rpcz_store.cc:276] 0620 13:57:29.942602 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:29.942741 (+   139us) service_pool.cc:224] Handling call
0620 13:57:31.221282 (+1278541us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54003f2d54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:31.221670 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388854528}
I20260620 13:57:31.225638  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:31.237352  5877 raft_consensus.cc:1240] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:31.237598  5880 raft_consensus.cc:1217] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 5.2->[8.3-11.5]   Dedup: 8.3->[9.4-11.5]
I20260620 13:57:31.237895  5882 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:31.238268  5880 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: [8.3-11.5]
W20260620 13:57:31.224469  5829 auto_rebalancer.cc:591] Failed to schedule move for tablet 0e0ab32eab32415c8e9ea1fda9508733: Illegal state: Replica 663684cf4ae54c929bf8240ca0b63a47 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:31.227519  5883 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260620 13:57:31.230441  5875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 880) took 3032 ms. Trace:
I20260620 13:57:31.243620  5875 rpcz_store.cc:276] 0620 13:57:28.198035 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:28.404304 (+206269us) service_pool.cc:224] Handling call
0620 13:57:30.343215 (+1938911us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:30.343970 (+   755us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:31.229934 (+885964us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54003f2850. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:31.230203 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4435021184}
I20260620 13:57:31.244381  5877 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:57:31.245916  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:31.247745  5875 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:31.249603  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.263644  5881 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:31.272324  5877 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260620 13:57:31.274391  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.280422  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:31.281947  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:31.283601  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:31.285447  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:31.286459  5849 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:31.286584  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:31.290215  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:31.291512  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:31.292665  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:31.305295  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 322348us
I20260620 13:57:31.307837  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:31.308231  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:31.137331  6032 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:31.312534  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:31.315873  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:31.316310  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:31.317600  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:31.318192  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:31.319404  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:31.326269  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260620 13:57:31.354858  6028 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:31.355553  5958 raft_consensus.cc:2410] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260620 13:57:31.355777  5956 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:31.356258  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:31.356907  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:31.356853  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:31.357956  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:31.359510  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.358172  5958 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:31.363692  5951 raft_consensus.cc:2393] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:31.364312  6025 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:31.365701  5951 raft_consensus.cc:1240] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:31.366506  5779 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56624 (request call id 345) took 9170 ms. Trace:
W20260620 13:57:31.369757  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 239750us
I20260620 13:57:31.371564 10100 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:31.371999 10187 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:31.372222 10211 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:31.372442 10100 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.373006 10211 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.379212  6552 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:31.379632 10261 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:31.381207  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 52237us
I20260620 13:57:31.383289  6552 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:31.359015  6028 raft_consensus.cc:2376] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9. Re-sending same reply.
I20260620 13:57:31.386303 10309 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:31.387804 10236 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:31.388388 10236 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:31.388773 10236 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:31.388893 10272 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:31.391571  6030 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:31.392967  6024 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:31.395608  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:31.400652 10289 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:31.401535 10289 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.402508  6552 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:31.403998 10027 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:57:31.404659 10051 raft_consensus.cc:3055] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:31.405200 10051 raft_consensus.cc:740] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:31.406569 10118 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:31.407768  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:31.407887 10027 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:31.413496  6026 raft_consensus.cc:2376] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12. Re-sending same reply.
I20260620 13:57:31.415616 10294 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:31.146713  9996 consensus_queue.cc:1059] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260620 13:57:31.416429 10294 raft_consensus.cc:697] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:31.365717  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:31.418067 10294 consensus_queue.cc:237] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.363510  5957 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260620 13:57:31.416249 10156 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:31.421018  5957 pending_rounds.cc:85] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 9
W20260620 13:57:31.424574  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 53616.6us
I20260620 13:57:31.425809 10051 consensus_queue.cc:260] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.427073 10274 consensus_queue.cc:1059] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:57:31.421285  5957 pending_rounds.cc:107] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260620 13:57:31.428113  5957 raft_consensus.cc:2889] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:31.428481 10274 consensus_queue.cc:1059] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:57:31.429738 10280 raft_consensus.cc:3055] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Stepping down as leader of term 8
W20260620 13:57:31.429947 10269 consensus_meta.cc:287] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.516s	user 0.001s	sys 0.014s
I20260620 13:57:31.430303 10280 raft_consensus.cc:740] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:57:31.430439  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 144447us
I20260620 13:57:31.432895 10052 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:31.426261  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:31.432971 10173 raft_consensus.cc:3055] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:31.434341  5875 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:31.419066  6025 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:31.432144  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:57:31.438649  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:57:31.382864 10261 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:31.443150  5956 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260620 13:57:31.443805 10305 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:31.434221 10100 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:31.447244 10346 consensus_queue.cc:1059] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260620 13:57:31.451514  5998 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:31.451398 10057 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:31.435501 10173 raft_consensus.cc:740] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:31.452369  6027 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 15.
I20260620 13:57:31.446897 10211 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:31.452970 10269 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:31.470646  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.471074 10127 consensus_queue.cc:1059] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:31.472435 10274 raft_consensus.cc:3055] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:31.472774  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:31.473614  6026 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:31.475497 10120 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:31.475811  5848 leader_election.cc:336] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.187s (SENT)
I20260620 13:57:31.476212 10120 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:31.477586  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.478525 10120 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:31.366994  5779 rpcz_store.cc:276] 0620 13:57:22.195998 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:22.196219 (+   221us) service_pool.cc:224] Handling call
0620 13:57:31.366183 (+9169964us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:57:26.363813 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:57:26.364422 (+   609us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:57:26.364456 (+    34us) write_op.cc:435] Acquired schema lock
0620 13:57:26.364473 (+    17us) tablet.cc:662] Decoding operations
0620 13:57:26.365897 (+  1424us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:57:26.365980 (+    83us) write_op.cc:641] Partition lock acquired for write op
0620 13:57:26.366007 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0620 13:57:26.431656 (+ 65649us) tablet.cc:701] Row locks acquired
0620 13:57:26.436231 (+  4575us) write_op.cc:260] PREPARE: finished
0620 13:57:26.466946 (+ 30715us) write_op.cc:270] Start()
0620 13:57:26.476131 (+  9185us) write_op.cc:276] Timestamp: P: 1781963846459336 usec, L: 0
0620 13:57:26.477389 (+  1258us) op_driver.cc:348] REPLICATION: starting
0620 13:57:26.559676 (+ 82287us) log.cc:844] Serialized 6700 byte log entry
0620 13:57:26.755917 (+196241us) op_driver.cc:464] REPLICATION: finished
0620 13:57:26.909211 (+153294us) write_op.cc:301] APPLY: starting
0620 13:57:26.937953 (+ 28742us) tablet.cc:1367] starting BulkCheckPresence
0620 13:57:27.445486 (+507533us) tablet.cc:1370] finished BulkCheckPresence
0620 13:57:27.445591 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:57:27.804320 (+358729us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:57:27.804667 (+   347us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0620 13:57:27.804722 (+    55us) write_op.cc:312] APPLY: finished
0620 13:57:27.805153 (+   431us) log.cc:844] Serialized 156 byte log entry
0620 13:57:27.805422 (+   269us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:27.805630 (+   208us) write_op.cc:454] Released schema lock
0620 13:57:27.805695 (+    65us) write_op.cc:341] FINISH: Updating metrics
0620 13:57:27.806179 (+   484us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:27.806219 (+    40us) write_op.cc:454] Released schema lock
0620 13:57:28.106986 (+300767us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b1800110ec0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc70ad22 00007f0fdc70cfc1 00007f0fdc70cf79 00007f0fdc70cf09 00007f0fdc70ced1 00007f0fdc70c1cd 0000000000389354 0000000000389199 00007f0fdc6ee03a
Metrics: {"mutex_wait_us":1938,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":119110,"apply.run_cpu_time_us":28869,"apply.run_wall_time_us":925543,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75255,"num_ops":17,"prepare.queue_time_us":371673,"prepare.run_cpu_time_us":63201,"prepare.run_wall_time_us":287683,"raft.queue_time_us":40321,"raft.run_cpu_time_us":10256,"raft.run_wall_time_us":105110,"replication_time_us":247485,"spinlock_wait_cycles":5195648,"thread_start_us":474796,"threads_started":4,"wal-append.queue_time_us":393408,"wal-append.run_cpu_time_us":29449,"wal-append.run_wall_time_us":2059840}]]}
I20260620 13:57:31.472942 10274 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:31.464283 10051 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:31.432126 10280 consensus_queue.cc:260] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:31.460968 10272 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:31.491822  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 65729.4us
I20260620 13:57:31.466797 10284 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:31.503480  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:31.505479  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:31.509280 10347 raft_consensus.cc:3055] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:31.509802 10347 raft_consensus.cc:740] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:57:31.513592  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.522897 10312 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:31.523742 10312 raft_consensus.cc:697] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:31.525182 10312 consensus_queue.cc:237] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:31.529162  5951 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260620 13:57:31.529659  5951 pending_rounds.cc:85] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 5
I20260620 13:57:31.529954  5951 pending_rounds.cc:107] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260620 13:57:31.530212  5951 raft_consensus.cc:2889] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:31.530452  6043 tablet_copy_source_session.cc:215] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Tablet Copy: opened 0 blocks and 1 log segments
W20260620 13:57:31.537323  6027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2722) took 1287 ms (client timeout 1529 ms). Trace:
W20260620 13:57:31.537794  6027 rpcz_store.cc:269] 0620 13:57:30.250683 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:30.250794 (+   111us) service_pool.cc:224] Handling call
0620 13:57:31.537087 (+1286293us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b54000d4b54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:31.537227 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1953855872}
I20260620 13:57:31.538815 10269 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:31.539765  5950 raft_consensus.cc:3055] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:31.540305  5950 raft_consensus.cc:740] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:31.542027  5950 consensus_queue.cc:260] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:31.540004  6043 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:46758 (request call id 874) took 3760 ms. Trace:
W20260620 13:57:31.545024  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 44831.8us
W20260620 13:57:31.547399  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 51326.7us
I20260620 13:57:31.549599  6026 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:31.543865  6043 rpcz_store.cc:276] 0620 13:57:27.779779 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:27.787427 (+  7648us) service_pool.cc:224] Handling call
0620 13:57:30.535929 (+2748502us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54000d4b54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8067d7 00007f0fe479c736 00007f0fe47a613e 00007f0fdc06361b 00007f0fe47a60ba 00007f0fe47a11cc 00007f0fe479c37b 00007f0fe4790fd1 00007f0fe38485d4 00007f0fe3848562
0620 13:57:31.530144 (+994215us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54000d4b54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf766470 00007f0fdf80531a 00007f0fe479c8bb 00007f0fe47a613e 00007f0fdc06361b 00007f0fe47a60ba 00007f0fe47a11cc 00007f0fe479c37b 00007f0fe4790fd1 00007f0fe38485d4 00007f0fe3848562
0620 13:57:31.539873 (+  9729us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5419362944}
I20260620 13:57:31.549103  5998 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:31.487530 10305 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:31.544602 10261 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:31.555912  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:31.552834 10339 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.390s	user 0.004s	sys 0.001s
I20260620 13:57:31.565027  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:31.565382 10284 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:31.569255  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:31.572240  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 70050.4us
W20260620 13:57:31.573330  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 62271.7us
W20260620 13:57:31.574649 10152 consensus_meta.cc:287] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.009s
I20260620 13:57:31.575739 10173 consensus_queue.cc:260] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:31.577191  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.511014 10347 consensus_queue.cc:260] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.583402  5954 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:31.585057  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.586503  5952 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:31.592645  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:31.594211  5849 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:31.595258  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 46919.9us
I20260620 13:57:31.595386 10269 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:31.598115  5950 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:31.582861 10347 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:31.553730 10272 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.616362 10275 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:31.596477 10269 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:31.587699 10261 raft_consensus.cc:697] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:31.595449 10187 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:31.569860 10289 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:31.618628 10275 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.623394 10141 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:31.632524  5958 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:31.605060  9898 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:31.631464  5998 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:31.621594 10280 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:31.604162 10100 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:31.634538  5881 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260620 13:57:31.641040  5881 pending_rounds.cc:85] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 9
I20260620 13:57:31.641422  5881 pending_rounds.cc:107] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260620 13:57:31.641512 10141 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:31.641695  5881 raft_consensus.cc:2889] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:31.625931  5776 catalog_manager.cc:5696] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 4 to 10, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 10 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:31.626277 10187 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:31.643679  5953 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260620 13:57:31.644073  5953 pending_rounds.cc:85] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 10
I20260620 13:57:31.647769  5953 pending_rounds.cc:107] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260620 13:57:31.647989  5953 raft_consensus.cc:2889] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:31.650687  6552 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:31.652359 10355 log.cc:927] Time spent T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260620 13:57:31.652624 10005 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:31.657907  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 43980.7us
W20260620 13:57:31.662133  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 68036.9us
I20260620 13:57:31.660909 10120 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:31.664841 10120 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:31.644912 10187 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:31.656426 10275 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:31.673730  6024 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260620 13:57:31.665241 10120 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:31.677217  6028 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260620 13:57:31.677286  5848 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.487s (SENT)
I20260620 13:57:31.678414  5848 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:31.682569  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.680133  9898 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.691076  6029 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:31.694289 10322 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:31.693970  5776 catalog_manager.cc:5696] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:31.696117 10120 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:31.687502  5998 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:31.705423  5997 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:31.644677 10261 consensus_queue.cc:237] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:31.644776 10141 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.643321 10274 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.713151 10057 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:31.691082  9898 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:31.724483  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.710875 10275 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:31.726020  5954 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260620 13:57:31.728366  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51487.6us
I20260620 13:57:31.688763 10100 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.733630  6587 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:57:31.735514  6583 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260620 13:57:31.735316  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:31.737391  6578 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260620 13:57:31.748021 10137 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:31.748240 10038 consensus_queue.cc:1059] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260620 13:57:31.755002 10359 log.cc:927] Time spent T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260620 13:57:31.755502  6584 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 10: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:31.755471 10038 raft_consensus.cc:3055] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:31.756121 10038 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:31.741590  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:31.745903 10358 log.cc:927] Time spent T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260620 13:57:31.739636  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 65870.8us
I20260620 13:57:31.753389 10137 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.756582 10184 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:31.756690 10274 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:31.755046  6585 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260620 13:57:31.757541 10305 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:31.755549 10270 consensus_meta.cc:287] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.737s	user 0.015s	sys 0.001s
I20260620 13:57:31.758472 10284 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:31.759930  5998 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:31.762682  5880 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260620 13:57:31.742060 10279 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:31.779577  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:31.739701  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:31.748901  5776 catalog_manager.cc:5696] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 6 to 8, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 8 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:31.782609  5776 catalog_manager.cc:5696] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:31.785331  5776 catalog_manager.cc:5696] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 7 to 8, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 8 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:31.787928  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:31.789240  9898 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:31.789776  9898 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:31.790140  9898 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:31.790577 10236 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.791893 10284 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:31.792523 10284 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:31.793071 10284 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:31.793130 10236 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:31.777747  5880 pending_rounds.cc:85] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 8
I20260620 13:57:31.793992  5880 pending_rounds.cc:107] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260620 13:57:31.794272  5880 raft_consensus.cc:2889] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:31.795047  9951 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:31.787376 10168 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:57:31.795908 10168 raft_consensus.cc:697] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:31.797514 10168 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:31.795548  9951 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.799654  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:31.800371  6580 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:31.801288 10282 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260620 13:57:31.803489  9951 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:31.791056 10173 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:31.765421  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:31.767231  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 133474us
I20260620 13:57:31.806556  6579 raft_consensus.cc:2393] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:31.789433  5776 catalog_manager.cc:5696] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 6 to 10, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 10 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
W20260620 13:57:31.804304  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 44504us
W20260620 13:57:31.812333  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 82114.9us
I20260620 13:57:31.817366  5776 catalog_manager.cc:5696] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
W20260620 13:57:31.820161  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 56633.5us
I20260620 13:57:31.774142 10272 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:31.804169 10160 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:31.823205  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.829690  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:31.830595  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:31.836090  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:31.836588 10100 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:31.839293  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:31.840852  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.841723  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:31.842854  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:31.841665 10275 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260620 13:57:31.851723  5959 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260620 13:57:31.852952 10120 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:31.854321  6583 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:31.855418 10236 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:31.856086 10236 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.862434  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2315) took 1261 ms. Trace:
I20260620 13:57:31.863076 10175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4cd17345f80464287c5952767849dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:57:31.862951  5959 rpcz_store.cc:276] 0620 13:57:30.601237 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:30.615768 (+ 14531us) service_pool.cc:224] Handling call
0620 13:57:30.616099 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:31.852174 (+1236075us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:31.862145 (+  9971us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002616d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:31.862338 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2732945280}
I20260620 13:57:31.838915 10160 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:31.873129 10160 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:31.882519  6551 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:31.881342  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:31.840687 10294 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:31.888522  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 60067.3us
I20260620 13:57:31.891333 10003 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260620 13:57:31.891592  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:31.891498 10265 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:31.892427  5880 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:31.892884 10265 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.895774  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:31.896459  5881 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:31.900766  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:31.807510 10038 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:31.902987 10038 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:31.907371 10347 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:31.907999 10347 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:31.908484 10347 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:31.906917 10100 consensus_queue.cc:1175] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b0ce39342d8c4a64904b30b98de02b9f" responder_term: 11 status { last_received { term: 11 index: 7 } last_committed_idx: 7 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)" } } last_received_current_leader { term: 11 index: 7 } }
I20260620 13:57:31.879525  9951 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:31.919090  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:31.922144 10278 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260620 13:57:31.925756 10003 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:31.932329  5881 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
W20260620 13:57:31.933521  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 49315us
W20260620 13:57:31.934929  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 57637.4us
I20260620 13:57:31.947902 10313 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:31.952375  6579 raft_consensus.cc:2410] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260620 13:57:31.955191 10160 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:31.955832 10160 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:31.956423  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.957958 10160 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:31.884183 10261 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260620 13:57:31.958209  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:31.959293  6024 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:31.960525 10367 log.cc:927] Time spent T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.061s	user 0.003s	sys 0.001s
I20260620 13:57:31.963379 10137 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:31.928614  9951 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:31.967692  9951 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:31.973774  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.975236 10270 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:31.975800 10270 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:31.977526  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:31.981807  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 97506.6us
W20260620 13:57:31.983580  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:31.984412  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:32.015234  5950 raft_consensus.cc:1275] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260620 13:57:31.942162 10294 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:32.021225  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:32.020793  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 66899.2us
I20260620 13:57:31.948009 10262 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:32.024940  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:32.028334  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 80554.9us
W20260620 13:57:32.031174  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 86964.5us
I20260620 13:57:32.036604 10160 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:31.981504 10272 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260620 13:57:31.989359 10187 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:32.037835 10312 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:32.037400  9898 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:32.041427 10152 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:32.041581 10313 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:32.043330 10141 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:32.046693  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:32.047722  6582 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:57:32.048036 10246 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:32.032312 10184 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260620 13:57:32.052651 10365 log.cc:927] Time spent T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260620 13:57:32.005609 10265 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:32.050535 10282 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260620 13:57:32.057291 10364 log.cc:927] Time spent T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260620 13:57:32.057088  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 115165us
I20260620 13:57:32.033290  5776 catalog_manager.cc:5696] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 4 to 6, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 6 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:32.068620  5998 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:32.073909  6028 raft_consensus.cc:2410] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260620 13:57:32.036720  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 58479.9us
I20260620 13:57:32.077593 10305 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:32.072703 10322 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:32.071954 10160 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:32.108006  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:32.123317  5997 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:32.099200  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 52635.2us
I20260620 13:57:32.127490  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:32.136492  6552 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:32.109138  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:32.108464  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:32.130734  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:32.098624  5848 leader_election.cc:336] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.626s (SENT)
I20260620 13:57:32.142356  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:32.078083 10120 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260620 13:57:32.143716  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:32.146565  5776 catalog_manager.cc:5696] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:32.084810 10275 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.061s
I20260620 13:57:32.186148  5849 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:32.095691 10137 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:32.159461  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:32.151629  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:32.103892 10316 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:32.133004 10038 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:32.193714 10279 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:32.194396  5776 catalog_manager.cc:5696] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 3 to 4, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 4 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
W20260620 13:57:32.195370  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 126824us
I20260620 13:57:32.196125 10324 consensus_queue.cc:1059] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260620 13:57:32.197153  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 102284us
I20260620 13:57:32.213424 10038 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:57:32.214958 10038 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:57:32.215565 10235 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:32.089133 10312 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:32.216125 10235 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:32.215858 10038 consensus_queue.cc:1243] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260620 13:57:32.217753 10312 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:32.132627 10168 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:32.152746 10278 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:32.218492 10005 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:32.219131 10278 raft_consensus.cc:697] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:32.219370 10005 raft_consensus.cc:697] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:32.220830 10005 consensus_queue.cc:237] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:32.221251 10278 consensus_queue.cc:237] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:32.096854 10152 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:32.210592  5950 raft_consensus.cc:2410] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260620 13:57:32.182196 10236 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:32.226207  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:32.206315 10316 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:32.182530 10305 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:32.242993  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 144415us
I20260620 13:57:32.218680 10235 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:32.234978 10187 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:32.243922 10316 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:32.254487  5848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.834s (SENT) [suppressed 24 similar messages]
I20260620 13:57:32.228274 10137 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:32.248118 10270 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:32.268842  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 127154us
I20260620 13:57:32.276217  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:32.144227 10160 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:32.322613  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 46509.6us
I20260620 13:57:32.256098 10312 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260620 13:57:32.330058  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:32.339581  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:32.265436 10168 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:32.113116 10246 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:32.325799 10057 raft_consensus.cc:2764] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260620 13:57:32.335400 10300 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:32.360374 10152 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:32.365010 10347 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:32.343990  9898 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:32.144011 10322 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:32.356087 10369 log.cc:927] Time spent T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260620 13:57:32.373572  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 161232us
W20260620 13:57:32.378301  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 241890us
I20260620 13:57:32.390795 10324 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:32.391595 10324 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:32.392925  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:32.394040  6033 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:32.394248  5884 raft_consensus.cc:2410] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260620 13:57:32.367952 10282 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:32.376672  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:32.396413 10057 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election won for term 12
W20260620 13:57:32.396589  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 49068.2us
I20260620 13:57:32.396976 10057 raft_consensus.cc:697] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:32.397645  5849 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:32.397931 10057 consensus_queue.cc:237] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:32.399720 10152 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:32.400270 10152 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:32.400686 10152 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:32.394114 10324 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:32.409160  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:32.413125  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 43525.3us
I20260620 13:57:32.398350  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:32.419948  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:32.383998 10360 log.cc:927] Time spent T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.379s	user 0.003s	sys 0.001s
I20260620 13:57:32.380450 10184 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260620 13:57:32.428580  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:32.440800  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:32.442751 10366 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.433s	user 0.002s	sys 0.000s
W20260620 13:57:32.429791 10173 consensus_meta.cc:287] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.618s	user 0.013s	sys 0.000s
I20260620 13:57:32.448463  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:32.395170 10282 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:32.453706 10137 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:32.388001  9898 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:32.454156 10284 consensus_meta.cc:287] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.000s
W20260620 13:57:32.444378 10368 log.cc:927] Time spent T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260620 13:57:32.430163 10275 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:32.469985  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 901) took 1005 ms. Trace:
I20260620 13:57:32.480093 10284 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:32.468847  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:32.483670  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:32.490226  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51592.3us
I20260620 13:57:32.493063  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:32.492302  5880 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:32.500005 10284 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:32.433056 10300 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:32.480223  6025 rpcz_store.cc:276] 0620 13:57:31.460951 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:31.462968 (+  2017us) service_pool.cc:224] Handling call
0620 13:57:31.483254 (+ 20286us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:31.553081 (+ 69827us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:31.553109 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:31.561477 (+  8368us) log.cc:844] Serialized 26 byte log entry
0620 13:57:31.806518 (+245041us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:31.806556 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:31.806637 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:32.096535 (+289898us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:32.456540 (+360005us) raft_consensus.cc:1685] finished
0620 13:57:32.456562 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:32.466179 (+  9617us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18208,"raft.queue_time_us":38789,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":24783,"spinlock_wait_cycles":14080384,"thread_start_us":185195,"threads_started":1,"wal-append.queue_time_us":312899}
I20260620 13:57:32.495714 10376 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:32.481176 10275 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:32.513267 10391 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:32.489380 10152 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:32.513967 10381 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:32.497375  9898 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:32.557880 10274 consensus_meta.cc:287] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.781s	user 0.010s	sys 0.004s
I20260620 13:57:32.577119 10152 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:32.555274 10284 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:32.591001  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 171136us
I20260620 13:57:32.600138  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:32.597424  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:32.602993  6031 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:32.566488 10187 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:32.564476 10120 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:32.613989  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:32.583710 10005 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:32.618858  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:32.619858  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:32.621621  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:32.622246  6028 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:32.547650 10376 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:32.609903 10168 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:32.591511 10391 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:32.610220 10284 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:32.604372 10187 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:32.584625 10381 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:32.667819  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 48264.3us
I20260620 13:57:32.678506  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:32.616112 10057 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:32.625169 10152 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:32.664969  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:32.649739  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:32.667066 10262 consensus_meta.cc:287] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.001s
I20260620 13:57:32.774137  6580 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260620 13:57:32.774530  6580 pending_rounds.cc:85] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 8
I20260620 13:57:32.774788  6580 pending_rounds.cc:107] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260620 13:57:32.775081  6580 raft_consensus.cc:2889] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:57:32.653126 10371 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260620 13:57:32.767315  5849 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:32.663287 10376 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:32.673275 10175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46858 (request call id 1030) took 5533 ms. Trace:
I20260620 13:57:32.648360 10282 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:32.633095 10120 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:32.683770 10387 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:32.660801 10307 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:32.657712 10275 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:32.679884  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:32.661011  9951 consensus_meta.cc:287] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.693s	user 0.012s	sys 0.001s
I20260620 13:57:32.649873 10300 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:32.649035  9898 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:32.806672  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:32.628610 10005 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:32.772555  5884 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 5.
I20260620 13:57:32.823426 10160 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:32.824331 10372 log.cc:927] Time spent T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.481s	user 0.001s	sys 0.001s
I20260620 13:57:32.828037 10381 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:32.804538 10152 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:32.828406 10284 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:32.828852 10394 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:32.656566 10316 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:32.801749 10175 rpcz_store.cc:276] 0620 13:57:27.139439 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:27.150531 (+ 11092us) service_pool.cc:224] Handling call
0620 13:57:27.470400 (+319869us) ts_tablet_manager.cc:934] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: Initiating tablet copy from peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
0620 13:57:31.861192 (+4390792us) tablet_copy_client.cc:368] Tablet copy session begun
0620 13:57:32.094971 (+233779us) tablet_metadata.cc:665] Metadata flushed
0620 13:57:32.105904 (+ 10933us) tablet_copy_client.cc:497] Wrote new tablet metadata
0620 13:57:32.672359 (+566455us) tablet_copy_client.cc:418] Wrote new consensus metadata
0620 13:57:32.672713 (+   354us) tablet_replica.cc:206] Creating consensus instance
0620 13:57:32.673047 (+   334us) ts_tablet_manager.cc:989] Replica registered.
0620 13:57:32.673148 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":62676,"tablet-copy.queue_time_us":302953,"thread_start_us":351543,"threads_started":2}
I20260620 13:57:32.915971  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:32.887838  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:32.883424  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:32.824349 10392 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:32.938730  5875 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260620 13:57:32.889187 10152 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:32.826891 10057 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:32.948470  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:32.949941  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:32.954627  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 212147us
I20260620 13:57:32.886025  9951 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:32.973042  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:32.973583  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:32.974920  6028 raft_consensus.cc:2410] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260620 13:57:32.953768 10152 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:32.947860 10282 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:33.007562  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.008927  5882 raft_consensus.cc:2410] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260620 13:57:33.009301  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:32.977509 10173 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:33.007467 10371 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260620 13:57:32.909691 10307 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:32.970974 10274 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:32.936381 10394 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:33.028074  5875 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260620 13:57:33.026124  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:33.035779  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 1039) took 1194 ms. Trace:
I20260620 13:57:33.036357  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:33.038857  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:33.050539  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.051808  5881 raft_consensus.cc:2393] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 9: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:33.020568 10165 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:32.953351 10392 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:33.081058 10392 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.082116 10160 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.083439 10120 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:33.037902 10173 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:33.088182  5876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 924) took 1481 ms. Trace:
I20260620 13:57:33.013600 10282 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:33.088722  5876 rpcz_store.cc:276] 0620 13:57:31.607025 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:31.607191 (+   166us) service_pool.cc:224] Handling call
0620 13:57:31.622143 (+ 14952us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:31.628253 (+  6110us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:31.628295 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:31.637386 (+  9091us) log.cc:844] Serialized 26 byte log entry
0620 13:57:31.924234 (+286848us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b48000d0a58. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe47261a1 00007f0fe471d237 00007f0fe471d0ca 00007f0fe481496f 00007f0fe4814637 00007f0fe4828c5c 00007f0fe4828c08 00007f0fe4828b88 00007f0fe4828b43 00007f0fe4827dec 00007f0fe3754f76
0620 13:57:31.938639 (+ 14405us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b1800057b80. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:57:32.185152 (+246513us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:57:32.359059 (+173907us) log.cc:844] Serialized 14 byte log entry
0620 13:57:32.495085 (+136026us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:32.495179 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:33.087642 (+592463us) raft_consensus.cc:1685] finished
0620 13:57:33.087672 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:33.087868 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13745,"prepare.queue_time_us":248064,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":7786,"raft.queue_time_us":8447,"raft.run_cpu_time_us":3980,"raft.run_wall_time_us":294229,"spinlock_wait_cycles":23447168,"thread_start_us":542112,"threads_started":3,"wal-append.queue_time_us":737242}
I20260620 13:57:33.092448 10282 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:33.093488  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 67455us
I20260620 13:57:33.094789  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:33.068099  5877 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260620 13:57:33.023865 10388 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:33.098491  5877 pending_rounds.cc:85] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 6
I20260620 13:57:33.064242 10376 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:33.071898 10400 log.cc:927] Time spent T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260620 13:57:33.072578 10401 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:33.074379 10394 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.075390 10005 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:33.107472  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:33.098995  5877 pending_rounds.cc:107] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260620 13:57:33.086879 10173 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.036228  6587 rpcz_store.cc:276] 0620 13:57:31.835916 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:31.837657 (+  1741us) service_pool.cc:224] Handling call
0620 13:57:31.837994 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:31.853247 (+ 15253us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:31.853287 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:31.853905 (+   618us) log.cc:844] Serialized 26 byte log entry
0620 13:57:31.953121 (+ 99216us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b18000939a0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:57:32.072366 (+119245us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:32.072445 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:32.072539 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:32.823567 (+751028us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:33.030325 (+206758us) raft_consensus.cc:1685] finished
0620 13:57:33.030347 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:33.030474 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9206,"raft.queue_time_us":9427,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":15738,"spinlock_wait_cycles":295562368,"thread_start_us":118065,"threads_started":1,"wal-append.queue_time_us":409047}
I20260620 13:57:33.109042  5877 raft_consensus.cc:2889] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:33.068819 10137 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:33.031172 10175 tablet_copy_client.cc:806] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 0 data blocks...
I20260620 13:57:33.101155 10187 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.105834 10312 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:33.068782 10274 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.099390 10165 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.110975 10160 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:33.131865  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 162768us
I20260620 13:57:33.123555 10005 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:33.122324 10392 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:57:33.135146  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 118554us
I20260620 13:57:33.111163 10376 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.105463 10388 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:33.197458  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 102780us
W20260620 13:57:33.198136  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 60030.5us
I20260620 13:57:33.115633 10401 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:33.143172 10316 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.138000 10175 tablet_copy_client.cc:670] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Starting download of 1 WAL segments...
I20260620 13:57:33.196890 10406 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:33.205360 10312 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:33.199155 10187 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:33.229127  6031 consensus_meta.cc:287] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.622s	user 0.010s	sys 0.001s
I20260620 13:57:33.220733 10274 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:33.215688 10383 log.cc:927] Time spent T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260620 13:57:33.229833  6031 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:33.198496 10392 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:33.222922 10382 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:33.224682  9951 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.236531 10406 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:33.210017 10294 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:33.210793 10057 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.282194  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.282903  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.141899 10160 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.268196  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.287770  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.273468  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.289846  5881 raft_consensus.cc:2368] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
I20260620 13:57:33.280510 10137 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:33.281409  6027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 915) took 1323 ms. Trace:
I20260620 13:57:33.281505  6028 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:33.290908  6027 rpcz_store.cc:276] 0620 13:57:31.958092 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:31.960153 (+  2061us) service_pool.cc:224] Handling call
0620 13:57:31.960536 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:32.023656 (+ 63120us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:32.024100 (+   444us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:32.124544 (+100444us) log.cc:844] Serialized 26 byte log entry
0620 13:57:32.376331 (+251787us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:32.376375 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:32.376445 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:33.281124 (+904679us) raft_consensus.cc:1685] finished
0620 13:57:33.281160 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:33.281328 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46591,"raft.queue_time_us":57095,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":7138,"thread_start_us":151476,"threads_started":1,"wal-append.queue_time_us":818440}
I20260620 13:57:33.292639 10392 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.293347  6027 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260620 13:57:33.294031 10376 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:33.295883  5883 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260620 13:57:33.296003 10403 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260620 13:57:33.297312 10410 log.cc:927] Time spent T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260620 13:57:33.298838 10137 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.299391 10307 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.301115 10137 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.301154 10165 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.302513  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.303388  5950 raft_consensus.cc:2368] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10.
I20260620 13:57:33.284019 10173 consensus_queue.cc:1059] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260620 13:57:33.285070  6026 raft_consensus.cc:1240] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:33.314584  5956 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:57:33.232295 10312 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:33.323284  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:33.324869  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:33.238224 10187 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.316936 10307 consensus_queue.cc:1059] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260620 13:57:33.328576 10184 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:33.329418 10406 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.329582 10388 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.333815  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.334421  6582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 1035) took 1500 ms. Trace:
I20260620 13:57:33.334621  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.320263 10401 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:33.364672  6582 rpcz_store.cc:276] 0620 13:57:31.834270 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:31.848059 (+ 13789us) service_pool.cc:224] Handling call
0620 13:57:31.852527 (+  4468us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:32.089485 (+236958us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:33.334052 (+1244567us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54006c5f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:33.334329 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447936256}
I20260620 13:57:33.365628  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.366370  5959 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 5.
I20260620 13:57:33.349223 10184 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:33.366963  6033 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260620 13:57:33.349740  5876 raft_consensus.cc:1275] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260620 13:57:33.272794 10274 consensus_queue.cc:1059] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260620 13:57:33.369168 10274 raft_consensus.cc:3055] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:33.369550 10274 raft_consensus.cc:740] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:33.269924 10382 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.370635 10279 raft_consensus.cc:3055] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:33.371058 10279 raft_consensus.cc:740] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:33.371994 10382 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.352283  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.355536  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.372067 10279 consensus_queue.cc:260] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:33.373062  5957 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 12: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:33.373446 10279 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:33.356267  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:33.356675 10379 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:33.374274 10379 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.376677  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.377879 10137 raft_consensus.cc:3055] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:33.378309 10137 raft_consensus.cc:740] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:33.380700  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:33.381415  6580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 1074) took 1290 ms. Trace:
I20260620 13:57:33.381659 10388 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:33.381846  6580 rpcz_store.cc:276] 0620 13:57:32.091489 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:32.091640 (+   151us) service_pool.cc:224] Handling call
0620 13:57:32.134015 (+ 42375us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:32.775843 (+641828us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:33.381190 (+605347us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54005d0f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:33.381355 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1471166208}
I20260620 13:57:33.382494 10388 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.372114  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.385648  6026 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:33.356427 10152 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.356950  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.357322  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:33.357620  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.386879  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.358083 10168 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:33.358186  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.358706 10415 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:33.422709  5951 raft_consensus.cc:2393] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:33.339584 10307 raft_consensus.cc:3055] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Stepping down as leader of term 11
W20260620 13:57:33.389318  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 52992.8us
I20260620 13:57:33.393764  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.388696 10152 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.389396  6026 raft_consensus.cc:2410] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260620 13:57:33.396133 10137 consensus_queue.cc:260] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:33.400302 10374 log.cc:927] Time spent T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.957s	user 0.012s	sys 0.000s
W20260620 13:57:33.400683 10387 consensus_meta.cc:287] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.000s
I20260620 13:57:33.405720 10391 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.396042  5952 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:33.393617 10187 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.424667 10307 raft_consensus.cc:740] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:33.447468  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:33.425911 10415 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.427495  6033 raft_consensus.cc:2393] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 8: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:33.439503  5953 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:33.440147  5958 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:33.426836 10168 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.410797 10284 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:33.445928 10387 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:33.449797  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.450453 10137 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:33.464200  5882 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260620 13:57:33.466363  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.467424  5884 raft_consensus.cc:2410] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:57:33.479475  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.480544  5881 raft_consensus.cc:2393] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:57:33.477588 10270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.096s	user 0.017s	sys 0.013s
I20260620 13:57:33.466791 10187 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:33.492339 10270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.017s	sys 0.013s
W20260620 13:57:33.512349  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 1.25777e+06us
I20260620 13:57:33.514362  6582 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:33.520824  6587 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:33.527976  5875 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:33.516081  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:33.530616  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:33.517959 10051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.126s	user 0.042s	sys 0.012s
I20260620 13:57:33.488019 10284 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.549345  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:33.550650 10051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.155s	user 0.043s	sys 0.012s
I20260620 13:57:33.551469  5878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 937) took 1513 ms. Trace:
I20260620 13:57:33.552201  5878 rpcz_store.cc:276] 0620 13:57:32.021692 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:32.021973 (+   281us) service_pool.cc:224] Handling call
0620 13:57:32.030299 (+  8326us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:32.030772 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:32.030813 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:32.038992 (+  8179us) log.cc:844] Serialized 26 byte log entry
0620 13:57:32.296494 (+257502us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:32.296540 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:32.296613 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:33.399582 (+1102969us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:33.521886 (+122304us) raft_consensus.cc:1685] finished
0620 13:57:33.521910 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:33.534618 (+ 12708us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6983,"raft.run_cpu_time_us":443,"raft.run_wall_time_us":441,"spinlock_wait_cycles":56116480,"thread_start_us":256412,"threads_started":1,"wal-append.queue_time_us":339092}
I20260620 13:57:33.497431 10187 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.539578 10173 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:33.567588  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:33.569908  6583 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260620 13:57:33.542013 10398 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:33.573825  5878 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:33.580279  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.512050 10307 consensus_queue.cc:260] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.581037  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.565181 10420 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:33.583411  5878 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
W20260620 13:57:33.581012  5848 connection.cc:256] RPC call timeout handler was delayed by -1.4110780070000146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260620 13:57:33.596887  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:33.600814  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.602777  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:33.603533  5878 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:33.601740  6583 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 16.
I20260620 13:57:33.590818 10418 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:33.580139 10173 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.617515  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:33.623452  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:33.624279  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.625048  6031 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:33.626261  5998 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:33.575577 10398 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.623279  5876 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260620 13:57:33.634367  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.637311  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:33.638427  5876 raft_consensus.cc:2368] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9.
I20260620 13:57:33.639459  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:33.640798  6031 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:33.635152  5879 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:33.613209 10307 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:33.645403  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.647575  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.649266  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.631457 10038 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:33.654776  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.654871 10038 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.656956  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:33.659365 10422 log.cc:927] Time spent T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260620 13:57:33.666170  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.671160  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.673810 10038 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.674719 10038 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:33.595072 10420 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.674336 10184 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.681519  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.684939  6587 raft_consensus.cc:2410] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260620 13:57:33.683136  6027 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260620 13:57:33.684072  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.687415  6031 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:33.696935  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.660483 10386 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:33.698516  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:33.700686  5878 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:33.703445  5881 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:33.683971 10415 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.706372  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.708981  5876 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:33.710297  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.714744  5878 raft_consensus.cc:2393] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:57:33.715504  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 89298.8us
I20260620 13:57:33.617797 10418 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.719826  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.704978 10322 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:33.724361  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.725626  6587 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:33.726079  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:33.731930 10385 log.cc:927] Time spent T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 1.127s	user 0.003s	sys 0.000s
I20260620 13:57:33.705526 10386 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.739718 10418 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.740391 10305 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.741163 10386 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.746629  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:33.747260  6029 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:33.747856 10398 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.748256  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.748937  6024 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:33.749841  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.750388  6024 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:33.751330  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.752638  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.754094  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:33.754657  6033 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 11
I20260620 13:57:33.755198  6029 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:33.746016  5883 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:33.755782 10173 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.713585 10414 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:33.756820 10414 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.757007  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.757968  5883 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:33.759130  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.759948  5883 raft_consensus.cc:2368] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
I20260620 13:57:33.760247 10388 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.760676  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.761325  5883 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:57:33.762115  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.762723  5883 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:33.766325  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.769937  5878 raft_consensus.cc:2410] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260620 13:57:33.763568  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.774729  5883 raft_consensus.cc:2410] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260620 13:57:33.776103  6029 raft_consensus.cc:1275] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260620 13:57:33.778390  5881 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
W20260620 13:57:33.779479  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:33.783565  5879 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:33.787874  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.793053  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.792603  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.796309  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.821199  6586 raft_consensus.cc:2410] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260620 13:57:33.796446  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.796988  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.784714 10415 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:33.798547  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.800083 10184 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.825433  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.799396  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.800648  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.787640 10165 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:33.804538  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:33.828445  5957 raft_consensus.cc:2410] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260620 13:57:33.787433 10322 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:33.805982  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.791806 10398 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260620 13:57:33.807157  6033 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:33.807313  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.831049  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.831676  5953 raft_consensus.cc:2410] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260620 13:57:33.794832  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.832549  5878 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:33.724452 10284 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.797664  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.822940  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:33.824383  6551 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:33.837786  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:33.837697  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.838356  6578 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:33.838652  5953 raft_consensus.cc:2393] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:33.834553  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.836256  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.839355  6585 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:33.845072  5881 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260620 13:57:33.842972  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:33.847954  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.840622  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:33.848719  6583 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:33.851207  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:33.851379  5997 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:33.824299 10420 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.851217  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:33.854256  6579 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:33.848968  5849 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:33.855790  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.856621  5953 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:33.857966  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.858758  5953 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:57:33.837044 10414 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.865357  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.874704  5881 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260620 13:57:33.853669 10305 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:33.843698 10184 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260620 13:57:33.878021  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.884394  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.885210  5953 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:33.886651  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:33.887472  5957 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:33.880316  5879 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:33.867218  5849 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:33.863680 10003 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:33.846962 10165 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.832979 10322 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.882149 10428 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:33.872565 10387 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:33.908813 10387 raft_consensus.cc:697] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:33.909940 10387 consensus_queue.cc:237] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:33.914500 10152 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:33.915277 10152 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.918262 10152 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.837682 10415 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:33.920734 10415 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:57:33.891743  5881 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:33.897699  5997 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:33.875002 10380 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:33.900703  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:33.904476  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 76470.4us
I20260620 13:57:33.905109  5849 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:33.923069  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:33.879184 10305 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:33.924110  6582 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
W20260620 13:57:33.925117  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 94799.8us
I20260620 13:57:33.930087  5998 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:33.924573  5849 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:33.931389  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 92212.1us
I20260620 13:57:33.923262 10152 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:33.941877  6584 raft_consensus.cc:2410] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260620 13:57:33.943313  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:33.945355  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:33.946664  6581 raft_consensus.cc:2393] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:33.947552  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.948378  6587 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:33.950979  6551 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:33.923838 10394 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:33.967648  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:33.956418 10038 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.013s
I20260620 13:57:33.969338 10394 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:33.969801 10394 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:33.972960 10168 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:33.974220  5877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2753) took 1206 ms. Trace:
I20260620 13:57:33.974634  5877 rpcz_store.cc:276] 0620 13:57:32.768168 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:32.768304 (+   136us) service_pool.cc:224] Handling call
0620 13:57:32.773388 (+  5084us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:33.126447 (+353059us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:33.973947 (+847500us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54001f40d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:33.974145 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677012352}
I20260620 13:57:33.975802 10307 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:57:33.956616  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.930684 10305 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:33.940478 10284 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:33.969825  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:33.981487  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:33.987967 10307 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:33.989562 10307 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:33.978631 10347 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:33.990079  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:33.990737  5953 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:33.994318  6579 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:33.987190  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:33.944417 10391 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:33.944720 10380 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:33.944566 10152 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:34.011087  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 79745.6us
I20260620 13:57:33.996924  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:34.009112  5997 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:34.013046  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:33.965477 10442 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:33.977205 10246 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:33.987895 10284 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:34.015838  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:33.997937 10038 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:33.996387 10307 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:34.007550 10415 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:34.033094  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:34.015944 10152 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:34.041282  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:34.041505  5953 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:34.043826  6029 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:34.044396  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.047178  5950 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:34.045187  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:34.045637  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:34.016558 10127 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:34.015391 10391 raft_consensus.cc:697] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:34.007947 10387 consensus_queue.cc:1048] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260620 13:57:34.032298 10284 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:34.048636  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:34.035444 10415 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:34.056542  6551 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:34.056711  5882 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260620 13:57:34.035195 10282 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:34.054688  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:34.014717 10184 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260620 13:57:34.058562  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:34.057760  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:34.060384  6029 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:34.052485 10347 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:34.068430  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.069113  5950 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:34.060680 10415 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:34.056335 10127 raft_consensus.cc:697] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:34.060940 10282 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:34.079891  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.067410 10434 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:34.087745  5950 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
W20260620 13:57:34.076885 10430 log.cc:927] Time spent T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260620 13:57:34.092618  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:34.099804 10432 log.cc:927] Time spent T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260620 13:57:34.111405 10165 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:34.114710 10127 consensus_queue.cc:237] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:34.115520 10429 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260620 13:57:34.116142 10322 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:34.119177  5956 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:34.131268  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:34.119092  5957 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:34.086126 10282 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:57:34.132993  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 143953us
I20260620 13:57:34.133951  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.134605  5957 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 5.
I20260620 13:57:34.092942 10434 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:34.137072  5998 leader_election.cc:400] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9.
I20260620 13:57:34.137660  5998 leader_election.cc:403] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260620 13:57:34.137782  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.138736  5957 raft_consensus.cc:2410] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260620 13:57:34.143913  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.144924  5957 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:34.146442  5998 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:34.147636  5998 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:34.150738  6578 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:34.157039 10444 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:34.160866  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:34.169435  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.169607  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.170393  5950 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:34.171031  5957 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:34.173952  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.175216  5957 raft_consensus.cc:2410] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260620 13:57:34.177321  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.178534  5957 raft_consensus.cc:2410] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260620 13:57:34.142225 10434 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:34.181663  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.191243  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:34.194255  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 160755us
I20260620 13:57:34.168074 10380 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 8. Current term is 9.
I20260620 13:57:34.171788 10272 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:34.199808  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.207216  5954 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:34.176075 10347 raft_consensus.cc:697] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:34.131568 10391 consensus_queue.cc:237] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:34.176745 10442 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:34.201113  5957 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:34.211504  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.211953  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.214844  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.216862 10305 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:34.221834  5880 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 12: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:34.216706  5957 raft_consensus.cc:2410] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260620 13:57:34.225502 10394 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:34.240425 10307 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:34.212527  5950 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 16.
I20260620 13:57:34.248935  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.250198  5954 raft_consensus.cc:2410] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260620 13:57:34.219002 10305 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:34.241951 10434 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:34.217556 10444 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:34.220768 10415 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:34.282739  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:34.284621  5954 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 9
I20260620 13:57:34.286154  5956 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:34.367547  6580 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:34.281237 10307 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:34.396412 10434 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:34.405961 10274 consensus_queue.cc:260] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:34.409379  5875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1791) took 1103 ms. Trace:
I20260620 13:57:34.409816  5875 rpcz_store.cc:276] 0620 13:57:33.305568 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:33.305686 (+   118us) service_pool.cc:224] Handling call
0620 13:57:34.409165 (+1103479us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540030e3d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:34.409305 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372873088}
I20260620 13:57:34.371359  6579 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260620 13:57:34.374125 10394 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:34.373996 10282 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:34.375303 10347 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:34.255076 10442 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:34.422345  5954 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
W20260620 13:57:34.425417  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 242470us
I20260620 13:57:34.447362  5998 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:34.443277 10272 raft_consensus.cc:697] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:34.452584  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:34.453222 10444 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:34.455154 10444 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:34.292443 10152 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:34.443871 10274 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:34.455649 10444 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:34.465821  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:34.455565 10415 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:34.468258  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:34.455830 10453 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:34.475610 10272 consensus_queue.cc:237] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:34.475937 10265 consensus_queue.cc:1059] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:57:34.476753 10165 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:34.433022 10284 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:34.483631  5954 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
W20260620 13:57:34.493070  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:34.501544  5954 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260620 13:57:34.502065  5954 pending_rounds.cc:85] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 6
I20260620 13:57:34.502354  5954 pending_rounds.cc:107] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260620 13:57:34.502631  5954 raft_consensus.cc:2889] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:34.479300 10453 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:34.470348 10175 tablet_copy_client.cc:538] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 13:57:34.502986  5954 pending_rounds.cc:107] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260620 13:57:34.510617  5954 raft_consensus.cc:2889] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:34.492069 10165 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:34.515443  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:34.521299  6028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2739) took 1787 ms. Trace:
I20260620 13:57:34.521930  6028 rpcz_store.cc:276] 0620 13:57:32.733672 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:33.071294 (+337622us) service_pool.cc:224] Handling call
0620 13:57:33.281314 (+210020us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:33.291041 (+  9727us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:34.521010 (+1229969us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54000b7cd0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:34.521214 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481017088}
W20260620 13:57:34.516731 10428 consensus_meta.cc:287] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.002s
W20260620 13:57:34.528327  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 58141.3us
I20260620 13:57:34.532895  5954 pending_rounds.cc:85] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 6
I20260620 13:57:34.509021 10453 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:34.518085 10165 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:34.536993  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:34.519162 10444 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:34.539759  5878 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:34.533954  5954 pending_rounds.cc:107] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260620 13:57:34.540556  5954 raft_consensus.cc:2889] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:34.546458 10442 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:34.557578  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:34.558393  5956 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:34.561371 10152 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:34.562701 10282 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:34.562958  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:34.568631 10312 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:34.569017 10284 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:34.569271  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 367523us
I20260620 13:57:34.537684 10428 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:34.570271  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:34.571236 10457 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:57:34.574666 10379 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:34.575392  5877 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:34.571491  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:34.581435  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:34.582828  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:34.583428  5848 connection.cc:256] RPC call timeout handler was delayed by -1.3138227639999513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
I20260620 13:57:34.590732  5849 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:34.592706  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:34.595885  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:34.599958 10439 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:34.608822  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:34.614130  5998 leader_election.cc:400] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
I20260620 13:57:34.614496  5998 leader_election.cc:403] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:57:34.634008  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:34.637924  6552 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:34.638964  5956 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:57:34.600446 10038 consensus_queue.cc:1059] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
W20260620 13:57:34.664222  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 50270us
I20260620 13:57:34.672801  5998 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:34.679446  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:34.680248  5878 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:34.664135  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:34.684252  5956 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:34.647748  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:34.667558  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:34.686769  6028 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:34.670872  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 82795.7us
I20260620 13:57:34.671608  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:34.644519 10439 raft_consensus.cc:697] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:34.696099  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:34.749814  6024 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:34.697722  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:34.698578  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:34.700261 10464 log.cc:927] Time spent T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260620 13:57:34.701375  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:34.702171  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:34.760910  6030 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:34.711690 10470 log.cc:927] Time spent T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260620 13:57:34.696715  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:34.618387 10401 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:34.765156  5956 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:34.719985  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:34.683907 10262 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:34.769840 10262 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:34.770268 10262 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:34.666368 10127 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.027s
I20260620 13:57:34.645067 10428 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
W20260620 13:57:34.739460  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 52068.8us
I20260620 13:57:34.740248  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:34.777840  6033 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:34.741340  6551 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:34.624696 10435 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:34.744833  6028 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:34.780608  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:34.746979  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 74268.1us
I20260620 13:57:34.758317  5877 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:34.763089  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:34.784597  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:34.784852  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:34.786586  6026 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:34.786515  5998 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:34.788178  6032 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:34.785516  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 87825.1us
I20260620 13:57:34.789522  6551 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:34.789650  5848 connection.cc:256] RPC call timeout handler was delayed by -1.2247138259999701s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
W20260620 13:57:34.791958  5848 connection.cc:256] RPC call timeout handler was delayed by -1.1482227640000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
W20260620 13:57:34.792303  5848 connection.cc:256] RPC call timeout handler was delayed by -1.1482227640000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
W20260620 13:57:34.792955  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:34.792598  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 132595us
W20260620 13:57:34.792783  5848 connection.cc:256] RPC call timeout handler was delayed by -1.1293227639999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2257s for a response
I20260620 13:57:34.799301  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:34.800238  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2071) took 1064 ms. Trace:
I20260620 13:57:34.763763 10442 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:57:34.796147  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:34.807435  6551 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:34.816519  5958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2332) took 1451 ms (client timeout 1566 ms). Trace:
I20260620 13:57:34.808226  5997 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:34.809717  5998 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:34.826897  5997 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:34.828054 10284 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:34.828907 10382 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:57:34.829348 10382 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:34.829751 10382 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:34.830417  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:34.824278 10038 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:34.831647  5998 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:34.832070 10038 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:34.832762 10038 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:34.832871  5998 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:34.834014  5998 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:34.834151  5881 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:34.835121  5998 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:34.835628 10444 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:34.836854 10444 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:34.836934 10462 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:57:34.837798 10444 consensus_queue.cc:1059] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:57:34.838820 10462 raft_consensus.cc:3055] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:34.778682 10401 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:34.839196 10462 raft_consensus.cc:740] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:34.839504 10401 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:34.840027 10462 consensus_queue.cc:260] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:34.842010 10262 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:34.843648 10187 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:34.816704 10475 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260620 13:57:34.844161 10460 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:34.844821 10460 raft_consensus.cc:697] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:34.790027 10457 raft_consensus.cc:2764] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260620 13:57:34.835867 10038 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:34.847291  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2063) took 1195 ms. Trace:
W20260620 13:57:34.822120  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:34.825337  5958 rpcz_store.cc:269] 0620 13:57:33.354273 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:33.356031 (+  1758us) service_pool.cc:224] Handling call
0620 13:57:34.805790 (+1449759us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b54002503d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:34.805897 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65768832}
I20260620 13:57:34.848140  5848 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:34.794834 10312 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:34.796139 10428 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:34.780922 10376 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.048s
I20260620 13:57:34.847175 10434 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election won for term 13
W20260620 13:57:34.817327  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 54314.4us
I20260620 13:57:34.800660  5959 rpcz_store.cc:276] 0620 13:57:33.735973 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.780671 (+1044698us) service_pool.cc:224] Handling call
0620 13:57:34.799792 (+ 19121us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:34.799934 (+   142us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:34.799954 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:34.799991 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:57:34.800023 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:34.800080 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:34.800180 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:34.823905  6551 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:34.861718  6032 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:34.857656  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1013) took 1120 ms. Trace:
I20260620 13:57:34.855840  5954 rpcz_store.cc:276] 0620 13:57:33.652627 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.527520 (+874893us) service_pool.cc:224] Handling call
0620 13:57:34.531798 (+  4278us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:34.583914 (+ 52116us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:34.583943 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:34.584582 (+   639us) log.cc:844] Serialized 52 byte log entry
0620 13:57:34.769084 (+184502us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:57:34.769149 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:34.769208 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:34.847019 (+ 77811us) raft_consensus.cc:1685] finished
0620 13:57:34.847049 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:34.847231 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1763,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":8849,"thread_start_us":155812,"threads_started":1,"wal-append.queue_time_us":225348}
I20260620 13:57:34.826035 10435 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:34.873652  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2051) took 1304 ms. Trace:
I20260620 13:57:34.891601  5956 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:34.802098 10127 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:34.806712  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2068) took 1083 ms. Trace:
W20260620 13:57:34.902004  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 78216.4us
I20260620 13:57:34.908421  6551 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:34.805461 10003 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.069s
W20260620 13:57:34.904059  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 67618us
I20260620 13:57:34.901954  5951 rpcz_store.cc:276] 0620 13:57:33.737248 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.856520 (+1119272us) service_pool.cc:224] Handling call
0620 13:57:34.856971 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:34.857212 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:34.857249 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:34.857306 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:57:34.857360 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:34.857433 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:34.857581 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:34.817780 10442 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:34.909567  6551 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:34.907500  5952 rpcz_store.cc:276] 0620 13:57:33.723216 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.764905 (+1041689us) service_pool.cc:224] Handling call
0620 13:57:34.806168 (+ 41263us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:34.806372 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:34.806400 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:34.806445 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:34.806484 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:34.806553 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:34.806656 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:34.794936 10322 consensus_queue.cc:1059] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.102s
I20260620 13:57:34.931778  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:34.904913  5950 rpcz_store.cc:276] 0620 13:57:33.568982 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.246664 (+677682us) service_pool.cc:224] Handling call
0620 13:57:34.267879 (+ 21215us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:34.268355 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:34.268383 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:34.281910 (+ 13527us) log.cc:844] Serialized 26 byte log entry
0620 13:57:34.526014 (+244104us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:34.617255 (+ 91241us) log.cc:844] Serialized 14 byte log entry
0620 13:57:34.617474 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:34.617545 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:34.873334 (+255789us) raft_consensus.cc:1685] finished
0620 13:57:34.873365 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:34.873567 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50505,"prepare.queue_time_us":37555,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":32,"raft.queue_time_us":430,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":88242,"thread_start_us":221481,"threads_started":2,"wal-append.queue_time_us":239925}
W20260620 13:57:34.916502  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 68434.2us
I20260620 13:57:34.855816 10038 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:34.914921  5954 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:34.895905 10428 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:34.872140 10454 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:57:34.983680  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:34.984489  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 48841.8us
I20260620 13:57:34.981426  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1016) took 1243 ms. Trace:
W20260620 13:57:35.018807  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 109281us
I20260620 13:57:35.033703  5954 rpcz_store.cc:276] 0620 13:57:33.737988 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.905738 (+1167750us) service_pool.cc:224] Handling call
0620 13:57:34.914702 (+  8964us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:34.981112 (+ 66410us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:34.981351 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:35.034039  6551 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:34.851970 10394 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260620 13:57:35.023204  5956 raft_consensus.cc:3055] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:34.868361 10387 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260620 13:57:34.846390 10460 consensus_queue.cc:237] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:34.913676 10127 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:34.916908 10434 raft_consensus.cc:697] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:35.071378  5956 raft_consensus.cc:740] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:35.043493  5848 leader_election.cc:400] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10.
I20260620 13:57:35.033357  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2067) took 1319 ms. Trace:
I20260620 13:57:34.904886 10435 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:34.926270 10442 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
W20260620 13:57:35.029546  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 97837.3us
I20260620 13:57:35.098927  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:35.033219  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:35.038220  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1023) took 1298 ms. Trace:
I20260620 13:57:34.917353 10458 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 13:57:35.072866  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:35.100109  5951 rpcz_store.cc:276] 0620 13:57:33.740097 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:35.028721 (+1288624us) service_pool.cc:224] Handling call
0620 13:57:35.037719 (+  8998us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:35.037900 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:35.037924 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:35.037966 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:35.038005 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:35.038058 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:35.038167 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:35.074345  5953 rpcz_store.cc:276] 0620 13:57:33.714437 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.696730 (+982293us) service_pool.cc:224] Handling call
0620 13:57:34.743483 (+ 46753us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:34.743693 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 9
0620 13:57:34.780107 (+ 36414us) log.cc:844] Serialized 14 byte log entry
0620 13:57:35.033003 (+252896us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:35.033056 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:35.033117 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:35.033184 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:35.033302 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30537,"prepare.queue_time_us":41149,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":40514,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":98,"thread_start_us":221930,"threads_started":1,"wal-append.queue_time_us":222243}
I20260620 13:57:35.018230 10038 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:35.103014  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 69054.4us
I20260620 13:57:35.026104 10428 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:35.058568 10465 log.cc:927] Time spent T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260620 13:57:35.111826  6551 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:35.120744  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 262015us
I20260620 13:57:35.103314  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1025) took 1362 ms. Trace:
W20260620 13:57:35.112746  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 79578.6us
I20260620 13:57:35.083806 10488 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:35.108825  5956 consensus_queue.cc:260] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:35.044332 10414 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:35.119637  5953 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 14. Current term is 15. Ops: []
I20260620 13:57:35.121476  5951 rpcz_store.cc:276] 0620 13:57:33.740646 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:35.101445 (+1360799us) service_pool.cc:224] Handling call
0620 13:57:35.102786 (+  1341us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:35.102958 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:35.102983 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:35.103024 (+    41us) raft_consensus.cc:1645] Marking committed up to 12
0620 13:57:35.103061 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:35.103144 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:35.103252 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:35.130208  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1027) took 1389 ms. Trace:
I20260620 13:57:35.071836 10127 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:34.981318 10187 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
I20260620 13:57:35.096176 10435 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:35.102335 10391 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:35.130762  5951 rpcz_store.cc:276] 0620 13:57:33.741183 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:35.129068 (+1387885us) service_pool.cc:224] Handling call
0620 13:57:35.129497 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:35.129766 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:35.129805 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:35.129867 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:35.129922 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:35.129996 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:35.130135 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:35.142978  5951 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:35.036495 10280 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260620 13:57:35.125068  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:35.108575 10415 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 13:57:35.135206  5956 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:35.066437 10246 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260620 13:57:35.021015 10274 consensus_queue.cc:1059] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260620 13:57:35.034848 10312 consensus_queue.cc:1059] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260620 13:57:35.065012 10262 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:35.102250 10436 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:35.134943  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1026) took 1394 ms. Trace:
I20260620 13:57:35.120755 10379 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:35.128566 10414 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:34.913436 10439 consensus_queue.cc:237] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:35.246658  5953 rpcz_store.cc:276] 0620 13:57:33.740907 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:35.102147 (+1361240us) service_pool.cc:224] Handling call
0620 13:57:35.119476 (+ 17329us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:35.134608 (+ 15132us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:35.134866 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:35.148080  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1032) took 1059 ms. Trace:
I20260620 13:57:35.261212  5951 rpcz_store.cc:276] 0620 13:57:34.088911 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:35.142293 (+1053382us) service_pool.cc:224] Handling call
0620 13:57:35.142720 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:35.147814 (+  5094us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:35.148018 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260620 13:57:35.254709  5878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.043s	sys 0.039s
I20260620 13:57:35.145258 10469 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:35.147464 10279 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260620 13:57:35.245622 10453 consensus_meta.cc:287] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.000s
W20260620 13:57:35.267056  5878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.044s	sys 0.039s
W20260620 13:57:35.269938  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 226604us
W20260620 13:57:35.279964  5848 connection.cc:256] RPC call timeout handler was delayed by -1.7456569790000458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25630000000000003s for a response
I20260620 13:57:35.284178  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1033) took 1159 ms. Trace:
I20260620 13:57:35.284747  5953 rpcz_store.cc:276] 0620 13:57:34.124987 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:35.260517 (+1135530us) service_pool.cc:224] Handling call
0620 13:57:35.283496 (+ 22979us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:35.283744 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:35.283782 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:35.283840 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:35.283886 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:35.283959 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:35.284105 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:35.273650  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:35.259539  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 137770us
I20260620 13:57:35.252620 10379 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:35.139269 10382 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:35.253670 10458 raft_consensus.cc:3055] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:35.259541 10414 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:35.328023  5848 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.566s (SENT)
I20260620 13:57:35.331480  5848 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:35.272353 10279 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:35.256669 10436 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:35.413772  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 1095) took 1256 ms. Trace:
I20260620 13:57:35.411429  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1015) took 1673 ms. Trace:
W20260620 13:57:35.412384  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 107574us
W20260620 13:57:35.377002  6024 consensus_meta.cc:287] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.002s
W20260620 13:57:35.425973  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:35.433846  6024 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
W20260620 13:57:35.351917  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 240163us
I20260620 13:57:35.289891  5997 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:35.435308  6551 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:35.431874  5958 rpcz_store.cc:276] 0620 13:57:33.737746 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.874014 (+1136268us) service_pool.cc:224] Handling call
0620 13:57:34.874572 (+   558us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:34.894599 (+ 20027us) raft_consensus.cc:1534] Early marking committed up to index 7
0620 13:57:34.931979 (+ 37380us) log.cc:844] Serialized 14 byte log entry
0620 13:57:35.272735 (+340756us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:35.276842 (+  4107us) log.cc:844] Serialized 52 byte log entry
0620 13:57:35.276980 (+   138us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:35.277412 (+   432us) log.cc:844] Serialized 14 byte log entry
0620 13:57:35.277574 (+   162us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:35.277665 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:35.411130 (+133465us) raft_consensus.cc:1685] finished
0620 13:57:35.411156 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:35.411350 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22133,"prepare.queue_time_us":38312,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":81,"raft.queue_time_us":298293,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":12431,"thread_start_us":220156,"threads_started":1,"wal-append.queue_time_us":377563}
W20260620 13:57:35.383172  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 284366us
W20260620 13:57:35.435986  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 146182us
W20260620 13:57:35.356451  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:35.431334  5956 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260620 13:57:35.437248  5956 pending_rounds.cc:85] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 8
I20260620 13:57:35.437603  5956 pending_rounds.cc:107] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260620 13:57:35.436686  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:35.437896  5956 raft_consensus.cc:2889] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:35.404902 10488 raft_consensus.cc:697] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:35.263592 10434 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:35.431732  6579 rpcz_store.cc:276] 0620 13:57:34.157768 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.162402 (+  4634us) service_pool.cc:224] Handling call
0620 13:57:34.162850 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:34.415402 (+252552us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:35.413505 (+998103us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54005d0f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:35.413713 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478532480}
I20260620 13:57:35.321091 10379 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:35.318110 10165 consensus_meta.cc:287] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.000s
I20260620 13:57:35.463956  6551 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:35.468092  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:35.438762  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1019) took 1700 ms. Trace:
I20260620 13:57:35.291226 10453 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:35.436811  5997 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:35.461836  6030 consensus_meta.cc:287] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.682s	user 0.012s	sys 0.000s
W20260620 13:57:35.412020 10487 log.cc:927] Time spent T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260620 13:57:35.328140 10458 raft_consensus.cc:740] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:35.561846 10458 consensus_queue.cc:260] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:35.562906 10458 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:35.564536 10498 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:35.565357 10498 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:35.565815 10498 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:35.521946  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 45621.6us
I20260620 13:57:35.479643  6551 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:35.567889  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 88326.9us
I20260620 13:57:35.568608  6551 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:35.569314 10307 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:35.569811 10307 raft_consensus.cc:697] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:35.474977 10448 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:57:35.382732 10387 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:35.408140 10255 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:57:35.556121  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:35.370071 10493 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:35.434908 10282 raft_consensus.cc:2764] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260620 13:57:35.451769 10279 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:35.555739  5956 rpcz_store.cc:276] 0620 13:57:33.738757 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.908708 (+1169951us) service_pool.cc:224] Handling call
0620 13:57:34.982861 (+ 74153us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:35.438497 (+455636us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:35.438708 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:35.413044 10270 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:35.571852  6031 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:35.384011 10454 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:35.570691 10307 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:35.550729 10160 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:35.631739  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 358157us
I20260620 13:57:35.558343  6030 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
W20260620 13:57:35.633183  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 196543us
W20260620 13:57:35.633313  5848 leader_election.cc:336] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.236s (SENT)
I20260620 13:57:35.636000  5924 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:35.557457 10187 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election won for term 15
W20260620 13:57:35.639803 10491 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260620 13:57:35.515787 10165 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:35.579869 10175 tablet_bootstrap.cc:492] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap starting.
I20260620 13:57:35.643229 10488 consensus_queue.cc:237] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:35.647608 10436 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:35.579876 10003 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:35.576808 10448 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:35.653720  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 216963us
I20260620 13:57:35.585248 10415 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:35.632658 10493 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:35.672557  5997 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:35.635362 10270 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:35.637804 10284 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:35.654915 10503 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:35.677421  6580 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 12: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:57:35.679237  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 45993.1us
W20260620 13:57:35.676719  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:35.719431  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:35.682850  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 46964.3us
I20260620 13:57:35.638226 10454 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:35.727391  5848 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.236s (SENT)
I20260620 13:57:35.730850  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:35.677366 10485 log.cc:927] Time spent T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260620 13:57:35.678447 10165 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
W20260620 13:57:35.700556 10442 consensus_meta.cc:287] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.001s
I20260620 13:57:35.682502 10270 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:35.676527 10504 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:35.669663 10187 raft_consensus.cc:697] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:35.687860 10382 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:35.682240 10160 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 13:57:35.695973 10507 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:35.696427 10453 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:35.675685 10493 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:35.676110 10448 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:57:35.744284 10498 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:35.764816  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:35.766618  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:35.769575  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:35.770249  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 97770.8us
I20260620 13:57:35.750411 10504 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:35.773013  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:35.771723 10274 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:35.752472 10442 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:35.773669  5956 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:35.752853 10160 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:35.777951  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:35.779551  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 75773.5us
I20260620 13:57:35.759210 10507 raft_consensus.cc:697] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:35.786029 10507 consensus_queue.cc:237] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:35.776515 10504 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:35.799630  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:35.749701 10506 consensus_queue.cc:1059] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260620 13:57:35.807364  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:35.809253  5955 raft_consensus.cc:2393] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 9: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:35.775887 10442 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:35.810057  5848 leader_election.cc:336] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.547s (SENT)
I20260620 13:57:35.810555  5848 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:35.780440 10160 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:35.688206 10503 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:35.769411 10312 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260620 13:57:35.791039 10280 raft_consensus.cc:3055] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:35.820899  5878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1822) took 1153 ms. Trace:
I20260620 13:57:35.827895  5878 rpcz_store.cc:276] 0620 13:57:34.667860 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.681214 (+ 13354us) service_pool.cc:224] Handling call
0620 13:57:34.681562 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:34.681980 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 5
0620 13:57:34.682011 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:34.682673 (+   662us) log.cc:844] Serialized 52 byte log entry
0620 13:57:35.320412 (+637739us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:57:35.320463 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:35.320550 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:35.820667 (+500117us) raft_consensus.cc:1685] finished
0620 13:57:35.820690 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:35.820842 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1867,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":593424,"threads_started":1,"wal-append.queue_time_us":711744}
I20260620 13:57:35.822155  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:35.823253 10492 log.cc:927] Time spent T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.491s	user 0.001s	sys 0.000s
I20260620 13:57:35.824007 10505 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:57:35.824457 10497 log.cc:927] Time spent T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260620 13:57:35.825052  6031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43502 (request call id 2462) took 1178 ms. Trace:
I20260620 13:57:35.822048 10511 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:35.805251 10439 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:35.843492  5956 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:35.839005  6031 rpcz_store.cc:276] 0620 13:57:34.646580 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.647492 (+   912us) service_pool.cc:224] Handling call
0620 13:57:35.824825 (+1177333us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54001e50d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:35.824990 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035497856}
I20260620 13:57:35.827615 10280 raft_consensus.cc:740] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:35.829705 10387 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:57:35.882661  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:35.862424 10521 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:35.864014 10505 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:35.872094 10454 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:35.837067 10506 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:35.943236 10506 raft_consensus.cc:697] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:35.944286 10506 consensus_queue.cc:237] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:35.952081  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:35.952823  5878 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 13
I20260620 13:57:35.955049  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:35.955394  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:35.955935  6584 raft_consensus.cc:2368] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10.
I20260620 13:57:35.957304  5879 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260620 13:57:35.878827  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 940) took 1857 ms. Trace:
I20260620 13:57:35.956450  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:35.958084  6025 rpcz_store.cc:276] 0620 13:57:34.021664 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.021800 (+   136us) service_pool.cc:224] Handling call
0620 13:57:34.040323 (+ 18523us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:34.046943 (+  6620us) raft_consensus.cc:1534] Early marking committed up to index 9
0620 13:57:34.081528 (+ 34585us) log.cc:844] Serialized 14 byte log entry
0620 13:57:34.082557 (+  1029us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:34.082619 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:34.082668 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:35.878435 (+1795767us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b5400215554. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:35.878503 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:35.878714 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12704,"prepare.queue_time_us":61060,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":348,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":14572928,"thread_start_us":14640,"threads_started":2,"wal-append.queue_time_us":91133,"wal-append.run_cpu_time_us":1329,"wal-append.run_wall_time_us":1067491}
I20260620 13:57:35.958593  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:35.879693 10502 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:35.880291 10394 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:35.851455 10274 raft_consensus.cc:2764] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260620 13:57:35.887995 10401 consensus_meta.cc:287] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 1.048s	user 0.006s	sys 0.006s
I20260620 13:57:35.888729 10280 consensus_queue.cc:260] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:35.894682 10428 consensus_meta.cc:287] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.753s	user 0.006s	sys 0.002s
W20260620 13:57:35.853914 10435 consensus_meta.cc:287] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.001s
W20260620 13:57:35.882121 10127 consensus_meta.cc:287] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.000s
I20260620 13:57:35.905977 10493 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:35.908375 10279 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:36.007373  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:36.008689  5959 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:35.908968 10503 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:35.841326 10187 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:35.910145 10379 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:35.911645 10270 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:35.914076 10473 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 1.132s	user 0.009s	sys 0.010s
I20260620 13:57:35.918079 10272 raft_consensus.cc:3055] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:36.024945 10452 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:36.025040 10272 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:35.925411  6578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 1055) took 1276 ms. Trace:
I20260620 13:57:35.841753 10515 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:36.026695  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2054) took 2457 ms. Trace:
I20260620 13:57:35.853211 10439 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:35.940932 10038 consensus_meta.cc:287] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.000s
I20260620 13:57:35.960575  6587 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEARNER]: Advancing to term 13
I20260620 13:57:35.961340  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.028264  6584 raft_consensus.cc:2393] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:57:35.964929  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:35.968529  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:35.972515  5849 leader_election.cc:400] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10.
I20260620 13:57:36.033914  5849 leader_election.cc:403] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260620 13:57:35.980505  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:35.985469  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:35.997542  6586 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:36.001107  5997 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:36.026072  6578 rpcz_store.cc:276] 0620 13:57:34.649258 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.649424 (+   166us) service_pool.cc:224] Handling call
0620 13:57:34.739967 (+ 90543us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:34.781652 (+ 41685us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:34.781684 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:34.797486 (+ 15802us) log.cc:844] Serialized 52 byte log entry
0620 13:57:34.999239 (+201753us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:34.999956 (+   717us) log.cc:844] Serialized 14 byte log entry
0620 13:57:35.103313 (+103357us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:35.103391 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:35.924289 (+820898us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b24000cd628. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc591614 00007f0fdc58f71b 00007f0fdc74a619 00007f0fdc74a2a5 00007f0fdc749800 00007f0fdf3c3828 00007f0fdf3c3f88 00007f0fdf39b738 00007f0fdf396b0a 00007f0fdf395f56
0620 13:57:35.925025 (+   736us) raft_consensus.cc:1685] finished
0620 13:57:35.925144 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:35.925339 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104205,"prepare.queue_time_us":193,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":118256,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":16548,"spinlock_wait_cycles":58907520,"thread_start_us":141896,"threads_started":1,"wal-append.queue_time_us":147537}
W20260620 13:57:36.036562  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:36.003861  5878 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:36.012728  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:36.016412  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:36.022019 10379 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:36.023269 10255 consensus_queue.cc:1059] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260620 13:57:35.992712 10236 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:35.993575 10305 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:36.024053 10270 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:36.032469  6024 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:36.033129  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:36.037292  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 65031.2us
I20260620 13:57:36.038770  5959 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:36.042472  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:36.063315  6032 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:36.027182  5957 rpcz_store.cc:276] 0620 13:57:33.569468 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.467441 (+897973us) service_pool.cc:224] Handling call
0620 13:57:34.483474 (+ 16033us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:34.494682 (+ 11208us) raft_consensus.cc:1534] Early marking committed up to index 5
0620 13:57:34.541455 (+ 46773us) log.cc:844] Serialized 14 byte log entry
0620 13:57:34.598815 (+ 57360us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:34.599429 (+   614us) log.cc:844] Serialized 26 byte log entry
0620 13:57:34.599688 (+   259us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:57:34.599721 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:34.599802 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:35.913353 (+1313551us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:36.026416 (+113063us) raft_consensus.cc:1685] finished
0620 13:57:36.026520 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:36.026643 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7946,"prepare.queue_time_us":49723,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":11407,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":14287,"spinlock_wait_cycles":10618880,"thread_start_us":98832,"threads_started":2,"wal-append.queue_time_us":166187}
I20260620 13:57:36.064291  6028 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260620 13:57:36.050216  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:35.985505 10394 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.071355  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:35.987370 10401 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.085052  5878 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 12: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:36.039022 10280 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:36.071897  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 216523us
W20260620 13:57:36.087015  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 50901.4us
I20260620 13:57:36.009017 10127 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.050225 10452 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 10
I20260620 13:57:36.091782  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:36.095448  5879 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:36.094792  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:36.096833  5877 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:36.097836  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:36.027259 10003 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260620 13:57:36.053799 10284 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:36.065500 10236 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.103976  6033 raft_consensus.cc:1240] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:35.993038 10428 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:35.983639 10521 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.065414 10184 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:36.004433 10435 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:35.994302 10502 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.072481 10493 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.105420  5998 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:36.045945 10038 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:36.065431 10305 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.116593  5878 raft_consensus.cc:1240] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: []
W20260620 13:57:36.120218  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 100860us
I20260620 13:57:36.027046 10515 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:36.128083  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.129956  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.130090  5877 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:57:36.131762  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:36.130543  6584 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:36.138717  5954 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:36.139565  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:36.138475  6551 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:36.141541  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.143352  6582 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:36.145316  6582 raft_consensus.cc:1240] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:36.145356  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:36.146045  5878 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:57:36.137454 10507 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:36.148721 10516 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:36.149118  6579 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260620 13:57:36.149215  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.149338 10516 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.150391 10382 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:36.152391 10394 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.158401  5878 raft_consensus.cc:1240] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:36.152611 10502 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.193498  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:36.194358  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:36.194605  5884 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
W20260620 13:57:36.139213 10414 consensus_meta.cc:287] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.785s	user 0.012s	sys 0.000s
I20260620 13:57:36.196166  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.199369  5849 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:36.196517  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.202428  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.202979  5875 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260620 13:57:36.185204  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.109100 10100 consensus_queue.cc:1059] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260620 13:57:36.206666  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:36.204154  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 50460.2us
W20260620 13:57:36.210713  5924 connection.cc:256] RPC call timeout handler was delayed by -2.2906672170000775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260620 13:57:36.110906 10284 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.182251 10460 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:57:36.211151  5924 connection.cc:256] RPC call timeout handler was delayed by -1.8532672170000524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260620 13:57:36.221876  5924 connection.cc:256] RPC call timeout handler was delayed by -1.8316672170000174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
W20260620 13:57:36.222293  5924 connection.cc:256] RPC call timeout handler was delayed by -1.7515672170001153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
I20260620 13:57:36.214732  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:36.222584  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6489672170000631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22650000000000003s for a response
I20260620 13:57:36.222965  6579 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:36.223225  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:36.188964 10394 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:36.225634  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:36.141238 10246 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260620 13:57:36.233577  5998 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:36.241467 10457 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:36.242117 10457 raft_consensus.cc:697] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:36.242532 10305 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.243077 10457 consensus_queue.cc:237] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:36.202730 10265 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:36.141456 10454 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.083s
I20260620 13:57:36.214792 10506 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:36.249496  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:36.214752 10312 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:36.257943  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:36.262535 10279 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:36.252684 10265 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.264873 10460 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:36.265964 10100 raft_consensus.cc:3055] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:36.266423 10100 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:36.266848 10401 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.267549 10100 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.270581 10100 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:36.209101 10414 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.273234  5998 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:36.228515 10382 raft_consensus.cc:697] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:57:36.274585  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 75295.5us
I20260620 13:57:36.232273 10394 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:36.288203 10428 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:36.288607  6581 raft_consensus.cc:2393] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 12: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:36.197746  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:36.324930  5877 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
W20260620 13:57:36.289876 10528 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260620 13:57:36.277891 10401 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:36.293185 10516 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.293655  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.393291  6031 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:36.294196 10439 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.294735 10236 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:36.295400 10127 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:36.296408  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:36.401089  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:36.401618  5957 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:36.297528  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:36.401867  6031 raft_consensus.cc:2393] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:36.299870 10538 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:36.300446 10389 raft_consensus.cc:3055] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:36.297971  6587 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEARNER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:36.305317 10435 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:36.305864 10282 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:57:36.407840 10538 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:36.306959  6580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 1052) took 1661 ms (client timeout 1719 ms). Trace:
I20260620 13:57:36.271857 10312 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:36.307299  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.307586  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:36.428416  5959 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:36.257100 10506 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:36.271996 10453 consensus_queue.cc:1175] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2e82c0c231624695ac5a813230bf5038" responder_term: 13 status { last_received { term: 9 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: [12.9-12.9]" } } last_received_current_leader { term: 0 index: 0 } }
W20260620 13:57:36.280887 10448 consensus_meta.cc:287] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.002s
I20260620 13:57:36.446496 10448 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.327850  5849 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:36.392026 10387 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:36.273906 10460 raft_consensus.cc:697] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:36.390144  5954 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:57:36.292308 10265 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:36.410372  6580 rpcz_store.cc:269] 0620 13:57:34.645207 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:34.645415 (+   208us) service_pool.cc:224] Handling call
0620 13:57:36.306747 (+1661332us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b5400525dd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:36.306879 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2107273088}
I20260620 13:57:36.404232  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.402773 10389 raft_consensus.cc:740] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:36.288337 10382 consensus_queue.cc:237] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.392771 10038 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:36.393240 10401 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:36.458268 10538 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:36.461824 10428 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:57:36.494361 10530 log.cc:927] Time spent T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.175s	user 0.001s	sys 0.001s
W20260620 13:57:36.452683 10160 consensus_meta.cc:287] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.004s
I20260620 13:57:36.495338 10160 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:36.455322 10504 consensus_meta.cc:287] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.667s	user 0.008s	sys 0.009s
I20260620 13:57:36.464145 10515 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:36.463415  5959 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:36.465623 10449 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:36.469122 10272 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:36.475713  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 147953us
I20260620 13:57:36.489656  5957 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:36.449436 10282 raft_consensus.cc:697] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:36.428148 10439 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:36.492013  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:36.503580  5849 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:36.494743 10428 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:36.463446 10501 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:36.512683  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:36.515288  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.493952 10448 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:36.498093 10401 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:36.519454 10414 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:36.520097  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.523967 10376 raft_consensus.cc:3055] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:57:36.525867 10394 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:36.511909 10534 log.cc:927] Time spent T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260620 13:57:36.567685 10547 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260620 13:57:36.567741  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:36.568624  6586 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 12: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:36.526804 10542 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:36.527400 10462 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:36.528259  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.569788  6033 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:36.527868 10460 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.512915 10521 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.531481 10284 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.532114 10389 consensus_queue.cc:260] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:36.576648 10389 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:36.577618  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:36.533309 10160 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:36.483942 10387 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.535390 10428 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:36.535624  5955 raft_consensus.cc:1275] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260620 13:57:36.508092 10449 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.537622 10469 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:36.538141 10272 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:36.540949 10531 raft_consensus.cc:3055] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:36.608731  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.518226 10439 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.504004 10504 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.544045 10506 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.553790  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.555683  6579 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:36.608844  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:36.555895  6582 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:36.566231  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:36.553628 10376 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:36.571028  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:36.614189  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:36.570308 10542 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:57:36.614564  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 43600.5us
I20260620 13:57:36.572431  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.615775  6030 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:36.514129 10457 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election won for term 12
W20260620 13:57:36.603729  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 330543us
I20260620 13:57:36.613137  6025 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 14. Current term is 15. Ops: []
I20260620 13:57:36.613338  5876 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 12: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:36.617991  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:36.618542  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.620021  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:36.620770  5882 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:36.624595  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.625838  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.628908 10387 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.629536 10387 consensus_queue.cc:1059] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:57:36.632398 10454 raft_consensus.cc:3055] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:36.632786 10454 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:36.639333  6580 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:36.649374  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.650723  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.651505  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.654067 10376 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.610623 10469 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:36.657595  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:36.658272  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.664038  6031 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:36.659253  6026 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:36.613492 10531 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:36.660547  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:36.662123 10539 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 13:57:36.662436  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:36.545655 10501 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.551342 10282 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:36.617086 10542 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:36.668429  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:36.622340 10305 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260620 13:57:36.673671  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.675675  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:36.676642  6030 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:36.677384  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:36.678013  5876 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
W20260620 13:57:36.671984 10452 consensus_meta.cc:287] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.571s	user 0.008s	sys 0.002s
I20260620 13:57:36.681892  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.682652  6028 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260620 13:57:36.683177  6028 pending_rounds.cc:85] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 8
I20260620 13:57:36.683442  6028 pending_rounds.cc:107] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260620 13:57:36.682735  6033 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:36.683722  6028 raft_consensus.cc:2889] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:36.683326  6029 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 6.
I20260620 13:57:36.667146 10444 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 13:57:36.689136  6031 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:36.694393  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:36.694700 10501 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.674885 10187 consensus_queue.cc:1059] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260620 13:57:36.704031  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 85531us
I20260620 13:57:36.706501  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.679479 10380 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:36.699155  6024 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:36.700451  6031 raft_consensus.cc:1240] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:36.706502  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:36.696434 10504 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.709319  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:36.690241 10507 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260620 13:57:36.690546 10452 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10.
I20260620 13:57:36.734902  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:36.738278  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:36.738682  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.738945  5875 raft_consensus.cc:2376] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13. Re-sending same reply.
I20260620 13:57:36.745146  6580 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260620 13:57:36.745319  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:36.745613  6580 pending_rounds.cc:85] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 9
I20260620 13:57:36.745939  6580 pending_rounds.cc:107] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260620 13:57:36.746165  6580 raft_consensus.cc:2889] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:36.745664  6584 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260620 13:57:36.746519  5876 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260620 13:57:36.686833 10531 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.747264 10448 consensus_queue.cc:1059] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260620 13:57:36.739462 10444 consensus_queue.cc:1059] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260620 13:57:36.733425 10415 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.032s
I20260620 13:57:36.749261 10531 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:36.747790 10394 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:36.755386  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.748311  6033 raft_consensus.cc:2393] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 14: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:36.769469  6030 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:36.770823  6584 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 16. Current term is 17. Ops: []
I20260620 13:57:36.749893  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:36.778131  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:36.730827 10305 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:36.776427  6586 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:57:36.780268  5875 raft_consensus.cc:1275] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260620 13:57:36.780435  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:36.781230  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:36.781790  5875 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:36.781852  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:36.785707  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:36.790243  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:36.764241 10272 raft_consensus.cc:3055] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:36.684926 10454 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.776033 10394 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:36.825814 10551 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260620 13:57:36.781414 10457 raft_consensus.cc:697] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:36.843079  5875 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
W20260620 13:57:36.843976  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 61195.5us
I20260620 13:57:36.779999 10322 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260620 13:57:36.730124 10380 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.830860 10272 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:57:36.846825 10550 log.cc:927] Time spent T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260620 13:57:36.878005 10542 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.879136 10380 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.880038  5877 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 11: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:36.848212 10265 raft_consensus.cc:3055] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:57:36.881783 10265 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:36.882766 10542 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.882956 10265 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.884058 10265 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:36.884553  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:36.885203  6031 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:36.886409  6031 raft_consensus.cc:1275] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260620 13:57:36.858706 10439 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.892904  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:36.894297  6552 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:36.894981 10275 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 13:57:36.895746  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:36.895535 10401 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.847987 10454 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:36.862305  5883 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:36.842840 10394 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:36.905012  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:36.909854  6031 raft_consensus.cc:1275] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260620 13:57:36.911888 10272 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:36.913667 10272 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:36.911741 10457 consensus_queue.cc:237] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:36.930706  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:36.935408  6581 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:36.930109  6033 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260620 13:57:36.923923  6552 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:36.940934  6031 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:36.954823  6031 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260620 13:57:36.926355 10524 log.cc:927] Time spent T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.817s	user 0.000s	sys 0.002s
I20260620 13:57:36.931511 10415 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:36.920742 10401 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:36.958158 10322 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:36.972990  6031 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:36.972011 10415 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:36.971511 10265 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
W20260620 13:57:37.023741 10558 log.cc:927] Time spent T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260620 13:57:37.006989 10415 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:37.015260  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:36.988101 10127 consensus_queue.cc:1059] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260620 13:57:36.992930 10322 raft_consensus.cc:697] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:37.035956 10127 raft_consensus.cc:3055] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:37.036401 10127 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:37.036266 10322 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.037391 10127 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.045317 10312 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:37.039319 10469 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.052135  6028 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260620 13:57:37.054913 10379 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:37.038764 10127 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:37.089844  6587 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: []
W20260620 13:57:37.090827  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:37.092129  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:37.100673  5950 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:37.108477  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:37.109107  5950 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:37.112429  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:37.117313  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:37.118468  5954 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:37.121845  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:37.120904  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2081) took 1325 ms. Trace:
I20260620 13:57:37.124696  5951 rpcz_store.cc:276] 0620 13:57:35.795406 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:35.803487 (+  8081us) service_pool.cc:224] Handling call
0620 13:57:35.803819 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:35.804028 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 11
0620 13:57:35.991349 (+187321us) log.cc:844] Serialized 14 byte log entry
0620 13:57:36.655760 (+664411us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b180033b380. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdf3a385c 00007f0fdc6edc8b 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b5da
0620 13:57:37.120392 (+464632us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:37.120449 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0620 13:57:37.120504 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:37.120716 (+   212us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:37.120845 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":464321,"prepare.queue_time_us":291569,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":2744,"spinlock_wait_cycles":3790208,"thread_start_us":306841,"threads_started":2,"wal-append.queue_time_us":219397}
I20260620 13:57:37.126677  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.128330  5951 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:37.129472  5951 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:37.130784  5951 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260620 13:57:37.131371  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.132033  5952 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:37.132135  5951 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:37.133252  5952 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260620 13:57:37.134196  5951 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:37.131453  5955 raft_consensus.cc:1240] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:37.135020  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.135843  5956 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
W20260620 13:57:37.136610  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:37.126739 10305 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:37.140564  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:37.150381  6581 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:37.151878  5951 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260620 13:57:37.153887  5955 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:37.155997 10415 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.208534 10501 raft_consensus.cc:3055] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:57:37.210438 10512 raft_consensus.cc:3055] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:37.215927 10512 raft_consensus.cc:740] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:57:37.217381  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:37.219738  5884 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:37.219825  6551 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:37.220779  5950 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:37.220824  5849 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:37.218133 10415 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:37.217577 10512 consensus_queue.cc:260] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.222921 10439 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:37.223918 10512 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:37.215754 10501 raft_consensus.cc:740] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:37.225247 10501 consensus_queue.cc:260] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.226625 10501 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:37.231933  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:37.245270  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:37.272042  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 52300.5us
I20260620 13:57:37.272992  6551 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:37.274097  6551 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:37.275060 10265 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:37.275590 10265 raft_consensus.cc:697] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:37.276473 10265 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.280376 10236 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:37.281152 10236 raft_consensus.cc:697] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:37.283413 10416 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:57:37.284188 10416 raft_consensus.cc:697] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:37.285435 10416 consensus_queue.cc:237] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:37.287818  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:37.297713  6551 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:37.303224 10246 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260620 13:57:37.304147 10246 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:37.282308 10236 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.316061  5955 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:37.341403  5950 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 14. Current term is 15. Ops: []
I20260620 13:57:37.228566 10435 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:37.335582 10175 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260620 13:57:37.345752  5954 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:37.350386 10307 consensus_queue.cc:1059] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:57:37.351943 10307 raft_consensus.cc:3055] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:37.352463 10307 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:37.355440 10469 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:37.361209  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:37.362040  5954 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:37.228991 10439 raft_consensus.cc:697] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:57:37.344552 10567 log.cc:927] Time spent T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260620 13:57:37.228464 10454 consensus_queue.cc:1059] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.140s
I20260620 13:57:37.379400 10454 raft_consensus.cc:3055] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:37.379793 10454 raft_consensus.cc:740] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:37.380628 10454 consensus_queue.cc:260] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.381785 10454 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:37.383685 10439 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.368309 10435 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.389750 10435 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:37.390954  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.377540 10394 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.394814 10175 tablet_bootstrap.cc:492] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:57:37.394879  5954 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:37.410868  6551 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:37.406137 10499 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:37.417213 10435 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:37.437105  5882 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260620 13:57:37.437381  5876 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:37.429495 10435 raft_consensus.cc:697] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:37.432108 10175 tablet_bootstrap.cc:492] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: Bootstrap complete.
I20260620 13:57:37.458361 10449 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:37.473258 10175 ts_tablet_manager.cc:1403] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: Time spent bootstrapping tablet: real 2.009s	user 0.050s	sys 0.062s
I20260620 13:57:37.473970 10449 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:37.467499  6580 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260620 13:57:37.469697 10545 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:37.479434 10545 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:37.481552  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 1.2247e+06us
I20260620 13:57:37.482292 10394 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:37.482362  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:37.491622  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:37.493357  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:37.476598 10449 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:37.477475 10454 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:37.461474  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:37.495746  6586 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:37.496007  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.497403 10526 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:57:37.497884 10526 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:37.498255 10526 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:57:37.500283  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1042) took 1231 ms. Trace:
I20260620 13:57:37.500645  5958 rpcz_store.cc:276] 0620 13:57:36.268634 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:36.268785 (+   151us) service_pool.cc:224] Handling call
0620 13:57:36.269130 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:37.056949 (+787819us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:37.056979 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:37.057526 (+   547us) log.cc:844] Serialized 26 byte log entry
0620 13:57:37.205199 (+147673us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:37.206110 (+   911us) log.cc:844] Serialized 14 byte log entry
0620 13:57:37.499947 (+293837us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:37.500015 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:37.500055 (+    40us) raft_consensus.cc:1685] finished
0620 13:57:37.500074 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:37.500231 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1493025,"prepare.queue_time_us":396,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":810786,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"spinlock_wait_cycles":1747328,"thread_start_us":106411,"threads_started":1,"wal-append.queue_time_us":91902}
I20260620 13:57:37.504966 10312 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:37.507480  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:37.511163  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:37.511843  5848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 3.417s (SENT) [suppressed 28 similar messages]
I20260620 13:57:37.517457 10376 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:37.521823  6030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2468) took 1059 ms. Trace:
I20260620 13:57:37.523627  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:37.525059  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:37.522225  6030 rpcz_store.cc:276] 0620 13:57:36.462348 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:36.778645 (+316297us) service_pool.cc:224] Handling call
0620 13:57:37.459607 (+680962us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:37.459798 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:37.459822 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:37.459866 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:37.459897 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:37.459950 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:37.521655 (+ 61705us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b54000d3c50. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:37.521764 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1565429504}
I20260620 13:57:37.527664  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:37.528551 10439 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:37.506376 10307 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.535849  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:37.532800 10439 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:37.541357 10439 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:37.541430 10175 raft_consensus.cc:359] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:37.542419 10175 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Initialized, Role: LEARNER
I20260620 13:57:37.542775 10522 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:37.528548 10279 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:37.529532 10312 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:37.545393 10435 consensus_queue.cc:237] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.547286 10175 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:37.549014  6028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2764) took 1302 ms. Trace:
I20260620 13:57:37.549495  6028 rpcz_store.cc:276] 0620 13:57:36.246393 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:36.691626 (+445233us) service_pool.cc:224] Handling call
0620 13:57:36.691950 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:37.052846 (+360896us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:37.548615 (+495769us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54000d4b54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:37.548919 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":827680640}
I20260620 13:57:37.481612 10545 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:37.569517  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:37.570351  5884 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:37.571468  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:37.574193  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:37.577323  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:37.582269  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:37.573462 10312 raft_consensus.cc:2764] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260620 13:57:37.593799 10246 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:37.594403 10246 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.597529  6024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2467) took 1143 ms. Trace:
I20260620 13:57:37.597673 10246 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:37.598070  6024 rpcz_store.cc:276] 0620 13:57:36.454415 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:36.758169 (+303754us) service_pool.cc:224] Handling call
0620 13:57:36.758413 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:36.758598 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 5
0620 13:57:36.759031 (+   433us) log.cc:844] Serialized 14 byte log entry
0620 13:57:36.829038 (+ 70007us) log.cc:844] Serialized 14 byte log entry
0620 13:57:37.596996 (+767958us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b1800264700. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc68540a 00007f0fe5dca5d9 00007f0fdc70d240 00007f0fdc707ce4 00007f0fdc707c55 00007f0fdf7f4440 00007f0fdf806af6 00007f0fdf817667 00007f0fdf8175e8
0620 13:57:37.597159 (+   163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:37.597214 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:57:37.597269 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:37.597341 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:37.597463 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":765794,"prepare.queue_time_us":428,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":1462,"raft.queue_time_us":2174,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2865,"spinlock_wait_cycles":15686912,"thread_start_us":56253,"threads_started":1,"wal-append.queue_time_us":149127}
W20260620 13:57:37.606738  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:37.607379  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:37.608426  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:37.608870  6552 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:37.606928  5884 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:37.614801  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:37.616187  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:37.591159 10307 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:37.558678 10526 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.617900 10262 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:37.606134 10279 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:37.644649 10279 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:37.641783 10457 consensus_queue.cc:1048] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260620 13:57:37.645140 10279 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:37.641108 10539 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260620 13:57:37.599048 10500 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:37.622167  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:37.657100  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 565457us
I20260620 13:57:37.658507  5952 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:37.658931  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:37.643224 10236 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260620 13:57:37.641606  5777 catalog_manager.cc:5696] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:37.621431 10387 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:57:37.667718  5848 leader_election.cc:336] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.534s (SENT)
W20260620 13:57:37.669538  5848 leader_election.cc:336] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.538s (SENT)
I20260620 13:57:37.669991  5848 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:37.674158  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:37.674208  5924 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 -> Peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Couldn't send request to peer b0ce39342d8c4a64904b30b98de02b9f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:57:37.674749  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 73648.9us
I20260620 13:57:37.674930  6586 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:37.662606 10175 ts_tablet_manager.cc:1434] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: Time spent starting tablet: real 0.189s	user 0.008s	sys 0.000s
I20260620 13:57:37.682130  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:37.683262 10442 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:37.683604 10515 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:37.683775 10442 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:37.684185 10515 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:37.685921 10442 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:37.622298 10394 consensus_queue.cc:1048] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260620 13:57:37.676764  5881 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:37.621371 10265 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:37.671133 10539 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:37.680675 10500 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.693926  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:37.697727  6578 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:37.760574  6032 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:37.699818  6025 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260620 13:57:37.674038 10282 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:37.755118  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 85935.7us
W20260620 13:57:37.763536  5848 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.617s (SENT)
I20260620 13:57:37.764047  6029 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260620 13:57:37.686966 10515 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:37.686502 10442 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:37.619961 10305 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260620 13:57:37.735391  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 74788.3us
W20260620 13:57:37.759824  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 83617.5us
I20260620 13:57:37.792268  6551 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:37.795034 10442 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.795570  5777 catalog_manager.cc:5696] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 9, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 9 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:37.797465 10442 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:37.799674  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:37.798544  5777 catalog_manager.cc:5696] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:37.803860  5777 catalog_manager.cc:5696] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 11, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 11 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:37.786475 10522 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:37.807634 10522 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:37.809228 10387 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:37.675700  5924 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:34.568241  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:57:37.698612 10265 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:37.762768  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 68938.3us
I20260620 13:57:37.698240 10526 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:37.766782  5848 leader_election.cc:336] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.658s (SENT)
I20260620 13:57:37.617753 10246 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260620 13:57:37.732733  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:37.696826 10284 consensus_queue.cc:1048] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260620 13:57:37.788672  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:37.801894 10279 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.806277  5777 catalog_manager.cc:5696] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 11, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 11 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:57:37.760187  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:37.700505 10439 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:37.828064  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 152416us
I20260620 13:57:37.828845  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:37.836472  5959 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260620 13:57:37.828758  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 62012.5us
I20260620 13:57:37.827291  6024 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:37.766187 10507 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 13:57:37.848845  5997 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:37.843688  5848 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.753s (SENT)
I20260620 13:57:37.844276  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:37.854216  6552 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:37.861351  5848 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:37.809950 10305 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:37.866321 10305 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:37.870108 10442 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 13:57:37.841900 10549 consensus_queue.cc:1048] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260620 13:57:37.873508 10279 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:37.874217 10439 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:37.861351  5777 catalog_manager.cc:5696] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 11, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 11 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:37.876189 10500 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:37.809950 10522 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:37.854075 10488 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:37.876997 10449 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:37.838912 10312 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:37.766718 10282 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:37.877909 10312 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:37.839641 10307 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:37.878485 10307 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:37.878306  5777 catalog_manager.cc:5696] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 5 to 8, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 8 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:37.847252  5998 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:37.835750 10265 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:37.882642  5776 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56594 (request call id 333) took 15362 ms (client timeout 15000 ms). Trace:
I20260620 13:57:37.878952 10307 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:37.886751  5777 catalog_manager.cc:5696] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:37.893795  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:37.894971  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:37.891144  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:37.896832  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.892110  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:37.893115  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.897667  5951 raft_consensus.cc:1275] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260620 13:57:37.898005  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.898286  5954 raft_consensus.cc:2393] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 12: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:37.897467  5956 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:37.899009  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.899833  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.897713  5959 raft_consensus.cc:2410] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260620 13:57:37.900650  5956 raft_consensus.cc:2410] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260620 13:57:37.901098  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.878305 10312 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:37.902151  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:37.902593  5997 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:37.901093  5955 raft_consensus.cc:2393] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 10: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:37.901832  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:37.898137  5951 pending_rounds.cc:85] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 5
I20260620 13:57:37.932039  5951 pending_rounds.cc:107] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260620 13:57:37.932399  5951 raft_consensus.cc:2889] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:57:37.933418  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 89764.2us
W20260620 13:57:37.934420  5848 leader_election.cc:336] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.786s (SENT)
I20260620 13:57:37.934689  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.935586  5954 raft_consensus.cc:2368] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 12. Current term is 13.
I20260620 13:57:37.936152  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:37.879632 10282 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:37.939512  5957 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:37.940289  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.934789  5848 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:37.943886  5848 leader_election.cc:336] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.821s (SENT)
I20260620 13:57:37.944811  5848 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:37.947021  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.893234 10279 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:37.951202  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:37.952185  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:37.952291  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.900480 10442 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260620 13:57:37.900851 10488 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:37.899757 10520 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:37.953948  5848 leader_election.cc:336] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.834s (SENT)
I20260620 13:57:37.975075 10520 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:37.884116  5776 rpcz_store.cc:269] 0620 13:57:22.493418 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:22.493581 (+   163us) service_pool.cc:224] Handling call
0620 13:57:22.533414 (+ 39833us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b540002b7d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf766470 00007f0fdf80531a 00007f0fe55baaac 00007f0fe56b90ae 00007f0fe3b7e4a4 00007f0fe3b7e432 00007f0fe3b7e361 00007f0fe3b7e2dc 00007f0fe3b7d592 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:37.856161 (+15322747us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:57:32.829852 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:57:32.830449 (+   597us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:57:32.830498 (+    49us) write_op.cc:435] Acquired schema lock
0620 13:57:32.830515 (+    17us) tablet.cc:662] Decoding operations
0620 13:57:33.075844 (+245329us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:57:33.075999 (+   155us) write_op.cc:641] Partition lock acquired for write op
0620 13:57:33.076030 (+    31us) tablet.cc:685] Acquiring locks for 10 operations
0620 13:57:33.077278 (+  1248us) tablet.cc:701] Row locks acquired
0620 13:57:33.077313 (+    35us) write_op.cc:260] PREPARE: finished
0620 13:57:33.077561 (+   248us) write_op.cc:270] Start()
0620 13:57:33.077737 (+   176us) write_op.cc:276] Timestamp: P: 1781963853077469 usec, L: 0
0620 13:57:33.077789 (+    52us) op_driver.cc:348] REPLICATION: starting
0620 13:57:33.078613 (+   824us) log.cc:844] Serialized 4009 byte log entry
0620 13:57:33.554931 (+476318us) op_driver.cc:464] REPLICATION: finished
0620 13:57:33.801682 (+246751us) write_op.cc:301] APPLY: starting
0620 13:57:33.801782 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0620 13:57:34.063363 (+261581us) tablet.cc:1370] finished BulkCheckPresence
0620 13:57:34.076760 (+ 13397us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:57:34.266075 (+189315us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:57:34.266412 (+   337us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0620 13:57:34.266465 (+    53us) write_op.cc:312] APPLY: finished
0620 13:57:34.266872 (+   407us) log.cc:844] Serialized 97 byte log entry
0620 13:57:34.367718 (+100846us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:34.372496 (+  4778us) write_op.cc:454] Released schema lock
0620 13:57:34.372593 (+    97us) write_op.cc:341] FINISH: Updating metrics
0620 13:57:34.373261 (+   668us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:34.373293 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":53001,"reported_tablets":37,"spinlock_wait_cycles":34338688,"child_traces":[["op",{"apply.queue_time_us":246427,"apply.run_cpu_time_us":19273,"apply.run_wall_time_us":571549,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45967,"num_ops":10,"prepare.queue_time_us":386199,"prepare.run_cpu_time_us":19921,"prepare.run_wall_time_us":370096,"raft.queue_time_us":253090,"raft.run_cpu_time_us":15173,"raft.run_wall_time_us":152200,"replication_time_us":476928,"thread_start_us":356287,"threads_started":4,"wal-append.queue_time_us":155019,"wal-append.run_cpu_time_us":84043,"wal-append.run_wall_time_us":2034093}]]}
I20260620 13:57:37.978246  5958 raft_consensus.cc:2368] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10.
I20260620 13:57:37.978380 10520 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:37.950381 10380 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260620 13:57:37.957170  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 103056us
I20260620 13:57:38.037886  5848 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:38.040736  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 46488.2us
I20260620 13:57:37.903266 10515 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260620 13:57:38.051822  6552 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:38.049775 10488 raft_consensus.cc:697] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:37.953209  5777 catalog_manager.cc:5696] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:57:37.956593  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 72743.4us
I20260620 13:57:37.955385 10457 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:37.938102 10439 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:37.939646 10539 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:38.072211 10414 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:37.953792 10279 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:37.937980 10261 consensus_queue.cc:1059] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.122s
I20260620 13:57:38.072548 10488 consensus_queue.cc:237] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:38.074362  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:37.979990 10380 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:37.957007 10545 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:38.060029 10272 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:38.055279 10387 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:38.074436 10540 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260620 13:57:38.080371  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:38.118000  5959 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:38.055239 10462 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:38.082629  5955 raft_consensus.cc:1275] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260620 13:57:37.950590 10454 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:37.967568 10498 consensus_queue.cc:1059] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.158s
I20260620 13:57:38.090651  5997 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:38.134073  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 43507us
I20260620 13:57:38.135320 10261 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:38.135780 10261 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:38.136159 10261 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:38.137341 10581 log.cc:927] Time spent T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260620 13:57:38.101570 10284 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260620 13:57:38.139842 10462 raft_consensus.cc:697] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:38.139937  5997 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:38.140980 10462 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:37.948351 10394 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:38.117020 10272 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:38.143594 10272 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:38.143699 10284 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:38.097821  5951 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:57:37.950645 10401 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:38.099422  5777 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:37.956820 10236 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
I20260620 13:57:38.102815  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:38.074961  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 121036us
I20260620 13:57:38.153975  5777 catalog_manager.cc:5696] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:57:38.155217  5848 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.008s (SENT)
W20260620 13:57:38.156307  5848 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.224s (SENT)
I20260620 13:57:38.156692  5848 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:38.105407  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 486460us
I20260620 13:57:38.038023 10501 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260620 13:57:38.164115  6580 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260620 13:57:38.114275  6552 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:37.955796  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:37.957214 10493 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.154s
I20260620 13:57:38.143392 10394 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.096326  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.106238 10279 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:38.172452  5950 raft_consensus.cc:2410] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:57:38.147061  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.173362  5954 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:38.150368  5959 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:38.150686  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.139010 10444 consensus_queue.cc:1059] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260620 13:57:38.163290 10305 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.163758  5958 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260620 13:57:38.111426 10500 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:38.111395 10449 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:38.167163  6578 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260620 13:57:38.132182 10439 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:38.172605  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:38.168938  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 54817.9us
I20260620 13:57:38.112365 10414 raft_consensus.cc:697] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:38.181733  5950 raft_consensus.cc:3055] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Stepping down as leader of term 15
I20260620 13:57:38.182142  5950 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:38.178994  5951 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:38.182974  5950 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:38.184232  5950 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:38.186813  5884 raft_consensus.cc:1240] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10. Ops: []
W20260620 13:57:38.187477  5848 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.852s (SENT)
I20260620 13:57:38.187906  5848 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:38.188977  5848 leader_election.cc:336] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.893s (SENT)
I20260620 13:57:38.189435  5848 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:38.115952 10380 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:38.192440 10507 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:38.193163 10305 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:38.207291  6043 tablet_copy_service.cc:342] P 663684cf4ae54c929bf8240ca0b63a47: Request end of tablet copy session b0ce39342d8c4a64904b30b98de02b9f-a4cd17345f80464287c5952767849dbb received from {username='slave'} at 127.0.0.1:46758
I20260620 13:57:38.207540 10305 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:38.207893  6043 tablet_copy_service.cc:434] P 663684cf4ae54c929bf8240ca0b63a47: ending tablet copy session b0ce39342d8c4a64904b30b98de02b9f-a4cd17345f80464287c5952767849dbb on tablet a4cd17345f80464287c5952767849dbb with peer b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:38.133530 10538 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260620 13:57:38.197815 10394 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:38.197499 10449 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.198477 10444 raft_consensus.cc:3055] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:38.152757 10401 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:38.201980  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 976) took 1255 ms. Trace:
I20260620 13:57:38.208658  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:38.171959 10457 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:38.213922  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:38.177820 10376 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:38.232985  6033 rpcz_store.cc:276] 0620 13:57:36.946892 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:36.961934 (+ 15042us) service_pool.cc:224] Handling call
0620 13:57:36.962386 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:37.617565 (+655179us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:37.617617 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:37.621656 (+  4039us) log.cc:844] Serialized 26 byte log entry
0620 13:57:37.884399 (+262743us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:37.884427 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:37.884506 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:38.201757 (+317251us) raft_consensus.cc:1685] finished
0620 13:57:38.201777 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:38.201912 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":654748,"raft.queue_time_us":654868,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":22512,"thread_start_us":203464,"threads_started":1,"wal-append.queue_time_us":543619}
I20260620 13:57:38.215736  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.245954  5880 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:57:38.246984  5951 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260620 13:57:38.247006  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:38.251420  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.253713  5882 raft_consensus.cc:2410] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:57:38.104848 10539 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.177899 10500 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:38.178340 10282 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260620 13:57:38.217348  6580 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 15 LEARNER]: Advancing to term 16
I20260620 13:57:38.240141  5875 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:57:38.232270 10444 raft_consensus.cc:740] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:38.241341  6032 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:57:38.223742 10549 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260620 13:57:38.242034 10401 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:38.241978 10376 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:38.271466 10531 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:38.197862 10499 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260620 13:57:38.224967 10394 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:38.203199 10454 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260620 13:57:38.281137  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.240413  5950 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260620 13:57:38.315415  5950 pending_rounds.cc:85] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 11
I20260620 13:57:38.274915 10262 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:38.227090 10501 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260620 13:57:38.316496 10262 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.277351 10051 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260620 13:57:38.202781 10439 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.318657 10262 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:38.319451 10444 consensus_queue.cc:260] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:38.320255 10439 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:38.320896 10444 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:38.315814  5950 pending_rounds.cc:107] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260620 13:57:38.321545  5950 raft_consensus.cc:2889] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:38.280700 10500 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:38.215262 10507 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:38.337399  6580 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260620 13:57:38.312016 10376 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:38.346052  5957 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260620 13:57:38.313422 10522 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:38.350574  5950 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260620 13:57:38.354418  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:38.364288  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:38.379451  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.357194 10501 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:38.385237  5952 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260620 13:57:38.385565  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.324904 10531 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.386286 10261 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:38.409655 10307 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.411327 10442 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Stepping down as leader of term 16
I20260620 13:57:38.361541 10522 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:38.379355 10272 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.379810 10262 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:38.427134  6033 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260620 13:57:38.430778  5956 raft_consensus.cc:2410] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260620 13:57:38.424131  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 46080.6us
W20260620 13:57:38.418458 10584 log.cc:927] Time spent T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260620 13:57:38.313845 10414 consensus_queue.cc:237] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.445371  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:38.368885 10515 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260620 13:57:38.446630  6029 raft_consensus.cc:2410] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260620 13:57:38.449482  6580 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260620 13:57:38.456243  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:38.457800  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:38.455065  6028 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.028s	sys 0.044s
W20260620 13:57:38.458321  6028 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.028s	sys 0.044s
I20260620 13:57:38.424317 10442 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:38.431845 10449 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:38.441248 10262 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.464229 10236 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:57:38.472497 10522 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:38.475841  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:38.477200  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.520344  5953 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:38.478278 10261 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:38.423148 10501 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.524109  5952 raft_consensus.cc:2376] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9. Re-sending same reply.
W20260620 13:57:38.525214  6552 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletCopyService.EndTabletCopySession -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 95749.2us
I20260620 13:57:38.514806  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.539044  5950 raft_consensus.cc:2393] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 6: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:38.542291  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.543174  5952 raft_consensus.cc:2376] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12. Re-sending same reply.
W20260620 13:57:38.537026  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 366676us
I20260620 13:57:38.545892  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:38.550418  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.551730  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:38.552772  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.561087  5950 raft_consensus.cc:2410] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260620 13:57:38.571758  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:38.537338 10284 raft_consensus.cc:697] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:38.538259 10261 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:38.584789  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:38.590137  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:38.591482  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:38.593989  5875 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:38.594980  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 56838.6us
I20260620 13:57:38.596721  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.597586  5952 raft_consensus.cc:2393] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 10: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:38.599591  5879 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260620 13:57:38.600795  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:38.602540  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:38.609992  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:38.610714  5879 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:38.610473 10261 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:38.611970  5879 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260620 13:57:38.614302 10444 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:38.614859 10444 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:38.615401  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:38.614274  5879 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260620 13:57:38.619192  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 430211us
W20260620 13:57:38.619872  5848 leader_election.cc:336] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.056s (SENT)
I20260620 13:57:38.620738  6580 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260620 13:57:38.621470  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:38.623293  6030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.014s	sys 0.035s
W20260620 13:57:38.623848  6030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.014s	sys 0.035s
I20260620 13:57:38.581805 10449 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:38.631490  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:38.537622 10380 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:38.641238  5953 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 16. Current term is 17. Ops: []
I20260620 13:57:38.641264  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:38.646106  5956 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:38.648088  6584 raft_consensus.cc:2393] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:38.647043  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:38.649873  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:38.658430  5875 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:38.665239  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:38.668576  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:38.592280 10539 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:38.543290 10312 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.674360  5953 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:57:38.674577  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:38.675151  6580 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:38.642011 10549 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:38.685088  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.703586  5956 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:38.705765  5956 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:57:38.717161  5957 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 12: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:38.646674 10051 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260620 13:57:38.723799  5884 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.017s	sys 0.003s
W20260620 13:57:38.724267  5884 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.017s	sys 0.003s
W20260620 13:57:38.718153  5848 leader_election.cc:336] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.962s (SENT)
I20260620 13:57:38.723848  5956 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260620 13:57:38.731504  5848 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.205s (SENT)
I20260620 13:57:38.736685 10284 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:38.720082 10265 consensus_meta.cc:287] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.812s	user 0.011s	sys 0.000s
I20260620 13:57:38.594202 10442 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.770027  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.679201 10512 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260620 13:57:38.805450  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:38.820345  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.821547 10236 consensus_queue.cc:1059] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
W20260620 13:57:38.828424  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 58898.4us
I20260620 13:57:38.830121 10272 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:38.831060  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:38.831746  5875 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:38.831606 10592 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:57:38.832090 10246 raft_consensus.cc:3055] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:38.832459 10246 raft_consensus.cc:740] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:38.833572  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:38.833352 10246 consensus_queue.cc:260] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.801522 10265 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:38.834650 10507 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:38.836653 10265 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:38.838727  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:38.709560 10549 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:38.727027 10531 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:38.849839  6586 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260620 13:57:38.858748  5999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.039s	sys 0.042s
W20260620 13:57:38.859345  5999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.040s	sys 0.042s
W20260620 13:57:38.859889  5955 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.008s	sys 0.039s
W20260620 13:57:38.860282  5955 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.008s	sys 0.039s
W20260620 13:57:38.863092  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:38.883637  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:38.910370  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.912569  5954 raft_consensus.cc:3055] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:38.912984  5954 raft_consensus.cc:740] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:38.845607 10442 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:57:38.926514  5997 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:38.919668  5954 consensus_queue.cc:260] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:38.933595  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 263388us
I20260620 13:57:38.934367  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:38.978083  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:38.922570 10579 log.cc:927] Time spent T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260620 13:57:38.940065  5956 raft_consensus.cc:1240] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260620 13:57:38.982744  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:38.941668  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:38.921044 10262 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:38.917042 10501 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:38.946764 10376 consensus_meta.cc:287] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.003s
W20260620 13:57:38.951511 10401 consensus_meta.cc:287] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.004s
I20260620 13:57:38.956192  5951 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260620 13:57:38.957401  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:39.001856  5959 raft_consensus.cc:2393] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 10: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:39.002101  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:39.002810  5956 raft_consensus.cc:2376] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12. Re-sending same reply.
I20260620 13:57:39.002839  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:38.960760 10261 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:38.962352 10444 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:38.920563 10507 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:57:38.973536  5848 leader_election.cc:336] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.563s (SENT)
I20260620 13:57:38.937508 10539 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:38.977324  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:38.969975 10498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.008s	sys 0.022s
W20260620 13:57:38.991490  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 65098.8us
I20260620 13:57:38.992357  6030 raft_consensus.cc:1240] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260620 13:57:38.971903 10279 consensus_meta.cc:287] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.000s
I20260620 13:57:38.993839  5954 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:38.991348 10380 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:38.989847  5998 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:38.971825 10591 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:39.003774  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:39.004710  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:39.000275 10587 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:39.034484  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:39.000125  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:39.006139  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:39.008880  6029 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
W20260620 13:57:39.023913 10498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.008s	sys 0.022s
I20260620 13:57:39.009275  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:39.026221  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 52714.5us
I20260620 13:57:38.923991 10515 consensus_queue.cc:1059] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
W20260620 13:57:39.084507  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 60080.8us
I20260620 13:57:39.086162  5997 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:39.083398  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:39.089704  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:39.097543  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:39.098477  5956 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:39.050349  5951 raft_consensus.cc:2393] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 12: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:57:39.031644  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 322426us
I20260620 13:57:39.106999  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:39.008721 10376 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:39.115201  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:39.125126  5958 raft_consensus.cc:3055] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:39.125685  5958 raft_consensus.cc:740] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:39.117036  5954 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260620 13:57:39.085472 10593 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:39.030484 10312 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:39.119150  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:39.123494  5955 raft_consensus.cc:3055] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:39.116439  6552 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:39.133345  5848 leader_election.cc:336] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 3.197s (SENT)
I20260620 13:57:39.139137  5848 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:39.103080 10127 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:39.136026  5955 raft_consensus.cc:740] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:39.028880 10444 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.101s
I20260620 13:57:39.145747  6024 raft_consensus.cc:2410] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260620 13:57:39.158558  6578 raft_consensus.cc:2393] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 12: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:57:39.159004  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 169241us
I20260620 13:57:39.008584 10401 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.151885 10416 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260620 13:57:39.152400  5955 consensus_queue.cc:260] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.166185 10401 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:39.166623  5955 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:39.120860 10587 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.168633 10587 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:39.126586  5958 consensus_queue.cc:260] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:39.169317  5958 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:39.173131  6030 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:39.153825  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:39.028697 10539 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.178184  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:39.178862  5875 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:57:39.179265  5955 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260620 13:57:39.150251 10435 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:39.163817 10246 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:39.148227  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 62151us
I20260620 13:57:39.032665 10279 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:39.161136  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:39.157493 10380 raft_consensus.cc:3055] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:57:39.084324 10591 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:39.181414  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:39.151544 10592 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:39.132010  6033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:57:39.130941 10051 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260620 13:57:39.197324  5958 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260620 13:57:39.217900  5958 pending_rounds.cc:85] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 6
I20260620 13:57:39.218297  5958 pending_rounds.cc:107] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260620 13:57:39.218832  5958 raft_consensus.cc:2889] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:39.151672 10549 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:39.186735 10261 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:39.203913  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:39.215123  6033 raft_consensus.cc:606] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Received request to transfer leadership to TS b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:39.229179  5997 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:39.215778  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:39.229928  5955 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
W20260620 13:57:39.217425  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 57709.8us
I20260620 13:57:39.229864  6033 raft_consensus.cc:614] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:39.221396  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:39.160702 10127 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.190676 10614 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:39.160357 10593 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.205226 10380 raft_consensus.cc:740] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:57:39.243007  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:39.245754  5876 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 13: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:39.239259  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:39.201325 10545 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:39.241484  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:39.234721  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:39.180878 10507 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260620 13:57:39.239526  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:39.244668  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:39.280876  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 49624.9us
I20260620 13:57:39.281335  5959 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:39.205341 10312 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:39.249859  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:39.257743  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:39.286164  6031 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
W20260620 13:57:39.264178  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:39.287197  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:39.289979  5998 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:39.292876  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:39.294881  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:39.297050  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:39.240486  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:39.277661  5956 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:39.245530 10454 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:39.304697  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:39.305022  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:39.282248  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:39.308822  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:39.247221 10614 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:39.303416  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:39.249018 10272 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:39.300807  5955 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:39.312027  5956 raft_consensus.cc:3055] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:39.309053  5958 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
W20260620 13:57:39.351342  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:39.353070  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:39.324930  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:39.353196  5956 raft_consensus.cc:740] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:39.285621 10549 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:39.232795 10607 consensus_queue.cc:1059] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260620 13:57:39.364681 10498 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:39.365895  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:39.386669  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:39.300081 10499 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:39.392477  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:39.362200  5956 consensus_queue.cc:260] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:39.389559  5954 raft_consensus.cc:2393] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 13: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:39.411780  5878 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 5 FOLLOWER]: Advancing to term 6
I20260620 13:57:39.296344 10501 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:39.316920 10592 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:39.350628 10590 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:39.304210 10522 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:39.420428  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:39.289963 10545 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.359202 10434 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:39.427282  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:39.292603 10312 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.308415 10608 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:39.350983 10614 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:39.366679 10601 log.cc:927] Time spent T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260620 13:57:39.386081 10498 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:39.442716  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:39.442561  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:39.421106 10416 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:39.521353  5956 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:39.352073 10594 consensus_queue.cc:1059] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260620 13:57:39.290589 10621 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.145s
I20260620 13:57:39.607911  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:39.530995  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:39.317624 10454 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.431546 10284 raft_consensus.cc:3055] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:39.432282 10549 raft_consensus.cc:697] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:39.436316 10607 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:39.545929  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:39.439085 10499 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.533259 10434 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.432471 10501 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.611737  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:39.599653  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 246613us
I20260620 13:57:39.522054 10376 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:39.647845  5956 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260620 13:57:39.638646  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:39.611763  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 321849us
I20260620 13:57:39.365934 10380 consensus_queue.cc:260] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.532063 10282 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:39.680974  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:39.675895  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:39.582692 10620 log.cc:927] Time spent T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260620 13:57:39.682202  6582 raft_consensus.cc:2410] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260620 13:57:39.438709 10522 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:39.597077 10605 log.cc:927] Time spent T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.419s	user 0.001s	sys 0.001s
W20260620 13:57:39.647842 10611 log.cc:927] Time spent T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.424s	user 0.000s	sys 0.001s
I20260620 13:57:39.704627  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2110) took 1101 ms. Trace:
I20260620 13:57:39.705039  5952 rpcz_store.cc:276] 0620 13:57:38.603403 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:38.604287 (+   884us) service_pool.cc:224] Handling call
0620 13:57:38.604582 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:38.604969 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 9
0620 13:57:38.604998 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:38.605460 (+   462us) log.cc:844] Serialized 26 byte log entry
0620 13:57:38.968613 (+363153us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:38.968657 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:38.968730 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:39.704411 (+735681us) raft_consensus.cc:1685] finished
0620 13:57:39.704432 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:39.704567 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":974,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":7107,"thread_start_us":362853,"threads_started":1,"wal-append.queue_time_us":511902}
W20260620 13:57:39.706804 10442 consensus_meta.cc:287] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.783s	user 0.007s	sys 0.003s
I20260620 13:57:39.687958  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:39.655828 10606 log.cc:927] Time spent T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.389s	user 0.001s	sys 0.000s
W20260620 13:57:39.675130 10626 log.cc:927] Time spent T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260620 13:57:39.675676 10618 log.cc:927] Time spent T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260620 13:57:39.697726  5878 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 6.
W20260620 13:57:39.674890 10628 log.cc:927] Time spent T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260620 13:57:39.684500 10279 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:39.615307 10284 raft_consensus.cc:740] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:39.655162 10416 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.615916 10401 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
W20260620 13:57:39.695891 10619 log.cc:927] Time spent T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.383s	user 0.002s	sys 0.000s
I20260620 13:57:39.697752 10591 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:39.708498 10549 consensus_queue.cc:237] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:39.709196 10500 consensus_meta.cc:287] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.361s	user 0.009s	sys 0.004s
I20260620 13:57:39.492900 10590 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.713002 10272 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:39.713871 10593 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:39.649847 10587 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:39.716042 10632 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:39.563637 10498 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:39.685007 10625 log.cc:927] Time spent T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
W20260620 13:57:39.723727  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:39.597504 10261 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:39.596894 10539 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:39.739599  5953 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:39.742352  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:39.743880  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:39.744468  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:39.746932  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:39.752310  6030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4cd17345f80464287c5952767849dbb"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:57:39.756937  5957 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260620 13:57:39.758096 10622 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.110s	user 0.000s	sys 0.006s
I20260620 13:57:39.772477 10592 consensus_queue.cc:1059] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:57:39.773924 10594 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:39.777709  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:39.793322 10394 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:39.768455  6578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46858 (request call id 1125) took 1589 ms (client timeout 1611 ms). Trace:
W20260620 13:57:39.988801  6578 rpcz_store.cc:269] 0620 13:57:38.179237 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:38.180655 (+  1418us) service_pool.cc:224] Handling call
0620 13:57:39.768114 (+1587459us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b540085aa54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:39.768348 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129224448}
I20260620 13:57:39.795120 10307 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:39.708036 10501 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:39.605110 10608 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.016697  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:39.828882  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:40.018563  5878 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:39.708036 10312 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:39.722916 10127 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:39.833514  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:40.028092  5956 raft_consensus.cc:2410] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260620 13:57:39.831815  5997 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:39.733364 10380 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:39.980461 10376 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:39.694810 10282 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:39.815459 10603 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.608s	user 0.006s	sys 0.001s
I20260620 13:57:39.885766  6030 raft_consensus.cc:606] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
W20260620 13:57:39.886113  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:40.033331  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:40.033869  5881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1846) took 1438 ms. Trace:
I20260620 13:57:39.886349 10261 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:39.886737  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:39.887197  5952 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:39.689327 10607 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.888604  5955 raft_consensus.cc:3055] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:40.043764  5955 raft_consensus.cc:740] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:39.890434  5951 raft_consensus.cc:2410] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260620 13:57:39.902225  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:39.969216  5875 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:39.969915  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 1129) took 1632 ms. Trace:
I20260620 13:57:39.969923  6031 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:39.815347 10414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.204s	user 0.024s	sys 0.021s
I20260620 13:57:39.865511 10632 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:39.984627  5879 raft_consensus.cc:2410] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260620 13:57:40.021744 10634 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:39.865075 10593 raft_consensus.cc:3055] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:39.842056 10272 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:39.992007  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 341103us
I20260620 13:57:40.030748 10462 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:40.011056  5876 raft_consensus.cc:1240] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:40.011720  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:40.114336  5957 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 12
I20260620 13:57:39.903345 10051 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:39.903740 10545 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:39.979588 10435 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:39.985302 10592 consensus_queue.cc:1243] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260620 13:57:40.030160  5884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 998) took 1840 ms. Trace:
I20260620 13:57:40.025821  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1847) took 1428 ms. Trace:
I20260620 13:57:39.864439 10587 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:40.121204  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:40.121694  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:40.039191  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 730409us
I20260620 13:57:39.844713 10500 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.045579  6587 rpcz_store.cc:276] 0620 13:57:38.337444 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:38.337580 (+   136us) service_pool.cc:224] Handling call
0620 13:57:38.337871 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:38.461211 (+123340us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:38.461255 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:38.464314 (+  3059us) log.cc:844] Serialized 26 byte log entry
0620 13:57:38.928422 (+464108us) raft_consensus.cc:1645] Marking committed up to 11
0620 13:57:38.928467 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:39.168246 (+239779us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400470ed4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:39.168305 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:39.889498 (+721193us) raft_consensus.cc:1685] finished
0620 13:57:39.889525 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:39.969830 (+ 80305us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6610,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":235756288,"thread_start_us":463664,"threads_started":1,"wal-append.queue_time_us":640076}
I20260620 13:57:39.980538  6026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2484) took 1004 ms. Trace:
I20260620 13:57:39.985018 10512 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
W20260620 13:57:40.045903  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 729794us
W20260620 13:57:40.069276  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:39.839540 10279 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:40.093287  5875 raft_consensus.cc:1240] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:40.094318  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2113) took 1486 ms. Trace:
W20260620 13:57:40.146467  5848 leader_election.cc:336] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.865s (SENT)
I20260620 13:57:40.147022  5848 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:40.148279  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:40.120030  5884 rpcz_store.cc:276] 0620 13:57:38.189476 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:38.189713 (+   237us) service_pool.cc:224] Handling call
0620 13:57:38.190026 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:38.724670 (+534644us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:38.724714 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:38.781259 (+ 56545us) log.cc:844] Serialized 26 byte log entry
0620 13:57:39.118797 (+337538us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:39.118831 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:39.118894 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:40.029903 (+911009us) raft_consensus.cc:1685] finished
0620 13:57:40.029924 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:40.030078 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":64082,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":14936,"thread_start_us":746306,"threads_started":2,"wal-append.queue_time_us":376987}
I20260620 13:57:40.043514 10442 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:40.095134  5878 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260620 13:57:40.034374  5881 rpcz_store.cc:276] 0620 13:57:38.595437 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:38.597422 (+  1985us) service_pool.cc:224] Handling call
0620 13:57:38.613086 (+ 15664us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:38.613280 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 8
0620 13:57:39.051453 (+438173us) log.cc:844] Serialized 14 byte log entry
0620 13:57:39.315074 (+263621us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b180031f9c0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc68540a 00007f0fe5dca5d9 00007f0fdc70d240 00007f0fdc707ce4 00007f0fdc707c55 00007f0fe31f6247 00007f0fdf806d87 00007f0fdf81649f 00007f0fdf816418
0620 13:57:39.315360 (+   286us) log.cc:844] Serialized 14 byte log entry
0620 13:57:39.764792 (+449432us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b180031f9c0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc68540a 00007f0fe5dca5d9 00007f0fdc70d240 00007f0fdc707ce4 00007f0fdc707c55 00007f0fdf7f4440 00007f0fdf806af6 00007f0fdf817667 00007f0fdf8175e8
0620 13:57:39.765377 (+   585us) log.cc:844] Serialized 14 byte log entry
0620 13:57:40.033470 (+268093us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:40.033530 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:40.033600 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:40.033701 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:40.033808 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77792,"prepare.queue_time_us":463495,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":119,"raft.queue_time_us":468826,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":7469,"spinlock_wait_cycles":10849280,"thread_start_us":841470,"threads_started":3,"wal-append.queue_time_us":240517}
W20260620 13:57:40.096578  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:40.158448  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:40.030917 10312 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:40.100467  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:39.993556  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 995) took 1564 ms. Trace:
I20260620 13:57:40.102619  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:40.103590  5955 consensus_queue.cc:260] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.010751 10394 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:40.051894 10414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.441s	user 0.025s	sys 0.025s
W20260620 13:57:40.036375  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 204642us
I20260620 13:57:40.036597 10636 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.123s
I20260620 13:57:40.094745  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:40.151257  5950 rpcz_store.cc:276] 0620 13:57:38.607906 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:38.608126 (+   220us) service_pool.cc:224] Handling call
0620 13:57:38.608397 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:38.608759 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:38.608785 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:38.640894 (+ 32109us) log.cc:844] Serialized 26 byte log entry
0620 13:57:39.150038 (+509144us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:39.150100 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:39.150206 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:39.738847 (+588641us) spinlock_profiling.cc:243] Waited 58.5 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:40.049683 (+310836us) raft_consensus.cc:1685] finished
0620 13:57:40.049715 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:40.094251 (+ 44536us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":88,"spinlock_wait_cycles":134643072,"thread_start_us":436217,"threads_started":1,"wal-append.queue_time_us":741612}
W20260620 13:57:40.183643 10625 log.cc:927] Time spent T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260620 13:57:40.224042  5957 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:40.224804  5953 raft_consensus.cc:2393] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:57:40.154855  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 160575us
W20260620 13:57:40.155388  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:40.149024  6026 rpcz_store.cc:276] 0620 13:57:38.975865 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:38.976016 (+   151us) service_pool.cc:224] Handling call
0620 13:57:39.005009 (+ 28993us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:39.027132 (+ 22123us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:39.027175 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:39.027708 (+   533us) log.cc:844] Serialized 26 byte log entry
0620 13:57:39.232826 (+205118us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:57:39.232867 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:39.232930 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:39.904449 (+671519us) raft_consensus.cc:1685] finished
0620 13:57:39.904478 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:39.980458 (+ 75980us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100373,"raft.queue_time_us":28148,"raft.run_cpu_time_us":566,"raft.run_wall_time_us":54852,"thread_start_us":126548,"threads_started":1,"wal-append.queue_time_us":310782}
I20260620 13:57:40.174531 10442 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:40.184213 10499 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:40.142076 10623 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.404s	user 0.000s	sys 0.000s
I20260620 13:57:40.038173 10236 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260620 13:57:40.195935  5955 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:40.120193  5882 rpcz_store.cc:276] 0620 13:57:38.597880 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:38.618034 (+ 20154us) service_pool.cc:224] Handling call
0620 13:57:38.618325 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:38.618541 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 7
0620 13:57:39.114297 (+495756us) log.cc:844] Serialized 14 byte log entry
0620 13:57:40.024904 (+910607us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:40.024977 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:40.025126 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:40.025617 (+   491us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:40.025751 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":437500,"prepare.queue_time_us":341547,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":439814,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":231416704,"thread_start_us":939551,"threads_started":3,"wal-append.queue_time_us":418905}
W20260620 13:57:40.196945  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 215544us
I20260620 13:57:40.144794 10435 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.194401  5951 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:40.098867 10593 raft_consensus.cc:740] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:57:40.107815  5832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 44168.5us
I20260620 13:57:40.211802  5997 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:40.260950  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 49236.7us
I20260620 13:57:40.262688 10444 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:40.216591  5883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 1000) took 1980 ms. Trace:
I20260620 13:57:40.216779  6031 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:40.045615 10376 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.154381  5849 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:40.277575  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 123275us
I20260620 13:57:40.278443  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:40.278733  5997 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:40.021096 10284 consensus_queue.cc:260] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.142973 10608 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:40.121881 10628 log.cc:927] Time spent T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260620 13:57:40.184636 10439 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:57:40.186551  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:40.231951  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 131587us
I20260620 13:57:40.234669  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:40.144122 10051 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.252312  6551 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:40.221041 10312 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.252369 10647 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:40.340648 10647 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:40.341145 10647 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:40.343791 10539 raft_consensus.cc:3055] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:40.344286 10539 raft_consensus.cc:740] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:40.345319 10539 consensus_queue.cc:260] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:40.289052 10651 consensus_queue.cc:1048] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260620 13:57:40.221782 10640 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:40.352519 10640 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.122849 10462 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:40.258909  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6912815569999111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260620 13:57:40.262902 10631 log.cc:927] Time spent T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
W20260620 13:57:40.355455  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6912815569999111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260620 13:57:40.355831  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6543815569999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260620 13:57:40.263381 10652 consensus_queue.cc:1048] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260620 13:57:40.356117  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6453815569999506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260620 13:57:40.356463  5924 connection.cc:256] RPC call timeout handler was delayed by -1.5949815569999828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
I20260620 13:57:40.356691 10462 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:40.193930  6025 rpcz_store.cc:276] 0620 13:57:38.428901 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:38.430787 (+  1886us) service_pool.cc:224] Handling call
0620 13:57:38.431117 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:38.438246 (+  7129us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:38.438277 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:38.448519 (+ 10242us) log.cc:844] Serialized 52 byte log entry
0620 13:57:38.994967 (+546448us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:38.995025 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:38.995150 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:39.993223 (+998073us) raft_consensus.cc:1685] finished
0620 13:57:39.993246 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:39.993451 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1238,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":12936,"thread_start_us":472798,"threads_started":1,"wal-append.queue_time_us":678887}
I20260620 13:57:40.286701 10621 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260620 13:57:40.357671  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 69087.4us
I20260620 13:57:40.358686  6025 raft_consensus.cc:1240] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:40.302722 10608 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:40.359359 10608 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:40.359840 10608 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:40.263907 10637 log.cc:927] Time spent T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260620 13:57:40.361135  6032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1002) took 1103 ms. Trace:
I20260620 13:57:40.263681 10654 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:57:40.264763 10590 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:40.237361 10442 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:40.365330 10593 consensus_queue.cc:260] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:40.366400 10593 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:40.118335 10634 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:40.367986 10640 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:40.273910  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:40.188519 10279 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.272889  5883 rpcz_store.cc:276] 0620 13:57:38.236176 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:38.237479 (+  1303us) service_pool.cc:224] Handling call
0620 13:57:38.237819 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:38.333321 (+ 95502us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:38.333359 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:38.334213 (+   854us) log.cc:844] Serialized 26 byte log entry
0620 13:57:38.414020 (+ 79807us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b180041b300. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:57:38.912861 (+498841us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:38.912904 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:39.169395 (+256491us) spinlock_profiling.cc:243] Waited 95.1 ms on lock 0x7b540040e554. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:39.169447 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:39.795023 (+625576us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:40.216277 (+421254us) raft_consensus.cc:1685] finished
0620 13:57:40.216312 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:40.216498 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1117,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8796,"spinlock_wait_cycles":232409344,"thread_start_us":498641,"threads_started":1,"wal-append.queue_time_us":766441}
I20260620 13:57:40.119156 10454 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:40.248762 10592 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:40.370417 10650 log.cc:927] Time spent T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260620 13:57:40.370329 10592 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.197633  6581 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:40.302103  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:40.304841 10439 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:40.289004 10633 consensus_queue.cc:1059] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
W20260620 13:57:40.304847 10595 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.001s	sys 0.004s
I20260620 13:57:40.304893 10635 consensus_queue.cc:1059] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260620 13:57:40.308252 10376 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:40.310194 10645 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260620 13:57:40.411506  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:40.312674 10663 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:40.289745 10246 consensus_meta.cc:287] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.077s	user 0.009s	sys 0.004s
I20260620 13:57:40.291178 10657 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:40.315824 10642 log.cc:927] Time spent T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260620 13:57:40.318872 10282 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:40.320645 10394 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:40.322081 10500 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:40.322369 10435 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:40.323261 10594 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:40.323539 10607 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:40.272742 10444 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:40.289697 10638 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.389s	user 0.001s	sys 0.000s
I20260620 13:57:40.268786 10653 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:40.445206 10640 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:40.286939 10501 consensus_queue.cc:1059] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260620 13:57:40.330035 10312 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:40.516541  5881 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:40.472378 10545 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:40.289633 10488 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260620 13:57:40.339375 10414 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:40.340070 10591 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:40.351528 10540 raft_consensus.cc:3055] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 13:57:40.357774  6027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 999) took 1114 ms. Trace:
I20260620 13:57:40.368883 10634 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:40.374150  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 83240.8us
W20260620 13:57:40.300246  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 65691.6us
I20260620 13:57:40.508102 10444 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:40.356742  5924 connection.cc:256] RPC call timeout handler was delayed by -1.5949815569999828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260620 13:57:40.549666  5924 connection.cc:256] RPC call timeout handler was delayed by -1.5670815569999377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260620 13:57:40.550051  5924 connection.cc:256] RPC call timeout handler was delayed by -1.5238815569999815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260620 13:57:40.550383  5924 connection.cc:256] RPC call timeout handler was delayed by -1.4554815569999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
I20260620 13:57:40.213050 10522 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:40.527889 10540 raft_consensus.cc:740] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:40.551332 10312 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:40.551916 10312 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.554092 10312 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:40.361617  6032 rpcz_store.cc:276] 0620 13:57:39.257517 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:39.281744 (+ 24227us) service_pool.cc:224] Handling call
0620 13:57:39.282059 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:39.299327 (+ 17268us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:39.299355 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:39.299811 (+   456us) log.cc:844] Serialized 26 byte log entry
0620 13:57:39.657994 (+358183us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:39.658196 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:39.658302 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:40.360867 (+702565us) raft_consensus.cc:1685] finished
0620 13:57:40.360900 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:40.361063 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26292,"raft.queue_time_us":16959,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":49557,"thread_start_us":264063,"threads_started":1,"wal-append.queue_time_us":467942}
I20260620 13:57:40.554913  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:40.555125  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:40.555763  5958 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 12: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:40.556365  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:40.556998  6032 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:40.557796  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:40.297360  6028 consensus_meta.cc:287] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.000s
W20260620 13:57:40.453934  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:40.410817 10595 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.002s	sys 0.005s
I20260620 13:57:40.466041  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:40.390092 10439 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:40.391142 10279 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:40.476703  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 174731us
W20260620 13:57:40.579752  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:40.504331  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:40.580271  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:40.580621  6584 raft_consensus.cc:2393] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 14: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:40.505839  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:40.508149  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:40.329248 10051 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:40.277411 10416 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:40.586858  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:40.587157  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:40.519560  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:40.584079  6551 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:40.588074  6578 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 17: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:40.519745  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:40.519636  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:40.521708  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:40.578864 10501 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:40.528225  6027 rpcz_store.cc:276] 0620 13:57:39.243709 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:39.243825 (+   116us) service_pool.cc:224] Handling call
0620 13:57:39.244151 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:39.292120 (+ 47969us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:39.292163 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:39.297976 (+  5813us) log.cc:844] Serialized 26 byte log entry
0620 13:57:39.403825 (+105849us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:39.403889 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:39.403989 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:40.357564 (+953575us) raft_consensus.cc:1685] finished
0620 13:57:40.357585 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:40.357716 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58725,"raft.queue_time_us":47823,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":10480,"thread_start_us":96745,"threads_started":1,"wal-append.queue_time_us":535133}
I20260620 13:57:40.475241 10657 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.592171 10501 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:40.592578  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:40.593677  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:40.593832 10657 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:40.594234 10501 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:40.594733  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:40.613788  6027 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:40.550688  5924 connection.cc:256] RPC call timeout handler was delayed by -1.3942815569999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
I20260620 13:57:40.571708  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:40.573359  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:40.614746  5924 connection.cc:256] RPC call timeout handler was delayed by -1.3942815569999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260620 13:57:40.615315  5924 connection.cc:256] RPC call timeout handler was delayed by -1.2898815569999442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
I20260620 13:57:40.570536  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:40.581951 10439 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:40.569517  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:40.571568  5998 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:40.619138  6032 raft_consensus.cc:2393] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 7: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:40.412926 10539 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:40.619606  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 50836.4us
I20260620 13:57:40.621675  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:40.622537  5955 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
W20260620 13:57:40.580693  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:40.624027  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:40.581979  5884 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:40.624954  5953 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:40.556547 10434 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:40.576733 10591 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:40.522867 10640 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:40.626035 10591 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.627641 10640 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:40.501753 10616 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:57:40.591043  6551 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:40.578878 10380 consensus_meta.cc:287] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.002s
I20260620 13:57:40.629892  6033 raft_consensus.cc:2410] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260620 13:57:40.374152  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 149664us
I20260620 13:57:40.630791  5848 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:40.632077 10591 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:40.632705 10669 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:40.633466 10669 consensus_queue.cc:1059] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:57:40.596836  6579 raft_consensus.cc:1240] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:40.634452 10669 raft_consensus.cc:3055] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:40.606752 10670 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:40.635028 10669 raft_consensus.cc:740] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:40.527429 10545 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.612860  6583 raft_consensus.cc:1240] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10. Ops: []
W20260620 13:57:40.527259  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 248887us
I20260620 13:57:40.636487 10669 consensus_queue.cc:260] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.635759 10670 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:40.637233  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:40.637846 10669 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:40.461102 10663 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.616127  5881 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:40.575269  6028 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 17.
W20260620 13:57:40.615674  5924 connection.cc:256] RPC call timeout handler was delayed by -1.2313815569999633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
I20260620 13:57:40.639127 10670 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:40.638926  5956 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
W20260620 13:57:40.639551  5924 connection.cc:256] RPC call timeout handler was delayed by -1.1449815569999373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
W20260620 13:57:40.640038  5924 connection.cc:256] RPC call timeout handler was delayed by -1.1449815569999373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
I20260620 13:57:40.639919 10654 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260620 13:57:40.640723  5924 connection.cc:256] RPC call timeout handler was delayed by -1.1377815569999257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260620 13:57:40.639886 10663 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:40.641467  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:40.642977 10394 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:40.644025 10663 raft_consensus.cc:2764] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260620 13:57:40.645069 10651 consensus_queue.cc:1059] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:57:40.645359  5924 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:40.647174  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:40.647524 10594 raft_consensus.cc:3055] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:40.648149 10640 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:40.649075 10640 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:40.649319 10666 consensus_queue.cc:1059] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:57:40.648178 10594 raft_consensus.cc:740] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:40.651455 10594 consensus_queue.cc:260] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.652405  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:40.653523 10594 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:40.655231  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:40.657948  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:40.659252  5875 raft_consensus.cc:2410] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260620 13:57:40.660310  6032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:57:40.660882  5848 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:40.663558  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:40.663800  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:40.667029  5884 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:40.668140  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:40.668411  5875 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:40.669055  5882 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:40.670768  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:40.671716  5882 raft_consensus.cc:2393] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 11: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:40.671589 10670 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:40.672837 10670 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:40.673357 10670 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:40.674118  5882 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:40.676455  5878 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260620 13:57:40.678524 10614 consensus_meta.cc:287] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 1.074s	user 0.011s	sys 0.002s
W20260620 13:57:40.679352 10615 log.cc:927] Time spent T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 1.375s	user 0.010s	sys 0.005s
I20260620 13:57:40.575829 10608 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:40.681450 10498 consensus_meta.cc:287] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.713s	user 0.000s	sys 0.012s
I20260620 13:57:40.681844 10498 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:40.682653  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:40.682773 10608 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:40.682933  6024 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:40.683801  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 94607.3us
W20260620 13:57:40.693143  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 102177us
I20260620 13:57:40.693507  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:40.520787 10653 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.686067  5848 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:40.661019  6032 raft_consensus.cc:606] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:40.694957  6032 raft_consensus.cc:614] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:40.696161  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:40.697964  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:40.698661  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:40.699528  5876 raft_consensus.cc:2410] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260620 13:57:40.691356  6027 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:40.678969 10614 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:40.614638 10414 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:40.705210  5878 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260620 13:57:40.712355 10442 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:40.713611  6026 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:40.712975  6030 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
W20260620 13:57:40.714583  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:40.716678  6552 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:40.717092  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:40.717533  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:40.717921  5878 raft_consensus.cc:2393] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 10: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:40.718256  5880 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:40.719655 10646 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:40.719797  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:40.720638  5880 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:40.721359  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:40.721494 10640 consensus_queue.cc:1059] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:57:40.721899  5878 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:40.723153 10312 raft_consensus.cc:3055] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:40.723376 10538 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:40.723511 10312 raft_consensus.cc:740] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:40.724416 10312 consensus_queue.cc:260] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:40.684630 10531 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:40.685350 10549 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:40.725906  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:40.695042 10261 consensus_meta.cc:287] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.625s	user 0.012s	sys 0.000s
I20260620 13:57:40.692219 10607 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 13:57:40.727607  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:40.749257  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 47899.2us
W20260620 13:57:40.763331  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:40.695607 10539 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:40.700438 10434 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:40.775287  5882 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:40.777357  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:40.806252  6032 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:40.778723  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260620 13:57:40.716504 10663 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:40.780612 10442 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:40.783183 10592 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:40.782397 10647 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.617096 10272 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:40.792275  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:40.790596  5848 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:40.794708  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:40.799966  6578 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:40.822678  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:40.810025  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:57:40.728678 10312 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:40.703783 10632 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:40.831286  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:40.804891 10434 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:40.842470  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:40.843670  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:40.844551  5881 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:40.845158  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:40.801136  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 71373.4us
I20260620 13:57:40.816417  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:40.824055  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:57:40.828598  5998 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:40.847921  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:40.849248  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:40.849938  6032 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:40.850719 10272 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:40.832971 10279 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:40.775189 10261 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:40.852473  6032 raft_consensus.cc:1240] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260620 13:57:40.853346 10684 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:40.853709 10261 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:40.831933 10640 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:40.854519 10640 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:40.854887 10640 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:40.814500 10051 consensus_queue.cc:1059] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260620 13:57:40.860602 10538 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:40.864114  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:40.844199  6583 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:40.866528  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:40.880736  6581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 1082) took 2259 ms. Trace:
I20260620 13:57:40.883080  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:40.884505  6583 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:40.881229  6581 rpcz_store.cc:276] 0620 13:57:38.606935 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:38.607624 (+   689us) service_pool.cc:224] Handling call
0620 13:57:38.640426 (+ 32802us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:40.371861 (+1731435us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:40.865829 (+493968us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54005bd954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:40.866067 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3580526848}
I20260620 13:57:40.841126 10657 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:40.828622 10531 raft_consensus.cc:697] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:40.796449 10549 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:40.879406 10279 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 13:57:40.862135 10498 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:40.899273 10674 log.cc:927] Time spent T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260620 13:57:40.899631 10671 log.cc:927] Time spent T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260620 13:57:40.917477  6032 raft_consensus.cc:1240] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:40.900177 10261 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260620 13:57:40.925029  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 60995.1us
I20260620 13:57:40.902843 10647 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:40.862881 10434 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:40.913792 10663 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:40.906183  6585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 1089) took 1206 ms. Trace:
I20260620 13:57:40.906832  6587 raft_consensus.cc:1217] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[6.7-6.7]   Dedup: 6.7->[]
I20260620 13:57:40.930915  6587 raft_consensus.cc:1240] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260620 13:57:40.912950  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:40.898984 10051 raft_consensus.cc:3055] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:40.939751  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:40.941450  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:40.840849 10592 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260620 13:57:40.901134 10666 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:40.930299  6585 rpcz_store.cc:276] 0620 13:57:39.699920 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:39.700077 (+   157us) service_pool.cc:224] Handling call
0620 13:57:39.700456 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:39.700743 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 8
0620 13:57:40.091790 (+391047us) log.cc:844] Serialized 14 byte log entry
0620 13:57:40.862766 (+770976us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b180036a720. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdf3a385c 00007f0fdc6edc8b 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b5da
0620 13:57:40.879729 (+ 16963us) log.cc:844] Serialized 14 byte log entry
0620 13:57:40.905690 (+ 25961us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:40.905766 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:40.905831 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:40.905921 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:40.906106 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27530,"prepare.queue_time_us":575422,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":42136,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":17678,"spinlock_wait_cycles":90580608,"thread_start_us":457931,"threads_started":2,"wal-append.queue_time_us":476530}
W20260620 13:57:40.925405  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 96893.3us
W20260620 13:57:40.926932  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 60488.9us
I20260620 13:57:40.927238  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:40.927486  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:40.953308 10670 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:40.953804  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:40.932439  6581 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:40.943780  5924 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:40.954761 10261 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:40.954903  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:40.956483  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:40.955621 10670 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:40.957422 10657 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 13:57:40.957544 10670 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:40.957705  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:40.957952 10657 raft_consensus.cc:697] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:40.958024 10670 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:40.958410  6581 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:40.958585 10670 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:40.956765  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:40.958873 10657 consensus_queue.cc:237] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:40.959581 10261 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:57:40.952823  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:40.961077  6583 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:40.962311 10261 consensus_queue.cc:1059] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:57:40.967795 10670 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:40.970641  5883 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260620 13:57:40.970386 10648 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:57:40.970674 10670 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:40.971951  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:40.972604  5883 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:40.972901 10648 consensus_queue.cc:1059] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:40.977002  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:40.928669 10593 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:40.980947  6032 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:40.939265 10539 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:40.974651  5998 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:40.948568 10279 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:40.938997 10051 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:40.950736 10592 consensus_queue.cc:1243] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260620 13:57:40.939870 10663 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:40.951025 10522 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:40.938868 10646 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260620 13:57:40.990839  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 162065us
I20260620 13:57:40.995635  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:40.997431  5849 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:40.982546 10414 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:41.003574  6032 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:40.951328 10669 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260620 13:57:41.006319  5883 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:57:41.014768  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:41.015020  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:41.013156  5848 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:41.013134 10627 log.cc:927] Time spent T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 1.397s	user 0.006s	sys 0.009s
I20260620 13:57:40.991358 10531 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.025507  6032 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:57:41.027858 10689 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:41.030299 10689 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:41.030728 10689 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:41.028800  6552 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:41.032200  6031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2780) took 1605 ms (client timeout 1984 ms). Trace:
W20260620 13:57:41.032620  6031 rpcz_store.cc:269] 0620 13:57:39.426352 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:39.638325 (+211973us) service_pool.cc:224] Handling call
0620 13:57:41.032029 (+1393704us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54004006d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:41.032130 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572270336}
W20260620 13:57:41.033542  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:41.033785  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:41.035877  6026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2495) took 1384 ms. Trace:
I20260620 13:57:40.976544 10666 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.036461  6026 rpcz_store.cc:276] 0620 13:57:39.652001 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:40.227046 (+575045us) service_pool.cc:224] Handling call
0620 13:57:40.254161 (+ 27115us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:40.714288 (+460127us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:41.035588 (+321300us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b5400059bd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:41.035780 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1056256768}
I20260620 13:57:41.003153 10663 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:41.005653 10414 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:41.003927 10646 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:41.024509 10686 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260620 13:57:41.040979  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 84563.1us
I20260620 13:57:40.990087 10593 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:41.050138  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:41.007205 10688 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:41.083051  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:41.037587 10587 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.047223 10414 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:41.041520 10651 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:41.041520 10594 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:41.047448 10646 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:41.106698  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:41.109905  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:41.110450  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:41.110594  6032 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
W20260620 13:57:41.094367  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 119799us
I20260620 13:57:41.111394  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:41.112133  6031 raft_consensus.cc:2393] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 9: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:41.113916 10695 log.cc:927] Time spent T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260620 13:57:41.095340 10522 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:41.115028 10694 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:57:41.116402 10613 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 1.583s	user 0.001s	sys 0.003s
I20260620 13:57:41.117838  5877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1854) took 2518 ms. Trace:
I20260620 13:57:41.118237  5877 rpcz_store.cc:276] 0620 13:57:38.599847 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:38.616411 (+ 16564us) service_pool.cc:224] Handling call
0620 13:57:38.616751 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:38.617093 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:38.617121 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:38.617575 (+   454us) log.cc:844] Serialized 26 byte log entry
0620 13:57:39.012883 (+395308us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:57:39.012924 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:39.012988 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:41.115794 (+2102806us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b24000fa088. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc591614 00007f0fdc58f71b 00007f0fdc74a619 00007f0fdc74a2a5 00007f0fdc7498ed 00007f0fdf37f4ae 00007f0fdf396c2c 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1
0620 13:57:41.117526 (+  1732us) raft_consensus.cc:1685] finished
0620 13:57:41.117551 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:41.117777 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1426,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":20373,"spinlock_wait_cycles":30160640,"thread_start_us":394815,"threads_started":1,"wal-append.queue_time_us":741054}
I20260620 13:57:41.119451 10683 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:41.120420  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:41.120203 10683 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.121708  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:41.122488 10683 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.101001 10647 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:41.124146  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:41.124370  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:41.125346  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:41.126260 10666 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.126291  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:41.082201 10653 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.107069  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:41.129480  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:41.129698  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:41.130453  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:41.092166 10688 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:41.133270  6027 raft_consensus.cc:2393] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:41.134477 10688 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:41.132258  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:41.135248 10279 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:41.133634  5883 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:41.122829  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:41.135810 10279 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.136647  5877 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:41.138258  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:41.138597 10279 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.138788  5877 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:41.133474  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:41.139819  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:41.140014  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:41.140413  5875 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:41.143522 10670 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 13:57:41.144713  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:41.145339  5956 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:41.144716 10640 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.146354  5877 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:41.147881  6584 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:41.148276 10640 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.149428 10684 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:41.150488  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:41.150324 10689 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.151254  5956 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:41.153294  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:41.153986  5956 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:41.158942  5951 raft_consensus.cc:1240] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260620 13:57:41.161150 10593 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.163523  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:41.167045  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:41.169929  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 58185.1us
I20260620 13:57:41.172799  5875 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:41.170845  5998 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:41.186299  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:41.142887 10312 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:57:41.214367  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:41.216563  5950 pending_rounds.cc:85] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 6
I20260620 13:57:41.107743 10272 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:41.216907  5950 pending_rounds.cc:107] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260620 13:57:41.217468  5950 raft_consensus.cc:2889] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:41.216699  5998 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:41.046793 10051 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.111760 10594 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:41.209048 10648 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:41.170675 10279 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:41.223192  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:41.220168 10587 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:41.221180 10272 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:41.335141  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:41.226339 10498 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:57:41.329578 10439 consensus_meta.cc:287] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.008s
I20260620 13:57:41.210047 10634 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:41.165094 10651 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:41.226835  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 194012us
I20260620 13:57:41.213181 10434 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:41.339990  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 116932us
W20260620 13:57:41.232542 10444 consensus_meta.cc:287] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.662s	user 0.013s	sys 0.006s
I20260620 13:57:41.363685  6552 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:41.212108 10401 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260620 13:57:41.347412  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 302311us
I20260620 13:57:41.228992 10594 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:41.229164 10648 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:41.356019  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:41.225572 10639 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260620 13:57:41.393196  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:41.349228 10702 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:41.399353  6582 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
W20260620 13:57:41.399636 10696 log.cc:927] Time spent T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260620 13:57:41.400338 10434 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:41.403848  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:41.411140  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:41.410403  5924 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:41.408905  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:41.412352  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:41.343557 10621 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:41.344180 10272 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:41.414268  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:41.416867  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:41.418234  6027 raft_consensus.cc:1240] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:41.419035  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:41.424350  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:41.396086 10648 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:41.425633  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:41.426761  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:41.429987  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:41.405141 10498 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:41.433807  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:41.406622 10607 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:41.437444  5848 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:41.438403  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:41.410930 10689 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.422376 10621 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:41.440641 10703 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260620 13:57:41.420521 10279 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election won for term 12
W20260620 13:57:41.441731  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:41.364086 10634 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.433219 10498 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:41.404492 10401 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:41.446987  5848 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:41.424979 10657 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:41.395931 10444 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:41.474057 10444 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:41.353964 10439 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:41.475618 10279 raft_consensus.cc:697] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:41.476855 10439 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:41.476691 10279 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.478217  6025 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260620 13:57:41.479156  5878 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:41.479285 10401 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:41.480154 10657 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:41.480618 10657 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:41.421619 10669 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:41.483425  5848 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:41.413578 10702 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.486992 10592 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:41.487241 10684 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:41.452576 10621 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:41.487541 10439 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:41.494189 10697 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:41.494808 10704 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:41.468027 10651 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.482441 10498 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:41.484375 10669 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:41.452826 10646 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.448818 10607 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:41.511538  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 109769us
W20260620 13:57:41.508759  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 145173us
I20260620 13:57:41.500299 10684 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:41.532930  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:41.504854 10439 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:41.519188  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:41.538348  6027 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:41.500022 10592 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:41.517032 10704 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:41.515187 10669 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:41.538940 10439 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:41.549302 10700 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260620 13:57:41.550002 10634 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.553115 10594 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.639653 10594 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.555362 10592 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:41.554874 10648 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.642580 10648 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.514726 10697 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:41.568696 10646 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:41.568781 10607 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.643471 10697 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:41.570621 10380 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:41.577948 10401 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:41.645705 10401 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:41.567000 10587 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:41.584501 10702 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:41.584874 10658 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:57:41.578457 10540 consensus_queue.cc:260] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:41.535065 10684 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:41.649291 10540 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 5 FOLLOWER]: Advancing to term 6
W20260620 13:57:41.609652  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:41.614856 10539 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:41.651369 10539 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:41.642580 10272 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:41.653421 10539 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:41.517130 10663 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.655179  5952 raft_consensus.cc:2393] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:41.656102 10663 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.661300 10614 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:41.663260 10284 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:41.667085  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2497) took 2014 ms. Trace:
I20260620 13:57:41.667522  6025 rpcz_store.cc:276] 0620 13:57:39.652609 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:40.359516 (+706907us) service_pool.cc:224] Handling call
0620 13:57:40.359925 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:41.478780 (+1118855us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:41.666799 (+188019us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000596d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:41.667017 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2570801920}
I20260620 13:57:41.629165  6030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2776) took 2329 ms. Trace:
I20260620 13:57:41.671425  6030 rpcz_store.cc:276] 0620 13:57:39.306678 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:40.046707 (+740029us) service_pool.cc:224] Handling call
0620 13:57:40.047015 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:40.714817 (+667802us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:41.628903 (+914086us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b54000b72d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:41.629093 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531086080}
I20260620 13:57:41.629985  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 1100) took 1053 ms. Trace:
W20260620 13:57:41.635893 10414 consensus_meta.cc:287] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.002s
W20260620 13:57:41.636381  6028 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2777) took 2280 ms (client timeout 1981 ms). Trace:
W20260620 13:57:41.677004  6028 rpcz_store.cc:269] 0620 13:57:39.356005 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:39.365661 (+  9656us) service_pool.cc:224] Handling call
0620 13:57:41.636156 (+2270495us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54001c8c54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:41.636282 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823262464}
I20260620 13:57:41.599295 10704 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:41.673174  6579 rpcz_store.cc:276] 0620 13:57:40.576118 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:40.591678 (+ 15560us) service_pool.cc:224] Handling call
0620 13:57:40.596656 (+  4978us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:40.634943 (+ 38287us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:41.629810 (+994867us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b540043bf50. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:41.629929 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10752896}
I20260620 13:57:41.680377 10414 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.698299 10272 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:41.703022  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:41.703152 10414 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:41.703878 10665 log.cc:927] Time spent T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 1.230s	user 0.000s	sys 0.004s
I20260620 13:57:41.700251 10621 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.705652  6032 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:41.706221 10697 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.707723 10621 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.714201  6586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 1131) took 2113 ms. Trace:
I20260620 13:57:41.714821  6586 rpcz_store.cc:276] 0620 13:57:39.600916 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:39.602126 (+  1210us) service_pool.cc:224] Handling call
0620 13:57:39.602637 (+   511us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:40.057817 (+455180us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:40.057863 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:40.109020 (+ 51157us) log.cc:844] Serialized 590 byte log entry
0620 13:57:40.293250 (+184230us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:40.293558 (+   308us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:40.293833 (+   275us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:41.703219 (+1409386us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:41.713852 (+ 10633us) raft_consensus.cc:1685] finished
0620 13:57:41.713877 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:41.714120 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96773,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":8094592,"thread_start_us":473263,"threads_started":2,"wal-append.queue_time_us":272830}
I20260620 13:57:41.731462  6582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 1141) took 1003 ms. Trace:
I20260620 13:57:41.734004  6582 rpcz_store.cc:276] 0620 13:57:40.727805 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:40.727974 (+   169us) service_pool.cc:224] Handling call
0620 13:57:40.728263 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:41.405074 (+676811us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:41.731092 (+326018us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54005113d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:41.731387 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542850816}
I20260620 13:57:41.729431 10545 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:41.715574 10669 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.757192 10394 raft_consensus.cc:3055] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:41.757555 10507 raft_consensus.cc:3055] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:41.757684 10394 raft_consensus.cc:740] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:41.758020 10507 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:41.758854 10394 consensus_queue.cc:260] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:41.759178 10507 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.760025 10394 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:41.760438 10507 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:41.770545 10632 raft_consensus.cc:1064] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:57:41.755707 10684 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.779583 10697 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:41.812275  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 392202us
W20260620 13:57:41.819422  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 263484us
W20260620 13:57:41.819621  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:41.834934  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:41.837435  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 301825us
W20260620 13:57:41.841449  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:41.822240  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:41.845993 10236 consensus_queue.cc:1059] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260620 13:57:41.851401 10236 raft_consensus.cc:3055] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:41.853643 10279 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:41.852483 10236 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:41.857748 10236 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.852403  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:41.864600 10697 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:41.866119  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:41.871848 10632 raft_consensus.cc:1068] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Unable to promote non-voter b0ce39342d8c4a64904b30b98de02b9f: Service unavailable: leader transfer in progress
I20260620 13:57:41.876780 10663 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:41.877996 10663 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:41.880899  6024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2779) took 2465 ms (client timeout 1681 ms). Trace:
W20260620 13:57:41.881495  6024 rpcz_store.cc:269] 0620 13:57:39.415691 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:39.494576 (+ 78885us) service_pool.cc:224] Handling call
0620 13:57:41.880220 (+2385644us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000e56d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:41.880563 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2459687168}
I20260620 13:57:41.882280 10684 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.775076 10657 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.884194  6029 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 10. Current term is 12. Ops: [10.7-10.7]
I20260620 13:57:41.886610 10657 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.883693 10545 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:57:41.888338  5884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1860) took 1236 ms. Trace:
I20260620 13:57:41.888532 10545 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 15 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:41.888774  5884 rpcz_store.cc:276] 0620 13:57:40.651975 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:40.652113 (+   138us) service_pool.cc:224] Handling call
0620 13:57:41.887712 (+1235599us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5400324954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:41.888033 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31823744}
I20260620 13:57:41.890494  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:41.893013  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1870) took 1197 ms. Trace:
I20260620 13:57:41.890384 10545 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.893502  5882 rpcz_store.cc:276] 0620 13:57:40.695745 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:40.695867 (+   122us) service_pool.cc:224] Handling call
0620 13:57:41.892503 (+1196636us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b54001f36d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:41.892797 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83427712}
I20260620 13:57:41.894091  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:41.898000  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 1095) took 1394 ms. Trace:
I20260620 13:57:41.899655  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:41.900215 10669 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.901350 10669 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:41.902247 10663 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:41.902078 10669 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:41.903384 10265 consensus_queue.cc:1175] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "663684cf4ae54c929bf8240ca0b63a47" responder_term: 10 status { last_received { term: 10 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 10 index: 10 } }
I20260620 13:57:41.898558  6587 rpcz_store.cc:276] 0620 13:57:40.503305 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:40.504838 (+  1533us) service_pool.cc:224] Handling call
0620 13:57:40.906699 (+401861us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:40.931428 (+ 24729us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:41.897436 (+966008us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540028cb50. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:41.897716 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923423104}
I20260620 13:57:41.886961  6029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2770) took 2615 ms. Trace:
I20260620 13:57:41.901755  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:41.914198  6029 rpcz_store.cc:276] 0620 13:57:39.271939 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:39.991447 (+719508us) service_pool.cc:224] Handling call
0620 13:57:41.883504 (+1892057us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:41.884763 (+  1259us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:41.886595 (+  1832us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54000e56d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:41.886844 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4350161664}
I20260620 13:57:41.866056 10697 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.916893  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:41.917681 10439 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.932756  5879 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:41.931527  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:41.936519  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:41.943902 10697 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.944780  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:41.946137  6028 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 13: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:41.951659  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:41.952330  6033 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2774) took 2660 ms (client timeout 1979 ms). Trace:
W20260620 13:57:41.953006  6033 rpcz_store.cc:269] 0620 13:57:39.291364 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:39.324542 (+ 33178us) service_pool.cc:224] Handling call
0620 13:57:41.951725 (+2627183us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000b7cd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:41.952051 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2932528512}
I20260620 13:57:41.953987  5883 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:41.961311  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:41.963619  6587 raft_consensus.cc:2393] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:41.964967  6584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 1101) took 1379 ms. Trace:
I20260620 13:57:41.965492  6584 rpcz_store.cc:276] 0620 13:57:40.585278 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:40.586606 (+  1328us) service_pool.cc:224] Handling call
0620 13:57:41.964535 (+1377929us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54005d34d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:41.964737 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327152384}
I20260620 13:57:41.966801  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:41.970255  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:41.971318  5876 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:41.972600  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:41.971349 10657 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:41.973912  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:41.963514 10663 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:41.979246 10236 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:41.987596  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:41.988471 10704 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:41.998313 10704 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:41.998996  5881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1861) took 1341 ms. Trace:
I20260620 13:57:41.999951  5881 rpcz_store.cc:276] 0620 13:57:40.657075 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:40.663381 (+  6306us) service_pool.cc:224] Handling call
0620 13:57:41.998536 (+1335155us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54003facd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:41.998759 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352006912}
I20260620 13:57:41.997538 10444 raft_consensus.cc:2955] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Committing config change with OpId 11.8: config changed from index 5 to 8, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:42.001618 10669 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:42.009066  5880 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:42.010708 10657 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.008917  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:41.985625 10663 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:42.008900  5997 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:42.017015 10663 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:42.031016  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:42.033041  6586 raft_consensus.cc:2410] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260620 13:57:42.033671 10549 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:42.034173  5882 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 13: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:42.035465 10312 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election won for term 12
W20260620 13:57:42.047363  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:42.061698  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:42.068998 10591 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:42.069803 10591 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:42.075399  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:42.076076 10498 consensus_meta.cc:287] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.011s
I20260620 13:57:42.076577 10498 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.040550 10312 raft_consensus.cc:697] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:42.092027  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:42.082362 10632 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:42.076483  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:42.082901 10439 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:42.098771  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:42.100567  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 137572us
I20260620 13:57:42.102562  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:42.102965  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:42.108142  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:42.110792 10640 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:42.111130  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:42.111433 10640 raft_consensus.cc:697] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:57:42.112458  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:42.112954 10051 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:42.112818 10640 consensus_queue.cc:237] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.098939 10632 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:42.122058  5879 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:42.127197  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:42.128615  5950 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 17.
I20260620 13:57:42.117264 10657 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:42.142647 10439 consensus_queue.cc:1059] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:42.139355 10498 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:42.147948 10312 consensus_queue.cc:237] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:42.151998  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 143248us
W20260620 13:57:42.156345 10732 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.115s	user 0.001s	sys 0.001s
I20260620 13:57:42.131670 10632 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:42.167059  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.197897  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:42.172483 10279 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:42.205945  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:42.209084  5953 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:42.215952  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:42.218712  6587 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
W20260620 13:57:42.223670  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 64020.3us
I20260620 13:57:42.223964 10621 consensus_queue.cc:1059] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:42.225455 10621 raft_consensus.cc:3055] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:42.225539 10705 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260620 13:57:42.225960 10621 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:42.227039 10652 consensus_queue.cc:1059] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260620 13:57:42.227252 10621 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.228856 10621 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:42.230098 10439 consensus_queue.cc:1059] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:57:42.231428 10439 raft_consensus.cc:3055] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:42.231917 10439 raft_consensus.cc:740] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:42.233465 10439 consensus_queue.cc:260] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.236745  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.238540  5959 raft_consensus.cc:1240] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:42.244956  5849 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:42.247020 10704 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:57:42.248353  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 66591.3us
I20260620 13:57:42.249629  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:42.217386 10657 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:42.251705 10657 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:42.252154 10657 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:42.257702  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:42.265802  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 154878us
I20260620 13:57:42.267045 10394 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:42.267319  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:57:42.267655 10394 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:42.268050 10394 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:42.268951 10697 consensus_queue.cc:1059] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:57:42.276973  5953 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:42.294662  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.293092  6586 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:42.300706  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:42.305639  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:42.311918  5879 raft_consensus.cc:2393] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 12: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:42.316505  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.316355  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:42.298008  5998 leader_election.cc:336] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 1.611s (SENT)
I20260620 13:57:42.327766  5959 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 14. Current term is 15. Ops: []
W20260620 13:57:42.336351  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:42.332067  5998 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:42.342657  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:42.327557 10684 raft_consensus.cc:3055] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:42.345885  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:42.344017 10439 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:42.393724 10591 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:42.394502 10507 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:42.395262 10691 raft_consensus.cc:3055] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:42.396603  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:42.398517  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:42.350850 10697 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:42.348551 10684 raft_consensus.cc:740] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:42.399928  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:42.405463 10738 log.cc:927] Time spent T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260620 13:57:42.403975  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 71954us
W20260620 13:57:42.405663  6578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46858 (request call id 1144) took 1610 ms (client timeout 1611 ms). Trace:
I20260620 13:57:42.405938  5878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2793) took 1299 ms. Trace:
I20260620 13:57:42.410735  6029 raft_consensus.cc:1275] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260620 13:57:42.413364  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:42.384405  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:42.397104  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:42.422760  5878 rpcz_store.cc:276] 0620 13:57:41.106006 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:41.106158 (+   152us) service_pool.cc:224] Handling call
0620 13:57:41.106546 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:41.479591 (+373045us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:42.405458 (+925867us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b5400324454. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:42.405743 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856410368}
I20260620 13:57:42.396013 10691 raft_consensus.cc:740] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:42.445312 10691 consensus_queue.cc:260] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.424901 10507 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:42.436065  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.447643 10507 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.448681  6582 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260620 13:57:42.449229  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:42.450788  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.451367 10669 raft_consensus.cc:3055] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:42.451789 10669 raft_consensus.cc:740] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:42.452335  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.453732  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.453517 10684 consensus_queue.cc:260] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.454938 10684 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:42.457564 10394 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.458134 10748 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:42.458876 10748 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.460242  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:42.460896  5950 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:42.461357 10748 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:42.462041  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:42.461930  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:42.462899  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:42.464007  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:42.428825  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:42.465508  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:42.466655  6033 raft_consensus.cc:2410] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260620 13:57:42.467374  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:42.467590  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:42.468274  6027 raft_consensus.cc:2376] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 17. Re-sending same reply.
I20260620 13:57:42.469620  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:42.429674  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:42.470602  6025 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 13: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:42.422676  6578 rpcz_store.cc:269] 0620 13:57:40.794625 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:40.823050 (+ 28425us) service_pool.cc:224] Handling call
0620 13:57:42.402786 (+1579736us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540085aa54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:42.405473 (+  2687us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2428692352}
I20260620 13:57:42.470993  5882 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
W20260620 13:57:42.435608 10746 log.cc:927] Time spent T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260620 13:57:42.434113  5883 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 12: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:42.471863  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:42.436918 10608 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:42.472260 10632 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.473224 10608 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.474598  5848 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:42.465548  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:42.476085  6030 raft_consensus.cc:2393] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 13: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:42.476733 10741 log.cc:927] Time spent T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.292s	user 0.000s	sys 0.002s
I20260620 13:57:42.476965 10652 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260620 13:57:42.439388  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 151580us
I20260620 13:57:42.477866  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:42.478506  6032 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:42.440102 10697 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.481570 10697 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:42.472653  6029 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:42.483521  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:42.484377  5880 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:42.485841  6028 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:42.487154 10608 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:42.487512 10636 consensus_queue.cc:1059] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:42.488756 10715 consensus_queue.cc:1059] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:42.489924  5876 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:42.490077 10715 raft_consensus.cc:3055] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:42.490624 10715 raft_consensus.cc:740] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:42.491740 10715 consensus_queue.cc:260] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.493170 10715 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:42.494309  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:42.441152  5959 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:42.425827 10663 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.436405  5958 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:42.500123  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.500339  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:42.501464  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.436023 10703 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:42.502269  5959 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:42.502350 10703 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:42.502882 10703 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:42.504822  5953 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:42.496724 10265 raft_consensus.cc:3055] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:42.506510 10265 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:42.507504 10265 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.508855 10265 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:57:42.508926 10745 log.cc:927] Time spent T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.093s	user 0.000s	sys 0.003s
W20260620 13:57:42.497087 10743 log.cc:927] Time spent T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.210s	user 0.000s	sys 0.004s
I20260620 13:57:42.495383  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:42.501552  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.515515  5958 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:42.452787 10669 consensus_queue.cc:260] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.519917  5957 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
W20260620 13:57:42.520326 10742 log.cc:927] Time spent T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.299s	user 0.002s	sys 0.000s
I20260620 13:57:42.523051  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.523975  5955 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:42.524039 10499 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:42.524801 10499 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.528964 10697 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:42.529820 10697 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.532850 10697 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:42.526963 10499 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:42.536602  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:42.537729 10740 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.352s	user 0.002s	sys 0.000s
I20260620 13:57:42.538690  5950 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 5. Current term is 6. Ops: []
I20260620 13:57:42.488752 10636 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:42.543769 10636 raft_consensus.cc:697] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:42.543514 10657 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.544891 10636 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.546562 10657 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:42.534952 10663 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:42.547911  5957 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260620 13:57:42.551771 10691 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:42.553310 10394 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:42.553673 10632 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:42.557247  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:42.558772 10703 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.585152  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:42.559809  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.560491 10312 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:42.560684 10279 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:42.561355 10748 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:42.563344  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:42.563613  5958 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:42.569141  6024 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:42.598592  5950 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260620 13:57:42.505834  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.454962  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.601670  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:42.607620  5958 raft_consensus.cc:1275] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260620 13:57:42.582172  6032 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:57:42.583612  6028 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260620 13:57:42.607511 10715 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:42.617048  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:42.580392  5955 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:42.615697  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:42.604821 10312 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.621201 10715 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.623196 10715 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:42.623344 10279 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:42.624986  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 61771us
I20260620 13:57:42.625442 10279 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:42.625846  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:42.619024 10748 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:42.628268 10663 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:42.633023 10657 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:42.643983  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:42.628770 10748 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:42.656971  5959 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:42.659029  5882 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260620 13:57:42.661231  5957 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:42.623196 10312 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:42.675345  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:42.671716 10261 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:42.677170  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:42.681495  5998 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.193:46177 timed out after 1.963s (SENT) [suppressed 14 similar messages]
I20260620 13:57:42.681150 10261 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.687849  5997 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:42.655306 10632 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:42.686735 10697 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:42.668865 10394 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:42.683375 10748 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:42.681600 10499 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:42.711781  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:42.714829  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:42.714207 10608 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260620 13:57:42.719988  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:42.720770  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:42.718976 10394 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.690322 10657 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:42.683674 10279 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:57:42.724582  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:42.731141  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:42.735091  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 108018us
I20260620 13:57:42.726598  5884 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:42.734272  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:42.738490 10261 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:42.738600  5875 raft_consensus.cc:1275] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260620 13:57:42.726439 10703 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:42.739282  5875 pending_rounds.cc:85] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 4
I20260620 13:57:42.739722  5875 pending_rounds.cc:107] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260620 13:57:42.740041  5875 raft_consensus.cc:2889] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:42.714558 10697 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.727396 10608 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:42.743511 10608 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:42.743193 10279 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.745399 10279 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:42.699167  5952 raft_consensus.cc:2955] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 5 to 8, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:42.749150  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:42.745234 10697 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:42.749552  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:42.755019  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:42.716182 10632 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.770761  5883 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:42.729228 10499 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:42.798421 10444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.005s	sys 0.016s
I20260620 13:57:42.799060  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:42.770324 10261 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:42.801635  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 52205.6us
I20260620 13:57:42.749828 10657 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.765265 10279 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:42.803117  6584 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 13: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:42.807698  6582 raft_consensus.cc:2368] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
W20260620 13:57:42.817494  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 68565us
I20260620 13:57:42.823925 10261 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:42.825682 10697 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:42.826882 10697 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.828125 10703 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:42.829310 10697 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:42.831797 10499 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:42.836694  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:42.838383  6579 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:42.840925  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:42.844345  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:42.850251 10750 log.cc:927] Time spent T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.242s	user 0.000s	sys 0.004s
I20260620 13:57:42.852998  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:42.865962  5883 raft_consensus.cc:2368] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
I20260620 13:57:42.852846  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:42.825944 10632 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:42.869135  5954 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:42.861987 10507 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:42.869105  5878 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 13: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:42.864550  5884 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 13: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:42.875741  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:42.876202  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:42.876901  5884 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:57:42.877215  5883 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:42.879287  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:42.880728  5884 raft_consensus.cc:2376] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7. Re-sending same reply.
I20260620 13:57:42.899055  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:42.899680  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 82718.3us
I20260620 13:57:42.860083 10394 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:42.882647  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:42.901796  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 83040.7us
I20260620 13:57:42.860992 10261 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:42.914006  5881 raft_consensus.cc:2410] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260620 13:57:42.813933 10444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.006s	sys 0.016s
W20260620 13:57:42.911676  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 103879us
I20260620 13:57:42.921200  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:42.926964  6579 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:42.933902  5878 raft_consensus.cc:3060] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 13
I20260620 13:57:42.942445  5997 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:42.944698  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:42.946112  5924 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:42.959666  6578 raft_consensus.cc:2955] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 5 to 8, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:42.963238  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:42.964033  5877 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:42.938227 10657 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:42.967190  5875 raft_consensus.cc:1240] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:42.968667  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:42.969214  5879 raft_consensus.cc:2410] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260620 13:57:42.950938 10279 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:42.952231 10261 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:42.991019  6579 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:42.992816 10261 raft_consensus.cc:697] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:42.993933 10261 consensus_queue.cc:237] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:42.994626  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:42.979038  5954 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:42.981801  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:42.981052  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:42.954809 10663 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:42.996245  5883 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
W20260620 13:57:43.007925  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:43.008163  5877 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:43.010108  5953 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10. Ops: []
W20260620 13:57:43.015419  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 43482.3us
I20260620 13:57:43.016477  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:43.017550 10657 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:57:43.035470  6584 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:43.036121  6028 raft_consensus.cc:1240] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:43.040067  5954 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:43.053185  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:43.057389  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 375892us
I20260620 13:57:43.062181  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:43.049412 10684 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:43.078909  6033 raft_consensus.cc:2393] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:43.054910 10051 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:43.063205 10279 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:43.083083  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:43.047199 10608 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:43.100338  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 57574.2us
I20260620 13:57:43.097314  6028 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 6.
I20260620 13:57:43.105958  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:43.096087 10663 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:43.076327 10507 consensus_queue.cc:1048] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260620 13:57:43.127826  5998 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:43.094194 10684 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:43.134207  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:43.135382  6028 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 13: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:43.141021 10632 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:57:43.141881 10753 log.cc:927] Time spent T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.161s	user 0.002s	sys 0.000s
W20260620 13:57:43.142707  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:43.143882  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:43.121371 10591 consensus_queue.cc:1059] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260620 13:57:43.144474  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:43.144748  6032 raft_consensus.cc:2410] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260620 13:57:43.145169 10591 raft_consensus.cc:3055] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:43.145535 10591 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:43.145560 10697 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:43.145946  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1098) took 1108 ms. Trace:
I20260620 13:57:43.146436  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:43.146245 10697 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:43.155330  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:43.107796 10051 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.147164  6027 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:43.147081  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:43.162247  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:43.161098  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:43.138427 10499 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:43.162818  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:43.161536  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:43.164418  6029 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:43.146653 10591 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.164438  6028 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 13: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:43.129283 10663 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:43.176394  6025 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:43.139918 10657 consensus_queue.cc:1059] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260620 13:57:43.172938 10591 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:43.188151  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 214894us
I20260620 13:57:43.146361  5951 rpcz_store.cc:276] 0620 13:57:42.037745 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:42.085787 (+ 48042us) service_pool.cc:224] Handling call
0620 13:57:42.115171 (+ 29384us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:42.339812 (+224641us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:42.339843 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:42.396350 (+ 56507us) log.cc:844] Serialized 52 byte log entry
0620 13:57:42.754050 (+357700us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:42.763601 (+  9551us) log.cc:844] Serialized 14 byte log entry
0620 13:57:42.768797 (+  5196us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:42.768914 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:43.141245 (+372331us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:43.145447 (+  4202us) raft_consensus.cc:1685] finished
0620 13:57:43.145554 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:43.145769 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":492,"prepare.queue_time_us":9260,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":121112,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":15481,"spinlock_wait_cycles":13780608,"thread_start_us":543228,"threads_started":2,"wal-append.queue_time_us":556318}
I20260620 13:57:43.194667  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:43.171548 10499 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:43.224853  6024 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: []
W20260620 13:57:43.233333  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 137629us
I20260620 13:57:43.233456  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:43.233978  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:43.234445  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:43.234928  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:43.235796  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:43.236407  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:43.240947  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:43.193080 10265 consensus_queue.cc:1059] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260620 13:57:43.240934  6551 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:43.247999  5881 raft_consensus.cc:2393] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 11: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:57:43.249405 10763 log.cc:927] Time spent T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.156s	user 0.000s	sys 0.002s
I20260620 13:57:43.247651  6586 raft_consensus.cc:2376] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12. Re-sending same reply.
I20260620 13:57:43.255642  5876 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260620 13:57:43.244406 10657 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:43.259253  5997 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:43.249150 10608 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:43.292033  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 215772us
W20260620 13:57:43.292558  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 169470us
W20260620 13:57:43.260246 10758 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260620 13:57:43.322696  5998 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:43.426369 10591 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260620 13:57:43.426609  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 104395us
I20260620 13:57:43.277153 10657 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:43.427547 10657 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:43.324692 10051 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:43.292924  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 47199.8us
I20260620 13:57:43.431973  5997 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:43.433715  5997 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:43.319808 10507 raft_consensus.cc:2804] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:43.333268 10434 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.122s
I20260620 13:57:43.333294 10663 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:43.334607 10765 log.cc:927] Time spent T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260620 13:57:43.327153 10769 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:43.356240 10759 log.cc:927] Time spent T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.187s	user 0.000s	sys 0.002s
I20260620 13:57:43.356415 10697 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:43.322422 10684 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:43.357244 10764 log.cc:927] Time spent T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260620 13:57:43.362032 10636 consensus_queue.cc:1059] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:43.363200 10703 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:43.363946 10762 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
W20260620 13:57:43.364436  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 250923us
I20260620 13:57:43.366235 10669 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:43.371277  5849 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:43.371796 10545 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:43.371857 10499 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:43.377524 10748 raft_consensus.cc:3055] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:43.381505  6029 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:43.478210  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:43.394996 10279 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:43.444648 10591 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:43.407243  5878 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
W20260620 13:57:43.417187  5777 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47386 (request call id 235) took 16926 ms (client timeout 15000 ms). Trace:
I20260620 13:57:43.417367 10691 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:43.423314 10767 raft_consensus.cc:3055] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:43.439752 10507 raft_consensus.cc:697] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:43.439879 10773 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:43.440277 10444 consensus_queue.cc:1059] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:57:43.440836 10769 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.479451 10684 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:43.494340 10769 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:43.494803 10507 consensus_queue.cc:237] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:43.497802 10591 raft_consensus.cc:697] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:57:43.498720  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 171639us
I20260620 13:57:43.498850 10591 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.499965  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:43.501488  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:43.502703 10444 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:43.503193 10444 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.505944 10444 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:43.506467 10444 raft_consensus.cc:3055] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:43.490825 10767 raft_consensus.cc:740] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:43.507689  5779 catalog_manager.cc:5696] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:43.508935 10767 consensus_queue.cc:260] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.513561 10771 raft_consensus.cc:1064] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:57:43.478366 10748 raft_consensus.cc:740] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:43.532791 10434 raft_consensus.cc:3055] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:43.534284 10434 raft_consensus.cc:740] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:43.534513 10773 raft_consensus.cc:697] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:43.535616 10773 consensus_queue.cc:237] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:43.509574  5779 catalog_manager.cc:5696] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:43.530803  6029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:57:43.539963  6029 raft_consensus.cc:606] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:43.540329  6029 raft_consensus.cc:614] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:43.539613 10691 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.542500 10691 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:43.543267 10499 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:43.544250 10499 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:43.544734 10499 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:43.545240 10499 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:43.544888  5779 catalog_manager.cc:5696] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 9 to 10, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 10 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:43.506821 10444 raft_consensus.cc:740] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:43.516012 10279 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:43.552510 10444 consensus_queue.cc:260] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:43.554077 10279 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:43.556627  6029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:57:43.560595 10748 consensus_queue.cc:260] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:43.562448 10748 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:43.567219 10663 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:43.546631  5779 catalog_manager.cc:5696] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 6 to 9, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 9 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:43.568413 10663 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.577154 10767 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:43.555383 10444 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:43.484984  5777 rpcz_store.cc:269] 0620 13:57:26.491173 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:26.531821 (+ 40648us) service_pool.cc:224] Handling call
0620 13:57:26.777100 (+245279us) spinlock_profiling.cc:243] Waited 96.8 ms on lock 0x7b540002b7d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf766470 00007f0fdf80531a 00007f0fe55baaac 00007f0fe56b90ae 00007f0fe3b7e4a4 00007f0fe3b7e432 00007f0fe3b7e361 00007f0fe3b7e2dc 00007f0fe3b7d592 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:43.416887 (+16639787us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:57:38.972539 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:57:39.161019 (+188480us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:57:39.171384 (+ 10365us) write_op.cc:435] Acquired schema lock
0620 13:57:39.171408 (+    24us) tablet.cc:662] Decoding operations
0620 13:57:39.280342 (+108934us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:57:39.285235 (+  4893us) write_op.cc:641] Partition lock acquired for write op
0620 13:57:39.294193 (+  8958us) tablet.cc:685] Acquiring locks for 11 operations
0620 13:57:39.618640 (+324447us) tablet.cc:701] Row locks acquired
0620 13:57:39.650524 (+ 31884us) write_op.cc:260] PREPARE: finished
0620 13:57:39.686233 (+ 35709us) write_op.cc:270] Start()
0620 13:57:39.715254 (+ 29021us) write_op.cc:276] Timestamp: P: 1781963859680814 usec, L: 0
0620 13:57:39.715291 (+    37us) op_driver.cc:348] REPLICATION: starting
0620 13:57:39.716330 (+  1039us) log.cc:844] Serialized 4367 byte log entry
0620 13:57:41.582458 (+1866128us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b1800339580. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc707c55 00007f0fdf779570 00007f0fdf772ec7 00007f0fdf7721b9 00007f0fdf77cd10
0620 13:57:41.781706 (+199248us) op_driver.cc:464] REPLICATION: finished
0620 13:57:41.784170 (+  2464us) write_op.cc:301] APPLY: starting
0620 13:57:41.784301 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0620 13:57:42.029206 (+244905us) tablet.cc:1370] finished BulkCheckPresence
0620 13:57:42.029264 (+    58us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:57:42.437902 (+408638us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:57:42.438253 (+   351us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0620 13:57:42.438325 (+    72us) write_op.cc:312] APPLY: finished
0620 13:57:42.438810 (+   485us) log.cc:844] Serialized 105 byte log entry
0620 13:57:42.439049 (+   239us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:42.507310 (+ 68261us) write_op.cc:454] Released schema lock
0620 13:57:42.507413 (+   103us) write_op.cc:341] FINISH: Updating metrics
0620 13:57:42.508112 (+   699us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:42.508146 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":495090,"reported_tablets":29,"spinlock_wait_cycles":222584576,"child_traces":[["op",{"apply.queue_time_us":2098,"apply.run_cpu_time_us":25410,"apply.run_wall_time_us":723862,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50151,"num_ops":11,"prepare.queue_time_us":726864,"prepare.run_cpu_time_us":16778,"prepare.run_wall_time_us":1642238,"raft.queue_time_us":1186325,"raft.run_cpu_time_us":1328,"raft.run_wall_time_us":3279,"replication_time_us":2066254,"spinlock_wait_cycles":53816576,"thread_start_us":1482916,"threads_started":4,"wal-append.queue_time_us":804618,"wal-append.run_cpu_time_us":37422,"wal-append.run_wall_time_us":2917366}]]}
W20260620 13:57:43.603161  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:43.603914  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:43.628051  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 189275us
W20260620 13:57:43.662823  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 330211us
W20260620 13:57:43.470253  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 279164us
W20260620 13:57:43.474749  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:43.738718 10632 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:43.739362 10632 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.476842  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:43.478858  5952 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
W20260620 13:57:43.405776 10760 log.cc:927] Time spent T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.195s	user 0.001s	sys 0.004s
I20260620 13:57:43.740875  5958 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:43.742376 10632 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:43.482374  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:43.743655 10279 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:43.486876  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:43.492115  6551 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:43.699313  5998 leader_election.cc:400] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
I20260620 13:57:43.744372  5953 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 15
I20260620 13:57:43.744603  5998 leader_election.cc:403] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260620 13:57:43.745244  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 46201.9us
I20260620 13:57:43.745518  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:43.746102  5958 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 6.
I20260620 13:57:43.744342 10279 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.747787  5998 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:43.749665 10608 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
I20260620 13:57:43.749306 10279 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:43.750830 10591 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 13:57:43.715656 10663 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:43.716915 10434 consensus_queue.cc:260] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:43.723899  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 222525us
I20260620 13:57:43.750068  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:43.726392  5880 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:43.704690 10507 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:43.706683 10657 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.743757  5951 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:43.480491 10703 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.778693 10512 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:57:43.743975  5997 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:43.779172 10512 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:43.779573 10512 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:57:43.779960  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:43.780474 10703 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:43.780934 10632 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:57:43.781502 10632 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:43.781634  5997 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:43.781894 10632 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:57:43.733541 10771 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.782922  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:43.778254  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 294375us
I20260620 13:57:43.786140 10591 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:43.786598 10591 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:43.787288 10781 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:43.787699 10781 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:43.788054 10781 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:43.788504  6551 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:43.790014 10780 consensus_queue.cc:1059] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:43.790153 10632 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.791366 10780 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:43.791500 10545 raft_consensus.cc:3055] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:43.792186 10545 raft_consensus.cc:740] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:43.792171 10780 raft_consensus.cc:697] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:43.793390 10545 consensus_queue.cc:260] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.794050 10632 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:43.791484 10499 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.793411 10780 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.755086  5849 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:43.794818 10545 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:43.799434 10669 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:43.771555  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 60435.3us
I20260620 13:57:43.786975 10591 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:43.799078  5779 catalog_manager.cc:5696] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 3 to 6, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 6 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:43.751915 10636 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:43.763979 10663 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:57:43.778218  5880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1883) took 1175 ms. Trace:
I20260620 13:57:43.753674 10434 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:43.815733  5880 rpcz_store.cc:276] 0620 13:57:42.603149 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:42.603595 (+   446us) service_pool.cc:224] Handling call
0620 13:57:43.778015 (+1174420us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000c53d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:43.778149 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2528460544}
I20260620 13:57:43.805011 10512 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.806139  5998 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:43.774745  5953 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:57:43.823434  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:43.823800  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:43.824112  6030 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:43.814610 10636 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.824988 10444 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:43.829499 10444 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.830577 10636 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:43.807451 10657 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:43.807180 10507 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.851022  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:43.851898  5880 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:43.847884  5779 catalog_manager.cc:5696] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:43.850299  6029 raft_consensus.cc:606] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:43.853211  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:43.853895  6551 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:43.751005 10279 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260620 13:57:43.868422  5997 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:43.857371  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:43.851020 10769 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260620 13:57:43.859352  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:43.806053 10703 consensus_queue.cc:1059] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260620 13:57:43.861295 10507 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:43.824536 10776 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:43.864271 10657 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:43.854238  6024 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:43.835495 10444 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:43.854955 10632 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 13:57:43.870434 10777 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:43.871016  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:43.911691  5951 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:43.911123  5779 catalog_manager.cc:5696] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 9 to 10, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 10 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:43.871850 10499 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:43.872615  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:43.874521  5884 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:57:43.876226  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:43.878275  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:43.914423  5881 raft_consensus.cc:2410] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:57:43.880731 10591 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.881366 10512 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:43.881636 10691 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:43.884315  5997 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:43.889806  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 83760.2us
I20260620 13:57:43.899861  6586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:43.917928  6586 raft_consensus.cc:606] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:43.903409  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:43.908762  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:43.902750 10669 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:57:43.914736  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 113616us
I20260620 13:57:43.886973 10773 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:43.919373  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:43.918807  6027 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:43.917788  6031 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 7.
I20260620 13:57:43.920578  5849 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:43.923386 10265 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:43.934883  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:43.935089 10265 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:43.920122 10691 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:43.939747  5779 catalog_manager.cc:5696] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 9 to 10, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 10 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:43.948846  5878 raft_consensus.cc:1240] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:43.954089 10591 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:43.917618 10663 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 17 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:43.922740 10773 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:43.937806 10265 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:43.958755  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260620 13:57:43.977766  5779 catalog_manager.cc:5696] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 5 to 11, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 11 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:43.982570  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:57:43.987378 10691 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:43.985870 10773 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:43.977368 10591 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:43.996029 10591 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:43.996655 10591 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:43.950654 10771 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:57:43.954144  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:43.958099 10748 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:43.999351  5779 catalog_manager.cc:5696] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 7 to 8, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 8 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
W20260620 13:57:44.001235  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:44.001731  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 47714.6us
I20260620 13:57:44.009481  5779 catalog_manager.cc:5696] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 7 to 10, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 10 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:57:44.003809  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:44.011916  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 74699.6us
I20260620 13:57:43.956985 10394 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 13:57:44.013441 10394 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:44.013911 10394 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:44.013518 10663 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.013924  5998 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:44.010290  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:44.018170  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:44.023973  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:44.024614  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:44.024745  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:44.025900  5880 raft_consensus.cc:2393] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 11: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:44.019125  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:44.027925  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:44.028973  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:44.029407  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:44.029557 10507 raft_consensus.cc:2804] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:44.029917  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:44.030242 10507 raft_consensus.cc:697] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:44.031721 10507 consensus_queue.cc:237] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:44.025406 10748 raft_consensus.cc:697] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:44.034749  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:44.035909  5875 raft_consensus.cc:2393] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:44.036743  5878 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260620 13:57:44.034125 10394 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:44.038106  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:44.038959  5883 raft_consensus.cc:2393] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:44.026942 10669 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:44.040520 10669 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:44.040745  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:44.040944 10669 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:44.041188  6030 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260620 13:57:44.041569  6032 raft_consensus.cc:2393] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:44.042269  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:44.043150 10394 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:44.043498  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:44.043301  5779 catalog_manager.cc:5696] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:44.044531  5884 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:43.994402 10265 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:44.006072  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:57:44.036268 10748 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.028152  5849 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:44.008808 10691 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:44.065661  5881 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260620 13:57:44.056253  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:44.057214  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 172976us
I20260620 13:57:43.987999 10632 consensus_queue.cc:1048] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260620 13:57:44.072862  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:44.048273  5848 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:44.075290  5997 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:44.075641  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 117824us
I20260620 13:57:44.077528  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:44.077556  5953 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260620 13:57:44.081331  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.081722  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.082198  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.082337  5959 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:44.087051  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:44.088001  5880 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 16.
I20260620 13:57:44.094342  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:44.067567  5779 catalog_manager.cc:5696] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 reported cstate change: config changed from index -1 to 10, term changed from 12 to 15, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to <none>, NON_VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) added. New cstate: current_term: 15 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
I20260620 13:57:44.095278  5951 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 13
I20260620 13:57:44.100119  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:44.101303  6031 raft_consensus.cc:2410] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 14 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260620 13:57:44.102699  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:44.103380  6024 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:44.104640  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:44.094604  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:44.109917  5878 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:57:44.047742 10684 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:44.114459  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:44.114531  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:44.115796  6032 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:44.116528  5877 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:44.117460  6028 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:44.066005 10691 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:44.127435  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:44.074692 10796 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:44.074501 10499 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:44.077972 10279 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:44.127070  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.128317  5959 raft_consensus.cc:2376] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7. Re-sending same reply.
I20260620 13:57:44.117714  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.120222  6031 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260620 13:57:44.138988  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:44.138656  5779 catalog_manager.cc:5696] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 7 to 10, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 10 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:44.110100 10394 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:44.097754 10632 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260620 13:57:44.147578  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 130920us
I20260620 13:57:44.151010  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.147651 10771 raft_consensus.cc:697] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:44.148356 10805 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260620 13:57:44.149459  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 101295us
I20260620 13:57:44.149997  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.110864 10789 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:44.151744  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:44.153035  6028 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 13: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:44.066721 10265 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.151743  5953 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:44.135869 10691 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:44.159631  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.166633  5779 catalog_manager.cc:5696] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:44.166237  6032 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:44.169375  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.170982  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.153982 10632 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:44.171469  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.150446 10499 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:44.167415  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:44.172708  5998 leader_election.cc:400] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
I20260620 13:57:44.152756 10394 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:44.183545  5998 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:44.178686  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:44.178095  5952 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:44.194911  5998 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:44.181952  5779 catalog_manager.cc:5696] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 8 to 9, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 9 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:57:44.183552 10265 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:44.183974 10785 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260620 13:57:44.184432  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.184234 10771 consensus_queue.cc:237] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.203415  5953 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:44.187288 10499 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:44.177774 10632 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:44.191656 10786 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260620 13:57:44.233505  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:44.191460 10791 raft_consensus.cc:2764] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260620 13:57:44.194409  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:44.194993  5955 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:44.217084  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:44.205972  5779 catalog_manager.cc:5696] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:57:44.151974 10796 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.154192 10279 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:44.178083 10805 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:44.204602 10394 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:44.250839  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:44.234692  6578 raft_consensus.cc:2393] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:44.173411 10789 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.238035  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:44.218788 10507 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:44.241009  6027 raft_consensus.cc:2368] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 12. Current term is 13.
I20260620 13:57:44.274139 10507 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:44.214767 10684 raft_consensus.cc:697] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:44.274592 10507 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:44.274996 10507 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:44.275465 10684 consensus_queue.cc:237] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.276244  5957 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:44.274174 10236 raft_consensus.cc:3055] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:57:44.277601 10236 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:44.277786  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:44.263135  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:44.241958  5779 catalog_manager.cc:5696] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 4 to 5, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 5 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:44.245431  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:44.195230 10799 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:44.260064  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 65234.9us
I20260620 13:57:44.308068  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:44.280727  5849 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:44.308887  6579 raft_consensus.cc:2393] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 13: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:44.246786  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 289224us
I20260620 13:57:44.257020  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:44.259210 10805 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.259554  5956 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:44.278847  6578 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 13: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:44.283046  5779 catalog_manager.cc:5696] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 8 to 11, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 11 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
W20260620 13:57:44.315151  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 77361.6us
I20260620 13:57:44.318019  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:44.318668  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:44.315333  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:44.320510  6584 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:44.308806  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:44.257676 10261 raft_consensus.cc:2764] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260620 13:57:44.326159  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:44.326730  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:44.327528  6579 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:44.330222  6024 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:44.331840  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:44.341019  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:44.319900 10663 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:44.324782 10791 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:44.326773 10780 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:44.352481  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:44.352913  5955 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:44.353227  6579 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 7.
I20260620 13:57:44.354611 10806 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:44.264060 10797 consensus_queue.cc:1059] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.174s
I20260620 13:57:44.356628 10796 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:44.331883 10512 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:44.359819  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:44.360685  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:44.354800  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:44.363806  6582 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:44.367559  6584 raft_consensus.cc:2393] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:44.365149  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:44.396283  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:44.397744  6579 raft_consensus.cc:2393] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:44.399264 10265 consensus_queue.cc:1059] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260620 13:57:44.399684 10512 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:44.320950 10236 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.340098 10776 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260620 13:57:44.367040 10051 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:44.377024 10802 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election won for term 7
W20260620 13:57:44.422695  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:44.349071 10773 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:44.351697 10663 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.437206 10051 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:44.450207  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:44.379523 10591 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.433547 10789 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:44.367667 10691 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:44.364053 10748 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260620 13:57:44.326606 10799 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.692768 10591 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:44.693599 10691 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:44.694321 10799 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:44.574613 10236 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:44.694550 10691 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:44.695513  5883 raft_consensus.cc:2393] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 14: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:57:44.576722 10781 consensus_meta.cc:287] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.788s	user 0.007s	sys 0.005s
I20260620 13:57:44.577600  6585 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
W20260620 13:57:44.574848  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:44.578140 10394 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:44.699757 10781 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.701718 10394 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:44.581800  5951 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:44.546376 10807 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election won for term 7
W20260620 13:57:44.594762  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:44.704461  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.705054  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:44.400157 10512 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:44.635264  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:44.714361  6582 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:44.377948 10499 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:44.639812  6025 raft_consensus.cc:2393] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:44.623615 10669 consensus_meta.cc:287] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
I20260620 13:57:44.652266 10632 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:44.653678 10813 log.cc:927] Time spent T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260620 13:57:44.654072 10800 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260620 13:57:44.636731 10802 raft_consensus.cc:697] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:44.655560 10279 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:44.658316 10776 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:44.674921 10051 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:44.675910 10812 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:44.677276 10773 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:44.678848 10814 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260620 13:57:44.679065 10507 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:44.687809 10780 raft_consensus.cc:3055] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:44.613885  6583 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:44.705828  5950 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260620 13:57:44.706503  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:44.781116  6585 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:44.707304  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:44.782311  6579 raft_consensus.cc:2393] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 11: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:44.705824  5951 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:44.717465  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:44.783448  5955 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:44.729347 10807 raft_consensus.cc:697] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:44.719511  6552 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:44.787629  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 68245.1us
I20260620 13:57:44.731737  5953 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:44.730954  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:44.732327  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:44.702369 10394 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:44.738559  6584 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:44.735255  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:44.717703 10767 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:44.702489 10781 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:44.717935 10691 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:44.723412 10512 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:44.802277  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:44.803709  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 68532.2us
I20260620 13:57:44.804190  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:44.804947  6583 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 18: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:44.732460 10669 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.806183  5954 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:44.812350  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:44.768913  6582 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:44.814003  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.728255  5957 raft_consensus.cc:1275] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260620 13:57:44.786430  5996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.022s	sys 0.077s
W20260620 13:57:44.815074  5996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.023s	sys 0.077s
I20260620 13:57:44.715039 10799 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:44.800323  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.728216 10806 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:44.786870 10780 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:57:44.826464  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 517670us
I20260620 13:57:44.822342  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.826846  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.828217  5950 raft_consensus.cc:2410] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260620 13:57:44.820572  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:44.824026  5951 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:44.792531 10434 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:44.832412  5951 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10. Ops: []
W20260620 13:57:44.833596  5924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.020s
W20260620 13:57:44.834014  5924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.000s	sys 0.020s
W20260620 13:57:44.834259  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 511359us
I20260620 13:57:44.836516  5997 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:44.837090  5955 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 7.
I20260620 13:57:44.838536  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:44.839798  5955 raft_consensus.cc:1240] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:44.839864  6027 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260620 13:57:44.840385  6027 pending_rounds.cc:85] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 8
I20260620 13:57:44.840617  6027 pending_rounds.cc:107] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260620 13:57:44.840893  6027 raft_consensus.cc:2889] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:57:44.841727  5958 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.007s	sys 0.013s
I20260620 13:57:44.842850  5953 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:44.843547  5954 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 14. Current term is 15. Ops: []
I20260620 13:57:44.844996  6551 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:44.845992  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 437816us
I20260620 13:57:44.763065 10776 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:44.849576  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:44.859215  6024 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:44.860778  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:44.794705 10394 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:44.861599  6033 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260620 13:57:44.865473  6033 pending_rounds.cc:85] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 9
I20260620 13:57:44.865633  6032 raft_consensus.cc:1240] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 6. Current term is 7. Ops: []
I20260620 13:57:44.865720  6033 pending_rounds.cc:107] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260620 13:57:44.866035  6033 raft_consensus.cc:2889] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:44.860689  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:44.863001  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:44.866962  6025 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 18: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:44.867491  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:44.870450  6027 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:44.863859  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:44.833719 10434 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:44.867873  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:44.865835  5997 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:44.872368  6024 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:57:44.873188  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:44.874114  6551 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:44.860246  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:44.800119 10767 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.875386  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:44.785629 10812 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:44.881582  6586 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.012s	sys 0.017s
W20260620 13:57:44.882157  6586 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.012s	sys 0.017s
I20260620 13:57:44.848362 10800 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:44.850225 10789 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:44.876192 10434 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:44.849179 10805 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:44.884768  5997 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:44.888089  5959 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260620 13:57:44.874828 10703 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:44.888053  5998 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:44.871742  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:44.904452  6578 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:44.849293 10444 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260620 13:57:44.843710 10799 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.876822 10773 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:44.886577 10684 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:44.879667 10657 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:57:44.879417 10809 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:44.893404 10499 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:44.893805 10825 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:44.895237 10608 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:44.888907 10771 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:44.876282 10818 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:44.888747 10591 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:44.906668  6024 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:57:44.909060  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:44.924950  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:44.938692  5953 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:44.875946 10796 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260620 13:57:44.898233 10265 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:57:44.937287  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 49326.5us
I20260620 13:57:44.913627 10791 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:44.939322 10771 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:44.911583 10807 consensus_queue.cc:237] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:44.936882  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:44.909042 10780 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.897675 10800 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.898236 10816 consensus_queue.cc:1059] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.071s
I20260620 13:57:44.915515 10797 consensus_queue.cc:1059] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260620 13:57:44.935672 10809 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.929412 10657 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:44.928218 10795 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 13:57:44.939175 10817 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:44.918668 10773 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:44.940961 10825 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.907163 10789 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.933710 10684 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:44.910480 10279 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:44.961591  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:44.963465  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:44.969806  5998 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:44.970304  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:44.967741  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 58752.4us
I20260620 13:57:44.974146  5953 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:45.000144  6027 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:45.053565  5997 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:44.948510 10812 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:44.972890 10789 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:45.075685 10261 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:45.076051  5924 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:44.978432 10810 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.099s
I20260620 13:57:45.077322  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:45.078104 10823 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:44.861162 10802 consensus_queue.cc:237] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.078625 10823 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:44.962999 10809 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:45.079092 10823 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:44.952953 10507 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:44.970852 10825 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:45.085144  5848 leader_election.cc:336] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.593s (SENT)
I20260620 13:57:45.085956  5951 raft_consensus.cc:2393] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 13: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:44.962790 10703 raft_consensus.cc:3055] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:45.090642 10703 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:45.091665 10703 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.092935 10812 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:45.093466 10812 raft_consensus.cc:697] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:44.957556 10800 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:44.953505 10669 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:44.959982 10781 raft_consensus.cc:3055] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:57:45.095726 10691 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:44.953969 10771 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:44.956063 10394 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:44.948827 10808 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:45.096845 10434 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.097172 10808 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.962395 10795 raft_consensus.cc:697] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:45.100632 10795 consensus_queue.cc:237] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.094293 10812 consensus_queue.cc:237] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:44.948933 10608 raft_consensus.cc:697] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:44.961908 10827 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:45.094470 10512 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.111701 10827 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:45.113190  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 143576us
I20260620 13:57:45.114440 10512 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:45.114714 10827 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:45.096089 10781 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:44.981102 10684 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:44.962116 10657 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:57:44.953454 10791 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:44.967795 10748 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:45.116205 10799 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:45.118090 10776 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:45.120236 10767 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:45.155741  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:45.120427 10771 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:44.963533 10773 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:44.937953 10663 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:45.131928  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 271015us
I20260620 13:57:44.950947 10818 raft_consensus.cc:697] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:45.136404  5848 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:45.137837  6027 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260620 13:57:45.140331  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:45.184737  5883 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:45.142515  6024 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:45.052631 10265 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:44.944969 10591 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.052724 10632 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:45.086423 10789 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:45.161761  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:45.161902  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:45.229038  5878 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
W20260620 13:57:45.148115  5998 connection.cc:256] RPC call timeout handler was delayed by -1.3671489560000509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
I20260620 13:57:45.230297  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:45.121145 10051 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.151582 10434 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:45.163205  6025 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260620 13:57:45.249787  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:45.164192 10819 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260620 13:57:45.255682  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:45.257098 10817 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:45.166610  5884 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260620 13:57:45.167604  5880 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260620 13:57:45.151547 10444 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:45.168229  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:45.264109  5881 raft_consensus.cc:2393] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:45.168722  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:45.265340  5877 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 14: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:45.170725  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:45.171164 10808 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:45.107712 10608 consensus_queue.cc:237] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:45.148396 10791 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:44.937727 10806 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.171496  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:45.178347  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 297096us
I20260620 13:57:45.160534  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:45.275213  5879 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:57:45.202178  6578 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 17. Current term is 18. Ops: []
I20260620 13:57:45.083681 10279 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:45.202451  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:45.203090  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:45.149920  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 295284us
I20260620 13:57:45.281704  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:45.195041 10663 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:44.943953 10822 consensus_queue.cc:1059] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.245s
I20260620 13:57:45.216195  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:45.216569  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:45.201834  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:45.231984  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:45.285637  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:45.235669 10828 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:45.237183  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:45.182601 10684 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:45.240423 10771 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:45.244133 10236 consensus_meta.cc:287] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.549s	user 0.007s	sys 0.003s
I20260620 13:57:45.244705 10781 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:45.247656  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 111359us
I20260620 13:57:45.317380  5848 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:45.255051  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 73194.9us
I20260620 13:57:45.262269  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:45.319568  5883 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:45.199774 10767 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260620 13:57:45.254951 10669 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:45.246673 10748 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:45.283799  5953 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260620 13:57:45.217137 10265 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.298605  6584 raft_consensus.cc:2393] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:45.235988  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:45.299943 10261 raft_consensus.cc:697] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:45.301306 10825 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:45.297559  6580 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:57:45.300261  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:45.311456  5876 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 14: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:45.270459 10810 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:45.275692 10817 raft_consensus.cc:697] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:57:45.315318  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 83460.3us
I20260620 13:57:45.320458  5848 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:45.321836  6583 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:57:45.270656 10444 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:45.342200  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:45.383339  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:45.324329 10789 raft_consensus.cc:3055] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:45.304493 10663 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.349200  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:45.349128  6552 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:45.380987  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 65096.6us
I20260620 13:57:45.246106 10818 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.324476 10776 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:45.392407  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:45.393810 10265 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:45.393446 10261 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.395496 10703 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:45.396129 10051 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:45.397485  5876 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260620 13:57:45.399217  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 99048.9us
I20260620 13:57:45.343600  5883 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
W20260620 13:57:45.384167  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 62043.7us
W20260620 13:57:45.385746  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 65357.5us
I20260620 13:57:45.403121  5848 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:45.346978  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:45.331799 10808 consensus_queue.cc:1175] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b0ce39342d8c4a64904b30b98de02b9f" responder_term: 13 status { last_received { term: 13 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 13 index: 9 } }
W20260620 13:57:45.408187  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 59070.8us
I20260620 13:57:45.442153 10657 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:45.314621 10828 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.408504 10807 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:45.444545 10636 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260620 13:57:45.443945 10805 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:45.444980 10817 consensus_queue.cc:237] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.317277 10684 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:45.448683  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 99675.2us
I20260620 13:57:45.430488 10829 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:45.434190 10834 consensus_queue.cc:1059] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.173s
I20260620 13:57:45.347543 10823 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:45.447451  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 45636.5us
I20260620 13:57:45.382409 10796 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:45.474244  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:45.467403  5849 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:45.489053  5849 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:45.490528  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:45.480569  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 77559.9us
I20260620 13:57:45.405539 10827 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260620 13:57:45.504652  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:45.482151  6552 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:45.484479  5954 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260620 13:57:45.332365 10748 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.470484 10776 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:45.536108  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:45.535713 10835 consensus_queue.cc:1059] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
W20260620 13:57:45.536545  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 54491.8us
I20260620 13:57:45.537596 10835 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:57:45.385653 10789 raft_consensus.cc:740] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:45.491808  5848 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:45.540311  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 48580.2us
I20260620 13:57:45.541673  5848 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:45.496707 10591 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:45.500723 10780 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:45.506866  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:45.510768  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:45.483180 10805 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.481339 10499 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:45.514356 10830 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:45.581351  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:45.582300  6578 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:45.519239 10833 raft_consensus.cc:3055] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:57:45.525025  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:45.593457  5955 raft_consensus.cc:2368] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12.
I20260620 13:57:45.525841  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:45.525923 10844 log.cc:927] Time spent T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260620 13:57:45.526470  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:45.527173  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:45.528529  5956 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260620 13:57:45.528673 10748 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:45.529697  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:45.534742 10797 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:45.611892  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 70283.3us
I20260620 13:57:45.553628  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:45.644757  5848 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:45.644796  6579 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:45.560521  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 47522.4us
W20260620 13:57:45.564558  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 57787.7us
I20260620 13:57:45.562462  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:45.571497  5950 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:45.588814  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:45.588994  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:45.589470  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:45.654635  6584 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:45.591789 10835 raft_consensus.cc:3055] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Stepping down as leader of term 6
I20260620 13:57:45.481243 10799 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260620 13:57:45.504267 10827 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:45.540442 10822 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:45.596840  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:45.510013 10796 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.540676 10669 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:45.648125 10499 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:45.597307  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:45.608704  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:45.510061 10806 raft_consensus.cc:2764] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260620 13:57:45.557768  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:45.563333 10776 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:45.641106  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 61219.3us
I20260620 13:57:45.693441  6586 raft_consensus.cc:2393] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 12: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:45.562242 10825 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:57:45.580924 10830 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:45.590545  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:45.706210  5879 raft_consensus.cc:2393] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:45.661224  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:45.599911 10819 raft_consensus.cc:3060] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:45.558812 10236 consensus_queue.cc:1059] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260620 13:57:45.593022 10833 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:45.675371  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:45.561416 10545 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260620 13:57:45.600351  5958 raft_consensus.cc:2393] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 13: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:45.679263  6552 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:45.680485  6587 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 18: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:45.681265  6551 leader_election.cc:400] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12.
I20260620 13:57:45.715042  6551 leader_election.cc:403] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260620 13:57:45.605667  5957 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:45.695859  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:45.656999 10797 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.703591 10657 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:45.656118 10748 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:45.534960 10773 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.677577 10827 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:45.667230 10835 raft_consensus.cc:740] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:45.674013 10279 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:45.713382  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:45.696542  6579 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:45.657528 10591 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.047s
W20260620 13:57:45.734042  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 70112.3us
I20260620 13:57:45.737903  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:45.757223  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:45.690557 10499 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:45.760170  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:45.740109  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 79009.9us
I20260620 13:57:45.761390  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:45.761883  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:45.753003  6551 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:45.754604  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 58723.7us
I20260620 13:57:45.755846  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260620 13:57:45.734383 10841 log.cc:927] Time spent T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260620 13:57:45.758033  5849 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:45.712843 10830 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:45.715679 10856 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:45.767673  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:45.755823 10825 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:57:45.782303  5954 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260620 13:57:45.744040 10051 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:45.743847 10434 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:45.775970  6031 raft_consensus.cc:2393] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:45.796535 10850 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260620 13:57:45.797801 10823 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:45.797423 10833 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.772043 10279 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:45.763224 10499 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:45.768339 10834 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:45.778138  6587 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:45.779533  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:45.789304 10859 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:45.753933 10512 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:45.800918 10512 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.806099 10856 raft_consensus.cc:697] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:45.757350 10767 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:45.807387 10767 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.807281 10856 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.760021 10748 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.760226 10777 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260620 13:57:45.768682  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:45.708302 10776 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:45.800185 10846 log.cc:927] Time spent T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: Append to log took a long time: real 0.143s	user 0.000s	sys 0.002s
I20260620 13:57:45.788882  6551 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:45.815703  6586 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260620 13:57:45.799286 10851 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260620 13:57:45.849273  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 91316.9us
I20260620 13:57:45.855190  5849 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:45.860345 10825 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:45.860802 10825 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:45.861166 10825 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:45.794809 10828 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:45.869601  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 90157.9us
I20260620 13:57:45.875676  5924 leader_election.cc:400] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 12. Current term is 13.
I20260620 13:57:45.876093  5924 leader_election.cc:403] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:57:45.869566  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:45.809082 10837 log.cc:927] Time spent T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260620 13:57:45.709657 10789 consensus_queue.cc:260] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:45.780681 10444 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:45.814119 10669 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:45.883162  5881 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260620 13:57:45.883482  5883 raft_consensus.cc:1275] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260620 13:57:45.885785  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:45.789724 10831 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260620 13:57:45.850934 10663 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:45.901626  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:45.902456  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:45.903702  5878 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260620 13:57:45.904838  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:45.909170  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:45.910279  5879 raft_consensus.cc:2368] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13.
I20260620 13:57:45.810729 10261 consensus_queue.cc:1059] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.089s
I20260620 13:57:45.874049 10859 raft_consensus.cc:697] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:45.886587 10828 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:45.879984 10799 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:45.908979  5878 pending_rounds.cc:85] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 7
I20260620 13:57:45.898841 10806 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:45.895049 10823 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 12. Current term is 13.
I20260620 13:57:45.930106  5878 pending_rounds.cc:107] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 12.8
W20260620 13:57:45.933557  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 144981us
I20260620 13:57:45.939463  5878 raft_consensus.cc:2889] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:45.938571  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:45.927798 10805 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:45.946432 10847 log.cc:927] Time spent T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260620 13:57:45.943626 10703 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:45.942016 10512 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:45.993367  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:45.997757  5884 raft_consensus.cc:1275] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260620 13:57:45.941308 10825 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.932351 10669 raft_consensus.cc:697] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:45.972378  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:46.003815  5875 raft_consensus.cc:2368] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14.
I20260620 13:57:45.922762 10860 consensus_queue.cc:1059] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260620 13:57:45.948243 10051 raft_consensus.cc:697] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:46.009847  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:46.008225  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:46.010560  5882 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:45.940757 10806 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:45.932965 10828 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:45.999578 10636 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:46.002038 10767 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:46.045336  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:45.916237 10835 consensus_queue.cc:260] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.042694  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:46.059772  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:46.060703 10767 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:46.062179 10831 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:46.062731 10831 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.064877 10831 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:46.066705  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:46.067548 10703 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:46.051196 10691 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election won for term 13
W20260620 13:57:46.068907 10855 log.cc:927] Time spent T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260620 13:57:46.069635 10835 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 6 FOLLOWER]: Advancing to term 7
W20260620 13:57:46.070689 10857 log.cc:927] Time spent T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260620 13:57:46.014065 10797 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:46.091341 10806 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:46.093986  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:46.095851  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:46.095026  5879 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:46.050467 10829 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:46.103366 10864 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:46.103685  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:46.104025  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:46.107246 10669 consensus_queue.cc:237] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.112098  6584 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:57:46.117456  5880 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:46.121814  6587 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:46.148180  5957 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
W20260620 13:57:46.103404 10852 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260620 13:57:46.163079  5876 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:46.083220 10816 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
W20260620 13:57:46.164000  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:46.098408 10748 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:46.049178 10636 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:46.167886  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 278689us
I20260620 13:57:46.172951  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:46.150300 10265 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:46.125783 10776 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:46.176857  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 174037us
I20260620 13:57:46.147996 10829 raft_consensus.cc:697] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:46.205679  6024 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:46.210582  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:46.210857  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:46.259069  5955 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:46.260905  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:46.251029  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:46.272897  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:46.273964  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:46.276777  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:46.277618  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:46.278733  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:46.279330  5954 raft_consensus.cc:2393] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 15: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:46.283263  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:46.281468  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:46.278873  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:46.283991  5954 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:46.297590  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:46.298324  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:46.298689  6027 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:46.310602  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:46.311218  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:46.311928  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:46.311424  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:46.177534 10691 raft_consensus.cc:697] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:46.320431  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:46.320782  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:46.321249  6033 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:46.321441  6032 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:46.319741  6585 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260620 13:57:46.073071 10859 consensus_queue.cc:237] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:46.326541  5848 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:46.176669 10051 consensus_queue.cc:237] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:46.312755 10852 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260620 13:57:46.251845 10823 consensus_queue.cc:1059] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.125s
I20260620 13:57:46.253353 10748 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260620 13:57:46.148866 10864 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:46.331638 10882 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:46.339475  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:46.340126 10444 consensus_queue.cc:1048] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
W20260620 13:57:46.342202 10499 consensus_meta.cc:287] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.000s
W20260620 13:57:46.330988 10791 consensus_meta.cc:287] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 1.034s	user 0.005s	sys 0.005s
W20260620 13:57:46.332393 10780 consensus_meta.cc:287] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.760s	user 0.011s	sys 0.000s
W20260620 13:57:46.335422 10279 consensus_meta.cc:287] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.002s
W20260620 13:57:46.380898  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 48666.9us
I20260620 13:57:46.379735  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:46.327417  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:46.335736 10865 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:46.383490 10823 raft_consensus.cc:3055] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:46.383891 10823 raft_consensus.cc:740] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:46.384912 10823 consensus_queue.cc:260] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:46.386472  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 59122.4us
I20260620 13:57:46.386654 10776 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:46.387039 10776 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:46.359189  5848 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:46.387430  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2199) took 1264 ms. Trace:
I20260620 13:57:46.387786  5952 rpcz_store.cc:276] 0620 13:57:45.123142 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:45.123268 (+   126us) service_pool.cc:224] Handling call
0620 13:57:45.154931 (+ 31663us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:45.186616 (+ 31685us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:57:45.328971 (+142355us) log.cc:844] Serialized 14 byte log entry
0620 13:57:45.476404 (+147433us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:45.479860 (+  3456us) log.cc:844] Serialized 26 byte log entry
0620 13:57:45.480121 (+   261us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:45.480192 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:45.480308 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:46.387198 (+906890us) raft_consensus.cc:1685] finished
0620 13:57:46.387225 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:46.387373 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39319,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":1128,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":16019,"thread_start_us":167583,"threads_started":2,"wal-append.queue_time_us":285851}
I20260620 13:57:46.387720 10691 consensus_queue.cc:237] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:46.390250 10868 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:46.387439 10776 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:46.365396 10434 consensus_meta.cc:287] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.005s
I20260620 13:57:46.391613  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:46.361521  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:46.394150  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:46.363469  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:46.395299  5953 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:46.395459  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:46.395536  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:46.396067  6584 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:46.368036  6033 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:46.368093  5878 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
W20260620 13:57:46.369089 10822 consensus_meta.cc:287] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.000s
I20260620 13:57:46.368983 10876 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260620 13:57:46.369889 10867 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260620 13:57:46.403558  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:46.373155 10828 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:46.252357 10265 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:46.350519 10827 consensus_meta.cc:287] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.000s
I20260620 13:57:46.375835 10499 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:46.392367 10279 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:46.383095 10865 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.353909 10825 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:46.394775  6587 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 15.
I20260620 13:57:46.399392 10434 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517) with higher term. Message: Invalid argument: T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12.
W20260620 13:57:46.403967  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:46.404022  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:46.428606  6578 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:46.404217  6582 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
W20260620 13:57:46.405467 10875 log.cc:927] Time spent T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260620 13:57:46.405771  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:46.370582 10829 consensus_queue.cc:237] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:46.406853  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:46.407152 10876 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:46.410138 10822 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:46.435217  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:46.436094  5878 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:46.436936  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:46.437402  5878 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:57:46.439754  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:46.440910  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:46.441869  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:46.443785  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:46.444581  5878 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 17.
I20260620 13:57:46.444691  6033 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:46.445588  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:46.414489  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:46.414628  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:46.432142  6584 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:46.416855 10663 consensus_queue.cc:1059] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260620 13:57:46.417876 10819 consensus_meta.cc:287] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.706s	user 0.011s	sys 0.000s
I20260620 13:57:46.419090 10864 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:46.464383  6583 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:46.419905  6579 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 15.
I20260620 13:57:46.382123  5998 leader_election.cc:400] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13.
I20260620 13:57:46.471880  5998 leader_election.cc:403] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260620 13:57:46.425993  5849 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:46.386510 10823 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:46.429642  6582 pending_rounds.cc:85] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 10
I20260620 13:57:46.472755  6582 pending_rounds.cc:107] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260620 13:57:46.473038  6582 raft_consensus.cc:2889] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:46.409871 10780 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260620 13:57:46.450353  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:46.452250  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:46.453500 10865 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:46.381071 10791 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:46.455323  5883 raft_consensus.cc:2393] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 10: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:57:46.495532  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 113516us
I20260620 13:57:46.420357 10799 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:46.458314  5956 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:57:46.400363 10817 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260620 13:57:46.450203 10876 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:46.460387 10636 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:46.425673 10827 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:46.463579 10834 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.004s
I20260620 13:57:46.463773  5951 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260620 13:57:46.473650  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 47720.5us
I20260620 13:57:46.505326  5849 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:46.492225 10663 raft_consensus.cc:3055] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:46.492508 10499 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:46.492723 10864 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13.
W20260620 13:57:46.495754  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 81339.5us
I20260620 13:57:46.447674  6586 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:46.496721  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:46.503369  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:46.380290 10882 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:46.473845 10819 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:46.500121 10279 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:46.511309 10865 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:46.515211 10825 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:46.516386 10830 consensus_meta.cc:287] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.000s
I20260620 13:57:46.515256 10834 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:46.484802 10780 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:46.487210 10669 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:46.499343 10799 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:46.524238  6033 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260620 13:57:46.526515 10773 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:46.528826 10791 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:46.529158  6028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2815) took 1379 ms. Trace:
I20260620 13:57:46.510679 10880 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:46.566305 10880 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:46.566776 10880 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:46.562711 10507 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:57:46.567440  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 70806.4us
I20260620 13:57:46.568526  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:46.562273  6028 rpcz_store.cc:276] 0620 13:57:45.149723 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:45.149856 (+   133us) service_pool.cc:224] Handling call
0620 13:57:45.162554 (+ 12698us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:45.472392 (+309838us) raft_consensus.cc:1534] Early marking committed up to index 8
0620 13:57:45.472427 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:45.479418 (+  6991us) log.cc:844] Serialized 26 byte log entry
0620 13:57:45.753073 (+273655us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:45.753119 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:46.528759 (+775640us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b54004006d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:46.528810 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:46.528855 (+    45us) raft_consensus.cc:1685] finished
0620 13:57:46.528871 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:46.529100 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1857,"raft.queue_time_us":773,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4502,"spinlock_wait_cycles":654499200,"thread_start_us":183975,"threads_started":1,"wal-append.queue_time_us":365670}
I20260620 13:57:46.570307  6028 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260620 13:57:46.539021  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:46.500406 10835 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:46.546151  5958 raft_consensus.cc:1275] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260620 13:57:46.549930  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:46.552448 10827 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:46.555980 10780 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:46.545222 10825 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:46.556766 10830 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.529807 10663 raft_consensus.cc:740] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:46.562592  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:46.563867  6024 raft_consensus.cc:2393] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:46.572584  5998 leader_election.cc:400] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14.
I20260620 13:57:46.573864  6584 raft_consensus.cc:2393] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 7: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:46.583796  5998 leader_election.cc:403] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260620 13:57:46.584438 10773 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177) with higher term. Message: Invalid argument: T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14.
I20260620 13:57:46.585188  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:46.585372  5849 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:46.561332 10799 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:46.585577  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:46.571192 10872 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:46.583420  6586 raft_consensus.cc:2376] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10. Re-sending same reply.
I20260620 13:57:46.586472  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:46.571328 10669 raft_consensus.cc:697] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:46.575922  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:46.595331 10791 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:46.578205 10835 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.580493 10822 consensus_queue.cc:1059] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260620 13:57:46.589845 10669 consensus_queue.cc:237] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:46.590754 10882 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:46.577998 10817 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260620 13:57:46.582139 10507 consensus_queue.cc:1048] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260620 13:57:46.598603  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:46.599869 10791 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:46.600272 10825 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:46.600389 10835 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:46.608011  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:46.608372  5924 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:46.592481 10827 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260620 13:57:46.577771 10819 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:46.608772  6587 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:57:46.596968 10822 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 17 LEADER]: Stepping down as leader of term 17
I20260620 13:57:46.610911  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:46.612107  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:46.612864 10830 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:46.615084  5884 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 14: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:46.614975  5849 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:46.615443  6583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46858 (request call id 1183) took 1060 ms. Trace:
I20260620 13:57:46.615962  6583 rpcz_store.cc:276] 0620 13:57:45.555322 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:45.737615 (+182293us) service_pool.cc:224] Handling call
0620 13:57:46.615258 (+877643us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b5400508054. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:46.615380 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552834304}
I20260620 13:57:46.616744 10830 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:57:46.617193  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:46.617296 10830 raft_consensus.cc:697] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:46.611052 10822 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:46.618357  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:46.618755 10663 consensus_queue.cc:260] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:46.619442 10822 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.586364 10773 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:46.620870 10663 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:46.621136 10773 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:46.621234 10822 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:57:46.621735 10773 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:46.622609 10279 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:46.590996  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:46.624074  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:46.625110  6579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:34178
I20260620 13:57:46.627601  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:46.628265  5876 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
W20260620 13:57:46.631902  6031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2818) took 1472 ms (client timeout 1625 ms). Trace:
W20260620 13:57:46.632321  6031 rpcz_store.cc:269] 0620 13:57:45.159982 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:45.160195 (+   213us) service_pool.cc:224] Handling call
0620 13:57:46.631682 (+1471487us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54001c6e54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:46.631817 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131356544}
I20260620 13:57:46.633553  6025 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260620 13:57:46.636302 10796 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:46.610185 10789 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 6 FOLLOWER]: Advancing to term 7
I20260620 13:57:46.636991  5849 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:46.637817 10827 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:46.638195 10827 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:46.638548 10827 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:46.643137 10684 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:46.644047  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:46.644809 10684 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:46.646142 10819 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:46.646638 10819 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.647441 10279 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:46.648774 10819 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:46.634595 10880 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:46.623787 10830 consensus_queue.cc:237] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:46.649767 10890 log.cc:927] Time spent T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.166s	user 0.002s	sys 0.000s
I20260620 13:57:46.653152  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:46.653653  6026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1066) took 1109 ms. Trace:
I20260620 13:57:46.653750  5958 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:46.637825  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:46.655951  6027 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 14: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:46.656208 10835 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:46.654115  6026 rpcz_store.cc:276] 0620 13:57:45.544239 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:45.544423 (+   184us) service_pool.cc:224] Handling call
0620 13:57:45.584191 (+ 39768us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:45.712100 (+127909us) raft_consensus.cc:1534] Early marking committed up to index 12
0620 13:57:45.786936 (+ 74836us) log.cc:844] Serialized 14 byte log entry
0620 13:57:46.002126 (+215190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:46.002188 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0620 13:57:46.002257 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:46.653434 (+651177us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54000e5bd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:46.653479 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:46.653598 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52605,"prepare.queue_time_us":182227,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":67786,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7387,"spinlock_wait_cycles":355530240,"thread_start_us":207600,"threads_started":2,"wal-append.queue_time_us":248702}
I20260620 13:57:46.648020 10279 raft_consensus.cc:697] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:46.656701 10835 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.657778 10279 consensus_queue.cc:237] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.613065  6587 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:46.626200 10776 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.625535 10799 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:46.694260  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 54431us
I20260620 13:57:46.696034  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:46.668624  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:46.673768  5849 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:46.700541  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:46.649801  5924 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:46.672509  5959 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260620 13:57:46.676656  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 90248.2us
I20260620 13:57:46.702344  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:46.677104  5958 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:46.702914  5959 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:46.704818  6552 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:46.715451  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 65741.5us
I20260620 13:57:46.716212  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:46.721048  5849 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:46.717154 10807 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:46.672578 10866 raft_consensus.cc:3055] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Stepping down as leader of term 16
I20260620 13:57:46.726307  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:46.726495  5959 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260620 13:57:46.665129 10833 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:46.724967  5924 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:46.728724  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:46.735049  6033 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:46.670825 10797 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:46.732858 10812 consensus_queue.cc:1048] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:57:46.733170  6587 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260620 13:57:46.659065 10835 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:46.660984 10880 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:46.717723 10684 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:46.671053 10545 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:46.736322  5998 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:46.695884 10882 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:46.740448  5952 raft_consensus.cc:1240] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:46.719650 10051 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:46.740800  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:46.749667  5959 raft_consensus.cc:2410] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260620 13:57:46.723095 10834 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:46.736923 10791 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:46.728547 10657 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:46.728945 10805 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:46.733687 10748 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:57:46.762425 10748 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:46.762825 10748 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:46.767994  5952 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:46.770190 10840 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260620 13:57:46.759629 10657 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:46.771941 10657 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:46.776229 10776 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:46.741812 10703 consensus_queue.cc:1059] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260620 13:57:46.750468  5998 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:46.753247  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 87661.7us
I20260620 13:57:46.750478  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:46.781277  5848 leader_election.cc:336] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.690s (SENT)
I20260620 13:57:46.755530  6587 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260620 13:57:46.729890 10866 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:46.739882 10507 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:46.737493 10771 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:46.757678  5951 raft_consensus.cc:1275] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260620 13:57:46.740252 10819 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:46.753665  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:46.761984 10805 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:46.776412  6585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 1176) took 1223 ms. Trace:
I20260620 13:57:46.754505 10051 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:46.784087  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:46.789495  5998 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:46.791193  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:46.792996 10825 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:46.807554  5951 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:46.735153  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:46.800486 10818 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:46.794539 10507 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:46.801056 10805 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:46.794798 10819 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:46.820662  6587 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:46.795207  6585 rpcz_store.cc:276] 0620 13:57:45.553500 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:45.553857 (+   357us) service_pool.cc:224] Handling call
0620 13:57:46.310103 (+756246us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:46.322995 (+ 12892us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:46.776167 (+453172us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b54009de4d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:46.776343 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670219648}
I20260620 13:57:46.755465 10545 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.802726 10767 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:46.743855 10797 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.757727 10834 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:46.804818  5957 raft_consensus.cc:2410] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260620 13:57:46.808809  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:46.757032 10817 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260620 13:57:46.817061  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 81984.2us
I20260620 13:57:46.810914 10051 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:46.822996 10822 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:57:46.823321 10819 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:46.828788  5952 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260620 13:57:46.820775 10825 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:46.831837 10767 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:46.816689  6581 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:46.874816  5848 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:46.779964 10876 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:46.839639  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:46.880033  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:46.883358  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 43822us
I20260620 13:57:46.841202 10882 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:46.851752 10834 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:46.900959  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:46.886379 10545 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:46.887934 10789 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:46.888926  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:46.893389 10799 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:46.899291 10684 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:46.899694 10444 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:46.898401 10773 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.873708 10780 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.943343  5958 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:46.900923  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:46.882349 10767 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:46.884094 10822 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:46.886204  6033 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 17. Current term is 18. Ops: []
I20260620 13:57:46.887873 10825 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:47.014218  6580 raft_consensus.cc:1240] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:46.959162 10871 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:46.961726 10789 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:46.853588 10812 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
W20260620 13:57:46.959437  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 75489.8us
I20260620 13:57:47.023578  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:47.025161  5998 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:46.962877  6027 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 13: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:46.984989  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 183152us
I20260620 13:57:46.966051 10776 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:46.947965  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 63986.7us
I20260620 13:57:46.977035 10444 raft_consensus.cc:697] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:47.060163 10444 consensus_queue.cc:237] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:46.982385 10822 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:47.063803 10507 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:47.064716  5884 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260620 13:57:47.011938  6025 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260620 13:57:47.039813  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:47.042866  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:47.041950 10884 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:47.047394  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:47.067940  6585 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:47.044130  6581 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260620 13:57:47.066883  5878 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:47.081490  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:47.084177  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:47.084394  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:47.084879  5959 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:47.085026  5951 raft_consensus.cc:2393] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:47.064307 10876 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:47.030690 10789 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:47.121831  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:47.136323  5959 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:47.111199  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:47.038110 10882 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:47.143164  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:46.874596 10866 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:47.146920  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:47.149314  5952 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260620 13:57:47.072388 10663 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:47.032501 10871 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:47.165925  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:47.176640  5884 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:47.067732 10776 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:47.179584  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:47.181216  5997 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:47.108991 10884 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:47.191231  6585 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260620 13:57:47.192559  5955 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:47.188094  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:47.190650  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:47.207311  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 122118us
I20260620 13:57:47.180668  5953 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:47.208101  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:47.208695  5959 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:47.209712  5878 raft_consensus.cc:1240] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260620 13:57:47.176812 10866 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:57:47.220976  5876 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260620 13:57:47.226032  6551 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:47.228840  6551 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:47.247521 10831 raft_consensus.cc:3055] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:47.248116 10831 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:47.250406 10831 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:47.257148 10831 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:47.263311 10810 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:47.263983 10810 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:47.266507 10810 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:47.270848 10236 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:47.276616 10797 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:47.228374 10507 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:47.309650  6585 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260620 13:57:47.232236 10880 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260620 13:57:47.279026 10748 consensus_meta.cc:287] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.005s
I20260620 13:57:47.243016 10777 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:47.228139 10882 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260620 13:57:47.290707 10776 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:47.304144 10799 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:47.223790 10778 consensus_queue.cc:1059] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260620 13:57:47.237195 10812 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.113s
I20260620 13:57:47.287631 10773 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:47.288663 10507 raft_consensus.cc:697] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:47.231698 10771 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.114s
I20260620 13:57:47.280671 10871 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:47.400718  5923 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.4.155.254:37547, user_credentials={real_user=slave}} blocked reactor thread for 47025.9us
I20260620 13:57:47.347755 10880 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:47.351910 10777 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:57:47.418179  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 189435us
W20260620 13:57:47.419473  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 194614us
W20260620 13:57:47.430354  5950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.002s	sys 0.010s
W20260620 13:57:47.431325  5950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.003s	sys 0.010s
W20260620 13:57:47.408905 10827 consensus_meta.cc:287] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.770s	user 0.018s	sys 0.000s
I20260620 13:57:47.373466 10748 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:47.412364 10880 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:47.417793 10777 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:47.404174 10799 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:47.470130 10819 consensus_meta.cc:287] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
I20260620 13:57:47.370409 10822 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:47.471966 10657 consensus_meta.cc:287] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.700s	user 0.012s	sys 0.000s
W20260620 13:57:47.476161 10908 log.cc:927] Time spent T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260620 13:57:47.476964 10902 log.cc:927] Time spent T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260620 13:57:47.477713 10909 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260620 13:57:47.463339 10776 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:47.479506 10507 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:47.483227 10051 consensus_meta.cc:287] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.001s
I20260620 13:57:47.483863 10884 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:47.487838 10833 consensus_meta.cc:287] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.747s	user 0.008s	sys 0.006s
I20260620 13:57:47.488758  5958 raft_consensus.cc:2368] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 15. Current term is 16.
I20260620 13:57:47.489864 10748 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:47.448681 10805 consensus_meta.cc:287] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.619s	user 0.003s	sys 0.007s
I20260620 13:57:47.441099 10773 consensus_queue.cc:1059] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260620 13:57:47.514729 10789 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:47.516125 10773 raft_consensus.cc:3055] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:47.516602 10773 raft_consensus.cc:740] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:47.517479 10773 consensus_queue.cc:260] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:47.450469 10827 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:47.521416 10827 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:47.521517 10822 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:47.441305 10808 consensus_queue.cc:1048] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260620 13:57:47.499831  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:47.499118 10834 consensus_meta.cc:287] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.003s
I20260620 13:57:47.514868 10748 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:47.522497  6579 raft_consensus.cc:606] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:47.527565  6579 raft_consensus.cc:614] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260620 13:57:47.528466  6584 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:57:47.529188  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:47.529667  5876 raft_consensus.cc:2410] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260620 13:57:47.530830  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 1076) took 1436 ms. Trace:
I20260620 13:57:47.531036  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:47.531287  5882 rpcz_store.cc:276] 0620 13:57:46.094352 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:46.094841 (+   489us) service_pool.cc:224] Handling call
0620 13:57:46.098503 (+  3662us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:46.454226 (+355723us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:46.454257 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:46.454729 (+   472us) log.cc:844] Serialized 26 byte log entry
0620 13:57:46.573145 (+118416us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:46.573187 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:47.522275 (+949088us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b5400378f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:47.522319 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:47.522391 (+    72us) raft_consensus.cc:1685] finished
0620 13:57:47.522414 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:47.530751 (+  8337us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10139,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":21630,"spinlock_wait_cycles":817065344,"thread_start_us":117916,"threads_started":1,"wal-append.queue_time_us":172886}
I20260620 13:57:47.522181 10822 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:47.546379  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:47.496042 10819 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:47.499778 10657 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:47.556957 10791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.031s	sys 0.084s
I20260620 13:57:47.511317 10776 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:47.567855  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:47.517470 10789 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:47.559790 10767 consensus_meta.cc:287] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.549s	user 0.000s	sys 0.011s
W20260620 13:57:47.560256  5984 heartbeater.cc:646] Failed to heartbeat to 127.4.155.254:37547 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.155.254:37547 timed out after 15.000s (SENT)
I20260620 13:57:47.511816 10051 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:47.573951  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:47.573848  6029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 1064) took 2345 ms (client timeout 2014 ms). Trace:
W20260620 13:57:47.580026  6029 rpcz_store.cc:269] 0620 13:57:45.228428 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:45.249525 (+ 21097us) service_pool.cc:224] Handling call
0620 13:57:47.568283 (+2318758us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b540037bed4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:47.573745 (+  5462us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057336064}
I20260620 13:57:47.581357  6029 raft_consensus.cc:3055] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:47.581733  6029 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:47.556818 10773 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:47.575896  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:47.524139 10805 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:47.537007 10834 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:47.540196 10748 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:47.569692 10791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.032s	sys 0.084s
I20260620 13:57:47.549921 10822 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:47.605665  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:47.606710  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:47.597868  6029 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:47.612660  5884 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:47.619069  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:47.620668  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:47.620968  5876 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:47.595804 10827 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:47.644701  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:47.646176  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34178 (request call id 22) took 1147 ms. Trace:
I20260620 13:57:47.588948 10767 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:47.619202 10789 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:47.630890  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:47.651015  6579 rpcz_store.cc:276] 0620 13:57:46.494247 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:46.624987 (+130740us) service_pool.cc:224] Handling call
0620 13:57:47.641325 (+1016338us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b54005d0f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7f6c33 00007f0fe47c4d0a 00007f0fddd48934 00007f0fddd488c2 00007f0fddd487f1 00007f0fddd4876c 00007f0fddd47a22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:47.641502 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2062680320}
I20260620 13:57:47.656656 10780 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:47.657567  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:47.658388  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 107085us
I20260620 13:57:47.659196 10051 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:47.660775  6584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 1131) took 1211 ms. Trace:
I20260620 13:57:47.661846 10748 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:47.687191  6584 rpcz_store.cc:276] 0620 13:57:46.449330 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:46.584783 (+135453us) service_pool.cc:224] Handling call
0620 13:57:47.660577 (+1075794us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b54005d0f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:47.660700 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2167855872}
I20260620 13:57:47.663003  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:47.689106  6027 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:47.689599  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 58821.4us
I20260620 13:57:47.663642  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:47.691606  5877 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:47.664683 10767 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:47.666549  6578 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:47.668143 10805 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:47.698894  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:47.699596  5951 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:47.668217 10789 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:47.673754  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:47.679390  5882 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:57:47.700564  5878 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:47.683056  5848 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
W20260620 13:57:47.693383  5849 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.195:41493 timed out after 1.789s (SENT) [suppressed 17 similar messages]
I20260620 13:57:47.694083  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:47.641088 10827 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:47.701643  5848 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:47.703183  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:47.703814  5882 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:47.660794 10834 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:47.684196 10799 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:47.707783  6580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 1129) took 1258 ms. Trace:
I20260620 13:57:47.708096  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:47.707808  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2216) took 1039 ms. Trace:
I20260620 13:57:47.713626 10776 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:47.713922  5953 raft_consensus.cc:1275] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260620 13:57:47.714407 10265 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:47.714980 10805 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:47.715711  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:47.717000 10827 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:47.717576  6027 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:57:47.701895 10748 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:57:47.725061  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:47.722309 10789 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:47.704939 10876 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:47.727774  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:47.711488  5955 rpcz_store.cc:276] 0620 13:57:46.667964 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:46.668094 (+   130us) service_pool.cc:224] Handling call
0620 13:57:46.668399 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:47.224828 (+556429us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:47.707638 (+482810us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b540019d2d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:47.707757 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1205045632}
I20260620 13:57:47.728117  6584 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:47.710064  6580 rpcz_store.cc:276] 0620 13:57:46.449042 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:46.656013 (+206971us) service_pool.cc:224] Handling call
0620 13:57:46.656363 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:47.019973 (+363610us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:47.707552 (+687579us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b540028bed4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:47.707724 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822390144}
I20260620 13:57:47.736454  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:47.736934  5882 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:47.737324  6579 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:47.741803  5877 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:57:47.744848  5955 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260620 13:57:47.747151  5952 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:47.754992  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:47.755914  5955 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:47.784612  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:47.811851  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:47.823463  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:47.824667  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:47.825456  5884 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:57:47.829278  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:47.830892  5952 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 15. Current term is 16. Ops: []
I20260620 13:57:47.837977  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:47.838809  6587 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:47.839792  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:47.845690  5877 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:47.845822  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:47.847498  5878 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 16.
I20260620 13:57:47.855886  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:47.868881  6581 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:47.872653  5924 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:47.874835  6579 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 16.
I20260620 13:57:47.876345  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:47.889573  5953 raft_consensus.cc:2410] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260620 13:57:47.888080  5955 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:47.894018  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:47.879134  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:47.895447  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:47.896219  6027 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:47.733417 10876 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:47.725972 10805 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:47.905663  6580 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:47.908042  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:47.909008  5951 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
W20260620 13:57:47.909739  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:47.899410  5877 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260620 13:57:47.731415 10657 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:47.728060 10748 raft_consensus.cc:697] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 17 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:47.877614  6551 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:47.908946  6584 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:47.823027 10819 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:47.921308  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 216661us
I20260620 13:57:47.893507 10663 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:47.725811 10777 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:47.983363  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 105860us
I20260620 13:57:48.001708  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:48.003356  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:48.017527  6028 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:47.904065 10789 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:47.871403 10799 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:47.904610 10916 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:47.905144 10876 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:48.027263  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:47.910981 10918 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:48.013542  6587 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 16.
I20260620 13:57:47.893076 10818 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260620 13:57:48.003286 10831 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:48.004113 10663 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:47.991623 10903 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260620 13:57:48.040664  6027 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
W20260620 13:57:48.041858  5956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2441) took 1825 ms (client timeout 1756 ms). Trace:
W20260620 13:57:48.032851  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 331269us
I20260620 13:57:47.996264 10657 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:47.919883 10810 consensus_queue.cc:1059] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.117s
I20260620 13:57:47.930444 10862 consensus_queue.cc:1059] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.112s
I20260620 13:57:47.911676 10805 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:48.014734 10778 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:47.906654 10796 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.120s
I20260620 13:57:48.054570  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:48.055936  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:48.058297  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:48.069525  6028 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:48.070775  6027 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 11
I20260620 13:57:48.066385  5876 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
W20260620 13:57:48.053144  5956 rpcz_store.cc:269] 0620 13:57:46.203551 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:46.203675 (+   124us) service_pool.cc:224] Handling call
0620 13:57:48.028310 (+1824635us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400042c54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:48.028418 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319180032}
I20260620 13:57:48.068776  6581 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:48.066944  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:48.080147  6585 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:48.060950 10818 consensus_queue.cc:1243] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260620 13:57:48.050968 10831 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:48.057945 10663 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:48.084112  5959 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260620 13:57:48.123889  5959 pending_rounds.cc:85] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 6
I20260620 13:57:48.085668 10866 raft_consensus.cc:3055] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Stepping down as leader of term 15
I20260620 13:57:48.064152 10918 raft_consensus.cc:697] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:48.050411 10789 raft_consensus.cc:697] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:48.124142  5959 pending_rounds.cc:107] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260620 13:57:48.134289  5959 raft_consensus.cc:2889] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:48.134761  5959 pending_rounds.cc:107] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260620 13:57:48.135026  5959 raft_consensus.cc:2889] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:48.057461 10822 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:48.075635 10657 raft_consensus.cc:697] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:57:48.122841  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:48.050649 10916 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:48.144079  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 106805us
I20260620 13:57:48.120317 10831 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:48.152746  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:48.085129 10778 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.127058 10866 raft_consensus.cc:740] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:48.163061  6028 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
W20260620 13:57:48.163741  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 284731us
I20260620 13:57:48.173751  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:48.137171 10799 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:48.161685  6027 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:48.179772  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:48.185014  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.192513  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2440) took 1993 ms. Trace:
I20260620 13:57:48.192775  5954 raft_consensus.cc:1275] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260620 13:57:48.193267  5954 pending_rounds.cc:85] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 5
I20260620 13:57:48.094604 10748 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:48.199695 10819 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:57:48.200387 10822 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 13:57:48.200724 10916 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:48.202137  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:48.202932  5876 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 14: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
W20260620 13:57:48.206688 10880 consensus_meta.cc:287] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.713s	user 0.001s	sys 0.008s
I20260620 13:57:48.184613 10935 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:48.215090  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:48.193837  5954 pending_rounds.cc:107] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260620 13:57:48.222047  5954 raft_consensus.cc:2889] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:57:48.190388 10922 log.cc:927] Time spent T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.279s	user 0.000s	sys 0.002s
I20260620 13:57:48.193019  5957 rpcz_store.cc:276] 0620 13:57:46.199125 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:46.272608 (+ 73483us) service_pool.cc:224] Handling call
0620 13:57:48.192220 (+1919612us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b540007a3d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:48.192444 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220869504}
I20260620 13:57:48.227978  6585 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:48.228979  6581 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260620 13:57:48.229393  6581 pending_rounds.cc:85] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 8
I20260620 13:57:48.229660  6581 pending_rounds.cc:107] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260620 13:57:48.229898  6581 raft_consensus.cc:2889] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:48.180562 10929 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260620 13:57:48.215081 10773 consensus_meta.cc:287] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.002s
I20260620 13:57:48.240192  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:48.181264 10799 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:48.254295  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.224490 10818 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:48.271270 10935 raft_consensus.cc:697] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:48.271339 10819 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 16 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:48.272411 10935 consensus_queue.cc:237] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:48.272923 10819 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.275344 10773 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:48.271466 10930 log.cc:927] Time spent T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260620 13:57:48.277012  5876 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:57:48.235988 10808 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:48.235234 10796 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:48.280444  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.242362 10777 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:48.275902 10773 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.258206 10776 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:48.258554 10936 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:48.285230 10939 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:48.225245 10880 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.223963 10789 consensus_queue.cc:237] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:48.224310 10657 consensus_queue.cc:237] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:48.293888 10939 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.276180 10818 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:48.302353  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.309188  6028 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 7.
I20260620 13:57:48.309217  5956 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
W20260620 13:57:48.312253  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 84270.5us
I20260620 13:57:48.232195 10918 consensus_queue.cc:237] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.315565  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:48.286458 10808 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:48.311815 10932 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260620 13:57:48.285746 10796 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.323874  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.289548 10776 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:48.350153 10773 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:48.290992 10936 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.351771 10781 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:48.352250 10936 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:48.353225  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:48.353703 10939 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:48.353888  5876 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
W20260620 13:57:48.359628  6024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43502 (request call id 2537) took 2059 ms (client timeout 1789 ms). Trace:
W20260620 13:57:48.360114  6024 rpcz_store.cc:269] 0620 13:57:46.300233 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:46.327275 (+ 27042us) service_pool.cc:224] Handling call
0620 13:57:48.359382 (+2032107us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54000d3754. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:48.359546 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392087296}
I20260620 13:57:48.361397  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.363261 10663 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.365684 10663 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:48.366369 10748 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:48.366962 10748 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:48.326926 10933 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:48.367837 10933 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:48.368194 10933 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:48.369099 10748 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:48.327200 10934 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260620 13:57:48.373245 10776 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:48.373777 10776 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:48.374266 10776 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.375653  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1082) took 1662 ms. Trace:
I20260620 13:57:48.375855  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:48.376060  6025 rpcz_store.cc:276] 0620 13:57:46.713276 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:46.713397 (+   121us) service_pool.cc:224] Handling call
0620 13:57:46.717511 (+  4114us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:47.065806 (+348295us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:48.375384 (+1309578us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400215554. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:48.375593 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675714944}
I20260620 13:57:48.376585 10880 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:48.377034  5924 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:48.377364  6025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "192c750f597c43858e1ad09e8d805685"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:57:48.377946  6025 raft_consensus.cc:606] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Received request to transfer leadership to TS 192c750f597c43858e1ad09e8d805685
I20260620 13:57:48.379556 10822 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:48.380024 10939 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:48.380563  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.380081 10822 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.381121 10934 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260620 13:57:48.381304  6032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2824) took 2045 ms (client timeout 1661 ms). Trace:
I20260620 13:57:48.381532 10934 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:48.381951 10934 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:48.382408 10822 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:48.382884 10796 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:48.381759  6032 rpcz_store.cc:269] 0620 13:57:46.335847 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:46.341760 (+  5913us) service_pool.cc:224] Handling call
0620 13:57:48.365113 (+2023353us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b5800034e98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:57:48.381238 (+ 16125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44982144}
I20260620 13:57:48.387558 10778 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:48.388134 10778 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:48.388579 10778 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.389484  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:48.390586 10778 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:57:48.391500 10663 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:57:48.392226 10663 raft_consensus.cc:697] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 16 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:48.393446 10663 consensus_queue.cc:237] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.394271 10871 raft_consensus.cc:3055] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Stepping down as leader of term 10
W20260620 13:57:48.395130 10942 log.cc:927] Time spent T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260620 13:57:48.379956  5875 raft_consensus.cc:1275] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260620 13:57:48.397230  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.351897  6029 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:48.386395 10808 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:48.377163 10880 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:48.410820  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:48.413681  5877 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:48.415199 10880 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.409114  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:48.408308  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.419443  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:48.394814  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:48.379549  5883 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1911) took 2471 ms (client timeout 2426 ms). Trace:
I20260620 13:57:48.399049  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.404439  6024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab83097997ba42219f9a63aad224f786"
dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
mode: GRACEFUL
new_leader_uuid: "2e82c0c231624695ac5a813230bf5038"
 from {username='slave'} at 127.0.0.1:50466
I20260620 13:57:48.420101  5876 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:48.421916  6578 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:57:48.422865  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:48.421052  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:48.426772 10778 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:48.427269 10778 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:48.427371 10776 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:48.427691 10778 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:48.428238 10940 log.cc:927] Time spent T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.153s	user 0.002s	sys 0.000s
I20260620 13:57:48.428309 10934 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.430542 10934 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:48.427381  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:48.432219  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:48.420634  5883 rpcz_store.cc:269] 0620 13:57:45.908662 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:45.908913 (+   251us) service_pool.cc:224] Handling call
0620 13:57:48.379322 (+2470409us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54003fa2d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:48.379449 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253831936}
W20260620 13:57:48.448364  5955 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.011s	sys 0.038s
W20260620 13:57:48.450114  5955 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.011s	sys 0.039s
I20260620 13:57:48.428309 10835 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:48.450059  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:48.399406 10748 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:48.449810  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.432753  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:48.469694  6025 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:57:48.472945  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:48.474651  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:48.394959 10871 raft_consensus.cc:740] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:48.475440  6585 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:48.477855  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:48.477973  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.478574  6578 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:57:48.478591  6025 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 18.
I20260620 13:57:48.479900  6029 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:48.386909 10805 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:48.468339  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:48.485487 10776 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:48.485195 10871 consensus_queue.cc:260] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.486080 10776 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.486631 10871 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:48.488610 10776 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:48.489182 10933 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.489836 10831 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.491281  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.491618  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.492470  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:48.493134  5850 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.000s	sys 0.018s
W20260620 13:57:48.504249  5850 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.000s	sys 0.018s
I20260620 13:57:48.509064  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:48.449720 10934 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:48.477950 10818 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:48.459560  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:48.449407 10434 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:48.478763 10767 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:48.477444 10835 raft_consensus.cc:697] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:48.492444  6029 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 18.
I20260620 13:57:48.522691  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:48.537056  5877 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
W20260620 13:57:48.537779  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 458083us
I20260620 13:57:48.538915  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:48.527298  6585 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:48.530057  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:48.530400  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:48.541628  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:48.542274  6587 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:48.542047 10876 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:48.537500 10434 raft_consensus.cc:697] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:48.542901  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:48.475613 10748 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.543543 10434 consensus_queue.cc:237] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.544056 10876 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:48.535620  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:48.525561  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:48.544850 10880 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:48.545594 10748 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:48.515164 10776 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:48.534214  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:48.541435  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:48.579344  5877 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:48.549880 10948 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:48.588805  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:48.551208  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.591305  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.560645  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:48.593268  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:48.593560  6586 raft_consensus.cc:2393] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
W20260620 13:57:48.594167  6586 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 1124) took 2146 ms (client timeout 1857 ms). Trace:
I20260620 13:57:48.561160  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 1085) took 1892 ms. Trace:
I20260620 13:57:48.594972  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:48.595870  5877 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:48.595446  5879 rpcz_store.cc:276] 0620 13:57:46.668987 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:46.669164 (+   177us) service_pool.cc:224] Handling call
0620 13:57:46.711750 (+ 42586us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:46.729346 (+ 17596us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:46.729391 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:46.729450 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:57:46.729525 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:48.560862 (+1831337us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b54002b25d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:48.560908 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:48.561087 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40018304}
I20260620 13:57:48.565289  6582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 1126) took 3384 ms. Trace:
I20260620 13:57:48.579859  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:48.598892  6585 raft_consensus.cc:2368] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 15. Current term is 16.
I20260620 13:57:48.580030  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.599511  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:48.599977  6029 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:48.579555  5848 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:48.601192  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:48.602771 10830 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:48.603435 10830 raft_consensus.cc:697] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:48.603832  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:48.604789  5879 raft_consensus.cc:2393] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:48.604559 10830 consensus_queue.cc:237] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.605518  6587 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
W20260620 13:57:48.594645  6586 rpcz_store.cc:269] 0620 13:57:46.447983 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:46.590674 (+142691us) service_pool.cc:224] Handling call
0620 13:57:48.560488 (+1969814us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b580005fa98. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d36ee 000000000036f859 00007f0fe474b8e0 00007f0fe48147c4 00007f0fe4814831 00007f0fe47c27a0 00007f0fe47c2084 00007f0fddd3a834 00007f0fddd3a7c2
0620 13:57:48.594084 (+ 33596us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15328768}
I20260620 13:57:48.607328 10929 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:57:48.608028  6032 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260620 13:57:48.602555  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:48.611083  5950 raft_consensus.cc:1240] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:48.525451 10934 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.616011  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:48.600706  5998 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:48.556398 10805 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:48.617400  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:48.597699  6582 rpcz_store.cc:276] 0620 13:57:45.180357 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:45.180482 (+   125us) service_pool.cc:224] Handling call
0620 13:57:45.202771 (+ 22289us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:46.484723 (+1281952us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:48.564954 (+2080231us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540085aa54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:48.565188 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2736635136}
I20260620 13:57:48.619410  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.623332 10876 consensus_queue.cc:1059] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:57:48.623690  6028 raft_consensus.cc:2393] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 14: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:48.624328  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:48.625051 10805 raft_consensus.cc:3055] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:48.619319  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.625456 10805 raft_consensus.cc:740] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:48.626616  5953 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260620 13:57:48.626397 10805 consensus_queue.cc:260] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.627445 10805 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:48.626844  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:48.628046  5956 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260620 13:57:48.628499  5956 pending_rounds.cc:85] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 7
I20260620 13:57:48.628779  5956 pending_rounds.cc:107] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260620 13:57:48.629031  5956 raft_consensus.cc:2889] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:48.631203 10817 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:48.632128 10817 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.633664  6030 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:57:48.634320 10937 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:48.636027 10876 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:57:48.639765  6025 raft_consensus.cc:1275] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260620 13:57:48.619257 10795 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260620 13:57:48.645876  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 45250.3us
I20260620 13:57:48.647754  5998 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:48.650967  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:48.665277  5951 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.012s	sys 0.018s
W20260620 13:57:48.665755  5951 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.012s	sys 0.018s
I20260620 13:57:48.666656  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:48.667445  6586 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:48.553828 10947 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:48.589848 10880 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:48.646833 10795 raft_consensus.cc:2764] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260620 13:57:48.560132 10827 consensus_queue.cc:1048] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260620 13:57:48.696821  6582 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:48.698269  5998 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:48.620635 10776 raft_consensus.cc:697] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:48.707636  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.708063  5950 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260620 13:57:48.710672  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:48.668701  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:48.704317  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:48.718408  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.721637  6587 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 14: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:48.587410 10808 consensus_queue.cc:1059] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.110s
I20260620 13:57:48.733090  6029 raft_consensus.cc:1275] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260620 13:57:48.695408 10444 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:48.692103 10936 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:48.737017  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:48.742704  5879 raft_consensus.cc:2410] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260620 13:57:48.743032  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:48.743516  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 45360.2us
I20260620 13:57:48.743762  6585 raft_consensus.cc:2393] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:48.744976  5998 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:48.737095  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.675971 10748 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:48.737708  6032 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 14: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:48.740077  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:48.620756 10912 consensus_queue.cc:1059] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260620 13:57:48.747537  6029 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260620 13:57:48.747903  6582 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:57:48.749825  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:48.751852  6582 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:48.752429  6587 raft_consensus.cc:2393] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 12: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:48.660508 10778 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.746842 10265 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:48.719202 10831 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:48.766597  6031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2826) took 1884 ms. Trace:
W20260620 13:57:48.762856  5958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2456) took 1681 ms (client timeout 2204 ms). Trace:
I20260620 13:57:48.772805  6026 raft_consensus.cc:1240] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260620 13:57:48.738824 10444 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:48.741963 10789 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:48.751209 10795 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 13:57:48.778097 10816 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:48.717971 10796 consensus_queue.cc:1059] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260620 13:57:48.783026  5849 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:48.801252  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:48.771612  5958 rpcz_store.cc:269] 0620 13:57:47.081010 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:47.081178 (+   168us) service_pool.cc:224] Handling call
0620 13:57:48.762543 (+1681365us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54002607d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:48.762762 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934291328}
I20260620 13:57:48.771402  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:48.710347 10947 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.771135  6031 rpcz_store.cc:276] 0620 13:57:46.881952 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:46.882091 (+   139us) service_pool.cc:224] Handling call
0620 13:57:46.884932 (+  2841us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:47.735563 (+850631us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:47.735592 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:47.824977 (+ 89385us) log.cc:844] Serialized 26 byte log entry
0620 13:57:48.241515 (+416538us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:57:48.242138 (+   623us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:48.748773 (+506635us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b54001c8754. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:48.748847 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:48.749055 (+   208us) raft_consensus.cc:1685] finished
0620 13:57:48.749071 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:48.766504 (+ 17433us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8265,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":71270,"spinlock_wait_cycles":1955261312,"thread_start_us":250517,"threads_started":1,"wal-append.queue_time_us":396617}
I20260620 13:57:48.715466 10880 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:48.788762 10444 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:48.736887 10818 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260620 13:57:48.806483  5849 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:48.808068 10934 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:48.809094 10776 consensus_queue.cc:237] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:48.810189 10778 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:48.788149 10789 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:48.734979 10835 consensus_queue.cc:237] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.814126 10947 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:48.746956 10748 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:48.819291 10950 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:48.780772 10808 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:48.822710  6026 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:48.864749  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
W20260620 13:57:48.919351  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 54690us
I20260620 13:57:48.788502 10767 raft_consensus.cc:697] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:48.773715 10265 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:48.922358  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 115912us
I20260620 13:57:48.860460 10816 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:48.863997 10789 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:48.915553  5952 raft_consensus.cc:1275] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260620 13:57:48.918201 10773 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:48.923261 10830 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:48.936627 10265 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:48.939414  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2235) took 1166 ms. Trace:
I20260620 13:57:48.934406  5849 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:48.945199  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:48.946461  5849 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:48.944626  5955 rpcz_store.cc:276] 0620 13:57:47.773240 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:47.891626 (+118386us) service_pool.cc:224] Handling call
0620 13:57:47.892160 (+   534us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:48.452207 (+560047us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:57:48.452254 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:48.475710 (+ 23456us) log.cc:844] Serialized 26 byte log entry
0620 13:57:48.713755 (+238045us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:48.713798 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:48.713872 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:48.939182 (+225310us) raft_consensus.cc:1685] finished
0620 13:57:48.939203 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:48.939349 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20167,"raft.queue_time_us":144784,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":14513,"thread_start_us":734816,"threads_started":2,"wal-append.queue_time_us":437293}
I20260620 13:57:48.920575  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:48.929415 10947 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:48.828256 10805 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260620 13:57:48.949522  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:48.949802  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 119421us
W20260620 13:57:48.951594  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 174119us
I20260620 13:57:48.969345  5955 raft_consensus.cc:2393] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 12: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:48.971582  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:48.979264  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 58737.2us
I20260620 13:57:49.010737  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:48.995591  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:49.027174  5958 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:48.988263  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:49.033007  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:49.030033  6029 raft_consensus.cc:3055] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:57:49.033914  6029 raft_consensus.cc:740] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:49.035408  6029 consensus_queue.cc:260] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:49.033946  5950 raft_consensus.cc:2393] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:49.036787  6029 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:49.030267  5875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 1924) took 1998 ms. Trace:
W20260620 13:57:49.038879  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 92493.9us
I20260620 13:57:49.030983  5957 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:49.041953  5959 raft_consensus.cc:2393] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 12: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:48.928785 10808 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.039517  5875 rpcz_store.cc:276] 0620 13:57:47.031961 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:47.032104 (+   143us) service_pool.cc:224] Handling call
0620 13:57:48.379640 (+1347536us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:48.396673 (+ 17033us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:49.030076 (+633403us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54003fa2d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:49.030211 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3076331392}
I20260620 13:57:49.048533  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:49.049273  5877 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:48.980880 10937 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:48.980612 10265 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:49.058311  6024 raft_consensus.cc:606] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Received request to transfer leadership to TS 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:49.058658  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:48.941215 10950 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260620 13:57:49.070879  5959 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:49.071626  6586 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:57:48.943300 10816 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.028990 10961 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:49.051147 10934 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:48.967561 10947 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:49.076705  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 106850us
I20260620 13:57:49.035722 10830 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:48.967561 10876 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260620 13:57:49.062862 10978 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:48.967834 10773 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.096899  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:49.117259  5959 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:49.124380 10948 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:49.125258 10748 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.126477 10808 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.126803 10876 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:49.127447 10876 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.129642 10876 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.130162 10816 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.108486 10830 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:49.134088 10830 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:49.128310 10808 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260620 13:57:49.135217 10805 consensus_queue.cc:1048] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260620 13:57:49.151917 10781 raft_consensus.cc:3055] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:49.152500 10781 raft_consensus.cc:740] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:49.093030 10934 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:49.153146 10934 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:49.153486 10781 consensus_queue.cc:260] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.157069 10880 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:49.158160  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 61571.5us
I20260620 13:57:49.097957 10947 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:49.158907  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:49.066571 10937 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.097108 10827 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:49.154860 10781 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:49.174860  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:49.179806  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:49.078384 10265 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.173645  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:49.186214  5950 raft_consensus.cc:2410] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
W20260620 13:57:49.166733  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 110532us
I20260620 13:57:49.189813  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2452) took 2905 ms. Trace:
I20260620 13:57:49.135008 10773 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.184546  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:49.193576  6583 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:57:49.163259 10880 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:49.084940 10767 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.200989  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:49.210539 10983 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260620 13:57:49.193140  5954 rpcz_store.cc:276] 0620 13:57:46.275582 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:46.310673 (+ 35091us) service_pool.cc:224] Handling call
0620 13:57:48.192406 (+1881733us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:48.234526 (+ 42120us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:49.180829 (+946303us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b540007a3d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:49.181130 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4326960384}
I20260620 13:57:49.213553  6580 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:49.215586 10983 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260620 13:57:49.200129  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:49.203291  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:49.217109  6584 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:49.200732 10816 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:49.185652 10818 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:49.205485 10977 consensus_queue.cc:1059] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260620 13:57:49.208143 10959 log.cc:927] Time spent T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260620 13:57:49.209374 10973 consensus_queue.cc:1059] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:49.101985 10961 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.189181 10862 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:49.239735  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:49.199648  5849 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:49.218485  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:49.203830 10971 log.cc:927] Time spent T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260620 13:57:49.195411 10795 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:49.192426 10827 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.233807  5958 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:49.237078  6551 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:49.244800  5956 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:57:49.245759  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:49.247354  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:49.250677  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:49.253325  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:49.255980  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:49.263720  5883 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:49.233539  5959 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:49.266016 10871 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:49.266762 10937 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.217553 10880 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.267787  6551 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:49.268421  5879 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:49.268774 10880 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.269246 10977 consensus_queue.cc:1059] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:57:49.270216 10977 raft_consensus.cc:3055] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:49.270526 10977 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:49.271139 10809 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:57:49.271945 10827 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.271658 10977 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.273267 10977 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:49.258697 10982 raft_consensus.cc:3055] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:49.275681 10982 raft_consensus.cc:740] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:49.218310 10773 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260620 13:57:49.224778 10818 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:49.277410  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 77884.4us
I20260620 13:57:49.244185 10862 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:49.226732 10983 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260620 13:57:49.286971  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:49.284413  6026 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
W20260620 13:57:49.276577  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:49.290482 10912 raft_consensus.cc:3055] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Stepping down as leader of term 13
W20260620 13:57:49.285501  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 45030.8us
I20260620 13:57:49.285818  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:49.258713 10795 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:49.284834  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 82549.7us
I20260620 13:57:49.227401 10816 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.294124  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:49.297158  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:49.282812 10818 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:49.291627 10964 log.cc:927] Time spent T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260620 13:57:49.290939 10912 raft_consensus.cc:740] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:49.286688 10862 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:49.311472  5883 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:57:49.258826 10972 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260620 13:57:49.281620 10975 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260620 13:57:49.319388  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:49.294839 10795 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:49.329488 10931 log.cc:927] Time spent T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 1.142s	user 0.000s	sys 0.019s
I20260620 13:57:49.360595  5959 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260620 13:57:49.361649  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:49.361758  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:49.329974 10816 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.294834 10799 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:49.332722 10822 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:49.335167  5879 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260620 13:57:49.335794  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:49.336382  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:49.336526  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:49.337422 10925 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 1.286s	user 0.006s	sys 0.006s
I20260620 13:57:49.339437  5878 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: [7.10-7.10]
I20260620 13:57:49.340425  5883 pending_rounds.cc:85] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 8
I20260620 13:57:49.374440  5875 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
I20260620 13:57:49.376472  5883 pending_rounds.cc:107] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260620 13:57:49.377058  5883 raft_consensus.cc:2889] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:49.342898 10771 raft_consensus.cc:3055] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:49.293100 10265 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:49.344791 10936 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:49.347630  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:49.347223 10982 consensus_queue.cc:260] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.350725  5877 raft_consensus.cc:1240] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260620 13:57:49.350754  5958 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 16 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 15. Current term is 16. Ops: []
I20260620 13:57:49.384927  6025 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260620 13:57:49.385303  6025 pending_rounds.cc:85] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 12
I20260620 13:57:49.385527  6025 pending_rounds.cc:107] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 16.13
I20260620 13:57:49.385711  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:49.386330  5958 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:49.385753  6025 raft_consensus.cc:2917] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Aborting config change with OpId 16.13: Aborted: Op aborted by new leader
I20260620 13:57:49.387244  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:49.387300  6025 raft_consensus.cc:2889] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:57:49.352335  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 58290.8us
I20260620 13:57:49.354550  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:49.367086  5849 leader_election.cc:400] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 15. Current term is 16.
I20260620 13:57:49.370397  5954 raft_consensus.cc:1240] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
I20260620 13:57:49.390677  5849 leader_election.cc:403] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260620 13:57:49.371508  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:49.374534  5884 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:49.383548  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:49.384013  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 115022us
I20260620 13:57:49.393853  5955 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:49.395061 10265 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260620 13:57:49.371582 10985 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260620 13:57:49.397492 10980 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:49.398851  5997 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:49.362443 10913 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260620 13:57:49.399751  5954 raft_consensus.cc:1240] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260620 13:57:49.402074  5849 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:49.380594 10771 raft_consensus.cc:740] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:49.408192 10840 consensus_queue.cc:1059] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:49.338711 10866 consensus_queue.cc:260] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.411583 10973 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:49.413342  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:49.420773  5879 raft_consensus.cc:1240] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:49.424245  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:49.491216  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 77951us
W20260620 13:57:49.491659  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 67497.7us
I20260620 13:57:49.492041  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:49.492261  6551 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:49.457849  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 55836us
I20260620 13:57:49.434242 10947 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:49.439451 10912 consensus_queue.cc:260] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:49.443429 10805 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 15. Current term is 16.
I20260620 13:57:49.399819 10961 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:49.381039 10822 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:49.449647 10789 consensus_meta.cc:287] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.001s
I20260620 13:57:49.370962 10827 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:49.487809  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:49.497584  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:49.445400 10934 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.386255 10936 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:49.491197 10444 consensus_meta.cc:287] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.630s	user 0.007s	sys 0.004s
I20260620 13:57:49.512451  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:49.517720  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:49.517397  6580 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260620 13:57:49.521449  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:49.504741 10816 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:49.547511  5958 raft_consensus.cc:1240] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:49.521075  6578 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:49.517346  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:49.556986  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:49.543798  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:49.555431  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:49.504992 10979 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:49.497274 10975 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:49.587900  6025 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:57:49.589599  5959 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
W20260620 13:57:49.591050  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 93548.2us
I20260620 13:57:49.400534 10937 consensus_queue.cc:1059] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.153s
I20260620 13:57:49.592396  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:49.511989 10835 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:57:49.595577  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:49.510524 10866 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:49.597675  6032 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260620 13:57:49.590531  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 73320.7us
I20260620 13:57:49.588518 10778 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:49.548101 10773 consensus_queue.cc:1175] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "192c750f597c43858e1ad09e8d805685" responder_term: 13 status { last_received { term: 13 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 13 index: 8 } }
I20260620 13:57:49.603147  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:49.496384 10986 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
I20260620 13:57:49.562088 10983 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:49.591086 10816 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:49.607620  5924 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:49.590257 10991 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:49.613500  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:49.634955  5849 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:49.637023  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 141076us
I20260620 13:57:49.637673  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:49.560343 10789 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:49.506608 10868 consensus_queue.cc:1059] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260620 13:57:49.593462 10799 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:49.501452 10977 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260620 13:57:49.592949 10663 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:49.626487  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:49.683552  5956 raft_consensus.cc:2393] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:49.504745 10818 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.663614 10657 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:49.685774 10657 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:49.686214 10657 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:49.691202 10818 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.691751 10817 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.697573  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:49.700007  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:49.700240  5879 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260620 13:57:49.702596 10657 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:49.703459  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:49.704062  5884 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:49.704813 10657 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:49.598618 10771 consensus_queue.cc:260] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.719952 10934 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.720577  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:49.721827  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:49.722370  6025 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:49.723518  6025 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260620 13:57:49.724381 10933 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.730898 10862 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.732350  6029 raft_consensus.cc:1240] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:49.737095  5953 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:49.642050 10876 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:49.599059 10835 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:49.592098 10979 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:49.643636 10947 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:49.648463  6031 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:49.649194 10970 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260620 13:57:49.651275 10954 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.876s	user 0.000s	sys 0.003s
I20260620 13:57:49.608104 10805 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260620 13:57:49.589564 10444 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:49.657521 10990 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.251s	user 0.000s	sys 0.002s
I20260620 13:57:49.629408 10816 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:49.659761 10978 consensus_queue.cc:1059] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:57:49.626298 10830 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:49.661319  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:49.780186  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 137644us
I20260620 13:57:49.740003  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:49.742245  6026 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:49.510782 10840 consensus_queue.cc:1048] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
W20260620 13:57:49.746202  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 111663us
I20260620 13:57:49.748255  5950 raft_consensus.cc:1240] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:49.751034  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:49.613066 10778 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.661654 10991 raft_consensus.cc:697] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:49.663229 10776 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:49.769666  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 141704us
I20260620 13:57:49.752635 10929 raft_consensus.cc:3055] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:49.778525  6025 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260620 13:57:49.753247 10835 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:49.797710  5956 raft_consensus.cc:2393] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:49.767895 10970 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:49.752635 10979 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:49.808967  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:49.757091 10868 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:57:49.806690  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:49.509124 10972 consensus_queue.cc:1175] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "192c750f597c43858e1ad09e8d805685" responder_term: 16 status { last_received { term: 16 index: 13 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260620 13:57:49.801369  6028 raft_consensus.cc:2368] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12.
I20260620 13:57:49.814670  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:49.814734  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:49.816256  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:49.839843  5878 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
W20260620 13:57:49.839975  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 45182.9us
I20260620 13:57:49.744926 10663 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:49.840698  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:49.842229  5998 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:49.837262 10805 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:49.792797 10830 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:49.808668 10929 raft_consensus.cc:740] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:49.843755 10805 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.803269 10933 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260620 13:57:49.753964 10795 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.871289  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:49.841475 10970 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:49.809046 10947 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260620 13:57:49.871945 10830 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:49.872789 10933 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:49.880749 10960 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260620 13:57:49.897996 11001 raft_consensus.cc:3055] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:49.898591 11001 raft_consensus.cc:740] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:49.899536 11001 consensus_queue.cc:260] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.900677 11001 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:49.900713 10795 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.840085 10776 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:49.902633 10996 log.cc:927] Time spent T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260620 13:57:49.903189 10817 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:57:49.903708 10817 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:49.903890 10933 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:57:49.904168 10817 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:57:49.905660 10444 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:49.906061 10862 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:49.907092 10949 log.cc:927] Time spent T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 1.096s	user 0.004s	sys 0.000s
I20260620 13:57:49.907678 10663 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:49.908135 10997 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260620 13:57:49.909467  5956 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 15: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:49.909478 10805 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.912052 10805 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:49.912535 10805 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:49.914510 10805 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:49.911319  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:49.916716  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2236) took 2143 ms. Trace:
I20260620 13:57:49.917145  5951 rpcz_store.cc:276] 0620 13:57:47.773537 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:47.909738 (+136201us) service_pool.cc:224] Handling call
0620 13:57:47.910179 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:47.913611 (+  3432us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:47.913674 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:47.914278 (+   604us) log.cc:844] Serialized 26 byte log entry
0620 13:57:48.666144 (+751866us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:48.666185 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:48.666254 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:49.906520 (+1240266us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:49.916423 (+  9903us) raft_consensus.cc:1685] finished
0620 13:57:49.916451 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:49.916657 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2973,"raft.queue_time_us":172000,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":4315,"spinlock_wait_cycles":24811776,"thread_start_us":620348,"threads_started":1,"wal-append.queue_time_us":796696}
I20260620 13:57:49.878484 11006 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:49.919772 11006 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:49.922484  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:49.924458  5956 raft_consensus.cc:1240] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:49.926357  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:49.932870  6028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43502 (request call id 2555) took 1224 ms. Trace:
I20260620 13:57:49.933321 10827 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:49.935504 11020 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:49.936028 11020 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:49.936434 11020 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:49.937759 10776 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.937942 10982 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:49.938365 10776 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:49.933336  6028 rpcz_store.cc:276] 0620 13:57:48.709044 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:48.709235 (+   191us) service_pool.cc:224] Handling call
0620 13:57:49.932665 (+1223430us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000d3754. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:49.932807 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2424882560}
I20260620 13:57:49.940569 10817 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:49.895582  6029 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:49.977209  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:49.828363 10992 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
W20260620 13:57:49.945768 10907 log.cc:927] Time spent T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 1.127s	user 0.001s	sys 0.001s
I20260620 13:57:49.947803 10991 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:49.889207 10822 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:49.872368 10810 consensus_queue.cc:1059] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
W20260620 13:57:49.880141  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 73554.2us
I20260620 13:57:49.952916  5956 raft_consensus.cc:1240] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:49.915021 10805 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:49.949112 10789 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:49.938850 10776 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:49.974413  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 219859us
I20260620 13:57:49.989296  5955 raft_consensus.cc:1240] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: []
W20260620 13:57:50.003625  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 161444us
I20260620 13:57:49.997987  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:50.021018 10799 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:50.021821 10799 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:50.022388 10799 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:50.030958 10778 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:50.031353 10955 log.cc:927] Time spent T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 1.177s	user 0.003s	sys 0.001s
I20260620 13:57:49.985323 10975 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:57:49.986814 11006 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:49.995450 10935 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:50.011339 10868 raft_consensus.cc:697] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:50.041390  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:50.034930  6552 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:50.045071 10961 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:50.126482  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 71478.5us
I20260620 13:57:50.045944  5848 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:50.011009 10822 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.097s
I20260620 13:57:49.962891 10929 consensus_queue.cc:260] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:50.133038  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 98196.7us
I20260620 13:57:50.052284 10831 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:50.134991  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:50.134322  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 88501.4us
I20260620 13:57:50.145509  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:50.056310 10980 consensus_queue.cc:1059] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260620 13:57:50.126938 11004 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:50.166204 10767 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260620 13:57:50.166603 11017 consensus_queue.cc:1175] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "192c750f597c43858e1ad09e8d805685" responder_term: 12 status { last_received { term: 10 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12. Ops: [11.10-11.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260620 13:57:50.146662 10975 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:50.167920 11028 consensus_queue.cc:1059] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260620 13:57:50.150610 10871 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260620 13:57:50.056954 10935 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:50.187932  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 53010.6us
I20260620 13:57:50.160758 10816 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.192656 10816 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:50.174877 10767 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:50.193634 10767 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:50.194069 10979 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.195392 10817 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:50.196486 10840 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:57:50.196610 10980 raft_consensus.cc:3055] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:50.196973 10840 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:50.197515 10840 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:50.197002 10980 raft_consensus.cc:740] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:50.199783 10980 consensus_queue.cc:260] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:50.201323 10980 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:50.160063 10970 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:50.203429 11005 log.cc:927] Time spent T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260620 13:57:50.198860 10935 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:50.204469 10970 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:50.205348 11008 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260620 13:57:50.187361 10947 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:50.207186 10947 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.207994  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:50.209400 10947 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:50.183537 11004 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:50.212553 11015 log.cc:927] Time spent T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260620 13:57:50.211824 10979 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:50.213487 10835 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.218559 10840 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.128664 11002 consensus_queue.cc:1059] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.156s
I20260620 13:57:50.187069 10933 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.222791 10776 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:50.147615 10961 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.184387 10975 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:50.174578 10929 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:50.225147 10835 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:50.225595 10866 consensus_meta.cc:287] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.003s
I20260620 13:57:50.212579 11004 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:50.154973 10831 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.228850  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:50.232682  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:50.233709  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:50.237609  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:50.239532  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:50.304311  5880 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:50.259903  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:50.264987  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:50.295930 10975 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:50.288338 11020 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:50.223022 10657 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:57:50.227010 11028 raft_consensus.cc:3055] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Stepping down as leader of term 11
W20260620 13:57:50.291543 10936 consensus_meta.cc:287] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.000s
I20260620 13:57:50.264315 10876 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:50.251150  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 209811us
I20260620 13:57:50.306120  5882 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:57:50.223203 10871 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:50.307659  5998 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:50.320036  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:50.323805  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 178365us
I20260620 13:57:50.324690  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:50.326177  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:50.332217  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:50.336530  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:50.335768  5880 raft_consensus.cc:2410] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260620 13:57:50.311517 11028 raft_consensus.cc:740] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:50.351684  5924 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:50.352947  5998 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:50.356892  6032 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
W20260620 13:57:50.357412  5849 leader_election.cc:336] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Timed out: RequestConsensusVote RPC to 127.4.155.195:41493 timed out after 1.789s (SENT)
I20260620 13:57:50.357889  5849 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:50.333148 11001 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:50.325736 10871 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:57:50.189018 10868 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.358887  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:50.325551 10936 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.323734 10876 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:50.337350 11006 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:50.360654  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:50.429204  5884 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260620 13:57:50.337141 10657 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:50.402172  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:50.405488  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 53866.3us
I20260620 13:57:50.424141  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2247) took 1078 ms. Trace:
I20260620 13:57:50.479221  5882 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 18.
I20260620 13:57:50.541997  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:50.466672  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:50.542317  5950 rpcz_store.cc:276] 0620 13:57:49.345550 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:49.350905 (+  5355us) service_pool.cc:224] Handling call
0620 13:57:49.378961 (+ 28056us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:49.797348 (+418387us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:50.423186 (+625838us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b5400306954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:50.423907 (+   721us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848876416}
I20260620 13:57:50.409190  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:50.544277  5950 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260620 13:57:50.544997 11025 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:50.545608 10916 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:57:50.355147 10835 consensus_queue.cc:1059] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.192s
I20260620 13:57:50.547855 10835 raft_consensus.cc:3055] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:50.479992  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:50.334601 10776 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:50.528676  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:50.555725  5876 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:50.529601  5884 pending_rounds.cc:85] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 10
I20260620 13:57:50.556463  5884 pending_rounds.cc:107] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260620 13:57:50.556731  5884 raft_consensus.cc:2889] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:50.520612 10796 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:50.360692 10816 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260620 13:57:50.430044 11030 log.cc:927] Time spent T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260620 13:57:50.416105 11034 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260620 13:57:50.414122 11021 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:50.413436 11016 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:50.414773 10984 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:50.358750 11027 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260620 13:57:50.539696 10840 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:50.540287 11028 consensus_queue.cc:260] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:50.497033 10957 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 1.718s	user 0.004s	sys 0.000s
I20260620 13:57:50.574911 10796 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.638263 10992 consensus_queue.cc:1059] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:50.639055 10796 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:50.639488 10992 consensus_queue.cc:1059] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:57:50.640295 10992 raft_consensus.cc:3055] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:57:50.640604 10992 raft_consensus.cc:740] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:50.641425 10992 consensus_queue.cc:260] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:50.642580 10992 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:50.649943 10657 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:50.575083 11021 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:50.650976 11021 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:57:50.652366 10830 consensus_meta.cc:287] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.726s	user 0.007s	sys 0.005s
I20260620 13:57:50.652799 10830 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.586120 11016 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.658226 11016 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:50.659286  5881 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:50.591506 10984 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.575253 10781 consensus_queue.cc:1059] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260620 13:57:50.532156 10799 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.664666 10781 raft_consensus.cc:3055] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:50.665110 10781 raft_consensus.cc:740] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:50.666031 10781 consensus_queue.cc:260] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:50.666415 10799 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:50.669435 11037 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:50.670073 11037 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:50.672456 11037 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:50.673045 10830 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:50.638195 10871 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.675779  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2246) took 1330 ms. Trace:
I20260620 13:57:50.677696  5954 raft_consensus.cc:1240] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:50.350008 10817 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:50.550820  5950 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:50.550604  5998 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:57:50.416097 11029 log.cc:927] Time spent T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260620 13:57:50.350975 11002 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.204s
I20260620 13:57:50.425298 11031 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:50.553980 11006 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:50.429443 11020 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:50.421006 10831 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:50.498443 10983 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:50.497915 10827 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:50.423228 10933 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:50.545635 11025 raft_consensus.cc:697] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:50.548573 10936 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:50.414026 10961 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:50.589666  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:50.590260  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:50.421187 10051 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.142s
I20260620 13:57:50.704125  6031 raft_consensus.cc:1275] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260620 13:57:50.552819 10835 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:50.705952 10835 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.707329 10835 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:50.708618 10985 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:50.709108 10985 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.710598  5881 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:57:50.712313 10871 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:50.713759 10985 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:50.714330 10983 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.715054  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2254) took 1367 ms. Trace:
I20260620 13:57:50.715502  5958 rpcz_store.cc:276] 0620 13:57:49.351290 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:49.388090 (+ 36800us) service_pool.cc:224] Handling call
0620 13:57:49.388340 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:49.587411 (+199071us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:50.714796 (+1127385us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54001829d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:50.714996 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365449600}
I20260620 13:57:50.715610 11025 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.716863  6027 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:50.717489 10983 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:50.627923  6028 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260620 13:57:50.700955 11031 raft_consensus.cc:697] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:50.720463  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:50.720192 11031 consensus_queue.cc:237] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.401463 10767 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.681211  5876 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:57:50.721138  6028 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:57:50.681795  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 131283us
I20260620 13:57:50.676302  5953 rpcz_store.cc:276] 0620 13:57:49.345302 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:49.350828 (+  5526us) service_pool.cc:224] Handling call
0620 13:57:49.380257 (+ 29429us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:49.737713 (+357456us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:50.675458 (+937745us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54001824d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:50.675692 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820049152}
W20260620 13:57:50.685310  6030 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 1063) took 5463 ms (client timeout 1532 ms). Trace:
W20260620 13:57:50.722522  6030 rpcz_store.cc:269] 0620 13:57:45.217576 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:45.235678 (+ 18102us) service_pool.cc:224] Handling call
0620 13:57:50.680450 (+5444772us) spinlock_profiling.cc:243] Waited 3.3 s on lock 0x7b54000d5f54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:50.680586 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7598404352}
I20260620 13:57:50.722888 10767 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:50.723618  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:50.723933  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:50.350800 11004 consensus_queue.cc:1059] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.223s
I20260620 13:57:50.680719 10781 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:50.716799  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:50.732977  5958 raft_consensus.cc:2393] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:57:50.690248  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 337233us
I20260620 13:57:50.725611  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:50.737978  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:50.739010  5953 raft_consensus.cc:2393] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:50.739212  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:50.741504  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:50.742381  5882 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:50.703037 11006 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:50.734331 10980 raft_consensus.cc:2804] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election won for term 18
I20260620 13:57:50.685904 10817 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.755618  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:50.758908  6552 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:50.759356  5953 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:50.759516  6030 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:57:50.747711 10983 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:57:50.762665  6552 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:50.745755 10985 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:50.777644  5884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 1105) took 1030 ms. Trace:
I20260620 13:57:50.769945  5955 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:50.790906  5953 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260620 13:57:50.792642  5884 rpcz_store.cc:276] 0620 13:57:49.747091 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:49.747263 (+   172us) service_pool.cc:224] Handling call
0620 13:57:49.747585 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:50.557162 (+809577us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:50.777286 (+220124us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b54003f2854. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:50.777559 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1566754048}
I20260620 13:57:50.789453  6028 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:57:50.793670  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:50.780589  6027 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:57:50.797775  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:50.800964 11002 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:50.802582  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:50.804736  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2482) took 1434 ms. Trace:
I20260620 13:57:50.805510 11002 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:50.805348  5959 rpcz_store.cc:276] 0620 13:57:49.369821 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:49.370998 (+  1177us) service_pool.cc:224] Handling call
0620 13:57:50.804485 (+1433487us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400044054. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:50.804660 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454169472}
W20260620 13:57:50.809932  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:50.810201 11002 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:50.826121 10816 consensus_queue.cc:1059] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260620 13:57:50.829897  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2472) took 2216 ms. Trace:
I20260620 13:57:50.830355 10816 raft_consensus.cc:3055] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:50.831000 10816 raft_consensus.cc:740] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:50.816319 10866 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:50.842036 10866 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:50.842720  6027 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:50.844218  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:50.845106  6027 raft_consensus.cc:2368] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 14. Current term is 15.
I20260620 13:57:50.845327 10866 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:50.846127  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:50.799220 11032 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:50.802845  6024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50466 (request call id 34) took 2407 ms. Trace:
I20260620 13:57:50.847767  6024 rpcz_store.cc:276] 0620 13:57:48.395859 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:48.404316 (+  8457us) service_pool.cc:224] Handling call
0620 13:57:50.802611 (+2398295us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b540037c3d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7f6c33 00007f0fe47c4d0a 00007f0fddd48934 00007f0fddd488c2 00007f0fddd487f1 00007f0fddd4876c 00007f0fddd47a22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:50.802727 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465152896}
I20260620 13:57:50.848359  6029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1104) took 1070 ms. Trace:
I20260620 13:57:50.849243  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:50.850075  6024 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:50.851011 10936 raft_consensus.cc:3055] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:50.851562 10936 raft_consensus.cc:740] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:50.841044 11001 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:50.852732 11001 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.856150 11001 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:50.848889  6029 rpcz_store.cc:276] 0620 13:57:49.777514 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:49.777738 (+   224us) service_pool.cc:224] Handling call
0620 13:57:49.778075 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:49.977122 (+199047us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:50.848075 (+870953us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54001ca054. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:50.848291 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269800832}
I20260620 13:57:50.858776  6029 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260620 13:57:50.861485  6029 raft_consensus.cc:1240] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:50.856690  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:50.852777 10936 consensus_queue.cc:260] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:50.863251 10977 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:50.863549 10936 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:50.864248  5850 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.006s	sys 0.019s
I20260620 13:57:50.863996 10977 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:50.811766  6552 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:50.867599  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 55937us
W20260620 13:57:50.870287  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:50.870213  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:50.871152 10819 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:50.871510  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:50.871693 10819 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:50.872296  6584 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 19: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:50.873328  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:50.873908 10819 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:50.875268  6584 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260620 13:57:50.864645  5850 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.006s	sys 0.019s
I20260620 13:57:50.875620  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:50.878631  5875 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:50.879560 11032 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:50.880259  5884 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260620 13:57:50.880810  5881 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260620 13:57:50.880993  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:50.879793  6585 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEARNER]: Advancing to term 17
I20260620 13:57:50.883992  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:50.885578  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:50.886364  5954 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:50.846254 10866 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:50.889019 10866 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.879617 11002 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260620 13:57:50.891829  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:50.894296  5875 raft_consensus.cc:1240] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 17. Current term is 18. Ops: []
I20260620 13:57:50.894730  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:50.895678  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:50.897387  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:50.898497 10991 raft_consensus.cc:3055] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:57:50.898906 10991 raft_consensus.cc:740] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:50.796679 11043 consensus_queue.cc:1059] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260620 13:57:50.899801 10991 consensus_queue.cc:260] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.901219 11043 raft_consensus.cc:3055] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:50.901664 11043 raft_consensus.cc:740] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:50.797405 10983 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:50.903316  5955 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:50.904052 10983 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.820369  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2261) took 1015 ms. Trace:
I20260620 13:57:50.907807  5956 rpcz_store.cc:276] 0620 13:57:49.804658 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:50.013176 (+208518us) service_pool.cc:224] Handling call
0620 13:57:50.810355 (+797179us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:50.810607 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:50.810647 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:50.810709 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:50.810756 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:50.810834 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:50.813381 (+  2547us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b5400044050. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:50.820273 (+  6892us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832623872}
I20260620 13:57:50.830480  5952 rpcz_store.cc:276] 0620 13:57:48.613373 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:48.615469 (+  2096us) service_pool.cc:224] Handling call
0620 13:57:48.628615 (+ 13146us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:48.940603 (+311988us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:50.829442 (+1888839us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b5400042c54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:50.829804 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":657797888}
I20260620 13:57:50.919638  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:50.920517  6583 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:50.921161  6030 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 19.
I20260620 13:57:50.764034 10980 raft_consensus.cc:697] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:50.766595 10434 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:50.774825 10771 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:50.925184  6585 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 17 LEARNER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260620 13:57:50.795017 10871 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 13:57:50.783453 10876 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:50.764235 11022 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:50.929456  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:50.766361 10809 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.165s
I20260620 13:57:50.964612  5953 raft_consensus.cc:1240] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:50.796536 10985 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.976007  5956 raft_consensus.cc:2393] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 8: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:50.964388  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:50.965385  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260620 13:57:50.901245 10991 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:50.761255 10975 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.880340 11032 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:50.970811  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:50.971295  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:50.987182  5950 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:50.987352  5882 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:50.933403 10912 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:57:50.962713 10952 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 2.143s	user 0.003s	sys 0.001s
I20260620 13:57:50.902642 11043 consensus_queue.cc:260] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:50.982157  5876 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:57:50.983393  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:50.983523  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 254060us
I20260620 13:57:50.983901  5881 raft_consensus.cc:1275] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260620 13:57:50.961552 11002 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:51.016945  5998 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:51.018339  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:51.024511  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:50.926347 10831 raft_consensus.cc:3055] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:51.028002  6585 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260620 13:57:50.923189 10986 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:51.038434  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:51.081815  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:51.088763  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:51.008937 10876 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:51.009200 11032 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:51.101936  5849 leader_election.cc:400] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 14. Current term is 15.
I20260620 13:57:51.110320  5849 leader_election.cc:403] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260620 13:57:51.026504 10981 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:51.023234 10948 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:51.113794  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:51.023794 10977 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:51.047672 11006 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:51.121678 11037 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 14. Current term is 15.
I20260620 13:57:51.122234 10982 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260620 13:57:51.123670 11046 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260620 13:57:51.046872 10781 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election won for term 15
W20260620 13:57:51.125830  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:51.178171  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:50.981043 11022 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.127775  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:51.129972 10988 consensus_queue.cc:1059] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:51.112015 10830 consensus_queue.cc:1059] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260620 13:57:51.046155 10929 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:51.079036 10868 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:51.157148  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58456 (request call id 1956) took 1342 ms. Trace:
I20260620 13:57:51.164341  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:51.103602 11043 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:51.128350 10866 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:51.251291  5879 rpcz_store.cc:276] 0620 13:57:49.814377 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:49.814489 (+   112us) service_pool.cc:224] Handling call
0620 13:57:51.156828 (+1342339us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002b39d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:51.157054 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2724346240}
W20260620 13:57:51.176688 10950 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.423s	user 0.003s	sys 0.045s
I20260620 13:57:50.924690 10816 consensus_queue.cc:260] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:51.035125 11002 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:51.216207  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:51.117385 10980 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:51.211432  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:51.181166  6585 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 15.
I20260620 13:57:51.086143 10831 raft_consensus.cc:740] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:57:51.106865  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 392512us
I20260620 13:57:51.259079  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:51.176373 10982 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:51.262588  5882 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:51.290759  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:51.291424  5880 raft_consensus.cc:1240] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:51.291608  6586 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:51.142515 10984 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:51.152325 10948 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.114524 10876 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:51.253396 10781 raft_consensus.cc:697] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:51.270735  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:51.293227 10816 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:51.299890  6587 raft_consensus.cc:2393] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:51.250464  5876 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:51.300439 10876 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:51.300209 10781 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.301070 10876 raft_consensus.cc:3055] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:57:51.301388 10876 raft_consensus.cc:740] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:51.302129 10876 consensus_queue.cc:260] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:51.182247 10663 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:51.303702 10663 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:51.188606 10819 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:51.161206 11006 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:51.273424 11003 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:51.286993 10817 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:51.296178  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:51.294999 10975 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:51.259380 10929 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.185065 10939 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:51.286440  6584 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:51.306856  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:51.358237  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:51.307199  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:51.274995 10950 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.509s	user 0.004s	sys 0.050s
I20260620 13:57:51.305677  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:51.321282  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:51.366832  6586 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260620 13:57:51.326946  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:51.351647  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:51.356612  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:51.309194  6583 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260620 13:57:51.266124 10830 consensus_queue.cc:1059] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260620 13:57:51.310900 11026 log.cc:927] Time spent T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260620 13:57:51.388110  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:51.385306  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:51.388649  6587 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 19: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:51.314900 10796 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:51.369367  6031 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260620 13:57:51.161675 10981 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.390959  6584 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:51.116029 10986 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.361696 10876 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:51.371745  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:51.383803  6026 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260620 13:57:51.369486 10975 raft_consensus.cc:3055] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Stepping down as leader of term 13
W20260620 13:57:51.421101  6028 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.019s	sys 0.027s
I20260620 13:57:51.305274 10982 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:51.341033  5876 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
W20260620 13:57:51.396021 11031 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.013s	sys 0.011s
I20260620 13:57:51.424659  6587 raft_consensus.cc:1240] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:51.418092  5997 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:51.389874 10835 consensus_meta.cc:287] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.004s
I20260620 13:57:51.264137 10868 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:51.412329 10796 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.430581  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1167) took 1927 ms. Trace:
I20260620 13:57:51.431027  5951 rpcz_store.cc:276] 0620 13:57:49.503280 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:49.918688 (+415408us) service_pool.cc:224] Handling call
0620 13:57:49.919052 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:49.935418 (+ 16366us) raft_consensus.cc:1534] Early marking committed up to index 8
0620 13:57:49.935702 (+   284us) log.cc:844] Serialized 14 byte log entry
0620 13:57:50.139473 (+203771us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:50.146073 (+  6600us) log.cc:844] Serialized 52 byte log entry
0620 13:57:50.146244 (+   171us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:50.308963 (+162719us) log.cc:844] Serialized 14 byte log entry
0620 13:57:50.309276 (+   313us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:50.309366 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:51.152938 (+843572us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b1800101b00. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc70abf3 00007f0fdc70cfc1 00007f0fdc70cf79 00007f0fdc70cf09 00007f0fdc70ced1 00007f0fdc70c1cd 0000000000389354 0000000000389199 00007f0fdc6ee03a
0620 13:57:51.430344 (+277406us) raft_consensus.cc:1685] finished
0620 13:57:51.430369 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:51.430520 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44313,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":80,"raft.queue_time_us":65975,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":19590,"spinlock_wait_cycles":5279488,"thread_start_us":339712,"threads_started":2,"wal-append.queue_time_us":382405}
W20260620 13:57:51.422307  6028 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.019s	sys 0.027s
I20260620 13:57:51.347695 11006 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:51.440563 10880 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:51.441140 10880 raft_consensus.cc:697] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:51.442008 10880 consensus_queue.cc:237] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:51.315217 10918 consensus_queue.cc:1059] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.098s
I20260620 13:57:51.443753 10918 raft_consensus.cc:3055] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 17 LEADER]: Stepping down as leader of term 17
I20260620 13:57:51.444139 10918 raft_consensus.cc:740] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:51.409808 10961 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:51.329773 10819 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.457978  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:51.426080 11031 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.014s	sys 0.011s
I20260620 13:57:51.369918 10939 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:51.450789  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:51.474570  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:51.470100 10981 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:51.470860 10819 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:51.420472 10771 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:51.488821  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:51.490451  6580 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260620 13:57:51.461652 11024 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:51.477402  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:51.425895 10985 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:51.507241  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:51.509006  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:51.481950  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:51.363543 11003 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.470763 10948 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:51.427094 10975 raft_consensus.cc:740] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:51.520264  5881 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:51.465260  5997 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:51.522322  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 57239.2us
W20260620 13:57:51.479705 11021 consensus_meta.cc:287] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.823s	user 0.014s	sys 0.000s
I20260620 13:57:51.502432  6585 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:51.444955 10918 consensus_queue.cc:260] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:51.453258 10817 consensus_queue.cc:1059] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260620 13:57:51.535707  5848 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:51.537319  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:51.538530  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:51.549957  5882 raft_consensus.cc:2410] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260620 13:57:51.540844  5883 raft_consensus.cc:1240] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:51.425328 10831 consensus_queue.cc:260] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.506645 11024 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:51.504909 11022 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:51.465826 10961 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.547847  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:51.539750  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:51.551070  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:51.578297  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:51.578903  5883 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 10.
I20260620 13:57:51.570399  6587 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:51.530952 10984 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:51.579921  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:51.582095  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:51.586367  5883 raft_consensus.cc:2410] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260620 13:57:51.587090 10871 consensus_queue.cc:1059] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:57:51.582450  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:51.529016 10434 consensus_queue.cc:1059] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260620 13:57:51.589401  5877 raft_consensus.cc:1240] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260620 13:57:51.594820  6552 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:51.503974 10771 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:51.603924 11055 log.cc:927] Time spent T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260620 13:57:51.605628 11052 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260620 13:57:51.607095  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2861) took 1258 ms. Trace:
I20260620 13:57:51.607877 10809 raft_consensus.cc:3055] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:51.608430 10809 raft_consensus.cc:740] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:51.608610  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:51.609525 10809 consensus_queue.cc:260] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.610201  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:51.611442 10809 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:51.611979  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:51.614920 10434 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:51.607601  6033 rpcz_store.cc:276] 0620 13:57:50.348635 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:50.349211 (+   576us) service_pool.cc:224] Handling call
0620 13:57:50.436567 (+ 87356us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:50.575487 (+138920us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:50.575544 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:50.711684 (+136140us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b2c000c06c8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fde0f5c71 00007f0fde1055d2 00007f0fdf837de1 00007f0fdf7fc81a 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22
0620 13:57:50.712342 (+   658us) log.cc:844] Serialized 26 byte log entry
0620 13:57:51.166390 (+454048us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:51.166435 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:51.274315 (+107880us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540037cdd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:51.274386 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:51.606767 (+332381us) raft_consensus.cc:1685] finished
0620 13:57:51.606797 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:51.607005 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":7031,"spinlock_wait_cycles":326911232,"thread_start_us":453636,"threads_started":1,"wal-append.queue_time_us":816593}
I20260620 13:57:51.616652  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:51.515606 10778 consensus_queue.cc:1059] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260620 13:57:51.628994 10975 consensus_queue.cc:260] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:51.629485 10778 raft_consensus.cc:3055] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:51.630080 10778 raft_consensus.cc:740] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:51.630463 10975 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:51.631672 10778 consensus_queue.cc:260] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.633653 10778 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:51.594385 10918 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:57:51.640914  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:51.642427  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:51.582867 10663 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:51.589356 10978 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:51.534273 11021 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.544557 10948 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260620 13:57:51.647656 10831 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:51.643070  6585 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:57:51.666342  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:51.651013  5952 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:51.626078 11028 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:51.519637 11004 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260620 13:57:51.654636  6581 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:51.745817  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:51.747231  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:51.661912 10948 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:51.755424 10948 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.758389 10948 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:51.652323 11021 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:51.654084 10961 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:51.760036 10961 consensus_queue.cc:1059] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:51.761058 10961 raft_consensus.cc:3055] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:51.761448 10961 raft_consensus.cc:740] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:57:51.674508 11051 log.cc:927] Time spent T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.249s	user 0.001s	sys 0.001s
W20260620 13:57:51.678308  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:51.678488  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:51.765424  6585 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 15: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:51.681443 11001 raft_consensus.cc:3055] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:51.682519 10835 raft_consensus.cc:3055] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:51.700728  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:51.649539 10981 consensus_queue.cc:1175] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "192c750f597c43858e1ad09e8d805685" responder_term: 14 status { last_received { term: 13 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260620 13:57:51.762517 10961 consensus_queue.cc:260] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.569216 10985 consensus_queue.cc:1059] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
I20260620 13:57:51.789448 10961 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:51.790213 10835 raft_consensus.cc:740] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:51.759053 10948 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:51.705579 10912 consensus_meta.cc:287] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.690s	user 0.007s	sys 0.002s
I20260620 13:57:51.575515 11024 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:51.791618 10948 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:51.794266 10948 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:51.595806 11022 consensus_queue.cc:1048] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.110s
I20260620 13:57:51.795352 11022 consensus_queue.cc:1243] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260620 13:57:51.584945 10984 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:51.797063 10984 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:51.708011 10771 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:51.650003 10978 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:51.711720  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:51.799743 10978 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:51.712642 10986 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:51.712658 10817 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:51.713572  6031 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260620 13:57:51.714411  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:51.807464 10817 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.808213  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:51.808290  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:51.809481  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:51.711778 10977 raft_consensus.cc:3055] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:51.813179 10977 raft_consensus.cc:740] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:51.720853  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:57:51.814145 10977 consensus_queue.cc:260] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.649477 10939 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:51.814129 10936 consensus_meta.cc:287] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.950s	user 0.010s	sys 0.003s
I20260620 13:57:51.725860  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:51.726436 10796 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:51.727909  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:51.818161  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:51.809608 10817 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:51.728379  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:51.728710  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:51.791632 10835 consensus_queue.cc:260] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.729755  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:51.730937 10929 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:51.820680  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:51.732868  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:51.820920 10835 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:51.821322  5880 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:51.733986  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:51.823272  5877 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:51.738740  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:51.825486  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:51.752056 10434 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:51.838434 10434 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.840620  6032 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:51.711845 11002 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:51.781561  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:51.782209 11001 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:51.844764 11001 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.804831 10912 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:51.856165 10912 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:51.861728  6029 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
W20260620 13:57:51.865588 11032 consensus_meta.cc:287] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.699s	user 0.007s	sys 0.004s
I20260620 13:57:51.809590  6031 raft_consensus.cc:1240] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:51.738479 10809 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:51.812155  6583 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 15. Current term is 16. Ops: []
I20260620 13:57:51.714665 11003 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:51.821518  6024 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 19: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:51.744750 10871 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:51.867640 10868 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:51.803975 11006 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:51.869239 10434 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:51.802798  5881 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 15: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:51.747417 10827 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:51.862447 10982 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.858984 10912 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:51.880429  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 53524.3us
I20260620 13:57:51.884029 11001 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:51.814857  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260620 13:57:51.898800  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:51.890383  5877 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:51.979310  5883 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:57:51.914465  5882 raft_consensus.cc:1240] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260620 13:57:51.894603 10984 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.952739  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:51.906062 11024 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.892529 10871 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:52.009321  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 56711.3us
I20260620 13:57:52.006732 10984 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:52.009516  6026 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: []
W20260620 13:57:52.035048  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:52.025884  5957 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.019s	sys 0.054s
W20260620 13:57:52.054502  5957 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.020s	sys 0.054s
I20260620 13:57:51.975266  6581 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:52.000353  6582 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:57:52.024842  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:51.926602 11043 consensus_meta.cc:287] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.663s	user 0.005s	sys 0.010s
I20260620 13:57:51.956674  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:51.964852 10991 consensus_meta.cc:287] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.976s	user 0.012s	sys 0.000s
I20260620 13:57:51.914242 10982 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:52.070740  5883 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 15. Current term is 16. Ops: []
W20260620 13:57:52.017088 11017 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.022s	sys 0.055s
I20260620 13:57:51.940155 10912 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:51.912258 11006 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:52.008512 10983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.010s	sys 0.063s
I20260620 13:57:52.064263  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:52.134542  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 70336.5us
I20260620 13:57:52.078290  6029 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:52.078228  6587 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
W20260620 13:57:52.080704  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:52.080156  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2248) took 2734 ms. Trace:
W20260620 13:57:52.092772  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:51.940035 10817 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:51.891286 10809 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:51.921622 10918 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:52.140568 11017 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.022s	sys 0.064s
I20260620 13:57:52.147710  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:52.075634 11003 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:52.149854 10778 consensus_queue.cc:1059] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260620 13:57:52.158820 11002 raft_consensus.cc:3055] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:52.154253  6024 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:52.159744  6585 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 7. Current term is 8. Ops: [7.10-7.10]
I20260620 13:57:51.919291 11032 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.138339  5957 rpcz_store.cc:276] 0620 13:57:49.345779 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:49.347191 (+  1412us) service_pool.cc:224] Handling call
0620 13:57:50.801019 (+1453828us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:57:50.801287 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:50.801581 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 7
0620 13:57:50.801960 (+   379us) log.cc:844] Serialized 14 byte log entry
0620 13:57:52.079154 (+1277194us) log.cc:844] Serialized 14 byte log entry
0620 13:57:52.079647 (+   493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:52.079722 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:52.079796 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:52.079921 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:52.080084 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":217837,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":29556,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":3145472,"thread_start_us":1251815,"threads_started":2,"wal-append.queue_time_us":662451}
I20260620 13:57:51.912227 10827 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:52.142403 10983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.010s	sys 0.064s
I20260620 13:57:52.128437 10871 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:52.163502  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:52.163516  6552 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:52.131641 10771 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:57:52.174484  5923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.021s	sys 0.034s
W20260620 13:57:52.174827  5923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.021s	sys 0.034s
I20260620 13:57:52.150295 11043 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:52.174046  6024 raft_consensus.cc:2410] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 9 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260620 13:57:52.159219 11002 raft_consensus.cc:740] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:52.161801 10809 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:52.141840 10912 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.179373  6027 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 15. Current term is 16. Ops: []
I20260620 13:57:52.177526  6580 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 8.
I20260620 13:57:52.169317 10796 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:52.188112 10781 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.000s	sys 0.048s
I20260620 13:57:52.151242 10961 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260620 13:57:52.156018 10991 consensus_queue.cc:1059] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260620 13:57:52.152544 10817 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:52.168668 11003 raft_consensus.cc:697] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:52.172129 11006 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:52.156454 10918 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:52.176182 11004 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260620 13:57:52.165150 10835 consensus_queue.cc:1059] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260620 13:57:52.194669 11025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.018s	sys 0.083s
I20260620 13:57:52.062366 10434 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260620 13:57:52.177227 10771 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:52.191679 10988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.012s	sys 0.037s
W20260620 13:57:52.258406 11025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.120s	user 0.018s	sys 0.084s
W20260620 13:57:52.287990 11059 log.cc:927] Time spent T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260620 13:57:52.181620 10978 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:52.195560 11004 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:52.190574 10796 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:52.296937 10827 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:52.299901 11032 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:52.197106 11006 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:52.314194 10796 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:52.294966 11004 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:52.302599 10912 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:52.311322 11024 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:52.329842 10817 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:52.332374 11006 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:52.333367 11003 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.339380 10978 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:52.341488 11028 consensus_meta.cc:287] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.609s	user 0.005s	sys 0.005s
I20260620 13:57:52.262785 11002 consensus_queue.cc:260] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.342890 11002 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:52.351282 10975 consensus_meta.cc:287] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.720s	user 0.009s	sys 0.003s
W20260620 13:57:52.308919 11061 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.051s	user 0.002s	sys 0.000s
I20260620 13:57:52.365725 11043 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:52.373193 10918 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:52.286895 10988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.012s	sys 0.038s
I20260620 13:57:52.381630 11004 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:52.421234  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:52.420984  5884 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:52.423738  5884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58452 (request call id 2859) took 1530 ms. Trace:
I20260620 13:57:52.424379  5884 rpcz_store.cc:276] 0620 13:57:50.893440 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:50.897123 (+  3683us) service_pool.cc:224] Handling call
0620 13:57:52.423184 (+1526061us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400169ed4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:52.423542 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3500910848}
W20260620 13:57:52.427156  5849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.264s	user 0.027s	sys 0.066s
I20260620 13:57:52.427353  5875 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260620 13:57:52.427716  5849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.265s	user 0.027s	sys 0.066s
W20260620 13:57:52.428185  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 1.29845e+06us
I20260620 13:57:52.428159  5776 catalog_manager.cc:5696] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:52.430136  5849 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:52.431798  5776 catalog_manager.cc:5696] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 6 to 9, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 9 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:52.434206  5849 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:52.434248  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:52.439182  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:52.464582  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:52.465364  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:52.439781  5924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.080s	user 0.011s	sys 0.045s
W20260620 13:57:52.467025  5924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.011s	sys 0.045s
W20260620 13:57:52.467733  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 1.16053e+06us
I20260620 13:57:52.469182  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:52.468438  5776 catalog_manager.cc:5696] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 6 to 8, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 8 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:52.472335  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:52.476035  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:52.476902  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:52.479166  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:52.480229  5957 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:52.484833  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:52.486778  5884 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:52.488726  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:52.489817  5951 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 19: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:52.459810  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:52.448318  6028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2872) took 1858 ms. Trace:
I20260620 13:57:52.476552  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:52.451790  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:52.492429  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:52.491482  6028 rpcz_store.cc:276] 0620 13:57:50.590018 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:50.795583 (+205565us) service_pool.cc:224] Handling call
0620 13:57:50.796026 (+   443us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:50.904989 (+108963us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:50.905028 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:50.905736 (+   708us) log.cc:844] Serialized 52 byte log entry
0620 13:57:51.446012 (+540276us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:51.446071 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:51.446164 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:52.308164 (+862000us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:52.447416 (+139252us) raft_consensus.cc:1685] finished
0620 13:57:52.447465 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:52.448018 (+   553us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":296,"raft.queue_time_us":410,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":56780032,"thread_start_us":539689,"threads_started":1,"wal-append.queue_time_us":1274822}
I20260620 13:57:52.493503  5776 catalog_manager.cc:5696] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 10 to 11, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 11 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:52.497921  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:52.498991  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:52.500594  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:52.501655  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:52.507058  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:52.564056 10817 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:52.624315  5952 raft_consensus.cc:2393] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 11: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:52.624627  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:52.624958 10817 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.625828  6031 raft_consensus.cc:2393] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:52.631678 10988 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:52.633190 10918 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:52.635946  6029 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 13: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:52.636902 10977 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:52.188659 10781 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.000s	sys 0.048s
I20260620 13:57:52.644290  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:52.639362  6026 raft_consensus.cc:2376] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14. Re-sending same reply.
I20260620 13:57:52.661712 10871 raft_consensus.cc:3055] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 15 LEADER]: Stepping down as leader of term 15
I20260620 13:57:52.662324 10871 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:52.661661 10975 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:52.663813 10771 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:52.663939 10871 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.665875 10936 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Leader election won for term 19
I20260620 13:57:52.666085  5875 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:52.666586 10936 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:52.667353  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:52.667781 11001 consensus_queue.cc:1059] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:57:52.668589  5953 raft_consensus.cc:2393] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 14: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:57:52.662492  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:52.669112 11001 raft_consensus.cc:3055] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:57:52.669579 11001 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:57:52.670305  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:52.671083 10988 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:52.672489 10988 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:52.673256 11004 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:52.671514 10978 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:52.675691  5950 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260620 13:57:52.676136 10978 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:52.671545  5876 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:57:52.680878 10817 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:52.661594  5779 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56610 (request call id 352) took 20272 ms (client timeout 15000 ms). Trace:
I20260620 13:57:52.664453 10975 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.689288 10975 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:52.690979  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:52.693041  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:52.694178  5951 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
W20260620 13:57:52.695495  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 242903us
I20260620 13:57:52.695748  5776 catalog_manager.cc:5696] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 11 to 12, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 12 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
W20260620 13:57:52.681780  5779 rpcz_store.cc:269] 0620 13:57:32.234991 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:32.238947 (+  3956us) service_pool.cc:224] Handling call
0620 13:57:52.506841 (+20267894us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:57:45.102199 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:57:45.103331 (+  1132us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:57:45.103405 (+    74us) write_op.cc:435] Acquired schema lock
0620 13:57:45.103423 (+    18us) tablet.cc:662] Decoding operations
0620 13:57:45.105255 (+  1832us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:57:45.105561 (+   306us) write_op.cc:641] Partition lock acquired for write op
0620 13:57:45.105593 (+    32us) tablet.cc:685] Acquiring locks for 19 operations
0620 13:57:45.244106 (+138513us) tablet.cc:701] Row locks acquired
0620 13:57:45.244123 (+    17us) write_op.cc:260] PREPARE: finished
0620 13:57:45.244307 (+   184us) write_op.cc:270] Start()
0620 13:57:45.244461 (+   154us) write_op.cc:276] Timestamp: P: 1781963865244241 usec, L: 0
0620 13:57:45.244483 (+    22us) op_driver.cc:348] REPLICATION: starting
0620 13:57:45.245255 (+   772us) log.cc:844] Serialized 7506 byte log entry
0620 13:57:46.391435 (+1146180us) op_driver.cc:464] REPLICATION: finished
0620 13:57:46.527753 (+136318us) write_op.cc:301] APPLY: starting
0620 13:57:46.527861 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0620 13:57:47.061602 (+533741us) tablet.cc:1370] finished BulkCheckPresence
0620 13:57:47.061731 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:57:48.281042 (+1219311us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:57:48.354164 (+ 73122us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0620 13:57:48.354216 (+    52us) write_op.cc:312] APPLY: finished
0620 13:57:48.354596 (+   380us) log.cc:844] Serialized 172 byte log entry
0620 13:57:48.708102 (+353506us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:48.737679 (+ 29577us) write_op.cc:454] Released schema lock
0620 13:57:48.750165 (+ 12486us) write_op.cc:341] FINISH: Updating metrics
0620 13:57:48.792997 (+ 42832us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:48.801178 (+  8181us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15991,"reported_tablets":40,"spinlock_wait_cycles":139520,"child_traces":[["op",{"apply.queue_time_us":127687,"apply.run_cpu_time_us":61090,"apply.run_wall_time_us":2242595,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83623,"num_ops":19,"prepare.queue_time_us":444329,"prepare.run_cpu_time_us":29067,"prepare.run_wall_time_us":300891,"raft.queue_time_us":317905,"raft.run_cpu_time_us":10482,"raft.run_wall_time_us":107707,"replication_time_us":1146705,"thread_start_us":801560,"threads_started":5,"wal-append.queue_time_us":730037,"wal-append.run_cpu_time_us":20884,"wal-append.run_wall_time_us":2798767}]]}
I20260620 13:57:52.680872  5876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58452 (request call id 2874) took 1156 ms. Trace:
I20260620 13:57:52.701675  5956 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 13: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:52.700008  5876 rpcz_store.cc:276] 0620 13:57:51.524841 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:51.525010 (+   169us) service_pool.cc:224] Handling call
0620 13:57:52.680603 (+1155593us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b5400324e54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:52.680789 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1950182144}
I20260620 13:57:52.702422  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:52.711423  6028 raft_consensus.cc:2410] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260620 13:57:52.716637 10871 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:52.716796  5952 raft_consensus.cc:2393] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:52.715878  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:52.692503 11028 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:52.721076  5951 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:52.710932 10939 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:52.727450  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:52.750248  5957 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 16.
I20260620 13:57:52.751585 10771 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:52.752499 10771 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:52.755924 10771 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:52.755986  5776 catalog_manager.cc:5696] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 14 to 15, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 15 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:52.732393 10978 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:52.759521 11025 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:52.760216 11025 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.763489  5952 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 15. Current term is 16. Ops: []
I20260620 13:57:52.763387  5776 catalog_manager.cc:5696] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 15 to 16, leader changed from <none> to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 16 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260620 13:57:52.769048 10936 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.766397  5776 catalog_manager.cc:5696] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 11 to 12, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 12 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:57:52.772149  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:52.777606 10434 raft_consensus.cc:3055] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:52.670962 11001 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.785264  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:52.787483 10778 raft_consensus.cc:3055] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:52.787958 10778 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:52.789278 10778 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.790571 10778 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:52.791496  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:52.791621 10809 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260620 13:57:52.792439  6028 raft_consensus.cc:2393] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:52.778106 10434 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:57:52.813663  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 329342us
I20260620 13:57:52.810567  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:52.826619  5955 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:52.843202  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:52.828882 10988 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:52.855280  6553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.085s	user 0.008s	sys 0.024s
W20260620 13:57:52.850060  6579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.124s	user 0.003s	sys 0.024s
W20260620 13:57:52.860411  6553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.008s	sys 0.025s
W20260620 13:57:52.871166  5998 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.325s	user 0.005s	sys 0.020s
W20260620 13:57:52.871598  5998 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.347s	user 0.005s	sys 0.020s
I20260620 13:57:52.823524 10939 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:52.876273  6579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.004s	sys 0.024s
W20260620 13:57:52.874482  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 1.35057e+06us
I20260620 13:57:52.884035  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:52.908627  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:52.868176 10988 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:52.914582  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:52.915045  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:52.911140 10950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.392s	user 0.028s	sys 0.038s
W20260620 13:57:52.920295  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:52.919196  5878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.272s	user 0.008s	sys 0.016s
W20260620 13:57:52.911819  6584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.392s	user 0.044s	sys 0.074s
I20260620 13:57:52.879631 10835 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:52.912475 11001 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:52.935675 11069 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:52.936317 11069 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.938611 11069 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:52.939406 10434 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:52.940052  5997 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.586s (SENT) [suppressed 15 similar messages]
I20260620 13:57:52.941256 10434 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:52.939440 10988 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.944142 10988 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:52.927811 11025 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:52.949096 11025 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:57:52.949740  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:52.950052  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:52.950326  5950 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:52.950872  6026 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:52.951169  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:52.950892  6031 raft_consensus.cc:2410] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260620 13:57:52.952924  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:52.954694  6025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.111s	user 0.039s	sys 0.072s
W20260620 13:57:52.955130  6025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.223s	user 0.039s	sys 0.073s
I20260620 13:57:52.955715  5955 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
W20260620 13:57:52.956009  6584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.523s	user 0.045s	sys 0.074s
I20260620 13:57:52.957816  5776 catalog_manager.cc:5696] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 9 to 13, leader changed from <none> to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195), now has a pending config: VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193), VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194), VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195), VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 13 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:52.959658  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:52.959921  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:52.961169  6580 raft_consensus.cc:2410] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260620 13:57:52.929525 10939 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:52.930079  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:52.931151  6578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.234s	user 0.010s	sys 0.018s
W20260620 13:57:52.963639  6578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.010s	sys 0.018s
I20260620 13:57:52.963696  5952 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
W20260620 13:57:52.932353  5878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.344s	user 0.008s	sys 0.016s
I20260620 13:57:52.964869 10831 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:52.967948 10831 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:52.968765 10831 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.971709  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:52.961038  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:52.981246 11043 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:52.982043 10977 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:52.981973 11043 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.982703 10977 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.984325 11043 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:57:52.984937 11043 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:52.985199 10977 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:52.985527 11043 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:52.987048 11066 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:52.987260 11004 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:52.987737 11066 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:52.919569 11037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.469s	user 0.012s	sys 0.059s
W20260620 13:57:52.988811 11037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.633s	user 0.012s	sys 0.060s
I20260620 13:57:52.989411 11037 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:52.990072 11066 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:52.989996 11037 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:52.913509 10980 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.197s	user 0.023s	sys 0.021s
W20260620 13:57:52.991335 10980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.363s	user 0.024s	sys 0.021s
I20260620 13:57:52.987861 11004 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:52.992849  6586 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.443s	user 0.039s	sys 0.042s
W20260620 13:57:52.997991  6033 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.043s	user 0.013s	sys 0.013s
W20260620 13:57:52.996878 10950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.577s	user 0.028s	sys 0.039s
I20260620 13:57:53.027549  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:53.003927  5776 catalog_manager.cc:5696] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 9 to 10, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 10 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
W20260620 13:57:53.028973  6586 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.636s	user 0.040s	sys 0.042s
W20260620 13:57:53.030782  6033 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.229s	user 0.013s	sys 0.014s
W20260620 13:57:53.006908 10880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.195s	user 0.016s	sys 0.029s
W20260620 13:57:53.034936  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:53.037416  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.038393  6580 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:53.039211 11004 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:53.039973 11043 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:52.991370 11066 raft_consensus.cc:3055] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 13:57:53.044253 11037 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:53.044593 11066 raft_consensus.cc:740] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:53.045435  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.046859  6585 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:53.047087 11066 consensus_queue.cc:260] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:53.048292  6031 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:53.048871  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.049225 11066 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:53.049762  6587 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 13: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:53.050982  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:53.037715 11003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.031s	sys 0.071s
I20260620 13:57:53.054569  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.055270  6582 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:57:53.056221 11037 consensus_queue.cc:1059] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:57:53.056843  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.057276 11065 raft_consensus.cc:3055] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:53.057518  6580 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:53.057789 11065 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:53.027549 10977 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:53.058959 10977 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:53.059692  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.059444 11065 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.060354  6583 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:53.060003  5776 catalog_manager.cc:5696] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 10 to 12, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 12 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:53.060997 11065 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:53.061841  5776 catalog_manager.cc:5696] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 5 to 6, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 6 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:53.062743  6031 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260620 13:57:53.063658  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:53.064743  6585 raft_consensus.cc:2410] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260620 13:57:53.071239  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:53.037276 10835 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.077538 10835 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:53.078173 11003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.031s	sys 0.071s
W20260620 13:57:53.082347  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 54469.4us
I20260620 13:57:53.083456  5997 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:53.084621 11001 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:53.085057 11001 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:53.085480 11001 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:53.087889 10778 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:53.089470  6581 raft_consensus.cc:2393] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:57:53.088335  5879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.438s	user 0.022s	sys 0.014s
I20260620 13:57:53.092502 10778 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.096094 10778 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:53.086935 10880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.446s	user 0.017s	sys 0.030s
I20260620 13:57:53.086475  5997 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:53.086411 11003 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:53.098227  5776 catalog_manager.cc:5696] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 11 to 12, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 12 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:57:53.113960  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:53.116379  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:53.116863  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:53.118294  5879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.632s	user 0.022s	sys 0.015s
I20260620 13:57:53.121192  5956 raft_consensus.cc:2393] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:53.123646  5952 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:53.123847  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.124141 10831 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:53.124666  6585 raft_consensus.cc:2393] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 13: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:53.124832 11065 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:53.124821 11003 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.129243  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:53.139987  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.139364  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.143962  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.146486  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:53.133739 10980 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:53.140125 10977 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:53.153834  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.162797  5950 raft_consensus.cc:2393] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 8: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:53.156204  5954 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:53.158522  6583 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:53.152750 10980 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:53.168414  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 471861us
I20260620 13:57:53.168911  6587 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:53.192655  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:53.197541  6580 raft_consensus.cc:2410] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260620 13:57:53.167775 10980 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:53.207940 11083 log.cc:927] Time spent T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260620 13:57:53.209824  5998 connection.cc:256] RPC call timeout handler was delayed by -1.3880524339999738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260620 13:57:53.210274  5998 connection.cc:256] RPC call timeout handler was delayed by -1.3160524339999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
W20260620 13:57:53.210585  5998 connection.cc:256] RPC call timeout handler was delayed by -1.2566524339999887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260620 13:57:53.216805  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 48385.9us
I20260620 13:57:53.218264  5997 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:53.219448 10771 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:53.219931 10771 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:53.220311 10771 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:53.219235 11006 consensus_queue.cc:1059] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260620 13:57:53.194428 10918 raft_consensus.cc:697] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:53.229221  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1115) took 1481 ms. Trace:
I20260620 13:57:53.230543  6551 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:53.232003  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:53.238391  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2871) took 1813 ms. Trace:
I20260620 13:57:53.235721  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 1216) took 1714 ms. Trace:
I20260620 13:57:53.236467  5776 catalog_manager.cc:5696] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:57:53.238767  5879 rpcz_store.cc:276] 0620 13:57:51.420969 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:51.422498 (+  1529us) service_pool.cc:224] Handling call
0620 13:57:51.422805 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:51.423013 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:51.423041 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:51.423525 (+   484us) log.cc:844] Serialized 26 byte log entry
0620 13:57:53.131931 (+1708406us) raft_consensus.cc:1645] Marking committed up to 12
0620 13:57:53.133465 (+  1534us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:53.142456 (+  8991us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:53.223230 (+ 80774us) raft_consensus.cc:1685] finished
0620 13:57:53.223250 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:53.234271 (+ 11021us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1632274,"threads_started":1,"wal-append.queue_time_us":1746484}
I20260620 13:57:53.232599  6033 rpcz_store.cc:276] 0620 13:57:51.747879 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:51.800357 (+ 52478us) service_pool.cc:224] Handling call
0620 13:57:51.800700 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:51.801035 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:51.801063 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:51.801563 (+   500us) log.cc:844] Serialized 26 byte log entry
0620 13:57:53.075732 (+1274169us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:53.075808 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:53.075934 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:53.223335 (+147401us) raft_consensus.cc:1685] finished
0620 13:57:53.223352 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:53.229154 (+  5802us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1160,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5232,"thread_start_us":1233427,"threads_started":1,"wal-append.queue_time_us":1363069}
I20260620 13:57:53.239246  6579 rpcz_store.cc:276] 0620 13:57:51.516804 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:51.518217 (+  1413us) service_pool.cc:224] Handling call
0620 13:57:51.518556 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:51.521246 (+  2690us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:51.521273 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:51.527756 (+  6483us) log.cc:844] Serialized 26 byte log entry
0620 13:57:51.715956 (+188200us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b1800471100. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc6ed607 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fdf3955ab 00007f0fdf39b0c3 00007f0fdf39b471 00007f0fdf7b7def
0620 13:57:53.037069 (+1321113us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:53.037168 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:53.037308 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:53.223510 (+186202us) raft_consensus.cc:1685] finished
0620 13:57:53.223525 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:53.231217 (+  7692us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2486,"raft.queue_time_us":5694,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5123,"spinlock_wait_cycles":8548224,"thread_start_us":1166520,"threads_started":1,"wal-append.queue_time_us":1602163}
W20260620 13:57:53.285871  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 522464us
I20260620 13:57:53.292918  6581 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:53.278038 10831 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:57:53.300717  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 430494us
I20260620 13:57:53.304756  5776 catalog_manager.cc:5696] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 11 to 13, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 13 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:57:53.315301  5776 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:53.301343 11003 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:53.329322  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:53.329995  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:53.330327  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:53.334740  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 98599.2us
W20260620 13:57:53.335069  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:53.336838 10977 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:57:53.339371 11076 log.cc:927] Time spent T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260620 13:57:53.338965 10977 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.346093  5878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 1111) took 1806 ms. Trace:
W20260620 13:57:53.350561  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 149301us
I20260620 13:57:53.332878 11065 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:53.331530  5776 catalog_manager.cc:5696] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:53.344713  5849 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:57:53.355288 11080 log.cc:927] Time spent T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.195s	user 0.003s	sys 0.000s
I20260620 13:57:53.356854  6578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 1215) took 1842 ms. Trace:
I20260620 13:57:53.357235  6578 rpcz_store.cc:276] 0620 13:57:51.514846 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:51.526313 (+ 11467us) service_pool.cc:224] Handling call
0620 13:57:51.526751 (+   438us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:51.533007 (+  6256us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:51.533042 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:51.545614 (+ 12572us) log.cc:844] Serialized 52 byte log entry
0620 13:57:52.964330 (+1418716us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:52.964395 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:52.964522 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:53.206418 (+241896us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:53.356483 (+150065us) raft_consensus.cc:1685] finished
0620 13:57:53.356509 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:53.356795 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10213,"raft.queue_time_us":1749,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":10599,"spinlock_wait_cycles":15784704,"thread_start_us":1348701,"threads_started":1,"wal-append.queue_time_us":1541584}
W20260620 13:57:53.350696  5959 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.009s	sys 0.024s
W20260620 13:57:53.360009  5959 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.010s	sys 0.024s
I20260620 13:57:53.353284  6586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 1174) took 1961 ms. Trace:
W20260620 13:57:53.358990  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 192793us
I20260620 13:57:53.343858 11085 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:53.374529  6552 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:53.350438  5878 rpcz_store.cc:276] 0620 13:57:51.539339 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:51.541245 (+  1906us) service_pool.cc:224] Handling call
0620 13:57:51.541561 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:51.541974 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:51.542014 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:51.542548 (+   534us) log.cc:844] Serialized 26 byte log entry
0620 13:57:52.965321 (+1422773us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:52.965427 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:52.965558 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:53.345833 (+380275us) raft_consensus.cc:1685] finished
0620 13:57:53.345853 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:53.346028 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":29024,"thread_start_us":1376796,"threads_started":1,"wal-append.queue_time_us":1733667}
W20260620 13:57:53.378718  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:53.377561  5776 catalog_manager.cc:5696] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 8 to 9, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 9 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:57:53.344978 10988 consensus_queue.cc:1059] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260620 13:57:53.341174 11037 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:53.388224  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 44434.7us
I20260620 13:57:53.360643  6586 rpcz_store.cc:276] 0620 13:57:51.391667 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:51.391824 (+   157us) service_pool.cc:224] Handling call
0620 13:57:51.392163 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:51.392370 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 10
0620 13:57:53.053370 (+1661000us) log.cc:844] Serialized 14 byte log entry
0620 13:57:53.312955 (+259585us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:53.318870 (+  5915us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:57:53.325076 (+  6206us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:53.332262 (+  7186us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:53.353227 (+ 20965us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4984,"prepare.queue_time_us":1645641,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":63,"raft.queue_time_us":10533,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":9905,"thread_start_us":1837141,"threads_started":2,"wal-append.queue_time_us":256335}
I20260620 13:57:53.368021 11065 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:53.393424  6551 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:53.404026  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.403553  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:53.418263  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.374204 11085 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:53.400923 11102 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260620 13:57:53.419399 11085 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:53.422719 11065 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:53.393540  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 48971.7us
I20260620 13:57:53.392696 10809 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election won for term 8
I20260620 13:57:53.424835 10434 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:53.424993 10809 raft_consensus.cc:697] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:53.426276 10809 consensus_queue.cc:237] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.388152 11028 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:53.430600 11028 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:53.431247 11028 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:53.433477 11001 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:53.433887 11107 raft_consensus.cc:3055] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Stepping down as leader of term 15
I20260620 13:57:53.434466 11107 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:53.436139  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.436846  5878 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:53.437999  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.438185  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.438939  5875 raft_consensus.cc:2410] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260620 13:57:53.439509  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.440207  5879 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:53.440069 11037 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.441218  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.441869  5876 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:53.442376 11037 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:53.438858  5883 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
W20260620 13:57:53.439895  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:53.399305 11082 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.134s	user 0.002s	sys 0.000s
I20260620 13:57:53.342387 10918 consensus_queue.cc:237] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:53.444180  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:53.440721 11107 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.444840  6584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 1175) took 2024 ms. Trace:
I20260620 13:57:53.451573  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:53.445168  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:53.445263 10778 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:53.452809 10778 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.453215  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.454138  6031 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:53.454948 10778 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:53.455586  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 70533.6us
I20260620 13:57:53.456449  6551 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:53.408238 10977 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:53.457871  6551 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:53.457978 11094 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260620 13:57:53.446293  5849 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:53.439914  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:53.415498 11084 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260620 13:57:53.395808 11088 log.cc:927] Time spent T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260620 13:57:53.446770 10434 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:53.400482 11089 log.cc:927] Time spent T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.151s	user 0.002s	sys 0.000s
I20260620 13:57:53.434320 10980 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.386620 10771 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.456457  5848 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:53.470042  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.471475  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:53.476496  6581 raft_consensus.cc:2393] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 8: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:53.471370  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.474395  6585 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:53.479491  6586 raft_consensus.cc:2393] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 19: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:53.479597  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.479532 11066 raft_consensus.cc:2764] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260620 13:57:53.465894 11037 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:53.466338 11003 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:57:53.485137  6033 raft_consensus.cc:2368] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9.
I20260620 13:57:53.493284 11085 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.496270  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1112) took 1765 ms. Trace:
I20260620 13:57:53.496680  6025 rpcz_store.cc:276] 0620 13:57:51.730669 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:51.730774 (+   105us) service_pool.cc:224] Handling call
0620 13:57:51.731082 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:51.731459 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:51.731491 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:51.731936 (+   445us) log.cc:844] Serialized 26 byte log entry
0620 13:57:52.955677 (+1223741us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:57:52.955748 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:52.955845 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:53.496047 (+540202us) raft_consensus.cc:1685] finished
0620 13:57:53.496067 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:53.496218 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":319,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":108,"thread_start_us":1223187,"threads_started":1,"wal-append.queue_time_us":1463993}
I20260620 13:57:53.502132  6031 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:53.502934  6032 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:53.486583  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.486855  6027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1125) took 1035 ms. Trace:
I20260620 13:57:53.487262 11066 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:53.490015  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:53.490747 11001 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:53.478557 10434 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.491604 11037 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:53.483383  5849 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:53.451000  6584 rpcz_store.cc:276] 0620 13:57:51.420470 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:51.420739 (+   269us) service_pool.cc:224] Handling call
0620 13:57:51.431403 (+ 10664us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:51.431792 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:51.431815 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:51.432275 (+   460us) log.cc:844] Serialized 26 byte log entry
0620 13:57:52.956613 (+1524338us) raft_consensus.cc:1645] Marking committed up to 11
0620 13:57:53.313945 (+357332us) log.cc:844] Serialized 14 byte log entry
0620 13:57:53.324475 (+ 10530us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:53.331904 (+  7429us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:53.444639 (+112735us) raft_consensus.cc:1685] finished
0620 13:57:53.444658 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:53.444783 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1072,"prepare.queue_time_us":81619,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":11242,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":7219,"thread_start_us":1880440,"threads_started":2,"wal-append.queue_time_us":1773551}
I20260620 13:57:53.485921  6551 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:53.498806  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 232435us
I20260620 13:57:53.519403  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:53.503947  6579 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:57:53.528379  6552 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:53.530021  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 52294.5us
I20260620 13:57:53.532437 11094 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:53.526551 10778 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:53.533425 11043 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:53.533596 10778 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:53.534098 11043 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:53.534226 10778 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:53.534507 11043 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:53.535346 10988 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:53.536070 10988 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:53.536669  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.538056 11003 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:53.539255 11065 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:53.539515  5849 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:53.539677 11065 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:53.540186 11065 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:53.530009  6552 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:53.540959  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:53.543010 10809 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:53.503913  6027 rpcz_store.cc:276] 0620 13:57:52.451811 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:52.452228 (+   417us) service_pool.cc:224] Handling call
0620 13:57:52.453244 (+  1016us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:52.454326 (+  1082us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:52.454377 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:52.456136 (+  1759us) log.cc:844] Serialized 26 byte log entry
0620 13:57:52.845629 (+389493us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:57:52.845690 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:52.845811 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:53.399622 (+553811us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:53.486443 (+ 86821us) raft_consensus.cc:1685] finished
0620 13:57:53.486464 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:53.486677 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124394,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":44734,"spinlock_wait_cycles":53253504,"thread_start_us":388601,"threads_started":1,"wal-append.queue_time_us":746496}
W20260620 13:57:53.558360  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:53.520359 11037 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:53.538599 10988 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:53.543293 11004 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:53.574345  5849 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:53.543437 10809 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:53.569342 11107 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:53.590255  6552 leader_election.cc:400] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9.
I20260620 13:57:53.590663  6552 leader_election.cc:403] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260620 13:57:53.579831 10950 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:53.581211 10809 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:53.576865 11004 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:57:53.595291  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 75713.6us
W20260620 13:57:53.599083  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 113285us
I20260620 13:57:53.586006 11106 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:53.569166 11028 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.602483  5997 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:53.609629  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.593686 10950 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:53.598258 11004 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:53.596526 10988 raft_consensus.cc:3055] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 13:57:53.595480 11085 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:53.600123 11108 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:53.621356 11108 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:53.611565  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:53.624049  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:53.612159  6552 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:53.601521 11066 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:53.616683 11028 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:53.620419 11118 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:53.626010  5883 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 14: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:53.619940  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.604152 11094 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:53.635211 10980 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:53.636237  5876 raft_consensus.cc:1240] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:53.636861 10831 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260620 13:57:53.637707  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.638363  5878 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:53.642359  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.643621  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.644393  5875 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:53.645426 10771 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:53.645851  5876 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 8.
I20260620 13:57:53.646176 11118 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:53.648456 11118 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:53.649133  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.648371  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.649864  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.650579  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.650990  6029 raft_consensus.cc:2368] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 12. Current term is 13.
I20260620 13:57:53.651157  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.651849  5881 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:53.651985  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:53.653101  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.653244  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.653458  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.650374  5876 raft_consensus.cc:2393] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 12: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:53.651245  6024 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:57:53.654103  5880 raft_consensus.cc:2410] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260620 13:57:53.655606  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.612696 10950 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:53.657660  6026 raft_consensus.cc:1240] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260620 13:57:53.658540  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.659502  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1181) took 1151 ms. Trace:
I20260620 13:57:53.634462 11108 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:53.660369 11122 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:53.661293 10434 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:53.661024 11122 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.661907 10434 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:53.662302 10434 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:53.662669 10434 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:53.629731 11066 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:53.663378 11066 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:53.666438 11110 log.cc:927] Time spent T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260620 13:57:53.669795 11006 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:53.670413 11006 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:53.670735 11006 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:53.673739 11003 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:53.674539 11003 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:53.678089  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.678874  5883 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:53.628937 11106 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.679872  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.680445  5883 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:53.681248  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.681357 11106 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:53.681702  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.681861  5883 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:53.682375  5882 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:53.627679 10988 raft_consensus.cc:740] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:53.683395  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.684185  5882 raft_consensus.cc:2410] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260620 13:57:53.683746 10988 consensus_queue.cc:260] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.684846 10988 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:53.650075  5877 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:57:53.687345  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:53.696244  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 84572.8us
I20260620 13:57:53.696710  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:53.698779  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 86219.3us
I20260620 13:57:53.703393  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:53.659951  5959 rpcz_store.cc:276] 0620 13:57:52.508158 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:52.508422 (+   264us) service_pool.cc:224] Handling call
0620 13:57:52.509071 (+   649us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:53.360352 (+851281us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:53.360380 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:53.417289 (+ 56909us) log.cc:844] Serialized 26 byte log entry
0620 13:57:53.591932 (+174643us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:57:53.591979 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:53.593091 (+  1112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:53.659175 (+ 66084us) raft_consensus.cc:1685] finished
0620 13:57:53.659200 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:53.659333 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":207952,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":178,"thread_start_us":985507,"threads_started":2,"wal-append.queue_time_us":198608}
I20260620 13:57:53.666591 11043 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.703514  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:53.707044  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:53.707170  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:53.707835  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.708259  5875 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:53.683720 11122 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:53.708673  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 78036.9us
I20260620 13:57:53.707841  5882 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
W20260620 13:57:53.709144  5924 connection.cc:256] RPC call timeout handler was delayed by -2.0792224760000408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
W20260620 13:57:53.711858  5924 connection.cc:256] RPC call timeout handler was delayed by -2.0192554599999539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260620 13:57:53.713392  6032 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:53.713896  5924 connection.cc:256] RPC call timeout handler was delayed by -2.0192554599999539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260620 13:57:53.714359  5924 connection.cc:256] RPC call timeout handler was delayed by -1.980555460000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
I20260620 13:57:53.716069  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.716882  6579 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 16.
I20260620 13:57:53.675031 11003 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.724598  6027 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
W20260620 13:57:53.726872  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:53.743441  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:53.744390  5880 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:53.715365  6551 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:53.748925  5997 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:53.750483  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.752279  6585 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260620 13:57:53.753824  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.756853  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.759599  6031 raft_consensus.cc:2393] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 14: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:53.760567  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:53.763449  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 51842.2us
I20260620 13:57:53.765013  5875 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:53.765702  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:53.774165  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.750607 10977 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:53.711369 11006 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:53.780773  6580 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260620 13:57:53.781270  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.723042 11065 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.789129  6024 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:57:53.799312  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.799250  5997 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:53.778230 11125 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:53.808712  6028 raft_consensus.cc:2368] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 15.
I20260620 13:57:53.800186  5998 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:53.812280 11120 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:53.812831 11120 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:53.812960 11122 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:53.813201 11120 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:53.813441 11122 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:53.813875 11122 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:53.781970 11123 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:53.836016  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:53.832772  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:53.836649  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:53.841704  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:53.842446  5957 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:53.843494  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:53.832487  6025 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 16.
I20260620 13:57:53.836607  6033 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:53.845198  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:53.851444  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 129619us
W20260620 13:57:53.853492  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 166592us
W20260620 13:57:53.853675  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 107812us
I20260620 13:57:53.841902  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:53.858659  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:53.859228  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:53.866535  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:53.852432  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:53.868587  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:53.869196  5951 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:53.869680  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:53.870261  5956 raft_consensus.cc:3060] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:53.871351  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:53.871829  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:53.872218  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:53.872792  5954 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 13
I20260620 13:57:53.873248  5952 pending_rounds.cc:85] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 12
I20260620 13:57:53.872381  6033 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:57:53.877187  5849 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:53.878407  5955 raft_consensus.cc:2410] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260620 13:57:53.873520  5952 pending_rounds.cc:107] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260620 13:57:53.879012  5952 raft_consensus.cc:2889] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:57:53.879819  5924 connection.cc:256] RPC call timeout handler was delayed by -1.8248554599999807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260620 13:57:53.880390  5924 connection.cc:256] RPC call timeout handler was delayed by -1.8248554599999807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260620 13:57:53.880795  5924 connection.cc:256] RPC call timeout handler was delayed by -1.807755459999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
I20260620 13:57:53.838627 11107 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 7 FOLLOWER]: Advancing to term 8
I20260620 13:57:53.877461  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:53.885473  5924 connection.cc:256] RPC call timeout handler was delayed by -1.7087554600000203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
I20260620 13:57:53.827409 11085 consensus_queue.cc:1059] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260620 13:57:53.901414 11094 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9.
W20260620 13:57:53.903424  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 122404us
I20260620 13:57:53.911950 11131 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:57:53.912047  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 203726us
I20260620 13:57:53.913211 11003 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:53.914677 11006 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:53.919742  5924 connection.cc:256] RPC call timeout handler was delayed by -1.6916554599999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
I20260620 13:57:53.920313  5997 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:53.951785  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:53.952858  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 67297.8us
I20260620 13:57:53.867457 11125 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.832283 11066 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:53.937860  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:53.829799 10809 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:53.918800  5880 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:57:53.941989  6584 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:57:53.957548  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:53.958134  5924 connection.cc:256] RPC call timeout handler was delayed by -1.5689224760000116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2722s for a response
W20260620 13:57:53.963364  5924 connection.cc:256] RPC call timeout handler was delayed by -1.4868044660000805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.37410000000000004s for a response
W20260620 13:57:53.963894  5924 connection.cc:256] RPC call timeout handler was delayed by -1.4315554600000269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
W20260620 13:57:53.964313  5924 connection.cc:256] RPC call timeout handler was delayed by -1.40872247599998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29s for a response
W20260620 13:57:53.964732  5924 connection.cc:256] RPC call timeout handler was delayed by -1.2005839970000807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
W20260620 13:57:53.965165  5924 connection.cc:256] RPC call timeout handler was delayed by -1.1564839970000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260620 13:57:53.965597  5924 connection.cc:256] RPC call timeout handler was delayed by -1.1303839970000809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
W20260620 13:57:53.966150  5924 connection.cc:256] RPC call timeout handler was delayed by -1.1303839970000809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
I20260620 13:57:53.967350 11119 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:53.967984 11119 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:53.968571 11119 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:53.971446  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:53.972259  5877 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:53.972802 11066 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:53.935770 11028 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:53.962477  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:53.979601  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 102505us
I20260620 13:57:53.831459 11123 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:53.995869  5957 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:54.000887 11028 raft_consensus.cc:697] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:54.001940 11025 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:57:54.001896 11028 consensus_queue.cc:237] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:54.003476 11025 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:57:54.003787  5849 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:54.004647 10809 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:54.004827  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:54.009135 11065 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:54.010023 11065 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:54.010504 11065 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:53.976174 11043 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:54.016871 10988 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:54.017853 10988 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260620 13:57:54.023238  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:54.029856  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:54.031898 11127 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:54.032673 11127 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:54.033236 11127 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:57:54.034976  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:54.035720  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:54.036684  5959 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 15
I20260620 13:57:54.042367  5997 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:54.040493  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 53414.6us
I20260620 13:57:54.044502  6551 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:53.986573 11003 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:53.999998 11102 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:54.010954 11065 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:54.055040  5954 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:54.057197  5877 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:54.061081  6552 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:54.057778  6032 raft_consensus.cc:2410] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 9 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260620 13:57:53.980883 11037 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:54.072428  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 65564.7us
W20260620 13:57:54.072669  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 71108.8us
W20260620 13:57:54.075937  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:54.073973 11102 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:54.079411 10809 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:54.080173 10809 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.081842 11102 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:54.082450 10809 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:54.083159 11134 raft_consensus.cc:3055] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:54.083609 11134 raft_consensus.cc:740] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:57:54.085243  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 93589.4us
I20260620 13:57:54.087695 11043 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:54.084807 11134 consensus_queue.cc:260] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.053421 11108 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:54.098979  5956 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:54.099614  5959 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:57:54.075551 10835 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:54.113831 10835 raft_consensus.cc:697] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:54.114904 10835 consensus_queue.cc:237] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.118594 11108 raft_consensus.cc:697] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:54.091073 10950 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.120203 11125 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:54.121907 10950 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:54.124354 10434 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:54.150048  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 52500.5us
I20260620 13:57:54.126857 11004 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:54.128191 10778 consensus_meta.cc:287] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.593s	user 0.006s	sys 0.006s
I20260620 13:57:54.129805  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:54.130892 11138 log.cc:927] Time spent T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260620 13:57:54.131745 11037 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:54.123531  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:54.138005 11106 consensus_queue.cc:1059] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:57:54.119761 11108 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.068419 11003 raft_consensus.cc:697] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:54.156374 10778 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.157266 11135 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:54.161989 11065 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:54.168833 11004 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:54.169144  5879 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260620 13:57:54.170518  5849 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:54.171440  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:54.171782  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:54.172933  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:54.204773  5877 raft_consensus.cc:2393] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 11: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:54.173709  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:54.174340  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 87256.2us
I20260620 13:57:54.174567  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:54.175172 11139 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260620 13:57:54.176985  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:54.177700  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:54.179680  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:54.181831 11134 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:54.192533  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 62818.2us
I20260620 13:57:54.204605  6033 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:54.206952  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:54.209048  6028 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 12: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:54.206905  6029 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:54.199273 11001 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:54.215773  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:54.216142  5875 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:54.219599  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:54.222247  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:54.214244 11037 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:54.223145 10809 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:54.223470 11037 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:54.224401 11037 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:57:54.223486  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 100543us
I20260620 13:57:54.223667 10809 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:54.199944 11120 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:54.227335  5997 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:54.214643 11001 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:54.234090 11142 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:54.236166 11120 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:54.236337 11123 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:54.224543 11127 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.236809 11140 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:54.241744  5997 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:54.243645  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:54.264477  6029 raft_consensus.cc:2393] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:54.261798  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:54.219830 11004 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260620 13:57:54.240067 11001 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:54.265350  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:54.228564 10835 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:54.275321  5924 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:54.277021  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:54.242157 10980 raft_consensus.cc:2804] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:54.275558 10918 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260620 13:57:54.353082  5951 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:54.267366 11143 log.cc:927] Time spent T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260620 13:57:54.232707 11131 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election won for term 16
W20260620 13:57:54.287122  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 45407.6us
I20260620 13:57:54.403997  5997 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:54.295871  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:54.339664 11120 raft_consensus.cc:2804] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:54.212268 11135 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.239945 11142 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:54.409755 11142 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:54.409933 11131 raft_consensus.cc:697] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:54.407611 10980 raft_consensus.cc:697] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:54.229091 10809 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:54.275221 11102 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260620 13:57:54.272413 10977 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:54.273214 11003 consensus_queue.cc:237] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.238941 11025 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:54.277797 10778 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177)
I20260620 13:57:54.364753 10835 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:54.386837  5876 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:54.272173 11107 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 13:57:54.405112  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:54.354969  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 141092us
W20260620 13:57:54.405856  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 157893us
W20260620 13:57:54.412972  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:54.377087 11137 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.287s	user 0.000s	sys 0.003s
I20260620 13:57:54.420622  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:54.432690  5877 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:54.416692  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:54.426231  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:54.434459  5879 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:57:54.418013  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 142806us
I20260620 13:57:54.427899  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:54.371580 11127 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:54.440002  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:54.423956  5878 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:54.372385 11065 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:54.276716 11122 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:54.372488 11140 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:54.419247  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:57:54.426936 10835 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:54.424774 11006 raft_consensus.cc:2764] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260620 13:57:54.456506  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:54.458230  6033 raft_consensus.cc:3060] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:54.426828 11120 raft_consensus.cc:697] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:54.471385  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:54.472245  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:54.478571  6025 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:54.473083  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:54.443236 11106 raft_consensus.cc:2804] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:57:54.476568  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:54.445348 10778 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:54.485689  6024 raft_consensus.cc:2368] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12.
I20260620 13:57:54.483312  5877 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:57:54.424235 11025 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:54.491621 11145 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260620 13:57:54.491751  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 47211.1us
I20260620 13:57:54.493078  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:54.494426 10434 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:54.494616 11106 raft_consensus.cc:697] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:54.495280 10778 raft_consensus.cc:697] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:57:54.495909  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:54.496277 10778 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.501332 11140 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:57:54.503582 11135 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:54.413928 10980 consensus_queue.cc:237] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:54.510282  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:54.510584 11121 raft_consensus.cc:3055] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:54.511066  5875 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:54.513293 11122 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:54.411077 11131 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:54.518316 11119 consensus_meta.cc:287] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.549s	user 0.013s	sys 0.000s
I20260620 13:57:54.518791 11119 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.511076 11121 raft_consensus.cc:740] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:57:54.523154  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 65386.8us
I20260620 13:57:54.523725 11121 consensus_queue.cc:260] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:54.525704 11121 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:54.527614  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:54.528636  5959 raft_consensus.cc:2410] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260620 13:57:54.528914 10809 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.531155  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:54.533373 11094 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:54.535629  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:54.534492 11094 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:54.539229  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 64638us
I20260620 13:57:54.540318  5998 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:54.541366 11094 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:54.541471  5998 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:54.544974 11025 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:54.514652 11142 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:54.550908 11106 consensus_queue.cc:237] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:54.555768  5951 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:54.494436  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:54.561842  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:54.564715  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:54.569016  5998 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:54.521581 11119 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:54.553793 11142 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:54.572019  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:54.572587  5954 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260620 13:57:54.577183  5956 raft_consensus.cc:3060] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:54.572901  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:54.573186 11122 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:54.573590  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:54.578498  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:54.572942  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:54.570767  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:54.572906  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:54.577767  5878 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:54.572690  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:54.579541  6031 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:54.580025  5959 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:54.580574  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:54.582773  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:54.570715  5879 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:57:54.586315 11149 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:54.569037 11102 raft_consensus.cc:2764] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260620 13:57:54.587740  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:54.588548  6584 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:57:54.588191  6552 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:54.590473  5951 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:54.591969  6033 raft_consensus.cc:2468] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:57:54.592285  6579 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260620 13:57:54.598984  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:54.595321  6552 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:54.603968  6031 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:54.599124  6025 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:57:54.576835 10809 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:54.600770  5959 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:54.604938  5956 raft_consensus.cc:2468] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:54.578445 11122 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:54.592489 11140 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:57:54.629069 11122 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:54.628575  6581 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260620 13:57:54.629823  6028 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260620 13:57:54.578646 11037 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:54.630796  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:54.677403  6584 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:54.677601  5878 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:57:54.632243  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:54.611835 11004 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:54.620855 10434 raft_consensus.cc:2804] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:57:54.595685 11134 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:54.605314 11119 raft_consensus.cc:2804] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:54.637451  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:54.636744 11120 consensus_queue.cc:237] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.692130 11119 raft_consensus.cc:697] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:54.693221 11119 consensus_queue.cc:237] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:54.638267  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:54.694643  6586 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:57:54.695381  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:54.695674  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:54.641136  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:54.680267  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:54.681166  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:54.699313 11150 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260620 13:57:54.702960  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:54.683043  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:54.704298  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 209963us
I20260620 13:57:54.704675  6581 raft_consensus.cc:2393] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:54.691082  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:54.705264  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:54.706364  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:54.707284 11140 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:57:54.707976 11140 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:54.708452 11140 raft_consensus.cc:697] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:54.709405 11140 consensus_queue.cc:237] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:54.711187  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:54.681756 10809 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:54.691509  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 54198.6us
I20260620 13:57:54.711938 10809 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.712607  5998 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:54.696025  6583 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:54.714197  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:54.726634  6587 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:54.722726 10434 raft_consensus.cc:697] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 15 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:54.728119  6582 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:54.721707  6584 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:54.728546 11150 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260620 13:57:54.686717 11134 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:54.735675  5849 leader_election.cc:400] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12.
I20260620 13:57:54.736752  5849 leader_election.cc:403] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260620 13:57:54.714246 10809 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:54.738643  6587 raft_consensus.cc:3060] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 17 LEARNER]: Advancing to term 18
I20260620 13:57:54.739300  5849 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:54.741746  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:54.716296 11004 raft_consensus.cc:697] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:54.714749 11149 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:54.688318 11001 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.746605 11142 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:54.747313 11142 raft_consensus.cc:697] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:54.747538 11001 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:54.742892 11123 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:54.748407 11142 consensus_queue.cc:237] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:54.757532  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:54.759511  6551 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:54.761518  6551 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:54.763965  5951 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260620 13:57:54.739248 11134 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:54.757279  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:54.768069  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:54.769912  6025 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:54.768311  6584 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:54.741132 11037 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:54.773407  6028 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260620 13:57:54.791735  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:54.792847  5959 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:57:54.752781 10918 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:54.769651 10809 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:54.764586 11003 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:54.730365 10434 consensus_queue.cc:237] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:54.802889  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 88810.2us
I20260620 13:57:54.783934 11065 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:57:54.810729  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 79566.8us
I20260620 13:57:54.814153  6025 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
W20260620 13:57:54.806227  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 308730us
I20260620 13:57:54.820433  6552 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:54.799337  6551 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:54.826287  6551 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:54.831821  5998 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:54.801676 11125 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260620 13:57:54.836886  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:54.845317  6028 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:57:54.839190  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 66199.8us
I20260620 13:57:54.829762 10809 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:54.828727 11127 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:54.847520  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:54.846809  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:54.848222  5955 raft_consensus.cc:3060] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:54.852569  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:54.853446  5959 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:54.856281 11149 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:57:54.859614  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:54.830989 11004 consensus_queue.cc:237] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:54.872359  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:54.875838  5955 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:54.849335  5997 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:54.900475  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:54.900537  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 53950.5us
I20260620 13:57:54.904994  6583 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:54.850208 11127 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:54.877182 11131 raft_consensus.cc:2804] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:54.919682  5959 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:54.921603  5849 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:54.883689 10809 raft_consensus.cc:697] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:54.923966  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:54.927773  5955 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260620 13:57:54.906198 11154 raft_consensus.cc:2804] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:54.883281 11003 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260620 13:57:54.891217 10778 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:54.904422 11094 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:54.907383 11065 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:54.935053  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 116315us
I20260620 13:57:54.849802 10835 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.941192  6552 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:54.906690 11164 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260620 13:57:54.942499  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:54.919737 11127 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:54.953552  5998 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:54.904032 11122 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:54.951293  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:54.948056 10778 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:54.969339 11155 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260620 13:57:54.917804 11037 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260620 13:57:54.971509 11037 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:57:54.972033 11037 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:54.972522 11037 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Advancing to term 17
W20260620 13:57:54.978585 11148 log.cc:927] Time spent T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260620 13:57:54.984865 11122 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:54.987437 11125 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:57:54.987712 10809 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.947800 11094 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:54.992040  5956 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260620 13:57:54.988263 11125 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:54.997148  6028 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:57:54.999220  6586 raft_consensus.cc:2368] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 12. Current term is 13.
I20260620 13:57:54.948367 11025 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:54.946394 11154 raft_consensus.cc:697] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:54.946815 11164 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:55.015182  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 61736.5us
I20260620 13:57:55.021775  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:55.041472 11171 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:55.042423 11171 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:55.045851  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 97547.5us
I20260620 13:57:54.946221 11065 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.003269 11025 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:55.052354  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:55.016718 11125 raft_consensus.cc:697] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:55.021338 11164 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:57:55.063607  5848 leader_election.cc:336] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.562s (SENT)
I20260620 13:57:55.048281 11122 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:57:55.050463 11142 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:55.054318 11025 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:57:55.074606  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 153155us
I20260620 13:57:55.075368  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:55.072106  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 166054us
I20260620 13:57:55.059747 11119 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:55.077420  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:55.071337 11122 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:55.083561  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:55.084300  5849 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:55.080376 11174 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:55.082800 11122 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:57:55.105393 11123 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12.
I20260620 13:57:55.106243 11123 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:57:55.106767 11123 raft_consensus.cc:697] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:55.107661 11123 consensus_queue.cc:237] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.074326 11142 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:55.111392 11125 consensus_queue.cc:237] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.118592  5924 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:55.119664  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:55.120106 11142 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:55.123919 10778 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:55.085906 11172 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:55.125799 11172 raft_consensus.cc:697] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:57:55.127801 11169 log.cc:927] Time spent T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260620 13:57:55.128960  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 44766.2us
W20260620 13:57:55.098445 11166 log.cc:927] Time spent T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260620 13:57:55.116701  5848 leader_election.cc:336] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.745s (SENT)
I20260620 13:57:55.129709  5849 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:55.142467  5849 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:55.144439  5848 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:57:55.127859 11170 log.cc:927] Time spent T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260620 13:57:55.145532  5998 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:55.151180 11119 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:55.151913 11174 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:55.152431 11174 raft_consensus.cc:697] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:55.153362 11174 consensus_queue.cc:237] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.154289 11176 raft_consensus.cc:2764] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260620 13:57:55.162801  5997 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:55.163293 11065 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:55.164060  5997 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:55.166040  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:55.143201 11127 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.162947  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:55.165627 11037 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.097630 11140 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:55.145939 11142 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:55.148305 10835 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:55.196811 11159 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:55.197630 11159 raft_consensus.cc:697] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:55.197736 11025 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.202497 11037 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:55.203445 11140 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:55.203948 11140 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:55.204538 11140 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:55.178001 11106 raft_consensus.cc:2804] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:55.207221 11120 raft_consensus.cc:2764] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260620 13:57:55.207441 11106 raft_consensus.cc:697] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:55.209142 11175 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:55.208721 11106 consensus_queue.cc:237] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:55.209749 11175 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.126808 11172 consensus_queue.cc:237] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.212039 11175 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:55.212110  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 49250.6us
I20260620 13:57:55.200304 11025 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:55.212621 11175 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:55.220620 11175 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.221609  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:55.222544  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:55.198742 11159 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.224236 11001 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:55.179114 11131 raft_consensus.cc:697] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:55.146170 11134 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.216529 11102 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:55.090054 11154 consensus_queue.cc:237] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:55.232460  5952 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:57:55.226565  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:57:55.235968  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 91638.6us
I20260620 13:57:55.238660  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:55.239475  6028 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
W20260620 13:57:55.240851  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 124205us
I20260620 13:57:55.243903  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:55.244736  6587 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:57:55.247578  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:55.248525  6583 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:55.189483 11119 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
W20260620 13:57:55.252460  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 86463.7us
I20260620 13:57:55.191872 11121 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260620 13:57:55.288831  6587 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
I20260620 13:57:55.259938 11175 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:55.242111 11107 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
W20260620 13:57:55.296753  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 73696.9us
W20260620 13:57:55.298133  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 54073.3us
I20260620 13:57:55.290700  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:57:55.299016  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:55.307781 11127 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:55.309190 11025 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:55.309605 11025 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:55.310019 11025 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:57:55.312148  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 46878.3us
I20260620 13:57:55.288894 10835 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:55.295135 11149 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:55.317821  5998 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:55.319418  5849 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:55.330538 11123 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:55.331158 11123 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.333428 11123 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:55.334765  5848 leader_election.cc:336] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.720s (SENT)
I20260620 13:57:55.335372  5848 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:55.315122 11142 raft_consensus.cc:697] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:55.337987 11142 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.338013 11134 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:55.302970 11122 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.348942 11122 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:55.322157 11164 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.357710  6031 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260620 13:57:55.368278  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:55.370685  6028 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260620 13:57:55.368137  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 55052.6us
I20260620 13:57:55.377846  6025 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
W20260620 13:57:55.378093  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 60354.3us
I20260620 13:57:55.378903  5998 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:55.356722 11190 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:57:55.378340  6025 pending_rounds.cc:85] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 9
I20260620 13:57:55.368629 11185 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:55.356769 11189 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260620 13:57:55.392552  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:55.325439 10835 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.371031 11119 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:55.372799 11182 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:57:55.419572  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:55.420398  6033 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:55.383764  6025 pending_rounds.cc:107] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 7.10
I20260620 13:57:55.396744  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:55.424157  6025 raft_consensus.cc:2889] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:57:55.387558  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:55.405347  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:55.424782  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:55.425012  6024 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 14
I20260620 13:57:55.373522 11149 raft_consensus.cc:697] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:55.377658 10977 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:55.412552  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:55.413242  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:55.383416  5848 leader_election.cc:336] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.764s (SENT)
I20260620 13:57:55.419305  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:55.393491 11122 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:55.434677  6582 raft_consensus.cc:2410] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260620 13:57:55.356626 11186 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.086s
I20260620 13:57:55.382886 11006 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:55.433214  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:55.432261  6581 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:55.317008 11131 consensus_queue.cc:237] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.393571 11189 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:55.431777  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:55.436792  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:55.439461  6029 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260620 13:57:55.444795  6587 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:55.396855 11190 raft_consensus.cc:697] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:55.439739  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:55.438877  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:55.443396  6578 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 19.
W20260620 13:57:55.445690  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 126339us
I20260620 13:57:55.445847  6584 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
W20260620 13:57:55.446509  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 63139.4us
W20260620 13:57:55.450111  5848 leader_election.cc:336] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.891s (SENT)
I20260620 13:57:55.450507  5848 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:55.453471  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:55.454123  5875 raft_consensus.cc:3060] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:55.455719 11157 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.503s	user 0.002s	sys 0.002s
I20260620 13:57:55.456168  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:55.456406  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:55.457130  6581 raft_consensus.cc:2393] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 13: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:55.457772  6032 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260620 13:57:55.458276  6581 raft_consensus.cc:1275] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260620 13:57:55.459079  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 51905.7us
I20260620 13:57:55.460259  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:55.462363  6024 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:57:55.455637 11006 raft_consensus.cc:697] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:55.463645 11006 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.464238 11107 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:55.464774 11107 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:55.468160  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:55.468835  5877 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 16.
I20260620 13:57:55.468194  6033 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:55.473476  5879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:55.474964  5879 raft_consensus.cc:3060] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:55.480669  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:55.428020 11125 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260620 13:57:55.438647 11122 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:55.498996  6587 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:55.482805 11107 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:55.490264  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:55.447286 11189 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:55.501390  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:55.478716  5875 raft_consensus.cc:2468] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:55.491011  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:55.427835 11119 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.509464 10918 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:57:55.516178 11191 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260620 13:57:55.509636  6581 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
W20260620 13:57:55.512209  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 52267.8us
I20260620 13:57:55.402331 11185 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:55.575484  5880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:55.575964 11185 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:55.579293  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 129194us
I20260620 13:57:55.582960  5998 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:55.583865 11107 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:55.480993 11172 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:55.549289  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:55.595983  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:55.558478  6587 raft_consensus.cc:1240] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:55.573164 11190 consensus_queue.cc:237] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:55.544251  5876 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:55.569553  5879 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:55.597805  5998 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:55.598197  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:55.593921  5880 raft_consensus.cc:2468] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:55.605736  6026 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:57:55.500721 11142 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:55.610093  5875 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:57:55.510661 11122 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:55.612295  5877 raft_consensus.cc:1240] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:55.615664  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:55.642481  5875 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:55.653857 10835 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:55.626302 11149 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.651626  5881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:55.653839 11154 consensus_queue.cc:1059] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:55.654243  5998 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:55.657626 11154 raft_consensus.cc:3055] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:57:55.657819 11106 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:55.658010 11154 raft_consensus.cc:740] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:55.658455 11106 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:55.658947 11106 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:55.644529  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:55.661732  6587 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:57:55.663033  6581 raft_consensus.cc:2468] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
I20260620 13:57:55.664227  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:55.615610 11134 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:55.511024 11176 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.133s
I20260620 13:57:55.622694 11175 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:55.643915 11107 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:55.717566  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:55.718823  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 97549.5us
I20260620 13:57:55.612004 11195 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.092s
I20260620 13:57:55.659291 11154 consensus_queue.cc:260] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.610754 11172 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.700287 11206 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:55.736498  5875 raft_consensus.cc:2468] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:57:55.738426  5998 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:55.738766  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:55.739398  5875 raft_consensus.cc:3060] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:55.739737 11120 raft_consensus.cc:2804] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:57:55.740294 11120 raft_consensus.cc:697] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:55.741258 11120 consensus_queue.cc:237] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:55.744019 11202 log.cc:927] Time spent T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260620 13:57:55.749064  5875 raft_consensus.cc:2468] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
W20260620 13:57:55.751027  5848 leader_election.cc:336] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.648s (SENT)
I20260620 13:57:55.750540 11210 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:57:55.751590  5848 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:55.749838  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:55.753573 11196 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:55.747087 11175 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.755194 11196 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:55.755857 11196 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.756701 11175 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:55.760936  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:55.750489  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:55.775898  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:55.765678 11140 consensus_meta.cc:287] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.561s	user 0.004s	sys 0.012s
I20260620 13:57:55.703363 11183 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.344s
I20260620 13:57:55.704449 11134 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.779361  5875 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:57:55.762504 11196 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:55.794942  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:55.795300  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:55.795677 11102 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:55.796181 11210 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:55.796620 11210 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:55.796974 11210 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:55.799938 11181 log.cc:927] Time spent T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.603s	user 0.004s	sys 0.000s
I20260620 13:57:55.800522  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:55.802191  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:55.803156  5878 raft_consensus.cc:2410] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260620 13:57:55.804039  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:55.804870  5878 raft_consensus.cc:2410] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260620 13:57:55.811825 11188 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:55.814185  5884 raft_consensus.cc:3060] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:55.817452  5881 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:55.795858  5875 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 13
I20260620 13:57:55.763506 11206 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:55.826088 11206 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:55.819734  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:55.832192 11131 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:57:55.832787 11131 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:55.833385 11131 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:57:55.832576  6552 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:55.836045  6552 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:55.836854 11175 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:55.837555 11175 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:55.838423 11175 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:55.843894 10835 raft_consensus.cc:2804] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:55.844525  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:55.846352 11119 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:55.848356  6581 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260620 13:57:55.848641 11183 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260620 13:57:55.848897 11209 log.cc:927] Time spent T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260620 13:57:55.849179 11183 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:55.849649 11183 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:55.851886 11131 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.854672 11131 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:55.855382 11176 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
W20260620 13:57:55.864616 11194 log.cc:927] Time spent T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
W20260620 13:57:55.868140 11151 log.cc:927] Time spent T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 1.052s	user 0.003s	sys 0.005s
I20260620 13:57:55.868989 11134 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:55.869567  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 1140) took 1453 ms. Trace:
I20260620 13:57:55.786944 11140 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:55.869985  5882 rpcz_store.cc:276] 0620 13:57:54.416076 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:54.416785 (+   709us) service_pool.cc:224] Handling call
0620 13:57:54.417093 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:54.417492 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:54.417521 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:54.418065 (+   544us) log.cc:844] Serialized 26 byte log entry
0620 13:57:54.588518 (+170453us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:54.588573 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:54.588662 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:55.867308 (+1278646us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:55.869223 (+  1915us) raft_consensus.cc:1685] finished
0620 13:57:55.869252 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:55.869502 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":168,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":57713536,"thread_start_us":169952,"threads_started":1,"wal-append.queue_time_us":352825}
I20260620 13:57:55.871987 11140 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:55.872277  5882 raft_consensus.cc:1240] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 14. Current term is 15. Ops: []
I20260620 13:57:55.872736 11172 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:55.796216 11102 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:55.819657 11154 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:55.892586  5875 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
W20260620 13:57:55.906935  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:55.918679  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 120718us
W20260620 13:57:55.932123  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 87823.6us
I20260620 13:57:55.937000 11171 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:55.937003  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:55.939182 11134 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:55.939930 11134 raft_consensus.cc:697] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:55.940819  6580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 1174) took 1332 ms. Trace:
I20260620 13:57:55.941285  5879 raft_consensus.cc:1275] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260620 13:57:55.941586  6583 raft_consensus.cc:1240] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: []
W20260620 13:57:55.940169 11199 log.cc:927] Time spent T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.336s	user 0.000s	sys 0.002s
I20260620 13:57:55.940928 11134 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.950034 11135 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:55.950302 11164 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:55.950740 11135 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:55.951678  6579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 1173) took 1344 ms. Trace:
I20260620 13:57:55.952064  6579 rpcz_store.cc:276] 0620 13:57:54.607512 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:54.607733 (+   221us) service_pool.cc:224] Handling call
0620 13:57:55.951491 (+1343758us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b5400740254. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:55.951622 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716382976}
I20260620 13:57:55.952872 11135 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:55.937393  5877 raft_consensus.cc:1275] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260620 13:57:55.961081  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:55.961158  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:55.966059  6026 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:55.941233  6580 rpcz_store.cc:276] 0620 13:57:54.608129 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:54.610013 (+  1884us) service_pool.cc:224] Handling call
0620 13:57:55.940588 (+1330575us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400525dd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:55.940731 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894844672}
I20260620 13:57:55.981597  5876 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:57:55.990041  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:55.928114 11189 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:55.998476 11001 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:56.001032 11001 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:56.003429 11001 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:56.005251  6580 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260620 13:57:56.005612  6580 pending_rounds.cc:85] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 10
I20260620 13:57:56.005846  6580 pending_rounds.cc:107] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260620 13:57:56.006071  6580 raft_consensus.cc:2889] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:57:56.006959 11187 log.cc:927] Time spent T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.715s	user 0.001s	sys 0.005s
I20260620 13:57:56.007313  6579 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:57:56.007530  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:56.008165  6582 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:56.009994  6582 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260620 13:57:56.013250  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:56.028846 11025 consensus_meta.cc:287] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.005s
I20260620 13:57:56.029412 11025 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:56.032342  6586 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46852 (request call id 1184) took 1343 ms (client timeout 1676 ms). Trace:
W20260620 13:57:56.032907  6586 rpcz_store.cc:269] 0620 13:57:54.689301 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:54.695394 (+  6093us) service_pool.cc:224] Handling call
0620 13:57:56.032067 (+1336673us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54004a7754. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:57:56.032260 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685191552}
I20260620 13:57:56.034231  5881 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260620 13:57:56.035954 11094 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:56.036074  5878 raft_consensus.cc:1275] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260620 13:57:56.037765  5878 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260620 13:57:56.038549  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:56.041101  5998 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:56.042228 11210 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.042618 11001 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 13:57:56.003759  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:56.089720 11159 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260620 13:57:56.011297 11220 raft_consensus.cc:2764] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260620 13:57:56.092103  5881 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:57:56.092774  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:56.093837  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:56.095638  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:55.978389 11122 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.097575  5877 raft_consensus.cc:2410] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260620 13:57:55.972708 10835 raft_consensus.cc:697] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:55.985267 11188 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:57:56.097622  5848 leader_election.cc:336] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.175s (SENT)
I20260620 13:57:56.110939  6024 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260620 13:57:56.117254  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:56.138916  5884 raft_consensus.cc:2468] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
W20260620 13:57:56.116539  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 186051us
I20260620 13:57:56.117380  5880 raft_consensus.cc:1275] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260620 13:57:56.118638  5951 raft_consensus.cc:2393] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 13: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:57:56.148031  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:56.152237  6031 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:57:56.152654  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:56.123158  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:56.154420  6025 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:56.136343  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:56.155982  5952 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 8.
I20260620 13:57:56.137871  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:56.157305  5955 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:56.152127  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:56.158670  5957 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:56.107483 11159 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:56.120643  5849 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:56.175681  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 78073us
W20260620 13:57:56.178022  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 57496.2us
I20260620 13:57:56.160038  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:56.163476  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:56.161039  5954 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260620 13:57:56.180302  6586 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:56.176321  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:56.182281  6579 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260620 13:57:56.178920  5849 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:56.184311  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:56.191421  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:56.181569 11107 consensus_queue.cc:1059] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260620 13:57:56.198071 11149 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260620 13:57:56.199169  6024 raft_consensus.cc:1275] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260620 13:57:56.200205 11001 consensus_queue.cc:1048] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:57:56.201503 11142 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:57:56.202041 11142 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:56.202090 11197 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260620 13:57:56.203092 11142 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.204567  6032 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:57:56.206264 11182 consensus_queue.cc:1059] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:57:56.207137 11182 raft_consensus.cc:3055] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:56.205866 11197 raft_consensus.cc:2955] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Committing config change with OpId 11.8: config changed from index 5 to 8, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:56.207468 11182 raft_consensus.cc:740] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:56.208810  5879 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260620 13:57:56.208468 11182 consensus_queue.cc:260] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.188930 11164 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:57:56.210166 11164 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:56.210362  5998 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:56.209697 11182 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:56.215811  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 69804.5us
I20260620 13:57:56.215895 11134 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:56.217440  6552 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:56.217782 11134 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:57:56.218464 11135 consensus_queue.cc:1048] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:57:56.219564 11125 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:56.219990 11125 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:56.220307 11125 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:56.220609 10835 consensus_queue.cc:237] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.221585  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:56.153162 11150 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:56.222537 11172 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:56.222595 11150 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.224366  5849 leader_election.cc:400] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 12. Current term is 13.
I20260620 13:57:56.224762  5849 leader_election.cc:403] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:57:56.224814 11150 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:56.225461 11150 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:56.225548 11172 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 12. Current term is 13.
I20260620 13:57:56.225977 11150 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:56.137144 10434 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260620 13:57:56.227342 11215 consensus_queue.cc:1048] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:57:56.227826  5879 raft_consensus.cc:1275] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260620 13:57:56.228745 11215 raft_consensus.cc:2804] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:57:56.229321 11215 raft_consensus.cc:697] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:56.183739 11159 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:57:56.230225 11215 consensus_queue.cc:237] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.234773 11189 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:56.237324 11122 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:56.239585 11119 raft_consensus.cc:3055] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:57:56.239962 11119 raft_consensus.cc:740] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:56.239899  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:56.240875  5954 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:56.210562 11164 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:56.241547 11102 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.243139  5959 raft_consensus.cc:1240] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 8. Current term is 9. Ops: []
I20260620 13:57:56.241225 11119 consensus_queue.cc:260] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.137568 11176 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:56.253263  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 59577.6us
I20260620 13:57:56.192379  6030 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:56.247081  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:56.246984  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:56.260262  5884 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:57:56.148437 11190 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:56.267208  5849 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:56.270323  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:56.275080  5876 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260620 13:57:56.277360  5956 raft_consensus.cc:3055] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:57:56.277724  5956 raft_consensus.cc:740] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:56.277963  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:56.278875  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:56.278489  5956 consensus_queue.cc:260] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:56.279465  5957 raft_consensus.cc:1275] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260620 13:57:56.139531 11127 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.124s
I20260620 13:57:56.279479  5958 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:56.285135  5956 raft_consensus.cc:3060] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:56.289171  5959 raft_consensus.cc:1275] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260620 13:57:56.288520  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:56.295516  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:56.265625 11192 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:57:56.298766  5957 raft_consensus.cc:1240] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:56.299728  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:56.299367  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:56.305042  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:56.268760 11172 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:57:56.281824 11037 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:56.296249 11186 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:56.302531 11119 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:56.226851 11150 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:56.333833 11224 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.091s	user 0.003s	sys 0.000s
I20260620 13:57:56.315618 11037 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:56.337203  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:56.316321  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:56.267094 11176 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:56.301258 11196 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:56.302717 11025 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:56.354260  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:56.354943  6029 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:56.355039  5956 raft_consensus.cc:1275] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260620 13:57:56.355690  5956 pending_rounds.cc:85] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 8
I20260620 13:57:56.355999  5956 pending_rounds.cc:107] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260620 13:57:56.356312  5956 raft_consensus.cc:2889] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:56.270579 11190 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.338671 11159 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:56.363505  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 59965.6us
I20260620 13:57:56.402062  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:56.406889  5957 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260620 13:57:56.407291  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 196996us
I20260620 13:57:56.408329  5956 raft_consensus.cc:1275] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260620 13:57:56.411432  5958 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:56.340106 11186 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:56.412667  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:56.370896 11106 consensus_meta.cc:287] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.698s	user 0.008s	sys 0.003s
I20260620 13:57:56.311020 11185 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260620 13:57:56.343277 11220 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:56.356875 11037 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:56.357834 11196 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:56.438088  6030 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260620 13:57:56.359850 11176 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:56.476658  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:56.479414  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 70552.3us
I20260620 13:57:56.423786 11186 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:56.544586  6586 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:57:56.443061 11196 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:56.491503  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:56.548017  5957 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
W20260620 13:57:56.492208  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 90222.4us
I20260620 13:57:56.496132 11102 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:56.555835 11125 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.505100  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:56.507545  6551 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:57:56.510210  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:56.519906 11210 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:56.505663 11181 log.cc:927] Time spent T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.083s	user 0.004s	sys 0.000s
I20260620 13:57:56.525375  5958 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260620 13:57:56.504529  6582 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260620 13:57:56.442065 11220 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:56.550763  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:56.433393 11106 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:56.626183  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 76778.1us
W20260620 13:57:56.628099  5848 leader_election.cc:336] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.257s (SENT)
W20260620 13:57:56.508286 11206 consensus_meta.cc:287] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.682s	user 0.004s	sys 0.007s
W20260620 13:57:56.579893 11230 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260620 13:57:56.580157 11228 log.cc:927] Time spent T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.351s	user 0.002s	sys 0.000s
W20260620 13:57:56.592269  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 84913.1us
W20260620 13:57:56.593873  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 90418.2us
I20260620 13:57:56.644630 11140 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 13:57:56.644896 11195 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:57:56.596765 11025 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:57:56.598254  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 47558.9us
W20260620 13:57:56.503993 11175 consensus_meta.cc:287] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.004s
I20260620 13:57:56.554132 11164 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.556844 11107 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260620 13:57:56.599706 11154 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:56.600131  5955 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:57:56.601279 11220 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:56.602552 11159 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 20 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:56.687876 11210 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:56.729558  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 2005) took 1149 ms. Trace:
I20260620 13:57:56.729797 11210 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:56.730176  5882 rpcz_store.cc:276] 0620 13:57:55.580036 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:55.873102 (+293066us) service_pool.cc:224] Handling call
0620 13:57:55.873379 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:55.873558 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:55.873586 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:55.874013 (+   427us) log.cc:844] Serialized 26 byte log entry
0620 13:57:56.255404 (+381391us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:56.255442 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:56.255502 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:56.729274 (+473772us) raft_consensus.cc:1685] finished
0620 13:57:56.729303 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:56.729486 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":380976,"threads_started":1,"wal-append.queue_time_us":467159}
I20260620 13:57:56.732379 11210 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:56.595345 11223 consensus_queue.cc:1048] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.093s
W20260620 13:57:56.616918 11183 consensus_meta.cc:287] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.767s	user 0.013s	sys 0.000s
I20260620 13:57:56.735610 11183 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:56.737397  5776 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56624 (request call id 346) took 14011 ms (client timeout 15000 ms). Trace:
W20260620 13:57:56.596040  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:56.744622  5776 rpcz_store.cc:269] 0620 13:57:42.725986 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:42.726241 (+   255us) service_pool.cc:224] Handling call
0620 13:57:56.737307 (+14011066us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:57:53.773415 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:57:53.774429 (+  1014us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:57:53.774491 (+    62us) write_op.cc:435] Acquired schema lock
0620 13:57:53.774509 (+    18us) tablet.cc:662] Decoding operations
0620 13:57:53.905158 (+130649us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:57:53.905291 (+   133us) write_op.cc:641] Partition lock acquired for write op
0620 13:57:53.905333 (+    42us) tablet.cc:685] Acquiring locks for 18 operations
0620 13:57:53.950823 (+ 45490us) tablet.cc:701] Row locks acquired
0620 13:57:53.950866 (+    43us) write_op.cc:260] PREPARE: finished
0620 13:57:53.973754 (+ 22888us) write_op.cc:270] Start()
0620 13:57:53.973965 (+   211us) write_op.cc:276] Timestamp: P: 1781963873973658 usec, L: 0
0620 13:57:53.974015 (+    50us) op_driver.cc:348] REPLICATION: starting
0620 13:57:53.974993 (+   978us) log.cc:844] Serialized 7455 byte log entry
0620 13:57:54.724672 (+749679us) op_driver.cc:464] REPLICATION: finished
0620 13:57:54.993271 (+268599us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdc6ed8ac 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc70a402 00007f0fe3234d70
0620 13:57:55.024992 (+ 31721us) write_op.cc:301] APPLY: starting
0620 13:57:55.025157 (+   165us) tablet.cc:1367] starting BulkCheckPresence
0620 13:57:55.160860 (+135703us) tablet.cc:1370] finished BulkCheckPresence
0620 13:57:55.160902 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:57:55.342071 (+181169us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:57:55.342545 (+   474us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0620 13:57:55.342599 (+    54us) write_op.cc:312] APPLY: finished
0620 13:57:55.343080 (+   481us) log.cc:844] Serialized 164 byte log entry
0620 13:57:55.376479 (+ 33399us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:55.388701 (+ 12222us) write_op.cc:454] Released schema lock
0620 13:57:55.422751 (+ 34050us) write_op.cc:341] FINISH: Updating metrics
0620 13:57:55.485572 (+ 62821us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:57:55.501169 (+ 15597us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":490053,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":290537,"apply.run_cpu_time_us":28734,"apply.run_wall_time_us":425573,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79439,"num_ops":18,"prepare.queue_time_us":133634,"prepare.run_cpu_time_us":32120,"prepare.run_wall_time_us":298655,"raft.queue_time_us":227293,"raft.run_cpu_time_us":20241,"raft.run_wall_time_us":373075,"replication_time_us":677815,"spinlock_wait_cycles":93408128,"thread_start_us":607958,"threads_started":4,"wal-append.queue_time_us":221948,"wal-append.run_cpu_time_us":24227,"wal-append.run_wall_time_us":2241241}]]}
I20260620 13:57:56.598732 11222 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:56.599056 11182 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:56.700974 11164 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:56.701203 11192 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:56.665740 11185 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:56.690447 11154 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:56.690131 11175 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.707377  5997 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:56.709303 11001 consensus_queue.cc:1059] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:57:56.710399 11190 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:56.629086 11106 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:56.724761 11238 log.cc:927] Time spent T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260620 13:57:56.738361 11183 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:56.738282  5778 catalog_manager.cc:5696] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 5 to 8, term changed from 13 to 15, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to <none>, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 2e82c0c231624695ac5a813230bf5038 (127.4.155.193), VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194), VOTER 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195), VOTER b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 15 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:56.781545  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:56.775820 11192 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Advancing to term 17
W20260620 13:57:56.779870  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 72585.8us
W20260620 13:57:56.743425  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 72846.6us
I20260620 13:57:56.798424  6551 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:56.641316  6029 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:57:56.778301 11154 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:56.816520  6551 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:56.822889  6551 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:56.820523  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:56.815795 11222 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260620 13:57:56.824817  6551 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:57:56.825238  5878 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260620 13:57:56.825361 11222 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260620 13:57:56.643517 11206 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.790674  5778 catalog_manager.cc:5696] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 9 to 10, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 10 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:57:56.813920  5848 leader_election.cc:336] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.553s (SENT)
I20260620 13:57:56.817580 11119 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:56.827158 11134 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:56.826334 11094 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:57:56.850842  5778 catalog_manager.cc:5696] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:56.779484 11185 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.848618  5848 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:56.836107 11221 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:57:56.863971  5953 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:56.838299 11183 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260620 13:57:56.862882 11150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.090s	sys 0.284s
I20260620 13:57:56.827325 10831 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260620 13:57:56.819989 10835 consensus_queue.cc:1048] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
W20260620 13:57:56.868044  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:56.816587 11236 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260620 13:57:56.825371 11195 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260620 13:57:56.816746 11159 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260620 13:57:56.858994 10918 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:57:56.847317 11107 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260620 13:57:56.865238 11125 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:56.827561 11164 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.039s
I20260620 13:57:56.825243 11189 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260620 13:57:56.873081  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:56.863649 11134 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:56.889190  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 82499us
I20260620 13:57:56.915671 11134 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:56.910013 11175 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:56.917723  6552 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:56.917809 11175 consensus_queue.cc:1048] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:57:56.863329 11094 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:56.873868  5778 catalog_manager.cc:5696] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 7 to 9, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 9 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:56.919297 11094 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:56.921733  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:56.902657  5952 raft_consensus.cc:1275] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260620 13:57:56.870271 11183 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:56.905635  5950 raft_consensus.cc:3055] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:57:56.909927 11223 raft_consensus.cc:3055] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:56.911403 11206 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:56.912417 11196 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:56.924980 11125 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:57:56.924896 11127 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:57:56.865126 11210 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260620 13:57:56.932580  5955 raft_consensus.cc:3055] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:57:57.094906  5955 raft_consensus.cc:740] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:56.933799 11185 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:56.893810 10918 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:56.940281  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 73276.1us
I20260620 13:57:56.940448 11220 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:56.941090 11183 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:56.947904  5778 catalog_manager.cc:5696] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 13, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 13 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:57:56.958477  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:56.968340  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:56.982177 11242 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.473s	user 0.003s	sys 0.000s
I20260620 13:57:56.856474 11037 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:56.923539  5950 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:57.069242 11222 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260620 13:57:57.070096  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 148783us
I20260620 13:57:57.071751 11142 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:56.884842 11182 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:56.880789 11140 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.067s
I20260620 13:57:56.868367 11221 consensus_queue.cc:1059] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260620 13:57:57.122812  5950 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:57.075080 11186 consensus_meta.cc:287] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.004s
I20260620 13:57:57.076310 11189 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:57.092805  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 265853us
I20260620 13:57:57.122656  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:57.134568  5953 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:57.113303  5778 catalog_manager.cc:5696] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 11 to 12, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 12 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:57.124897  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:57:57.090886 11223 raft_consensus.cc:740] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:57.092140 11125 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:57.125782  5955 consensus_queue.cc:260] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:57.143884  5955 raft_consensus.cc:3060] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:57.120496 10918 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:57:57.139199  5950 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:57.148478  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:57.154124  5952 raft_consensus.cc:2393] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 15: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:57.152999  5849 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:57.148969  5778 catalog_manager.cc:5696] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:57.160606  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:57.161285  6029 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:57:57.161195  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:57.162891  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:57.147759 11185 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:57.164605 11185 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:57.166726  5953 raft_consensus.cc:2410] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260620 13:57:57.169284  5778 catalog_manager.cc:5696] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:57.132470 11220 raft_consensus.cc:697] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:57.174850  5955 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260620 13:57:57.176864  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:57.177955  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:57.148025 11125 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:57.186659  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:57.187179 11190 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:57.187726 11190 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:57.188154 11190 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:57.191313 10778 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:57:57.186699 11222 raft_consensus.cc:3055] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:57.192349 11222 raft_consensus.cc:740] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:57.193166 11222 consensus_queue.cc:260] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:57.193701  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:57.193534 10831 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:57:57.194135  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:57.194938  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:57.195516  6586 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:57.186558  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:57.197631  6029 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:57.194331 11222 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:57.203707  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:57.207402  6583 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260620 13:57:57.170121 11182 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:57:57.164669 11037 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:57.174455 11119 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:57.178951 11236 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:57.145627 11142 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:57.213493  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 407589us
I20260620 13:57:57.139716 11186 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:57.214918  5955 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260620 13:57:57.182278  5778 catalog_manager.cc:5696] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:57:57.215626  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 400230us
I20260620 13:57:57.145157 11189 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:57.225749  6029 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:57:57.194289 10831 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:57.235051  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 421167us
W20260620 13:57:57.211527 11197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.042s	sys 0.109s
I20260620 13:57:57.126266 11154 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:57.236544  5778 catalog_manager.cc:5696] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:57.239151  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:57.227705 11182 raft_consensus.cc:697] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:57.245714  5882 raft_consensus.cc:1240] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260620 13:57:57.205732 11175 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260620 13:57:57.257025  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:57.243665  5848 leader_election.cc:336] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.981s (SENT)
I20260620 13:57:57.253554  5997 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:57.268141  5953 raft_consensus.cc:1240] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260620 13:57:57.275244  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:57.277911  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:57.229822 11106 consensus_queue.cc:1048] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260620 13:57:57.227391 11119 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:57.247402 11185 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:57.245024 11197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.042s	sys 0.110s
I20260620 13:57:57.310681  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:57.311928  5953 raft_consensus.cc:2393] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:57.311481  5778 catalog_manager.cc:5696] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 12, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 12 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:57.224355 11223 consensus_queue.cc:260] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:57.329912  5778 catalog_manager.cc:5696] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 9 to 10, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 10 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:57.344990  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:57.346959  6579 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260620 13:57:57.284747 10835 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:57.369275  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:57.370280  5953 raft_consensus.cc:2368] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12.
W20260620 13:57:57.373252  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 173307us
I20260620 13:57:57.386751 11185 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:57.387362 11185 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:57.392289 11185 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:57.394596 11185 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260620 13:57:57.403079  5877 raft_consensus.cc:1275] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260620 13:57:57.405428  5957 pending_rounds.cc:85] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 3
I20260620 13:57:57.405755  5957 pending_rounds.cc:107] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260620 13:57:57.405995  5957 raft_consensus.cc:2889] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:57.406311  5957 pending_rounds.cc:107] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260620 13:57:57.406548  5957 raft_consensus.cc:2889] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:57.409258  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:57.409947  6580 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 15. Current term is 16. Ops: []
W20260620 13:57:57.408674  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 126185us
I20260620 13:57:57.410647  5778 catalog_manager.cc:5696] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 10, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 10 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:57.413817  5997 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:57.410133  6578 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:57:57.419389  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 226416us
I20260620 13:57:57.368396 11164 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:57.275545 11220 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:57.427474  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:57.427665  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:57.430799  6580 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:57:57.426191  5778 catalog_manager.cc:5696] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 6 to 10, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 10 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:57.406328  6586 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:57.401249 10778 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:57.426717  5950 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260620 13:57:57.433202  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:57.420840 11223 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:57.243044 11150 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
W20260620 13:57:57.425314 11094 consensus_meta.cc:287] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.000s
I20260620 13:57:57.447642  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:57.443207  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 183203us
I20260620 13:57:57.447160  5778 catalog_manager.cc:5696] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 12, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 12 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:57.450076  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:57.454237  5875 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:57.456213  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:57.456842  5883 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:57.261606 11254 consensus_queue.cc:1048] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
W20260620 13:57:57.458755  5848 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.742s (SENT)
I20260620 13:57:57.460784  5848 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:57.435240 11149 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:57:57.461752 11185 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:57:57.373546 10835 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:57.466003  5848 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.608s (SENT)
I20260620 13:57:57.433501 11267 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:57.479622  5875 raft_consensus.cc:2468] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
W20260620 13:57:57.467697  5848 leader_election.cc:336] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.795s (SENT)
I20260620 13:57:57.482396  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:57.483019  5876 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:57.372846 11182 consensus_queue.cc:237] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:57.458472 11192 consensus_meta.cc:287] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.625s	user 0.013s	sys 0.000s
I20260620 13:57:57.486756  6581 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260620 13:57:57.491015  5875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:57.486862  5778 catalog_manager.cc:5696] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 3 to 7, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 7 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:57:57.492141  5875 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:57.489876  6026 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260620 13:57:57.462184 11149 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:57.433274 11164 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:57.506872  5950 raft_consensus.cc:1240] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 10. Current term is 11. Ops: []
I20260620 13:57:57.502487  5875 raft_consensus.cc:2468] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:57.506728  5778 catalog_manager.cc:5696] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 7 to 8, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 8 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:57:57.508796  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:57.509433  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:57.510166  5955 raft_consensus.cc:2393] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 13: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:57.510490  6029 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260620 13:57:57.557480  5956 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260620 13:57:57.559020  5778 catalog_manager.cc:5696] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 7 to 11, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 11 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:57:57.501724 11134 consensus_meta.cc:287] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.001s
I20260620 13:57:57.444914 10778 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:57.496362 11186 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:57.575572  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 163252us
I20260620 13:57:57.508556 11149 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
W20260620 13:57:57.576308 11232 log.cc:927] Time spent T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260620 13:57:57.499549 11172 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:57.578639  5879 raft_consensus.cc:1275] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260620 13:57:57.463812 11094 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:57.582779  5875 raft_consensus.cc:1275] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260620 13:57:57.592721  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:57.594154 10835 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:57.605150  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:57.611783  5849 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:57.612007  5875 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:57.567670 11154 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:57.579226 10831 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:57.497857 11192 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:57.595778 11247 log.cc:927] Time spent T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260620 13:57:57.567143 11271 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.129s
I20260620 13:57:57.562718  5876 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:57:57.615345 11159 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:57:57.643910  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:57.618662 11186 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:57:57.687223  5955 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:57.230387 11236 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:57.648169  6579 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10. Ops: []
I20260620 13:57:57.626662  5849 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:57:57.585845 11264 consensus_queue.cc:1048] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260620 13:57:57.490836 11267 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:57.620337 11142 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:57.586066 11134 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:57.689474  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:57.696552  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 70015.2us
W20260620 13:57:57.713083  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:57.677924  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:57.630115 11119 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:57.698855  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 114002us
I20260620 13:57:57.614660 11172 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:57.712314  5956 raft_consensus.cc:2468] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:57:57.696147 11159 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:57:57.730350  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:57.731237  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:57.731841  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:57.735621  5955 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
W20260620 13:57:57.707653 11232 log.cc:927] Time spent T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260620 13:57:57.752539  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:57.753816  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:57.702131 11185 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:57.754487  5954 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:57:57.753942  5952 raft_consensus.cc:3055] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 16 LEADER]: Stepping down as leader of term 16
I20260620 13:57:57.701907 11186 raft_consensus.cc:697] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:57.770279  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:57.765021  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:57.765777  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:57.647758 10831 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260620 13:57:57.766925  6578 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
W20260620 13:57:57.769086  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 276855us
I20260620 13:57:57.764354  5952 raft_consensus.cc:740] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:57:57.788614  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:57.796219  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 336007us
I20260620 13:57:57.788105  5955 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:57.723327 11210 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:57.746711 11159 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:57:57.816695  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:57.830904  6580 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 20.
I20260620 13:57:57.842814  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:57.857396  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:57.867506  5955 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260620 13:57:57.869155  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:57.871302  5955 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 13: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:57.873859  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:57.794075 11154 consensus_queue.cc:1059] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260620 13:57:57.834287 11185 raft_consensus.cc:697] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:57:57.792295 11119 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260620 13:57:57.879014  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:57.824164 11065 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:57.886016  6025 raft_consensus.cc:2410] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260620 13:57:57.830550 11195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.018s	sys 0.006s
I20260620 13:57:57.850008 11265 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:57.864297 11142 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:57.823123 11210 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:57.896054 11215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.010s	sys 0.006s
W20260620 13:57:57.891180 11262 log.cc:927] Time spent T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.386s	user 0.002s	sys 0.000s
W20260620 13:57:57.891698 11258 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
W20260620 13:57:57.921329 11263 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
I20260620 13:57:57.886966 11106 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:57.881732 11236 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:57.948395  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 88241.8us
W20260620 13:57:57.951315  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 93366.2us
W20260620 13:57:57.893630 11195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.019s	sys 0.006s
W20260620 13:57:57.926857 11277 log.cc:927] Time spent T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
W20260620 13:57:57.943730 11215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.016s	sys 0.006s
W20260620 13:57:57.975714  5883 consensus_meta.cc:287] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.502s	user 0.012s	sys 0.000s
I20260620 13:57:57.891239 11001 consensus_queue.cc:1048] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260620 13:57:57.944713 11292 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:57.965956  5997 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:57.950695 11094 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:57.969599  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 188836us
I20260620 13:57:57.986788 11192 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:58.043551  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 77647.6us
W20260620 13:57:57.981853  6584 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.002s	sys 0.005s
I20260620 13:57:57.896973 11065 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:57.988525  5882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.008s	sys 0.010s
W20260620 13:57:58.047137  5882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.008s	sys 0.011s
I20260620 13:57:58.001058 11236 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:57.913323 11265 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:57.927291 11142 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:57.989348 11268 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260620 13:57:58.010385  5883 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 16.
I20260620 13:57:57.893649 11273 consensus_queue.cc:1048] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260620 13:57:57.967768 11106 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:58.045506  6584 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.003s	sys 0.006s
I20260620 13:57:57.915872 11186 consensus_queue.cc:237] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:58.001024 11172 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:57.969063 11293 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
W20260620 13:57:58.011265 11269 log.cc:927] Time spent T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260620 13:57:58.072001  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:58.109071  6583 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 16: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:58.012305 11134 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:58.014072 11119 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:58.073757  5880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 1168) took 1262 ms. Trace:
W20260620 13:57:58.063419  5957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.011s	sys 0.006s
W20260620 13:57:58.115439  5957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.012s	sys 0.006s
W20260620 13:57:58.074780  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 109912us
I20260620 13:57:58.076488  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:58.117661  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:58.087466  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 69282.4us
I20260620 13:57:58.092974  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:58.115303  5880 rpcz_store.cc:276] 0620 13:57:56.811152 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:56.811285 (+   133us) service_pool.cc:224] Handling call
0620 13:57:56.824974 (+ 13689us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:56.847214 (+ 22240us) raft_consensus.cc:1534] Early marking committed up to index 9
0620 13:57:56.847242 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:56.854653 (+  7411us) log.cc:844] Serialized 26 byte log entry
0620 13:57:57.234429 (+379776us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:57.234472 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:57.234547 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:58.073439 (+838892us) raft_consensus.cc:1685] finished
0620 13:57:58.073459 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:58.073694 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30148,"raft.queue_time_us":22412,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":16944,"thread_start_us":346576,"threads_started":1,"wal-append.queue_time_us":568097}
I20260620 13:57:57.978197 11185 consensus_queue.cc:237] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:58.076421 11197 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.006s	sys 0.023s
I20260620 13:57:58.127676  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:58.016093 11267 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:57:58.103628 11280 log.cc:927] Time spent T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.341s	user 0.002s	sys 0.000s
I20260620 13:57:58.091325 11298 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:58.134253  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:58.151337  6583 raft_consensus.cc:2393] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 17: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:58.090410 11276 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:58.095368 11300 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:58.151404  5998 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:57:58.140172 11197 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.007s	sys 0.023s
I20260620 13:57:58.139407 11154 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:58.079452 11236 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.157174  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:58.163134  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:58.176576  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:58.046991 11292 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.181890  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:58.152668 11001 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:58.135673 11119 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.191035  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:58.191709  5953 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.010s	sys 0.015s
W20260620 13:57:58.194320  5953 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.010s	sys 0.015s
I20260620 13:57:58.168426 11210 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:58.169019 11154 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:57:58.225009  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 45726.3us
I20260620 13:57:58.225162  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:58.226025  6582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 1200) took 1054 ms. Trace:
I20260620 13:57:58.187278 11290 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:58.180044 11172 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:57:58.235287  6582 rpcz_store.cc:276] 0620 13:57:57.171691 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.171830 (+   139us) service_pool.cc:224] Handling call
0620 13:57:57.172212 (+   382us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:57.177610 (+  5398us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:57.177641 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:57.178206 (+   565us) log.cc:844] Serialized 52 byte log entry
0620 13:57:57.434716 (+256510us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:57.434818 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:57.435068 (+   250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:58.225780 (+790712us) raft_consensus.cc:1685] finished
0620 13:57:58.225807 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:58.225969 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34073,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4326,"thread_start_us":207490,"threads_started":1,"wal-append.queue_time_us":434489}
I20260620 13:57:58.241611  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:58.242274  6582 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:58.245157 11308 raft_consensus.cc:3055] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:57:58.245613 11308 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:57:58.226673 11299 log.cc:927] Time spent T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.251s	user 0.001s	sys 0.001s
I20260620 13:57:58.158202 11298 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:58.230204 11285 log.cc:927] Time spent T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260620 13:57:58.259503  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.259747  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 1206) took 1084 ms. Trace:
I20260620 13:57:58.251039  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:57:58.249338 11270 log.cc:927] Time spent T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260620 13:57:58.253779  6030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2628) took 1131 ms. Trace:
W20260620 13:57:58.246678 11247 log.cc:927] Time spent T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260620 13:57:58.255157 11310 raft_consensus.cc:2804] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:58.255766 11326 consensus_queue.cc:1048] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260620 13:57:58.256729 11222 consensus_meta.cc:287] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.050s	user 0.011s	sys 0.000s
I20260620 13:57:58.230515 11195 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260620 13:57:58.234171 11154 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:57:58.254786 11319 log.cc:927] Time spent T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260620 13:57:58.254832 11290 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:57:58.302572 11256 log.cc:927] Time spent T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.873s	user 0.000s	sys 0.003s
W20260620 13:57:58.303490 11190 consensus_meta.cc:287] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 1.115s	user 0.005s	sys 0.009s
I20260620 13:57:58.303817 11290 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:58.304189  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.303910 11190 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.305287  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.261085 11308 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.306128 11190 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:58.278997  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:58.160996 11300 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.240600 11192 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:57:58.307997  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:58.308259 11300 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:58.308979  5881 raft_consensus.cc:1240] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 14. Current term is 15. Ops: []
I20260620 13:57:58.309327  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:57:58.253612 10918 consensus_meta.cc:287] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 1.082s	user 0.012s	sys 0.001s
I20260620 13:57:58.310715  6579 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260620 13:57:58.311435  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2626) took 1506 ms. Trace:
I20260620 13:57:58.311777  6033 rpcz_store.cc:276] 0620 13:57:56.804629 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:56.804953 (+   324us) service_pool.cc:224] Handling call
0620 13:57:56.805296 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:56.805654 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:56.805682 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:56.819875 (+ 14193us) log.cc:844] Serialized 26 byte log entry
0620 13:57:57.213048 (+393173us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:57.213100 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:57.213201 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:58.301902 (+1088701us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:57:58.311164 (+  9262us) raft_consensus.cc:1685] finished
0620 13:57:58.311183 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:58.311385 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8202,"raft.queue_time_us":961,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":8578,"spinlock_wait_cycles":5015424,"thread_start_us":388978,"threads_started":1,"wal-append.queue_time_us":541512}
W20260620 13:57:58.313262 11274 log.cc:927] Time spent T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.491s	user 0.004s	sys 0.000s
I20260620 13:57:58.313946  6585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 1204) took 1141 ms. Trace:
I20260620 13:57:58.314355  6585 rpcz_store.cc:276] 0620 13:57:57.172830 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.173038 (+   208us) service_pool.cc:224] Handling call
0620 13:57:57.173326 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:57.206746 (+ 33420us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:57.206773 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:57.210500 (+  3727us) log.cc:844] Serialized 26 byte log entry
0620 13:57:57.383512 (+173012us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:57.383647 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:57.383905 (+   258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:58.313733 (+929828us) raft_consensus.cc:1685] finished
0620 13:57:58.313757 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:58.313886 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33047,"raft.queue_time_us":80080,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":23323,"thread_start_us":143278,"threads_started":1,"wal-append.queue_time_us":536105}
I20260620 13:57:58.297216 11310 raft_consensus.cc:697] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:58.318367 11310 consensus_queue.cc:237] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:58.261477 11172 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:58.161352 11276 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.192921 11001 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.246448 11292 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:58.266896  6030 rpcz_store.cc:276] 0620 13:57:57.123987 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.127509 (+  3522us) service_pool.cc:224] Handling call
0620 13:57:57.127868 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:57.128293 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:57.128320 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:57.151972 (+ 23652us) log.cc:844] Serialized 52 byte log entry
0620 13:57:57.436655 (+284683us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:57.582961 (+146306us) log.cc:844] Serialized 14 byte log entry
0620 13:57:57.774396 (+191435us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:57.774498 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:58.250165 (+475667us) raft_consensus.cc:1685] finished
0620 13:57:58.250186 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:58.253719 (+  3533us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100799,"prepare.queue_time_us":142167,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":73,"raft.queue_time_us":111989,"raft.run_cpu_time_us":465,"raft.run_wall_time_us":17670,"spinlock_wait_cycles":1971072,"thread_start_us":476505,"threads_started":3,"wal-append.queue_time_us":424994}
I20260620 13:57:58.298709  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.306391  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:58.332949  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 88905.4us
I20260620 13:57:58.196471 11273 consensus_queue.cc:1048] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260620 13:57:58.292464 11142 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:58.320873  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:58.357236  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:58.290616 11065 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:58.310654 10918 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.370466  5958 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260620 13:57:58.317091 10778 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:58.260092  6587 rpcz_store.cc:276] 0620 13:57:57.175802 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.175948 (+   146us) service_pool.cc:224] Handling call
0620 13:57:57.204615 (+ 28667us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:57.375177 (+170562us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:57:57.389277 (+ 14100us) log.cc:844] Serialized 14 byte log entry
0620 13:57:57.425782 (+ 36505us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:57.426448 (+   666us) log.cc:844] Serialized 52 byte log entry
0620 13:57:57.426603 (+   155us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:57:57.430524 (+  3921us) log.cc:844] Serialized 14 byte log entry
0620 13:57:57.430930 (+   406us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:57.431091 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:58.259511 (+828420us) raft_consensus.cc:1685] finished
0620 13:57:58.259533 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:58.259691 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35737,"prepare.queue_time_us":139252,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":2824,"raft.queue_time_us":81473,"raft.run_cpu_time_us":2213,"raft.run_wall_time_us":38592,"spinlock_wait_cycles":6892672,"thread_start_us":188097,"threads_started":3,"wal-append.queue_time_us":292150}
I20260620 13:57:58.350224  5998 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:58.361121 11298 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:58.299449 11215 consensus_queue.cc:1059] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260620 13:57:58.361565 11001 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:58.327943 11295 consensus_queue.cc:1059] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260620 13:57:58.319379 11304 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260620 13:57:58.337666 11159 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:57:58.361368 11321 log.cc:927] Time spent T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260620 13:57:58.349166  6582 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:57:58.348333 11172 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:58.348665 11195 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:58.580633  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1223) took 1088 ms. Trace:
W20260620 13:57:58.587250  6029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.021s	sys 0.013s
W20260620 13:57:58.452411  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 102273us
W20260620 13:57:58.637027  6029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.022s	sys 0.014s
W20260620 13:57:58.557788  5959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.018s	sys 0.058s
W20260620 13:57:58.637857  5959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.022s	sys 0.058s
W20260620 13:57:58.613147  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:58.637423  5998 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:58.392794  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:58.583869  6552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.011s	sys 0.006s
W20260620 13:57:58.583636  5954 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.000s	sys 0.018s
I20260620 13:57:58.399910  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.334743 11190 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:57:58.481638 11125 consensus_meta.cc:287] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.274s	user 0.012s	sys 0.002s
W20260620 13:57:58.593123 11220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.000s	sys 0.009s
W20260620 13:57:58.585208 11150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.002s	sys 0.015s
W20260620 13:57:58.665161  5954 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.000s	sys 0.020s
I20260620 13:57:58.666160  5950 raft_consensus.cc:2410] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260620 13:57:58.451880 11106 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:58.454706 10918 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:58.451843 11265 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:58.454319 11223 consensus_meta.cc:287] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 1.003s	user 0.009s	sys 0.000s
I20260620 13:57:58.637729  5953 rpcz_store.cc:276] 0620 13:57:57.492540 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.493123 (+   583us) service_pool.cc:224] Handling call
0620 13:57:57.505034 (+ 11911us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:57.581308 (+ 76274us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:57.581348 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:57.590416 (+  9068us) log.cc:844] Serialized 26 byte log entry
0620 13:57:58.195153 (+604737us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:58.195211 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:58.195314 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:58.580403 (+385089us) raft_consensus.cc:1685] finished
0620 13:57:58.580426 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:58.580569 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9663,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7608,"thread_start_us":551621,"threads_started":1,"wal-append.queue_time_us":895159}
W20260620 13:57:58.670320  6552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.011s	sys 0.010s
W20260620 13:57:58.705632  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 895079us
I20260620 13:57:58.585665 11210 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:58.659761  5955 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.001s	sys 0.006s
W20260620 13:57:58.454049 11149 consensus_meta.cc:287] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.846s	user 0.010s	sys 0.002s
W20260620 13:57:58.378410 11183 consensus_meta.cc:287] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.249s	user 0.014s	sys 0.000s
W20260620 13:57:58.711259  5955 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.002s	sys 0.007s
I20260620 13:57:58.639542 10778 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:58.710311  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 72985.5us
I20260620 13:57:58.708598 11189 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:58.591449  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 322236us
I20260620 13:57:58.691784  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.712652  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:58.723620  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:58.671186 11220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.000s	sys 0.009s
I20260620 13:57:58.452284 11292 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:57:58.734887  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:58.704939 11328 raft_consensus.cc:3055] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Stepping down as leader of term 15
W20260620 13:57:58.716189 11150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.005s	sys 0.029s
I20260620 13:57:58.713313 11001 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Leader election won for term 20
I20260620 13:57:58.735955  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:58.773976 11001 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:58.774482  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:58.745440  5953 raft_consensus.cc:2376] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10. Re-sending same reply.
I20260620 13:57:58.775300  5950 raft_consensus.cc:2368] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12.
I20260620 13:57:58.776212  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.776553  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.776981  5953 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:58.777915  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:58.778080  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.778550  5950 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:58.715353 11119 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:58.748332  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:58.778847  5953 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:57:58.779872  5956 raft_consensus.cc:2410] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260620 13:57:58.779884 11001 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.781178  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.781919  5956 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 8.
I20260620 13:57:58.783217  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:58.784596  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.786463  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:58.788060  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:58.789378  5953 raft_consensus.cc:2368] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12.
I20260620 13:57:58.790361  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.791697  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.672251 11278 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.068s
I20260620 13:57:58.793051  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.792555  5950 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:58.672449 11125 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.714026 11300 consensus_queue.cc:1059] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260620 13:57:58.748991 11328 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:58.727030 10778 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.807157  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:58.811501  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.807436  5953 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 13: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:58.772361 11307 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:58.731666 11223 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.068s
I20260620 13:57:58.736398 10918 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:58.816236  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2352) took 1064 ms. Trace:
I20260620 13:57:58.723563 11210 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:58.716621 11183 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.817328  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2504) took 1416 ms. Trace:
I20260620 13:57:58.728241 11106 consensus_queue.cc:1059] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260620 13:57:58.717847 11149 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.796541 11292 raft_consensus.cc:697] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:57:58.839329  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:58.892026  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:57:58.892584  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:58.842525  6024 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 15. Ops: []
I20260620 13:57:58.843165  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:58.845135  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:58.869418  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.868011  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:58.872926  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:58.874756  5883 raft_consensus.cc:1240] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 15. Ops: [13.7-14.8]
I20260620 13:57:58.877017  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:57:58.896648  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:58.877578  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
W20260620 13:57:58.871037  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 156171us
I20260620 13:57:58.876582  5959 rpcz_store.cc:276] 0620 13:57:57.751628 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.751781 (+   153us) service_pool.cc:224] Handling call
0620 13:57:57.752051 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:57.752225 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 11
0620 13:57:57.930574 (+178349us) log.cc:844] Serialized 14 byte log entry
0620 13:57:58.805144 (+874570us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:58.805193 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0620 13:57:58.806187 (+   994us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:58.806273 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:58.816088 (+  9815us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29681,"prepare.queue_time_us":470831,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":2362,"raft.queue_time_us":95207,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":58124,"thread_start_us":984797,"threads_started":3,"wal-append.queue_time_us":786821}
I20260620 13:57:58.898648  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:58.886605  5957 rpcz_store.cc:276] 0620 13:57:57.400904 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.404850 (+  3946us) service_pool.cc:224] Handling call
0620 13:57:57.405206 (+   356us) raft_consensus.cc:1471] Updating replica for 3 ops
0620 13:57:57.422965 (+ 17759us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:57.422996 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0620 13:57:57.423734 (+   738us) log.cc:844] Serialized 78 byte log entry
0620 13:57:58.115930 (+692196us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:58.584088 (+468158us) log.cc:844] Serialized 14 byte log entry
0620 13:57:58.584643 (+   555us) log.cc:844] Serialized 14 byte log entry
0620 13:57:58.595690 (+ 11047us) log.cc:844] Serialized 14 byte log entry
0620 13:57:58.595894 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:58.595978 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:58.817100 (+221122us) raft_consensus.cc:1685] finished
0620 13:57:58.817122 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:58.817269 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12864,"prepare.queue_time_us":118871,"prepare.run_cpu_time_us":3512,"prepare.run_wall_time_us":9446,"raft.queue_time_us":216036,"raft.run_cpu_time_us":454,"raft.run_wall_time_us":57942,"spinlock_wait_cycles":94732928,"thread_start_us":1068069,"threads_started":2,"wal-append.queue_time_us":727806}
I20260620 13:57:58.900924  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:58.901455  5957 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:58.901507  6552 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:58.905630  6581 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260620 13:57:58.906219  5878 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260620 13:57:58.907184  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.907950  5959 raft_consensus.cc:2376] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13. Re-sending same reply.
I20260620 13:57:58.884433 11300 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:58.916771  6552 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:57:58.912016  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:58.918330  5950 raft_consensus.cc:2376] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13. Re-sending same reply.
I20260620 13:57:58.920485  5883 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260620 13:57:58.912377  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.914620 11125 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:58.927040  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:58.927425  5959 raft_consensus.cc:2410] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260620 13:57:58.928437  5876 raft_consensus.cc:2410] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260620 13:57:58.928556  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:58.915582 11300 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.930266  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:57:58.931638 11221 raft_consensus.cc:2804] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:57:58.932168 11221 raft_consensus.cc:697] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:58.933073 11221 consensus_queue.cc:237] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.934564  6581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 1272) took 1444 ms. Trace:
I20260620 13:57:58.934958  6581 rpcz_store.cc:276] 0620 13:57:57.490512 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.501796 (+ 11284us) service_pool.cc:224] Handling call
0620 13:57:57.505033 (+  3237us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:58.906140 (+1401107us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:58.934307 (+ 28167us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540059f954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:58.934509 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3220483456}
I20260620 13:57:58.935636 11175 raft_consensus.cc:2804] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:57:58.936189 11175 raft_consensus.cc:697] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:58.937112 11175 consensus_queue.cc:237] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.937525 11164 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:58.897188 11328 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:58.867200 11307 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:58.891633 10918 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:57:58.976891  6584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46858 (request call id 1270) took 1542 ms. Trace:
I20260620 13:57:59.149327  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:59.149588  6030 raft_consensus.cc:1240] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:58.974982  6029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1177) took 1419 ms. Trace:
I20260620 13:57:59.000957  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:58.956377  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:58.978863  5880 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
W20260620 13:57:59.073205  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:58.979337  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:59.153486  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:59.098263  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2357) took 1345 ms. Trace:
I20260620 13:57:59.077353  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:58.941948  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:59.150605  6029 rpcz_store.cc:276] 0620 13:57:57.555210 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.555439 (+   229us) service_pool.cc:224] Handling call
0620 13:57:57.555794 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:57.708525 (+152731us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:57.708577 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:57.763144 (+ 54567us) log.cc:844] Serialized 26 byte log entry
0620 13:57:58.638366 (+875222us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:57:58.638429 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:58.638537 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:58.974708 (+336171us) raft_consensus.cc:1685] finished
0620 13:57:58.974735 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:58.974911 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27671,"raft.queue_time_us":84139,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"thread_start_us":919020,"threads_started":2,"wal-append.queue_time_us":1082971}
W20260620 13:57:58.971354 11335 log.cc:927] Time spent T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260620 13:57:59.154495  5878 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
W20260620 13:57:58.973282 11340 log.cc:927] Time spent T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260620 13:57:59.149600  6584 rpcz_store.cc:276] 0620 13:57:57.434156 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.434301 (+   145us) service_pool.cc:224] Handling call
0620 13:57:57.434729 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:57.435079 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 10
0620 13:57:58.076186 (+641107us) log.cc:844] Serialized 14 byte log entry
0620 13:57:58.585712 (+509526us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:58.586249 (+   537us) log.cc:844] Serialized 26 byte log entry
0620 13:57:58.586422 (+   173us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:57:58.586468 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:58.586550 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:58.976683 (+390133us) raft_consensus.cc:1685] finished
0620 13:57:58.976702 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:58.976833 (+   131us) inbound_call.cc:177] Queueing success response
0620 13:57:59.094797 (+117964us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b4800042b58. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe47261a1 00007f0fe471d237 00007f0fe471d0ca 00007f0fe481496f 00007f0fe4814637 00007f0fe4828c5c 00007f0fe4828c08 00007f0fe4828b88 00007f0fe4828b43 00007f0fe4827dec 00007f0fe3754f76
Metrics: {"mutex_wait_us":298983,"prepare.queue_time_us":36530,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":6778,"raft.queue_time_us":10455,"raft.run_cpu_time_us":10338,"raft.run_wall_time_us":1954409,"spinlock_wait_cycles":6809344,"thread_start_us":1076005,"threads_started":2,"wal-append.queue_time_us":779926}
I20260620 13:57:59.166898  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:59.078320  5957 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:57:59.168289  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:59.168525  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:58.915910 11159 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:58.955045 11313 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:57:59.028951 11346 log.cc:927] Time spent T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260620 13:57:59.126818 11255 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:59.164430  5953 raft_consensus.cc:2410] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
W20260620 13:57:59.160627  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 243973us
W20260620 13:57:58.955296 11318 log.cc:927] Time spent T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.333s	user 0.001s	sys 0.001s
W20260620 13:57:58.972579 11312 log.cc:927] Time spent T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260620 13:57:58.970814 11339 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260620 13:57:59.192822  5884 raft_consensus.cc:1240] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 15. Ops: []
I20260620 13:57:59.077636  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:57:58.972062 11344 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260620 13:57:59.169790  5957 raft_consensus.cc:2393] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 12: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:57:59.083447  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2354) took 1331 ms. Trace:
I20260620 13:57:59.154115  5955 rpcz_store.cc:276] 0620 13:57:57.752845 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.887144 (+134299us) service_pool.cc:224] Handling call
0620 13:57:57.914140 (+ 26996us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:58.047170 (+133030us) raft_consensus.cc:1534] Early marking committed up to index 10
0620 13:57:58.711779 (+664609us) log.cc:844] Serialized 14 byte log entry
0620 13:57:58.913468 (+201689us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:58.922902 (+  9434us) log.cc:844] Serialized 26 byte log entry
0620 13:57:58.923047 (+   145us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:57:58.923082 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:58.923169 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:59.097986 (+174817us) raft_consensus.cc:1685] finished
0620 13:57:59.098016 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:59.098187 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37420,"prepare.queue_time_us":199921,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":4275,"raft.queue_time_us":116171,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":40553,"thread_start_us":900541,"threads_started":3,"wal-append.queue_time_us":306763}
I20260620 13:57:59.169978  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:59.196414  5878 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
W20260620 13:57:59.052125 11321 log.cc:927] Time spent T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260620 13:57:59.171849 11001 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:57:59.198199 11001 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:59.198613 11001 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:59.187521 11183 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:58.978123 11172 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:58.956666 11154 consensus_meta.cc:287] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.629s	user 0.008s	sys 0.004s
I20260620 13:57:59.190999 11210 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:58.977025 11292 consensus_queue.cc:237] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.151427  5883 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:57:59.181105  6024 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
W20260620 13:57:58.970204 11345 log.cc:927] Time spent T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260620 13:57:59.002256 11332 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:58.976027 11293 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:59.064625 11288 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:58.975932 10778 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:59.068848 11149 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:59.127650 11300 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:57:59.187827  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:59.411974 11154 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.159003 11164 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:59.169413 11328 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:57:59.165141 11310 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:57:59.193969  5959 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:59.106402 11107 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:59.199821  6031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1172) took 1691 ms. Trace:
I20260620 13:57:59.195746  5954 rpcz_store.cc:276] 0620 13:57:57.752114 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.790600 (+ 38486us) service_pool.cc:224] Handling call
0620 13:57:57.791038 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:58.706075 (+915037us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:58.706128 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:58.707239 (+  1111us) log.cc:844] Serialized 26 byte log entry
0620 13:57:59.081215 (+373976us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:59.081273 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.081363 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:59.083164 (+  1801us) raft_consensus.cc:1685] finished
0620 13:57:59.083192 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:59.083368 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":207133,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":1182499,"threads_started":2,"wal-append.queue_time_us":342277}
I20260620 13:57:59.204624  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1219) took 2051 ms. Trace:
I20260620 13:57:59.002362 11196 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:59.221589  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
W20260620 13:57:59.284550  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:59.189625 11313 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.385010 11186 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:59.450259  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:59.508045  6031 rpcz_store.cc:276] 0620 13:57:57.508674 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.508781 (+   107us) service_pool.cc:224] Handling call
0620 13:57:57.576146 (+ 67365us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:57.717102 (+140956us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:57.717151 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:57.720245 (+  3094us) log.cc:844] Serialized 26 byte log entry
0620 13:57:58.076517 (+356272us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:58.076563 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:58.076654 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:59.199619 (+1122965us) raft_consensus.cc:1685] finished
0620 13:57:59.199639 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:59.199769 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26309,"raft.queue_time_us":69319,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":35631,"thread_start_us":379111,"threads_started":2,"wal-append.queue_time_us":622763}
I20260620 13:57:59.511965  5883 raft_consensus.cc:2393] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:57:59.385677 11175 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:59.400540 11037 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:59.192077 11255 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:59.457180  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 2016) took 2055 ms. Trace:
W20260620 13:57:59.431479 11346 log.cc:927] Time spent T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
W20260620 13:57:59.467927 11233 negotiation.cc:336] Failed RPC negotiation. Trace:
0620 13:57:56.211692 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.4.155.194:38517 (local address 127.0.0.1:39830)
0620 13:57:56.466738 (+255046us) negotiation.cc:107] Waiting for socket to connect
0620 13:57:56.466821 (+    83us) client_negotiation.cc:175] Beginning negotiation
0620 13:57:56.467346 (+   525us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0620 13:57:59.465465 (+2998119us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.4.155.194:38517: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":254154,"thread_start_us":254789,"threads_started":1}
I20260620 13:57:59.468575 11253 raft_consensus.cc:1064] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: attempting to promote NON_VOTER b0ce39342d8c4a64904b30b98de02b9f to VOTER
I20260620 13:57:59.517692 11186 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.520378 11313 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:59.520553 11186 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:59.521109 11037 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:59.484933 11308 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:59.523159 11037 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:57:59.465734 11354 log.cc:927] Time spent T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
I20260620 13:57:59.523756 11175 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.496315  6580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 1209) took 1448 ms. Trace:
I20260620 13:57:59.187533  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:57:59.526135  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 338658us
I20260620 13:57:59.480891  5884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:59.509688  5876 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:59.528996 11107 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:59.500331  5956 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:59.508210  5958 rpcz_store.cc:276] 0620 13:57:57.153342 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.160350 (+  7008us) service_pool.cc:224] Handling call
0620 13:57:57.160776 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:58.370877 (+1210101us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.204342 (+833465us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540007add4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:59.204564 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2781488512}
W20260620 13:57:59.513239  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:59.531961  5950 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:57:59.466045 11353 log.cc:927] Time spent T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.401s	user 0.001s	sys 0.000s
I20260620 13:57:59.514731  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:59.488446 10918 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:59.517369  6032 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 13. Current term is 15. Ops: []
I20260620 13:57:59.520810 11253 consensus_queue.cc:237] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.526506 11175 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:59.531317  5884 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 8 FOLLOWER]: Advancing to term 9
W20260620 13:57:59.510077  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:59.515755  5882 rpcz_store.cc:276] 0620 13:57:57.401906 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.418111 (+ 16205us) service_pool.cc:224] Handling call
0620 13:57:57.418479 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:57.420124 (+  1645us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:57.420164 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:57.424458 (+  4294us) log.cc:844] Serialized 26 byte log entry
0620 13:57:58.056560 (+632102us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:58.056608 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:58.056675 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:59.456897 (+1400222us) raft_consensus.cc:1685] finished
0620 13:57:59.456928 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:59.457102 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1206,"raft.queue_time_us":1355,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5020,"thread_start_us":622738,"threads_started":1,"wal-append.queue_time_us":1227792}
I20260620 13:57:59.513553  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:57:59.536986  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2528) took 1235 ms. Trace:
W20260620 13:57:59.607630  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:59.608517  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:59.609225  5955 raft_consensus.cc:2393] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:59.609359  5954 rpcz_store.cc:276] 0620 13:57:58.301853 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.514486 (+1212633us) service_pool.cc:224] Handling call
0620 13:57:59.536901 (+ 22415us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:59.557729  5876 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:57:59.525713  6580 rpcz_store.cc:276] 0620 13:57:58.047735 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.047871 (+   136us) service_pool.cc:224] Handling call
0620 13:57:58.048218 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:58.052225 (+  4007us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:58.052264 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:58.066447 (+ 14183us) log.cc:844] Serialized 52 byte log entry
0620 13:57:58.584937 (+518490us) raft_consensus.cc:1645] Marking committed up to 12
0620 13:57:58.584993 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:58.585102 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:59.496064 (+910962us) raft_consensus.cc:1685] finished
0620 13:57:59.496091 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:59.496242 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":867685,"raft.queue_time_us":8468,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":871446,"thread_start_us":450997,"threads_started":1,"wal-append.queue_time_us":702768}
I20260620 13:57:59.506950 11164 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.587170  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:59.497390 11332 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.614282  5882 raft_consensus.cc:2468] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:57:59.630152  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:59.631080  5876 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:57:59.627802  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:59.628316  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2525) took 1327 ms. Trace:
I20260620 13:57:59.635070  5955 rpcz_store.cc:276] 0620 13:57:58.301033 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.500734 (+1199701us) service_pool.cc:224] Handling call
0620 13:57:59.628240 (+127506us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260620 13:57:59.645540  5848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.994s (SENT) [suppressed 33 similar messages]
I20260620 13:57:59.652783  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:59.654525  5954 raft_consensus.cc:2410] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260620 13:57:59.658340  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:59.489723 11293 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.682898  6587 raft_consensus.cc:1217] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Deduplicated request from leader. Original: 14.12->[16.13-16.13]   Dedup: 16.13->[]
I20260620 13:57:59.667698  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:59.684331  5958 raft_consensus.cc:2393] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 13: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:59.659422  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:59.684890  6587 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260620 13:57:59.684968  5883 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:57:59.671856 11362 log.cc:927] Time spent T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260620 13:57:59.683024  6581 raft_consensus.cc:1240] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:59.668026  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:57:59.687500  6582 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 16. Current term is 17. Ops: [13.11-16.13]
I20260620 13:57:59.688061  5956 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:59.690084  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2541) took 1324 ms. Trace:
I20260620 13:57:59.690327  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:59.693818  6586 raft_consensus.cc:2368] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:57:59.693526  5958 rpcz_store.cc:276] 0620 13:57:58.365506 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.613920 (+1248414us) service_pool.cc:224] Handling call
0620 13:57:59.690020 (+ 76100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:59.694854  5958 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:59.695400  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2546) took 1156 ms. Trace:
I20260620 13:57:59.696870  6579 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:59.697160  6584 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 13. Current term is 14. Ops: []
I20260620 13:57:59.698002  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:59.698168  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:59.698559  6578 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 12. Current term is 13. Ops: []
I20260620 13:57:59.619261 11183 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:57:59.695693  5958 rpcz_store.cc:276] 0620 13:57:58.538856 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.694356 (+1155500us) service_pool.cc:224] Handling call
0620 13:57:59.694681 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.695197 (+   516us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.695344 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:59.699699  6579 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 19. Current term is 20. Ops: [17.12-19.13]
W20260620 13:57:59.700031  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:59.700119  5958 raft_consensus.cc:3055] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Stepping down as leader of term 8
I20260620 13:57:59.700508  5958 raft_consensus.cc:740] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:59.700758  6578 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260620 13:57:59.700809  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:59.701529  6585 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:57:59.701217  5958 consensus_queue.cc:260] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.702203  5958 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 8 FOLLOWER]: Advancing to term 9
I20260620 13:57:59.695847  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:57:59.699903  5955 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260620 13:57:59.705041  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2542) took 1339 ms. Trace:
W20260620 13:57:59.700521  5924 connection.cc:256] RPC call timeout handler was delayed by -4.0170360360000359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260620 13:57:59.706158  5924 connection.cc:256] RPC call timeout handler was delayed by -3.9810360359999777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
I20260620 13:57:59.706369  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:57:59.706600  5924 connection.cc:256] RPC call timeout handler was delayed by -3.8811360360000435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260620 13:57:59.707024  5924 connection.cc:256] RPC call timeout handler was delayed by -3.8667360360000202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
W20260620 13:57:59.707448  5924 connection.cc:256] RPC call timeout handler was delayed by -3.8127360360000466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
W20260620 13:57:59.707825  5924 connection.cc:256] RPC call timeout handler was delayed by -3.7902360360000102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260620 13:57:59.708212  5924 connection.cc:256] RPC call timeout handler was delayed by -3.5247360360000357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260620 13:57:59.708595  5924 connection.cc:256] RPC call timeout handler was delayed by -3.3735360360000186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2267s for a response
I20260620 13:57:59.709354  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:59.712548  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038"
I20260620 13:57:59.713564  5876 raft_consensus.cc:2410] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260620 13:57:59.705410  5955 rpcz_store.cc:276] 0620 13:57:58.365765 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.699327 (+1333562us) service_pool.cc:224] Handling call
0620 13:57:59.699612 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.704756 (+  5144us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.704967 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:59.724078  5954 raft_consensus.cc:1240] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 14. Current term is 15. Ops: []
I20260620 13:57:59.623418 11221 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:59.734010  5956 raft_consensus.cc:3055] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:57:59.754567  5956 raft_consensus.cc:740] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:59.754277  6582 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:59.736723  5882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2e82c0c231624695ac5a813230bf5038" is_pre_election: true
I20260620 13:57:59.738413  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2532) took 1435 ms. Trace:
I20260620 13:57:59.738736  6585 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:57:59.756458  5954 rpcz_store.cc:276] 0620 13:57:58.302964 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.719240 (+1416276us) service_pool.cc:224] Handling call
0620 13:57:59.719623 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.738141 (+ 18518us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.738346 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:59.767530 11287 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:57:59.767906  5956 consensus_queue.cc:260] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:59.771823  5956 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:59.772673  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42748 (request call id 1176) took 2313 ms. Trace:
I20260620 13:57:59.773029  5879 rpcz_store.cc:276] 0620 13:57:57.459139 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.459610 (+   471us) service_pool.cc:224] Handling call
0620 13:57:57.459880 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:57.602948 (+143068us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.772407 (+2169459us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54003f2854. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:59.772585 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272399104}
I20260620 13:57:59.775187  5958 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260620 13:57:59.775563  5958 pending_rounds.cc:85] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 7
I20260620 13:57:59.775790  5958 pending_rounds.cc:107] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260620 13:57:59.776026  5958 raft_consensus.cc:2889] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:59.776698  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2549) took 1040 ms. Trace:
I20260620 13:57:59.776997  5958 rpcz_store.cc:276] 0620 13:57:58.737138 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.699732 (+962594us) service_pool.cc:224] Handling call
0620 13:57:59.700013 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.776452 (+ 76439us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.776641 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:59.778821  5881 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 16. Current term is 17. Ops: []
I20260620 13:57:59.780012  5881 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 15. Current term is 16. Ops: []
I20260620 13:57:59.758553  5954 raft_consensus.cc:3055] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 16 LEADER]: Stepping down as leader of term 16
I20260620 13:57:59.781136  5881 raft_consensus.cc:1240] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260620 13:57:59.781245  5954 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:59.786985  5955 raft_consensus.cc:3055] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:57:59.787539  5955 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:57:59.733177 11196 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:59.794010 11236 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:59.793910 11196 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.796572 11196 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:59.781986  5954 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.798031  5954 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:57:59.798273  5881 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 16. Current term is 17. Ops: []
I20260620 13:57:59.799985  5881 pending_rounds.cc:85] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Aborting all ops after (but not including) 9
I20260620 13:57:59.800508  5881 pending_rounds.cc:107] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260620 13:57:59.800910  5881 raft_consensus.cc:2889] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:59.802089  5955 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.759068 11210 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:59.821281  5955 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:57:59.809109  5952 consensus_queue.cc:260] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.790632  5950 raft_consensus.cc:2468] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:57:59.746098  5884 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:57:59.490110 11288 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.740626  5924 leader_election.cc:400] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 12. Current term is 13.
I20260620 13:57:59.777019 11338 raft_consensus.cc:3055] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:57:59.760457 10831 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260620 13:57:59.793203 11364 log.cc:927] Time spent T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260620 13:57:59.733412 11183 raft_consensus.cc:697] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:59.804172  5956 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260620 13:57:59.835654  5956 pending_rounds.cc:85] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 7
I20260620 13:57:59.835898  5956 pending_rounds.cc:107] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260620 13:57:59.836107  5956 raft_consensus.cc:2889] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:59.836963  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2554) took 1024 ms. Trace:
I20260620 13:57:59.837423  5956 rpcz_store.cc:276] 0620 13:57:58.812395 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.733413 (+921018us) service_pool.cc:224] Handling call
0620 13:57:59.733849 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.836643 (+102794us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.836893 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:59.769562 11221 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.743932  5959 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
W20260620 13:57:59.809165 11261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.757s	user 0.020s	sys 0.031s
W20260620 13:57:59.849588 11261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.835s	user 0.021s	sys 0.031s
I20260620 13:57:59.830245  5924 leader_election.cc:403] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:57:59.830758  5952 raft_consensus.cc:3060] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Advancing to term 17
W20260620 13:57:59.856655  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:59.856683 11254 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:57:59.857645 11254 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.860169 11254 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:59.827383  5884 raft_consensus.cc:1240] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 11. Current term is 12. Ops: []
I20260620 13:57:59.848584  6581 raft_consensus.cc:2393] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 13: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:57:59.848834  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2555) took 1036 ms. Trace:
I20260620 13:57:59.829473 11338 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:57:59.858143  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:59.867646  5959 rpcz_store.cc:276] 0620 13:57:58.812680 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.999351 (+186671us) service_pool.cc:224] Handling call
0620 13:57:59.848772 (+849421us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:59.869266 11287 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:57:59.870842 11306 log.cc:927] Time spent T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 1.812s	user 0.000s	sys 0.009s
I20260620 13:57:59.870726 11295 raft_consensus.cc:3055] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Stepping down as leader of term 16
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:454: Failure
Failed
Bad status: Timed out: Client connection negotiation failed: client connection to 127.4.155.194:38517: received 0 of 4 requested bytes
I20260620 13:57:59.889333 11094 raft_consensus.cc:3055] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:57:59.889532 11154 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:59.889271 11295 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:57:59.889873 11094 raft_consensus.cc:740] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:57:59.890690 11295 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.890941 11094 consensus_queue.cc:260] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.891791 11295 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:57:59.892118 11094 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:57:59.892247 11001 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.877983  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:59.839386 10918 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:57:59.878199  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:57:59.894450  6024 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:57:59.879952  5883 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:57:59.880379  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:57:59.886370  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:57:59.880864 11254 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:57:59.888125 11287 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.894940  6029 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:57:59.889755  4719 tablet_server.cc:179] TabletServer@127.4.155.193:0 shutting down...
I20260620 13:57:59.909338  6586 raft_consensus.cc:1217] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-8.8]   Dedup: 6.7->[8.8-8.8]
I20260620 13:57:59.910200  6586 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260620 13:57:59.911922  6027 raft_consensus.cc:2393] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:57:59.912122  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:57:59.921100  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 180836us
I20260620 13:57:59.922676  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:57:59.926781  5883 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260620 13:57:59.928519  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:57:59.931830 11189 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:57:59.833766  5954 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260620 13:57:59.932371 11189 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:57:59.932857 11189 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:57:59.933053  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2561) took 1118 ms. Trace:
I20260620 13:57:59.918643 11254 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.890691 11164 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:57:59.913997 11210 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 12. Current term is 13.
I20260620 13:57:59.942305 10831 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:57:59.942972 10831 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.944088  6031 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:57:59.913856 10918 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:57:59.881330 11273 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:57:59.953294  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2349) took 2202 ms. Trace:
I20260620 13:57:59.954496 11293 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:59.953790 11273 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.956087 11332 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:57:59.889202 11338 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.933583  5954 rpcz_store.cc:276] 0620 13:57:58.814350 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.757983 (+943633us) service_pool.cc:224] Handling call
0620 13:57:59.758388 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.932690 (+174302us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.932980 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:59.970083  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:57:59.937249  5952 raft_consensus.cc:1275] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260620 13:57:59.938531 11001 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:57:59.940878 11356 negotiation.cc:336] Failed RPC negotiation. Trace:
0620 13:57:58.889679 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:39830 (local address 127.4.155.194:38517)
0620 13:57:59.680747 (+791068us) server_negotiation.cc:207] Beginning negotiation
0620 13:57:59.680794 (+    47us) server_negotiation.cc:400] Waiting for connection header
0620 13:57:59.680883 (+    89us) server_negotiation.cc:408] Connection header received
0620 13:57:59.681099 (+   216us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0620 13:57:59.681141 (+    42us) server_negotiation.cc:462] Received NEGOTIATE request from client
0620 13:57:59.734929 (+ 53788us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0620 13:57:59.824301 (+ 89372us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39830: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":756292,"thread_start_us":282208,"threads_started":1}
I20260620 13:57:59.926520 11313 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:57:59.971719  5952 pending_rounds.cc:85] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 12
I20260620 13:57:59.989048  5952 pending_rounds.cc:107] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260620 13:57:59.989502  5952 raft_consensus.cc:2889] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:57:59.975876  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1230) took 1069 ms. Trace:
I20260620 13:57:59.890940 11183 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:57:59.990156  5954 rpcz_store.cc:276] 0620 13:57:58.899724 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.967048 (+1067324us) service_pool.cc:224] Handling call
0620 13:57:59.967570 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.967821 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.967861 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:59.967929 (+    68us) raft_consensus.cc:1645] Marking committed up to 11
0620 13:57:59.967975 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.968055 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:59.968227 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:59.927198  5955 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260620 13:57:59.953752  5951 rpcz_store.cc:276] 0620 13:57:57.750692 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.750823 (+   131us) service_pool.cc:224] Handling call
0620 13:57:57.751196 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:57.899334 (+148138us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:57:59.203899 (+1304565us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b180044f380. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdf3a385c 00007f0fdc6edc8b 00007f0fe554c759 00007f0fdc709e9b 00007f0fdc70813f 00007f0fdc707c55 00007f0fe31f6247 00007f0fdf806d87 00007f0fdf81649f
0620 13:57:59.385179 (+181280us) log.cc:844] Serialized 14 byte log entry
0620 13:57:59.835412 (+450233us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:59.835878 (+   466us) log.cc:844] Serialized 26 byte log entry
0620 13:57:59.836015 (+   137us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:57:59.836045 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.836113 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:57:59.952761 (+116648us) raft_consensus.cc:1685] finished
0620 13:57:59.952908 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:57:59.953106 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1915,"prepare.queue_time_us":334427,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":217254,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":16157,"spinlock_wait_cycles":4234624,"thread_start_us":582500,"threads_started":3,"wal-append.queue_time_us":493876}
I20260620 13:57:59.995959  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2550) took 1193 ms. Trace:
I20260620 13:57:59.996616  5955 rpcz_store.cc:276] 0620 13:57:58.802241 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.737464 (+935223us) service_pool.cc:224] Handling call
0620 13:57:59.786828 (+ 49364us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.995672 (+208844us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.995905 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:57:59.998298  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2350) took 2247 ms. Trace:
I20260620 13:57:59.968344 11338 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:00.086617  6551 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:00.089128  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.090852  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:00.092973  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.098620  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.106099  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.106995  6580 raft_consensus.cc:2393] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 9: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:58:00.068504 10831 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:00.100724 11293 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:58:00.108585 11288 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:00.109218 11254 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:00.112717 11287 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:00.278609  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:00.283679  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:00.284606  6585 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:00.296140  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.300339  6585 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:58:00.138857 11293 raft_consensus.cc:697] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:58:00.219094 11328 consensus_meta.cc:287] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.711s	user 0.015s	sys 0.000s
W20260620 13:58:00.322026 11368 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260620 13:58:00.323426 11366 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260620 13:58:00.327373 11293 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:00.338812  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.343495  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.343572  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.345888  6585 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:00.348728  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42078 (request call id 1226) took 1449 ms. Trace:
I20260620 13:58:00.349781 11189 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:00.349261  5950 rpcz_store.cc:276] 0620 13:57:58.898336 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.919241 (+ 20905us) service_pool.cc:224] Handling call
0620 13:58:00.347799 (+1428558us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54002620d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:00.347923 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":869453184}
W20260620 13:58:00.345292 11330 log.cc:927] Time spent T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 1.893s	user 0.016s	sys 0.018s
I20260620 13:58:00.367632  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.337370 11273 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:00.379701  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:00.381352  6582 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260620 13:58:00.386505 11189 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:00.392843  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:00.429489  6582 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260620 13:58:00.429605  5877 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.003s	sys 0.007s
W20260620 13:58:00.431906  5877 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.004s	sys 0.008s
W20260620 13:58:00.422741  5959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.004s	sys 0.006s
I20260620 13:58:00.438512  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1228) took 1539 ms. Trace:
I20260620 13:58:00.439673  5877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 2018) took 3012 ms. Trace:
I20260620 13:58:00.440132  5877 rpcz_store.cc:276] 0620 13:57:57.431450 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.431708 (+   258us) service_pool.cc:224] Handling call
0620 13:57:57.432507 (+   799us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:57.452997 (+ 20490us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:57.453029 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:59.496708 (+2043679us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b2c00103cc8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fde0f5c71 00007f0fde1055d2 00007f0fdf837de1 00007f0fdf7fc81a 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22
0620 13:57:59.505541 (+  8833us) log.cc:844] Serialized 52 byte log entry
0620 13:57:59.873543 (+368002us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:58:00.432196 (+558653us) log.cc:844] Serialized 14 byte log entry
0620 13:58:00.432432 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:00.432495 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:00.432523 (+    28us) raft_consensus.cc:1685] finished
0620 13:58:00.439473 (+  6950us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:00.439618 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":238261,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":10287,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":23632,"spinlock_wait_cycles":16783232,"thread_start_us":878640,"threads_started":2,"wal-append.queue_time_us":563669}
I20260620 13:58:00.439002  5959 rpcz_store.cc:276] 0620 13:57:58.898718 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.873910 (+975192us) service_pool.cc:224] Handling call
0620 13:57:59.874317 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:59.874736 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.874778 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:59.875335 (+   557us) log.cc:844] Serialized 26 byte log entry
0620 13:58:00.437201 (+561866us) raft_consensus.cc:1645] Marking committed up to 11
0620 13:58:00.437238 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:00.437307 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:00.438131 (+   824us) raft_consensus.cc:1685] finished
0620 13:58:00.438152 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:00.438460 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":15334,"thread_start_us":516615,"threads_started":1,"wal-append.queue_time_us":398575}
I20260620 13:58:00.601351 11293 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:00.715529 11380 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:00.716084 11293 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:00.716244 11380 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:00.719858 11332 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:00.720487 11332 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:00.720882 10778 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:00.721612 10778 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:00.724112 10778 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:00.870673  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:00.743777 11332 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:01.111819  6025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.000s	sys 0.008s
W20260620 13:58:01.112556  6025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.000s	sys 0.008s
W20260620 13:58:01.215255  6551 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.000s	sys 0.008s
W20260620 13:58:01.215142  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 124988us
W20260620 13:58:01.226631  6551 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.001s	sys 0.009s
W20260620 13:58:01.227383  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 790185us
W20260620 13:58:01.228540  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.062129 11380 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:01.292044  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.241233 11293 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:01.308487 10918 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:01.322235  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2652) took 1439 ms. Trace:
I20260620 13:58:01.322804  6025 rpcz_store.cc:276] 0620 13:57:59.882704 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:00.425862 (+543158us) service_pool.cc:224] Handling call
0620 13:58:00.426307 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:00.426600 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 8
0620 13:58:00.426960 (+   360us) log.cc:844] Serialized 14 byte log entry
0620 13:58:01.321861 (+894901us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:01.321921 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:58:01.321974 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.322046 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.322170 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1715,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":207000,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":883713,"threads_started":2,"wal-append.queue_time_us":867374}
W20260620 13:58:01.468413  5876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.623s	user 0.007s	sys 0.023s
W20260620 13:58:01.469038  5876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.624s	user 0.007s	sys 0.023s
I20260620 13:58:01.475328  5875 raft_consensus.cc:1217] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Deduplicated request from leader. Original: 13.7->[14.8-14.8]   Dedup: 14.8->[]
I20260620 13:58:01.476383  5875 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260620 13:58:01.478940  5875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2899) took 2476 ms. Trace:
I20260620 13:58:01.479387  5875 rpcz_store.cc:276] 0620 13:57:59.002542 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.857104 (+854562us) service_pool.cc:224] Handling call
0620 13:57:59.857590 (+   486us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:01.476805 (+1619215us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.478616 (+  1811us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400001c54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:01.478863 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3720112896}
W20260620 13:58:01.482086  5958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.703s	user 0.023s	sys 0.031s
W20260620 13:58:01.482604  5958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.704s	user 0.023s	sys 0.031s
I20260620 13:58:01.483319  5876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 2025) took 2575 ms. Trace:
I20260620 13:58:01.483319  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2359) took 2585 ms. Trace:
I20260620 13:58:01.484138  5958 rpcz_store.cc:276] 0620 13:57:58.897588 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.777739 (+880151us) service_pool.cc:224] Handling call
0620 13:57:59.778066 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:59.778399 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.778425 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:59.778841 (+   416us) log.cc:844] Serialized 26 byte log entry
0620 13:58:01.482956 (+1704115us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:58:01.482994 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.483063 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:01.483122 (+    59us) raft_consensus.cc:1685] finished
0620 13:58:01.483135 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.483261 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6774,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":8002,"thread_start_us":1703816,"threads_started":1,"wal-append.queue_time_us":533009,"wal-append.run_cpu_time_us":1525,"wal-append.run_wall_time_us":1013902}
I20260620 13:58:01.485859  5876 rpcz_store.cc:276] 0620 13:57:58.907921 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.758406 (+850485us) service_pool.cc:224] Handling call
0620 13:57:59.800709 (+ 42303us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:59.801170 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.801211 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:57:59.813446 (+ 12235us) log.cc:844] Serialized 52 byte log entry
0620 13:58:01.469483 (+1656037us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:58:01.470475 (+   992us) log.cc:844] Serialized 14 byte log entry
0620 13:58:01.482997 (+ 12522us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.483063 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:01.483122 (+    59us) raft_consensus.cc:1685] finished
0620 13:58:01.483134 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.483261 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1104,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":108,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4274,"thread_start_us":1636975,"threads_started":3,"wal-append.queue_time_us":513290,"wal-append.run_cpu_time_us":2250,"wal-append.run_wall_time_us":1022107}
I20260620 13:58:01.498160  6583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46852 (request call id 1214) took 3357 ms. Trace:
I20260620 13:58:01.498677  6583 rpcz_store.cc:276] 0620 13:57:58.140965 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.188214 (+ 47249us) service_pool.cc:224] Handling call
0620 13:57:58.188922 (+   708us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:58.321849 (+132927us) raft_consensus.cc:1534] Early marking committed up to index 9
0620 13:57:58.337210 (+ 15361us) log.cc:844] Serialized 14 byte log entry
0620 13:57:58.714198 (+376988us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:57:58.714259 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:57:58.714307 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.497823 (+2783516us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54003b74d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:01.497884 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.498059 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":191394,"prepare.queue_time_us":31125,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":22136,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":200060,"spinlock_wait_cycles":304983808,"thread_start_us":360117,"threads_started":1,"wal-append.queue_time_us":514612,"wal-append.run_cpu_time_us":14675,"wal-append.run_wall_time_us":1589811}
W20260620 13:58:01.510147  5924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.585s	user 0.015s	sys 0.027s
W20260620 13:58:01.511974  5924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.586s	user 0.016s	sys 0.028s
W20260620 13:58:01.512321  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 1.58688e+06us
I20260620 13:58:01.514329  5924 leader_election.cc:400] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 15.
I20260620 13:58:01.514612  5924 leader_election.cc:403] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260620 13:58:01.521062  5848 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.875s	user 0.021s	sys 0.019s
W20260620 13:58:01.522840  5848 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.876s	user 0.022s	sys 0.020s
W20260620 13:58:01.523342  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 1.87772e+06us
W20260620 13:58:01.523861  5848 connection.cc:256] RPC call timeout handler was delayed by -1.9555046130000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
W20260620 13:58:01.524514  5848 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.897s (SENT)
W20260620 13:58:01.525710  5848 leader_election.cc:336] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.982s (SENT)
I20260620 13:58:01.526286  5848 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:01.536572 11307 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:01.539177  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.540310 10977 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:01.545102 11405 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 15.
I20260620 13:58:01.546550  5880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2887) took 2705 ms. Trace:
I20260620 13:58:01.547394  5880 rpcz_store.cc:276] 0620 13:57:58.841224 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.841349 (+   125us) service_pool.cc:224] Handling call
0620 13:57:58.869261 (+ 27912us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.152930 (+283669us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.546270 (+2393340us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b540030f2d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:01.546482 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251506048}
I20260620 13:58:01.548053 11405 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:58:01.548779  5848 connection.cc:256] RPC call timeout handler was delayed by -1.7978626889999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260620 13:58:01.550393  5848 connection.cc:256] RPC call timeout handler was delayed by -1.3684010959999569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260620 13:58:01.550804  5848 connection.cc:256] RPC call timeout handler was delayed by -1.309412769000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
W20260620 13:58:01.551189  5848 connection.cc:256] RPC call timeout handler was delayed by -1.2680127689999381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
W20260620 13:58:01.551527  5848 connection.cc:256] RPC call timeout handler was delayed by -1.183930417000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26320000000000005s for a response
W20260620 13:58:01.551971  5848 connection.cc:256] RPC call timeout handler was delayed by -1.1066364119999434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.336s for a response
W20260620 13:58:01.552345  5848 connection.cc:256] RPC call timeout handler was delayed by -1.0765454109999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
I20260620 13:58:01.553798 10977 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260620 13:58:01.556362  6024 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.609s	user 0.016s	sys 0.030s
W20260620 13:58:01.558000  6024 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.610s	user 0.017s	sys 0.030s
I20260620 13:58:01.562737 11405 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.564680  5848 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:01.570361  5848 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:01.566864 11405 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:01.572418 11405 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:01.573523 11405 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.572754 10977 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:01.577105 11405 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:01.579195 11405 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:01.580245 11405 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:01.583653  5924 connection.cc:256] RPC call timeout handler was delayed by -1.3224151470000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260620 13:58:01.584120  5924 connection.cc:256] RPC call timeout handler was delayed by -1.3224151470000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260620 13:58:01.584648  5924 connection.cc:256] RPC call timeout handler was delayed by -1.1505151469999646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260620 13:58:01.585011  5924 connection.cc:256] RPC call timeout handler was delayed by -1.1505151469999646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260620 13:58:01.585366  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0425151470000174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260620 13:58:01.585690  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0425151470000174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260620 13:58:01.586061  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0254151469999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260620 13:58:01.585777  5848 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:01.586476  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0254151469999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260620 13:58:01.586966  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0146151469999722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260620 13:58:01.587333  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0146151469999722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
I20260620 13:58:01.587718  5848 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:01.589565  6024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43502 (request call id 2650) took 1710 ms. Trace:
I20260620 13:58:01.589934  6024 rpcz_store.cc:276] 0620 13:57:59.879296 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.926097 (+ 46801us) service_pool.cc:224] Handling call
0620 13:57:59.939351 (+ 13254us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.939598 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 10
0620 13:58:01.558409 (+1618811us) log.cc:844] Serialized 14 byte log entry
0620 13:58:01.589223 (+ 30814us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:01.589281 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:58:01.589323 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.589395 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.589507 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":416694,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":113,"thread_start_us":1640962,"threads_started":2}
I20260620 13:58:01.583767 11406 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:01.592381 11405 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:01.593600  5924 leader_election.cc:400] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:58:01.593930  5924 leader_election.cc:403] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:58:01.594933 11405 consensus_queue.cc:1059] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:01.595763 11405 consensus_queue.cc:1243] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer b0ce39342d8c4a64904b30b98de02b9f log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260620 13:58:01.596724 11405 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:58:01.598415 11405 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:01.600147 11406 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.602511 11406 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:01.588943 10977 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:01.603084 11406 raft_consensus.cc:3055] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:58:01.615326 11406 raft_consensus.cc:740] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:01.616999 11406 consensus_queue.cc:260] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.608047 10977 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:58:01.618371  5953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2552) took 2806 ms (client timeout 1647 ms). Trace:
I20260620 13:58:01.618472 10977 consensus_queue.cc:1059] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260620 13:58:01.612807  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:01.619822  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.620568 11397 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:01.621105 11397 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.623471 11397 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:01.624198  5997 connection.cc:256] RPC call timeout handler was delayed by -2.1791553169999816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
W20260620 13:58:01.625720  5879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.850s	user 0.015s	sys 0.032s
W20260620 13:58:01.626209  5879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.850s	user 0.017s	sys 0.033s
I20260620 13:58:01.624670 11397 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:01.626737 11397 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.626921  5879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 2026) took 2718 ms. Trace:
I20260620 13:58:01.628050  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:01.628909  6583 raft_consensus.cc:2393] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 14: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:01.627959  5879 rpcz_store.cc:276] 0620 13:57:58.908093 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.774221 (+866128us) service_pool.cc:224] Handling call
0620 13:57:59.774548 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:59.774938 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.774959 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:59.775438 (+   479us) log.cc:844] Serialized 26 byte log entry
0620 13:58:01.626580 (+1851142us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:58:01.626621 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.626685 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:01.626724 (+    39us) raft_consensus.cc:1685] finished
0620 13:58:01.626736 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.626868 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2320,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":82,"thread_start_us":1850771,"threads_started":1,"wal-append.queue_time_us":323881,"wal-append.run_cpu_time_us":1744,"wal-append.run_wall_time_us":1094267}
I20260620 13:58:01.630651  6026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1176) took 4075 ms. Trace:
I20260620 13:58:01.631062  6026 rpcz_store.cc:276] 0620 13:57:57.554889 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.561066 (+  6177us) service_pool.cc:224] Handling call
0620 13:57:57.561399 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:57.729470 (+168071us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:57.729501 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:57.729937 (+   436us) log.cc:844] Serialized 26 byte log entry
0620 13:57:57.937150 (+207213us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:57:57.937202 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.870236 (+1933034us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:58:01.630141 (+1759905us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54001e50d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:01.630335 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:01.630399 (+    64us) raft_consensus.cc:1685] finished
0620 13:58:01.630412 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.630565 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35738,"raft.queue_time_us":110971,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":35861,"spinlock_wait_cycles":405333248,"thread_start_us":105264,"threads_started":1,"wal-append.queue_time_us":167315,"wal-append.run_cpu_time_us":11477,"wal-append.run_wall_time_us":2906997}
W20260620 13:58:01.632717  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:01.633113  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.633952  6030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2891) took 2814 ms. Trace:
I20260620 13:58:01.634415  6030 rpcz_store.cc:276] 0620 13:57:58.819531 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.819665 (+   134us) service_pool.cc:224] Handling call
0620 13:57:58.819997 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.152753 (+332756us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.633704 (+2480951us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54000b72d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:01.633897 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757531520}
I20260620 13:58:01.638741 11221 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:01.618882  5953 rpcz_store.cc:269] 0620 13:57:58.811810 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.869168 (+ 57358us) service_pool.cc:224] Handling call
0620 13:58:01.618072 (+2748904us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54002512d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:01.618279 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609133440}
I20260620 13:58:01.635370 11107 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:01.640869 11406 raft_consensus.cc:3060] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:01.641249 11107 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260620 13:58:01.648231  5884 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.717s	user 0.015s	sys 0.005s
W20260620 13:58:01.648774  5884 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.718s	user 0.015s	sys 0.005s
I20260620 13:58:01.649372 11404 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:01.649562  5884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 2035) took 2562 ms. Trace:
I20260620 13:58:01.649915  5884 rpcz_store.cc:276] 0620 13:57:59.086902 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.868891 (+781989us) service_pool.cc:224] Handling call
0620 13:57:59.900796 (+ 31905us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:59.930030 (+ 29234us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.930075 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:59.930694 (+   619us) log.cc:844] Serialized 26 byte log entry
0620 13:58:01.649160 (+1718466us) raft_consensus.cc:1645] Marking committed up to 5
0620 13:58:01.649202 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.649281 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:01.649319 (+    38us) raft_consensus.cc:1685] finished
0620 13:58:01.649331 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.649507 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28679,"raft.queue_time_us":34055,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":1718011,"threads_started":1,"wal-append.queue_time_us":434215,"wal-append.run_cpu_time_us":2349,"wal-append.run_wall_time_us":1031877}
W20260620 13:58:01.652748  5849 connection.cc:256] RPC call timeout handler was delayed by -1.3380730920000588s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
I20260620 13:58:01.653200 11408 raft_consensus.cc:3055] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:58:01.653620 11408 raft_consensus.cc:740] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:58:01.653208  5849 connection.cc:256] RPC call timeout handler was delayed by -1.2885730919999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260620 13:58:01.660228  5849 connection.cc:256] RPC call timeout handler was delayed by -1.2885730919999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260620 13:58:01.660874  5849 connection.cc:256] RPC call timeout handler was delayed by -1.0941730920000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
I20260620 13:58:01.660521 11408 consensus_queue.cc:260] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:01.661242  5849 connection.cc:256] RPC call timeout handler was delayed by -1.0698730919999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
W20260620 13:58:01.665766  6031 consensus_meta.cc:287] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 1.721s	user 0.031s	sys 0.012s
I20260620 13:57:59.999593  5952 rpcz_store.cc:276] 0620 13:57:57.751034 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:57.753431 (+  2397us) service_pool.cc:224] Handling call
0620 13:57:57.753782 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.797487 (+2043705us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b4c0010dd40. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fddac6120 00007f0fddad7129 00007f0fdda9cd44 00007f0fddac462d 00007f0fddac4293 00007f0fdf7f756b 00007f0fdf7f8095 00007f0fdf7f3310 00007f0fdf7f4bbe 00007f0fdf7fef29 00007f0fdf7ff7f6
0620 13:57:59.998025 (+200538us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:57:59.998232 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90018560}
I20260620 13:58:01.672318  6031 raft_consensus.cc:2410] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260620 13:58:01.661752  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 71578.3us
W20260620 13:58:01.665719  5849 connection.cc:256] RPC call timeout handler was delayed by -1.0698730919999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
W20260620 13:58:01.673646 11317 log.cc:927] Time spent T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 3.218s	user 0.022s	sys 0.017s
I20260620 13:58:01.637557 11397 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:01.682524  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:01.684666  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 90151.4us
W20260620 13:58:01.688486  5881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.845s	user 0.007s	sys 0.021s
W20260620 13:58:01.703719  5881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.860s	user 0.008s	sys 0.022s
I20260620 13:58:01.703831 11414 consensus_queue.cc:1059] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:58:01.705202  5881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58452 (request call id 2897) took 2703 ms. Trace:
I20260620 13:58:01.705644  5881 rpcz_store.cc:276] 0620 13:57:59.001967 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.799360 (+797393us) service_pool.cc:224] Handling call
0620 13:57:59.799760 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:59.812991 (+ 13231us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.813024 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:57:59.813446 (+   422us) log.cc:844] Serialized 26 byte log entry
0620 13:58:01.704658 (+1891212us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:58:01.704717 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.704800 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:01.704843 (+    43us) raft_consensus.cc:1685] finished
0620 13:58:01.704855 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:01.705143 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1861203,"threads_started":1,"wal-append.queue_time_us":512295,"wal-append.run_cpu_time_us":2442,"wal-append.run_wall_time_us":1079446}
W20260620 13:58:01.683028  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.711138 11413 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:01.711660  5924 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:01.711733 11413 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.713730  6032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2893) took 2872 ms. Trace:
I20260620 13:58:01.714252 11413 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:01.714126  6032 rpcz_store.cc:276] 0620 13:57:58.840867 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.841122 (+   255us) service_pool.cc:224] Handling call
0620 13:57:58.868784 (+ 27662us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.544275 (+675491us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.713492 (+2169217us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b54001c8754. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:01.713668 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1491144960}
I20260620 13:58:01.714969 11413 consensus_queue.cc:1059] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260620 13:58:01.716972 11416 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260620 13:58:01.718338  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.718178 11413 consensus_queue.cc:1059] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260620 13:58:01.715831 11414 consensus_queue.cc:1243] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260620 13:58:01.689286 11412 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260620 13:58:01.684789 11409 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:01.724795 11409 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.725402 11414 raft_consensus.cc:3055] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:01.725883 11414 raft_consensus.cc:740] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:01.726662 11414 consensus_queue.cc:260] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.727052 11409 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:01.728201 11414 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:01.728427 11409 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 13:58:01.728987 11409 raft_consensus.cc:697] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:01.718786 11416 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260620 13:58:01.730600 11417 raft_consensus.cc:3055] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:58:01.731025 11410 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:01.730650 11409 consensus_queue.cc:237] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.732245 11410 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.731045 11417 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:58:01.736691  5998 connection.cc:256] RPC call timeout handler was delayed by -1.7176850490000106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
W20260620 13:58:01.737529  5998 connection.cc:256] RPC call timeout handler was delayed by -1.2393195900000364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260620 13:58:01.737943  5998 connection.cc:256] RPC call timeout handler was delayed by -1.1601195900000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260620 13:58:01.738286  5998 connection.cc:256] RPC call timeout handler was delayed by -1.1601195900000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
I20260620 13:58:01.738438 11397 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:01.739578 11397 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.742848 11397 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:01.740162  5924 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:01.747568 11182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.966s	user 0.009s	sys 0.010s
W20260620 13:58:01.748060 11182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.966s	user 0.009s	sys 0.010s
W20260620 13:58:01.708228  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:01.738633  5998 connection.cc:256] RPC call timeout handler was delayed by -1.1538195900000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
W20260620 13:58:01.753482  5998 connection.cc:256] RPC call timeout handler was delayed by -1.1538195900000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
W20260620 13:58:01.754015  5998 connection.cc:256] RPC call timeout handler was delayed by -1.11331959000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260620 13:58:01.754434  5998 connection.cc:256] RPC call timeout handler was delayed by -1.0809195900000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260620 13:58:01.756271  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 130008us
I20260620 13:58:01.755568  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:01.667387 11408 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:01.766021 11419 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:01.766597 11419 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.768918 11419 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:01.736342 11417 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.770345 11417 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:01.764801  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:58:01.775043  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:01.775669  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.670451 11406 raft_consensus.cc:3055] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:58:01.775974  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:01.786829 11418 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:58:01.777225 11406 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:01.776916 11106 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:01.780458 11414 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:01.791839 11418 raft_consensus.cc:697] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:58:01.818066  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 114874us
I20260620 13:58:01.798795 11106 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:01.810420 11409 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:01.822774 11106 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:01.822919 11409 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.825547 11409 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:01.829061  6581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46864 (request call id 1199) took 2133 ms. Trace:
I20260620 13:58:01.829965  6581 rpcz_store.cc:276] 0620 13:57:59.695442 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.695555 (+   113us) service_pool.cc:224] Handling call
0620 13:58:01.828719 (+2133164us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54004eb954. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:01.828861 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330808576}
W20260620 13:58:01.819749  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 55054.8us
I20260620 13:58:01.798136 11410 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:01.837751  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:01.812919 11414 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:01.846055  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:58:01.842783  5848 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.647s (SENT)
I20260620 13:58:01.850457  5848 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:01.857746  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 117925us
I20260620 13:58:01.834650 11106 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.800472 11406 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.866082  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.866855  5952 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:58:01.869119  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.869848  5952 raft_consensus.cc:2393] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:01.872473  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.873190  5953 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:58:01.873510  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.874537  5958 raft_consensus.cc:2410] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260620 13:58:01.876348  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.869148  5998 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:01.845808 11412 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260620 13:58:01.880398  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.883126  5958 raft_consensus.cc:2376] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12. Re-sending same reply.
I20260620 13:58:01.884672 11409 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:01.885289 11409 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:01.886013 11415 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.022s
I20260620 13:58:01.886700 11415 consensus_queue.cc:1243] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260620 13:58:01.887379 11106 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:01.888037 11415 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260620 13:58:01.888929  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.889648  5958 raft_consensus.cc:2376] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9. Re-sending same reply.
I20260620 13:58:01.891489  6586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 1197) took 2196 ms. Trace:
I20260620 13:58:01.891932  6586 rpcz_store.cc:276] 0620 13:57:59.694753 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.701721 (+  6968us) service_pool.cc:224] Handling call
0620 13:57:59.702029 (+   308us) raft_consensus.cc:1471] Updating replica for 2 ops
0620 13:57:59.910603 (+208574us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.891197 (+1980594us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54005f4bd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:01.891425 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476263168}
I20260620 13:58:01.892311 11424 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:01.892872 11424 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:01.894069  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.899780  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.901731  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.905347  5950 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 17: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:58:01.893302 11424 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:01.906256  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.902338  5955 raft_consensus.cc:1240] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260620 13:58:01.908810  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.910167  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.903648  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.903690  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.916222  5951 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:01.900462  5959 raft_consensus.cc:3060] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:01.916193  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.917807  5952 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:01.919541  5950 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:58:01.920817  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.921662  5955 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:58:01.924072  5955 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260620 13:58:01.903985  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 138405us
I20260620 13:58:01.935007  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.937108 11409 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:01.900218 11414 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.900458 11423 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:01.942907  5959 raft_consensus.cc:2468] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
I20260620 13:58:01.943475  6033 raft_consensus.cc:1240] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260620 13:58:01.926600 11418 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:01.926668 11106 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:01.926021 11278 raft_consensus.cc:2804] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:58:01.953560  5955 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:01.961122  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.988276  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:01.989226  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 120168us
I20260620 13:58:01.989743  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.990473  5950 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:58:01.963137  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2892) took 3143 ms. Trace:
I20260620 13:58:01.963254  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.991947  5959 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:58:01.991706  6033 rpcz_store.cc:276] 0620 13:57:58.820007 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.820357 (+   350us) service_pool.cc:224] Handling call
0620 13:57:58.820713 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:01.943179 (+3122466us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b54004b0da0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7741a0 00007f0fdf7fe5a0 00007f0fdf7ff611 00007f0fdf7fc16f 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c
0620 13:58:01.962859 (+ 19680us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:01.963068 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135764864}
I20260620 13:58:01.993077  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.993718  5959 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:58:01.993587  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.994344  5955 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:58:01.994448 11367 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:01.994524  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.995445  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.969421  5958 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
I20260620 13:58:01.998301  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:01.999043  5955 raft_consensus.cc:2376] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14. Re-sending same reply.
I20260620 13:58:01.945786 11426 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:02.000094  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.998322  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.001010  5958 raft_consensus.cc:2393] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 12: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:58:02.001039  5955 raft_consensus.cc:2410] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260620 13:58:02.001976  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.002725  5958 raft_consensus.cc:2393] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:01.976800  5951 raft_consensus.cc:2468] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:58:01.995805  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.999845 11426 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.004180  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.005376  5951 raft_consensus.cc:2410] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 13 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260620 13:58:02.006220 11426 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:01.996220  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.006863  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:02.007007  5950 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:58:02.008177  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.008935  5950 raft_consensus.cc:2410] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 18 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260620 13:58:02.009765  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.010502  5950 raft_consensus.cc:2410] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260620 13:58:02.001982  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.994992 11367 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.013375  5955 raft_consensus.cc:1275] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260620 13:58:02.015796  5848 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.767s (SENT)
I20260620 13:58:02.020889  5958 raft_consensus.cc:3060] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:02.028983 11255 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:02.030014  5848 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.831s (SENT)
I20260620 13:58:02.031795 11412 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:02.034745 11412 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.035573 11276 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:02.037216 11412 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:02.037786 11412 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:02.038259 11412 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.031925 11415 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:02.032130 10831 consensus_queue.cc:1059] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:58:02.039527 11415 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.040074 10831 raft_consensus.cc:3055] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:02.040624 10831 raft_consensus.cc:740] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:02.042461 11415 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:02.033034 11408 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:02.044201 11408 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.032938 11221 consensus_queue.cc:1048] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:58:02.046902 11408 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:02.048774  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.034155 11430 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:02.041849 10831 consensus_queue.cc:260] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.056587 11412 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:02.052780 11430 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.054741 10831 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:02.062742 11430 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:02.064284  5848 leader_election.cc:336] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.852s (SENT)
W20260620 13:58:02.065165  5848 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.867s (SENT)
W20260620 13:58:02.085824  6031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43502 (request call id 2646) took 2198 ms (client timeout 2068 ms). Trace:
W20260620 13:58:02.086877  6031 rpcz_store.cc:269] 0620 13:57:59.877103 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.877257 (+   154us) service_pool.cc:224] Handling call
0620 13:58:02.074711 (+2197454us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b54001c9b54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:02.075032 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71707008}
W20260620 13:58:02.094708  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.066787  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:02.112509  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.113536  6586 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: []
I20260620 13:58:02.119812  6582 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260620 13:58:02.115350  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:02.120785  6581 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 13: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:02.116716  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:02.122264  6582 raft_consensus.cc:1275] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 LEARNER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260620 13:58:02.122524  5952 raft_consensus.cc:2410] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260620 13:58:02.117918  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:02.125173 11406 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:02.125883  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:02.127259  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:01.984330 11106 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:58:02.149801  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.130650  6582 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
W20260620 13:58:02.162220  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 95642us
I20260620 13:58:02.154050  5951 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
W20260620 13:58:02.164621  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.164220  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.167681  5951 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:58:02.169642  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:02.171545  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:02.166563  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 237645us
I20260620 13:58:02.175560 11440 consensus_queue.cc:1048] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:58:02.176384  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:02.177157  6581 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:58:02.178512  6583 raft_consensus.cc:2410] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260620 13:58:02.125900  5952 raft_consensus.cc:1275] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260620 13:58:02.188011  5952 pending_rounds.cc:85] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 9
I20260620 13:58:02.188414  5952 pending_rounds.cc:107] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260620 13:58:02.188768  5952 raft_consensus.cc:2889] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:02.190085  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.191591  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.175896  5997 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:02.196167  5997 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:02.197887  5997 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:02.184595  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:01.983537 11423 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.211915  5952 raft_consensus.cc:2410] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260620 13:58:02.214262  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:02.226646  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.162220 11106 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:02.167093 11210 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:02.249859 11424 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.253801 11367 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:02.256451  5954 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:58:02.173202 11409 consensus_queue.cc:1059] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260620 13:58:02.257594 11409 raft_consensus.cc:3055] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:58:02.257978 11409 raft_consensus.cc:740] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:02.258841 11409 consensus_queue.cc:260] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.203429 11311 consensus_queue.cc:1059] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260620 13:58:02.261691 11311 consensus_queue.cc:1243] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer 2e82c0c231624695ac5a813230bf5038 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260620 13:58:02.262210 11311 raft_consensus.cc:3055] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:02.262540 11311 raft_consensus.cc:740] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:02.267879 11311 consensus_queue.cc:260] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.269133 11311 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:02.271571  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:02.276589  5956 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.434s	user 0.018s	sys 0.009s
I20260620 13:58:02.277352 11423 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:02.278009  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.278544 11304 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:58:02.279242 11304 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:02.279657 11304 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:02.282039 11397 consensus_queue.cc:1059] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260620 13:58:02.283555  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.283578 11397 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:02.284751 11397 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:02.285239 11397 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:02.286195 11289 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260620 13:58:02.260742 11409 raft_consensus.cc:3060] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:02.297842 11397 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.305207 11435 raft_consensus.cc:2804] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:58:02.306726 11419 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Stepping down as leader of term 19
I20260620 13:58:02.315343 11419 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:02.316314 11419 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.317644 11419 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:58:02.321005 11435 raft_consensus.cc:697] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:02.322353 11435 consensus_queue.cc:237] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.309446 11106 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.311079  5952 raft_consensus.cc:1217] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 8.9->[9.10-12.12]   Dedup: 9.10->[10.11-12.12]
I20260620 13:58:02.312068 11294 raft_consensus.cc:3055] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Stepping down as leader of term 9
W20260620 13:58:02.310978  5882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.530s	user 0.015s	sys 0.041s
I20260620 13:58:02.308537 11289 raft_consensus.cc:3055] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Stepping down as leader of term 13
W20260620 13:58:02.327541  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:02.353070  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:02.327484  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 195116us
I20260620 13:58:02.331192  5952 pending_rounds.cc:85] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 10
I20260620 13:58:02.355261  5952 pending_rounds.cc:107] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260620 13:58:02.355674  5952 raft_consensus.cc:2889] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:02.156575  5958 raft_consensus.cc:1275] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:58:02.363304  5848 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:02.365443  5848 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:02.373355  6551 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:02.384147  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:02.385198  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:02.380947  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca260 after lost signal to thread 4722
I20260620 13:58:02.382551  6551 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:02.352662 11289 raft_consensus.cc:740] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:02.370401 11142 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:02.369445 11294 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:02.391340 11257 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260620 13:58:02.397409  5956 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.555s	user 0.019s	sys 0.010s
I20260620 13:58:02.374931 11404 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260620 13:58:02.401228  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 203402us
W20260620 13:58:02.408839  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.394170 11397 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:02.398056 11300 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:02.401072 11257 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:58:02.466743  5882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.686s	user 0.016s	sys 0.041s
W20260620 13:58:02.468492  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:02.469533  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.473978 11106 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:02.416594 11300 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:02.440884 11305 consensus_queue.cc:1059] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.095s
I20260620 13:58:02.439792 11404 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:02.441636 11257 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:02.484609  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.493582  6029 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:58:02.486124  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.494779  6027 raft_consensus.cc:2368] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 15. Current term is 16.
I20260620 13:58:02.487679  6031 raft_consensus.cc:1240] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 16. Current term is 17. Ops: []
I20260620 13:58:02.488816  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:02.489588  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:02.490880  6026 raft_consensus.cc:1240] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:02.492103  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:02.497467  6025 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:02.500519  6032 raft_consensus.cc:1240] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: []
W20260620 13:58:02.450558 11410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.034s	sys 0.069s
I20260620 13:58:02.505317  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:02.508522  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.509408  6024 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:58:02.479048 11300 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:02.523730  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.525192  6029 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:58:02.531996  6025 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
W20260620 13:58:02.513289 11410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.035s	sys 0.070s
I20260620 13:58:02.499553 11424 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:02.503147 11278 raft_consensus.cc:697] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:02.517555 11293 raft_consensus.cc:3055] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Stepping down as leader of term 16
I20260620 13:58:02.441433 11289 consensus_queue.cc:260] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:02.547178  5998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.002s	sys 0.006s
I20260620 13:58:02.562913  5848 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:58:02.564828  5957 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260620 13:58:02.602182  5957 pending_rounds.cc:85] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 8
I20260620 13:58:02.602540  5957 pending_rounds.cc:107] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260620 13:58:02.570513  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:02.593531  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.499807 11404 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.468008 11294 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:02.603593  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:02.604077  5998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.002s	sys 0.007s
I20260620 13:58:02.602844  5957 raft_consensus.cc:2889] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:58:02.604458  5847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.010s	sys 0.036s
W20260620 13:58:02.604501  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 580591us
W20260620 13:58:02.605053  5847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.010s	sys 0.036s
I20260620 13:58:02.592958 11305 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:02.607036  6583 raft_consensus.cc:2410] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260620 13:58:02.614766 11305 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.617926 11404 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:02.619530  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003821a0 after lost signal to thread 5815
W20260620 13:58:02.621362  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.592665 11439 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:02.598778 11293 raft_consensus.cc:740] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:02.640846  6024 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260620 13:58:02.605871 11445 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:02.649457 11445 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.651193 11307 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:02.651819 11445 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:02.651738 11307 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.647205 11410 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260620 13:58:02.648118 11406 consensus_meta.cc:287] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.000s
I20260620 13:58:02.639037 11278 consensus_queue.cc:237] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.653231  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.646067 11449 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:02.664561  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.765337  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:02.666323  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.766423  6031 raft_consensus.cc:2393] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 14: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:58:02.766537  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.729820  6028 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 12. Current term is 13. Ops: []
I20260620 13:58:02.740314  5997 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:58:02.741099  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 358600us
W20260620 13:58:02.748849  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003366a0 after lost signal to thread 5908
I20260620 13:58:02.768481  5959 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
W20260620 13:58:02.768940  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003af440 after lost signal to thread 5983
W20260620 13:58:02.769251  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08002ebb20 after lost signal to thread 5984
W20260620 13:58:02.727391 11255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.014s	sys 0.006s
I20260620 13:58:02.630806 11443 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:58:02.760246  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.761966  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.765668  6027 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 13: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:02.767560  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:02.770269  6054 debug-util.cc:398] Leaking SignalData structure 0x7b0800419540 after lost signal to thread 6057
W20260620 13:58:02.792018  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6d00 after lost signal to thread 6611
W20260620 13:58:02.792570  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003e45a0 after lost signal to thread 6612
I20260620 13:58:02.740370  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:02.781453  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.771973  6551 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:02.795858  5954 raft_consensus.cc:2393] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 15: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
W20260620 13:58:02.812803  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.826529  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.827719  6027 raft_consensus.cc:2393] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 15: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:02.829836  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:02.839191  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.839742  6026 raft_consensus.cc:2410] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260620 13:58:02.790136 11255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.015s	sys 0.006s
I20260620 13:58:02.840965  6551 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:02.846933  6028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2890) took 4028 ms. Trace:
W20260620 13:58:02.791566 11414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.007s	sys 0.021s
I20260620 13:58:02.858127  6028 rpcz_store.cc:276] 0620 13:57:58.819043 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:58.819259 (+   216us) service_pool.cc:224] Handling call
0620 13:57:58.819625 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:02.767452 (+3947827us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.846599 (+ 79147us) spinlock_profiling.cc:243] Waited 3.91 s on lock 0x7b540037cdd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:02.846858 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8992165248}
I20260620 13:58:02.870601  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.871683  6028 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 16: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:58:02.874814  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.848127  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.790414 11425 raft_consensus.cc:2764] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260620 13:58:02.882027  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.869385  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.883319  6031 raft_consensus.cc:2410] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260620 13:58:02.867341  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2360) took 3969 ms. Trace:
I20260620 13:58:02.868079  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:02.884999  5953 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.017s	sys 0.019s
W20260620 13:58:02.885313  5953 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.017s	sys 0.019s
I20260620 13:58:02.883419  6026 raft_consensus.cc:2468] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:58:02.843624 11380 raft_consensus.cc:2804] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
W20260620 13:58:02.894582  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:02.869999 11414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.007s	sys 0.021s
I20260620 13:58:02.906059  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.644529 11439 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.883850  5956 rpcz_store.cc:276] 0620 13:57:58.897904 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.841550 (+943646us) service_pool.cc:224] Handling call
0620 13:57:59.841974 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:57:59.842231 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 10
0620 13:58:02.401868 (+2559637us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.866576 (+464708us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:02.866660 (+    84us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:58:02.866723 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.866922 (+   199us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:02.867141 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4823,"prepare.queue_time_us":9912,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":19693,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3332,"thread_start_us":3018617,"threads_started":2}
I20260620 13:58:02.912923  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:02.900380  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.879786 11413 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:02.909123  5953 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:02.921823  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.922644  5953 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:58:02.923810  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:02.924582  5953 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:58:02.926020  5953 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260620 13:58:02.929733 11289 raft_consensus.cc:3060] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:02.932489 11378 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:02.933115 11378 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:02.933568 11378 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:02.914357  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:02.888088  5958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.010s
W20260620 13:58:02.951493  5958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.011s	sys 0.010s
W20260620 13:58:02.916580  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:02.917663  5956 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:02.955008  5957 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:58:02.818415 11449 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.969532  5956 raft_consensus.cc:2468] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:02.973714  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.975363  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:02.986440  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 407565us
W20260620 13:58:02.898025  5951 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.020s
W20260620 13:58:02.993746  5951 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.000s	sys 0.021s
I20260620 13:58:02.866474 11293 consensus_queue.cc:260] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:02.823729 11443 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:02.998061  5956 raft_consensus.cc:1275] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260620 13:58:03.000383  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:02.965201 11413 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.012091 11449 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:03.013134 11257 consensus_meta.cc:287] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.000s
W20260620 13:58:03.018018 11304 consensus_meta.cc:287] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.738s	user 0.003s	sys 0.008s
I20260620 13:58:03.026364  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.027935  6026 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
W20260620 13:58:03.011667 11436 log.cc:927] Time spent T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260620 13:58:03.048081 11447 log.cc:927] Time spent T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.387s	user 0.000s	sys 0.001s
W20260620 13:58:03.050410 11451 log.cc:927] Time spent T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260620 13:58:03.057637  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.307395  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 653640us
I20260620 13:58:03.402966  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2581) took 1388 ms. Trace:
W20260620 13:58:03.300285  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 737212us
W20260620 13:58:03.333729  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.074327  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 213516us
W20260620 13:58:03.455535  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.456971 11142 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:03.457093  6551 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:03.457960 11142 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:03.458514 11142 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:03.307297  5882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58456 (request call id 2030) took 4398 ms. Trace:
W20260620 13:58:03.341470  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.107331 10831 consensus_meta.cc:287] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.044s	user 0.014s	sys 0.001s
I20260620 13:58:03.013604 11257 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.188313 11293 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:03.499449  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.500571  6027 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:58:03.502377  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:03.161973 11294 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:58:03.177208 11300 consensus_meta.cc:287] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.640s	user 0.012s	sys 0.000s
I20260620 13:58:03.019613 11304 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.551929 11304 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.018522 11305 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:03.172854 11307 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.150605 11378 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.555318  6032 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: []
I20260620 13:58:03.555953 11378 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:03.557124  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.558037  6026 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:58:03.124814 11380 raft_consensus.cc:697] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:03.157582 11413 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:03.146333 11419 consensus_meta.cc:287] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Time spent flushing consensus metadata: real 0.827s	user 0.014s	sys 0.000s
I20260620 13:58:03.560667 11332 consensus_queue.cc:1048] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:58:03.561880 11380 consensus_queue.cc:237] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.123565 11439 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:03.092841 11442 log.cc:927] Time spent T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260620 13:58:03.145469 11443 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:03.403831  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2580) took 1456 ms. Trace:
I20260620 13:58:03.565773 11487 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.564271  5955 rpcz_store.cc:276] 0620 13:58:01.962719 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.019905 (+ 57186us) service_pool.cc:224] Handling call
0620 13:58:02.020283 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:02.133262 (+112979us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:58:02.133294 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:02.133774 (+   480us) log.cc:844] Serialized 26 byte log entry
0620 13:58:02.549307 (+415533us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:58:02.600065 (+ 50758us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.600321 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.600566 (+   245us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:02.650193 (+ 49627us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b4800002dd8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe47261a1 00007f0fe471d237 00007f0fe471d0ca 00007f0fe481496f 00007f0fe4814637 00007f0fe4828c5c 00007f0fe4828c08 00007f0fe4828b88 00007f0fe4828b43 00007f0fe4827dec 00007f0fe3754f76
0620 13:58:03.184289 (+534096us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b180009a900. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc70abf3 00007f0fdc70cfc1 00007f0fdc70cf79 00007f0fdc70cf09 00007f0fdc70ced1 00007f0fdc70c1cd 0000000000389354 0000000000389199 00007f0fdc6ee03a
0620 13:58:03.403188 (+218899us) raft_consensus.cc:1685] finished
0620 13:58:03.403243 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.403617 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51717,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":63,"raft.queue_time_us":562,"raft.run_cpu_time_us":4549,"raft.run_wall_time_us":629467,"spinlock_wait_cycles":15139584,"thread_start_us":353390,"threads_started":1,"wal-append.queue_time_us":390892}
W20260620 13:58:03.108819 11448 log.cc:927] Time spent T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260620 13:58:03.108450 11452 log.cc:927] Time spent T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260620 13:58:03.166126 11455 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260620 13:58:03.185979 11456 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260620 13:58:03.134605 11457 log.cc:927] Time spent T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260620 13:58:03.030812 11464 log.cc:927] Time spent T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
W20260620 13:58:03.333877  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.335623  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 348052us
W20260620 13:58:03.583701  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.584256  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.584745  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.408638  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.587594  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:03.588476  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.402967  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2583) took 1338 ms. Trace:
I20260620 13:58:03.593870  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2585) took 1529 ms. Trace:
I20260620 13:58:03.592187  5952 rpcz_store.cc:276] 0620 13:58:02.064287 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.310162 (+245875us) service_pool.cc:224] Handling call
0620 13:58:02.310569 (+   407us) raft_consensus.cc:1471] Updating replica for 3 ops
0620 13:58:02.379780 (+ 69211us) raft_consensus.cc:1534] Early marking committed up to index 10
0620 13:58:02.400042 (+ 20262us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.856467 (+456425us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0620 13:58:02.857131 (+   664us) log.cc:844] Serialized 52 byte log entry
0620 13:58:02.857274 (+   143us) raft_consensus.cc:1645] Marking committed up to 12
0620 13:58:02.857534 (+   260us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.982740 (+125206us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b1800215a40. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc68540a 00007f0fe5dca5d9 00007f0fdc70d240 00007f0fdc707ce4 00007f0fdc707c55 00007f0fe31f6247 00007f0fdf806d87 00007f0fdf81649f 00007f0fdf816418
0620 13:58:02.983036 (+   296us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.983558 (+   522us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.990095 (+  6537us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:03.181279 (+191184us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b1800215a40. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc70abf3 00007f0fdc70cfc1 00007f0fdc70cf79 00007f0fdc70cf09 00007f0fdc70ced1 00007f0fdc70c1cd 0000000000389354 0000000000389199 00007f0fdc6ee03a
0620 13:58:03.402152 (+220873us) raft_consensus.cc:1685] finished
0620 13:58:03.402207 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.402643 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":535341,"prepare.queue_time_us":154470,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":133,"raft.queue_time_us":52590,"raft.run_cpu_time_us":505,"raft.run_wall_time_us":25879,"spinlock_wait_cycles":69167104,"thread_start_us":437497,"threads_started":1,"wal-append.queue_time_us":640803}
W20260620 13:58:03.467403  6029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.005s	sys 0.001s
W20260620 13:58:03.595573  6029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.006s	sys 0.001s
I20260620 13:58:03.594300  5958 rpcz_store.cc:276] 0620 13:58:02.064764 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.357977 (+293213us) service_pool.cc:224] Handling call
0620 13:58:02.358389 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:02.380134 (+ 21745us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:58:02.380163 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:02.382790 (+  2627us) log.cc:844] Serialized 26 byte log entry
0620 13:58:02.952083 (+569293us) raft_consensus.cc:1645] Marking committed up to 14
0620 13:58:02.990688 (+ 38605us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.990966 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.991050 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:03.183721 (+192671us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b4800002dd8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe47261a1 00007f0fe471d237 00007f0fe471d0ca 00007f0fe481496f 00007f0fe4814637 00007f0fe4828c5c 00007f0fe4828c08 00007f0fe4828b88 00007f0fe4828b43 00007f0fe4827dec 00007f0fe3754f76
0620 13:58:03.185209 (+  1488us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:58:03.593403 (+408194us) raft_consensus.cc:1685] finished
0620 13:58:03.593455 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.593674 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84938,"prepare.queue_time_us":483543,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":91,"raft.queue_time_us":30958,"raft.run_cpu_time_us":4765,"raft.run_wall_time_us":190945,"spinlock_wait_cycles":10331648,"thread_start_us":568863,"threads_started":1,"wal-append.queue_time_us":641730}
I20260620 13:58:03.596575  6029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1190) took 1052 ms. Trace:
I20260620 13:58:03.597692  5958 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260620 13:58:03.598091  5958 pending_rounds.cc:85] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 11
I20260620 13:58:03.596985  6029 rpcz_store.cc:276] 0620 13:58:02.543846 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.544131 (+   285us) service_pool.cc:224] Handling call
0620 13:58:02.546105 (+  1974us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:02.919440 (+373335us) raft_consensus.cc:1534] Early marking committed up to index 10
0620 13:58:02.919519 (+    79us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:02.927296 (+  7777us) log.cc:844] Serialized 26 byte log entry
0620 13:58:03.596107 (+668811us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:58:03.596184 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.596253 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:03.596338 (+    85us) raft_consensus.cc:1685] finished
0620 13:58:03.596356 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.596499 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4102,"raft.queue_time_us":98308,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":1035830,"threads_started":2,"wal-append.queue_time_us":222421}
I20260620 13:58:03.598322  5958 pending_rounds.cc:107] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260620 13:58:03.598696  5958 raft_consensus.cc:2889] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:03.469251 11221 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260620 13:58:03.446058  5998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.016s	sys 0.064s
I20260620 13:58:03.599074  5958 pending_rounds.cc:107] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260620 13:58:03.599308 11221 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:58:03.599431  5998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.017s	sys 0.065s
I20260620 13:58:03.599785 11221 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:58:03.599984  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 993983us
I20260620 13:58:03.476850  6030 raft_consensus.cc:2410] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260620 13:58:03.602931  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:03.603737  6582 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260620 13:58:03.599458  5958 raft_consensus.cc:2889] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:03.477160 11311 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.605784 11311 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:03.606456  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:03.477494  6024 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:03.478107  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.608428  6031 raft_consensus.cc:2368] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 15. Current term is 16.
W20260620 13:58:03.484086  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.491657 11408 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.495383  6580 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:58:03.508734  6027 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:03.509799  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:03.515318  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:03.518235 11257 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:03.530349  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:03.529891 11300 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.495398 11210 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.463503  5882 rpcz_store.cc:276] 0620 13:57:58.908815 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.779421 (+870606us) service_pool.cc:224] Handling call
0620 13:57:59.779719 (+   298us) raft_consensus.cc:1471] Updating replica for 3 ops
0620 13:57:59.780066 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.780095 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0620 13:57:59.780727 (+   632us) log.cc:844] Serialized 78 byte log entry
0620 13:58:02.467440 (+2686713us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:58:02.479501 (+ 12061us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.546591 (+ 67090us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.903506 (+356915us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b18001ece80. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc68540a 00007f0fe5dca5d9 00007f0fdc70d240 00007f0fdc707ce4 00007f0fdc707c55 00007f0fdf7f4440 00007f0fdf806af6 00007f0fdf817667 00007f0fdf8175e8
0620 13:58:02.903752 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.903856 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:03.306127 (+402271us) raft_consensus.cc:1685] finished
0620 13:58:03.306282 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.306871 (+   589us) inbound_call.cc:177] Queueing success response
0620 13:58:03.439221 (+132350us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b18001ece80. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc70ad22 00007f0fdc70cfc1 00007f0fdc70cf79 00007f0fdc70cf09 00007f0fdc70ced1 00007f0fdc70c1cd 0000000000389354 0000000000389199 00007f0fdc6ee03a
Metrics: {"mutex_wait_us":672687,"prepare.queue_time_us":13709,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":3470,"raft.queue_time_us":369762,"raft.run_cpu_time_us":482,"raft.run_wall_time_us":20771,"spinlock_wait_cycles":102268032,"thread_start_us":2752602,"threads_started":2,"wal-append.queue_time_us":472374,"wal-append.run_cpu_time_us":3123,"wal-append.run_wall_time_us":1195137}
I20260620 13:58:03.546759 10831 consensus_queue.cc:1048] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:58:03.547885 11404 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.633841 11404 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.636854 11404 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.637893 11404 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:03.548383  6552 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:03.548959  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.639536  6552 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:03.566490 11487 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.558992  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:03.640345  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 92217.5us
I20260620 13:58:03.576066 11414 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:03.641094  6552 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:03.641611 11414 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:03.642063  6552 leader_election.cc:336] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:03.576625  6587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46864 (request call id 1200) took 3880 ms. Trace:
I20260620 13:58:03.454056  5950 rpcz_store.cc:276] 0620 13:58:02.013986 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.159084 (+145098us) service_pool.cc:224] Handling call
0620 13:58:02.205160 (+ 46076us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:02.205583 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:58:02.205625 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:02.216214 (+ 10589us) log.cc:844] Serialized 26 byte log entry
0620 13:58:02.612279 (+396065us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:58:02.985971 (+373692us) log.cc:844] Serialized 14 byte log entry
0620 13:58:02.986195 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.986272 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:03.174908 (+188636us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b4800002dd8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe47261a1 00007f0fe471d237 00007f0fe471d0ca 00007f0fe481496f 00007f0fe4814637 00007f0fe4828c5c 00007f0fe4828c08 00007f0fe4828b88 00007f0fe4828b43 00007f0fe4827dec 00007f0fe3754f76
0620 13:58:03.402025 (+227117us) raft_consensus.cc:1685] finished
0620 13:58:03.402232 (+   207us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.402638 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40746,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":40807,"raft.run_cpu_time_us":4031,"raft.run_wall_time_us":185726,"spinlock_wait_cycles":5928192,"thread_start_us":705615,"threads_started":2,"wal-append.queue_time_us":665755}
I20260620 13:58:03.580955 11444 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:03.612255 11311 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:03.599018  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:03.621786  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.629521 11300 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:03.576050  5848 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:03.630560 11210 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.631469  6033 raft_consensus.cc:2410] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260620 13:58:03.654450  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.643344  6587 rpcz_store.cc:276] 0620 13:57:59.695735 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:59.695933 (+   198us) service_pool.cc:224] Handling call
0620 13:57:59.696250 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:57:59.696472 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:57:59.696496 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:02.251220 (+2554724us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b2c000fb6b8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fde0f5c71 00007f0fde1055d2 00007f0fdf837de1 00007f0fdf7fc81a 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22
0620 13:58:02.251654 (+   434us) log.cc:844] Serialized 26 byte log entry
0620 13:58:02.535868 (+284214us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:58:02.536835 (+   967us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:02.536914 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:03.575836 (+1038922us) raft_consensus.cc:1685] finished
0620 13:58:03.575889 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.576321 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71491328,"thread_start_us":283780,"threads_started":1,"wal-append.queue_time_us":630899}
I20260620 13:58:03.658299  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:03.658650  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.660353  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:03.660511  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 157474us
I20260620 13:58:03.662169  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.663843 11293 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:03.664053  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:03.665359  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.665074 11408 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:03.665699 11142 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.666561  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:03.642876  6552 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:03.671772  6552 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:03.605805  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:03.667987  6024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1193) took 1023 ms. Trace:
I20260620 13:58:03.663861  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.670428 11210 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.638638 11404 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:03.668407  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 92574.4us
I20260620 13:58:03.686818 11404 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.687652 11404 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:03.690788  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.691659  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:03.692170  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.694625  5950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2388) took 1038 ms. Trace:
I20260620 13:58:03.695518 11416 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:03.701136  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:03.701514  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 100562us
I20260620 13:58:03.702540  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:03.703534  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:03.703735  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:03.672574 11444 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:03.693660 11221 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:03.706040  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 63224.8us
I20260620 13:58:03.706539  6585 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: []
I20260620 13:58:03.704881 11487 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.695075  5950 rpcz_store.cc:276] 0620 13:58:02.656075 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:03.656817 (+1000742us) service_pool.cc:224] Handling call
0620 13:58:03.693296 (+ 36479us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:03.693884 (+   588us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:58:03.693931 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:03.694000 (+    69us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:58:03.694078 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.694145 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.694538 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260620 13:58:03.662938  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:03.674232  6024 rpcz_store.cc:276] 0620 13:58:02.644526 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.645063 (+   537us) service_pool.cc:224] Handling call
0620 13:58:02.758318 (+113255us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:03.607448 (+849130us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.667726 (+ 60278us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54001c8754. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:03.667927 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541451008}
W20260620 13:58:03.720345  6552 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:03.723053  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.733732  6552 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:03.719077 11300 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:03.732379  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:03.731216  6033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 1181) took 1238 ms. Trace:
I20260620 13:58:03.736660  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:03.736939  6033 rpcz_store.cc:276] 0620 13:58:02.488382 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.488537 (+   155us) service_pool.cc:224] Handling call
0620 13:58:03.720314 (+1231777us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001c9654. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:03.726828 (+  6514us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2462906752}
I20260620 13:58:03.735838  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.743085  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.739488  6030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46758 (request call id 1183) took 1250 ms. Trace:
I20260620 13:58:03.744792  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2376) took 1331 ms. Trace:
I20260620 13:58:03.745434  6030 rpcz_store.cc:276] 0620 13:58:02.489193 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.489325 (+   132us) service_pool.cc:224] Handling call
0620 13:58:03.728278 (+1238953us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54001e69d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:03.739431 (+ 11153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2143761152}
I20260620 13:58:03.747053  6028 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 9.
I20260620 13:58:03.756105  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.757665  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:03.762449  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.739017 11487 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:58:03.733528 11404 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260620 13:58:03.777778 11406 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:03.778601 11406 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.780350 11404 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.781250 11406 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.781015 11404 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:03.745824 11408 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:03.749158 11142 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.774612 11221 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:03.774946  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 112136us
I20260620 13:58:03.775533  5997 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:03.783828  5997 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:03.784358  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:03.784929  5997 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:03.786422  5997 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:03.775879  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2382) took 1336 ms. Trace:
I20260620 13:58:03.787528 11437 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:03.787698 11210 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.788020 11142 raft_consensus.cc:2804] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:03.788446 11439 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:03.777240  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:03.788973  6032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1188) took 1285 ms. Trace:
I20260620 13:58:03.776734 11311 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:03.788573 11142 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:03.847741  5849 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:03.862219 11444 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:03.975042  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.838335  5951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2582) took 1674 ms. Trace:
W20260620 13:58:03.838860  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 96923.8us
I20260620 13:58:03.838866 11487 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.891978  6027 raft_consensus.cc:2410] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260620 13:58:03.875397  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.792660  6032 rpcz_store.cc:276] 0620 13:58:02.503527 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.505898 (+  2371us) service_pool.cc:224] Handling call
0620 13:58:02.506254 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:03.555919 (+1049665us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.764529 (+208610us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540005a0d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:03.788915 (+ 24386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2411568512}
I20260620 13:58:03.767932 11293 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:58:03.791280  5955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2383) took 1379 ms. Trace:
I20260620 13:58:03.881289 11419 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:03.835793 11410 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260620 13:58:03.767083  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:03.835906  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.000761  5950 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:04.007570  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.827483  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.847401 11408 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:58:03.839066 11435 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:58:03.839124 11404 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:03.862810  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.892446  6026 raft_consensus.cc:2410] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260620 13:58:03.942090  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:03.837950 11492 log.cc:927] Time spent T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260620 13:58:03.850044  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:04.038259  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.038729  6024 raft_consensus.cc:2376] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13. Re-sending same reply.
I20260620 13:58:04.039904  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.040274  6025 raft_consensus.cc:2410] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260620 13:58:04.040644  6024 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:03.904445  6551 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:04.041795  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 137508us
W20260620 13:58:04.042660 11500 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260620 13:58:04.043223 11278 raft_consensus.cc:2804] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:03.787259  5956 rpcz_store.cc:276] 0620 13:58:02.409047 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:03.404490 (+995443us) service_pool.cc:224] Handling call
0620 13:58:03.405453 (+   963us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:03.406116 (+   663us) raft_consensus.cc:1534] Early marking committed up to index 9
0620 13:58:03.446766 (+ 40650us) log.cc:844] Serialized 14 byte log entry
0620 13:58:03.744656 (+297890us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:03.744716 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:58:03.744776 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.744851 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.744989 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":214731,"prepare.queue_time_us":77734,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":216747,"thread_start_us":72970,"threads_started":2,"wal-append.queue_time_us":143819}
I20260620 13:58:04.045855  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:04.046658  5956 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:58:03.900274 11414 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.047757 11221 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:04.048225 11221 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:04.048614 11221 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:04.052119 11300 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260620 13:58:03.868048  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 161151us
W20260620 13:58:04.055615  6552 leader_election.cc:336] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:04.057448  6552 leader_election.cc:336] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:04.057916  6552 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:03.749693  5959 rpcz_store.cc:276] 0620 13:58:02.407488 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.936096 (+528608us) service_pool.cc:224] Handling call
0620 13:58:03.408135 (+472039us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:58:03.408637 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:03.437031 (+ 28394us) raft_consensus.cc:1534] Early marking committed up to index 9
0620 13:58:03.471338 (+ 34307us) log.cc:844] Serialized 14 byte log entry
0620 13:58:03.735841 (+264503us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:03.735909 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:58:03.735960 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.736034 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.738871 (+  2837us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":257438,"prepare.queue_time_us":62510,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":238903,"spinlock_wait_cycles":43855744,"thread_start_us":18636,"threads_started":1,"wal-append.queue_time_us":95951}
I20260620 13:58:03.788446 11210 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.059432  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.060456  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:03.788035 11437 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:04.061203 11437 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:04.036013 11435 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:04.061772  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:04.061908 11435 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:04.062393  5959 raft_consensus.cc:2468] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:58:03.834517 11422 consensus_queue.cc:1048] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260620 13:58:04.063318  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.883494 11416 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:04.064016 11257 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
W20260620 13:58:03.860865  6580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46858 (request call id 1294) took 1736 ms (client timeout 2094 ms). Trace:
W20260620 13:58:04.064674  6580 rpcz_store.cc:269] 0620 13:58:02.124434 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.125650 (+  1216us) service_pool.cc:224] Handling call
0620 13:58:03.832583 (+1706933us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540043b2d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:03.860779 (+ 28196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3147330944}
I20260620 13:58:03.789062 11304 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:03.828298  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.067915 11304 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.068645  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.060675  6027 raft_consensus.cc:2410] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
W20260620 13:58:03.996018  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.070189  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:03.988420 11142 raft_consensus.cc:3060] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:04.029106  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.030170 11488 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:04.009209 11487 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.000862  5955 rpcz_store.cc:276] 0620 13:58:02.409562 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:03.566834 (+1157272us) service_pool.cc:224] Handling call
0620 13:58:03.576326 (+  9492us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:03.576851 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 7
0620 13:58:03.577382 (+   531us) log.cc:844] Serialized 14 byte log entry
0620 13:58:03.788658 (+211276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:03.788712 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0620 13:58:03.788760 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.788825 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.788950 (+   125us) inbound_call.cc:177] Queueing success response
0620 13:58:03.898250 (+109300us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b4800002dd8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe47261a1 00007f0fe471d237 00007f0fe471d0ca 00007f0fe481496f 00007f0fe4814637 00007f0fe4828c5c 00007f0fe4828c08 00007f0fe4828b88 00007f0fe4828b43 00007f0fe4827dec 00007f0fe3754f76
Metrics: {"mutex_wait_us":176816,"prepare.queue_time_us":2013,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":217076,"raft.run_cpu_time_us":1295,"raft.run_wall_time_us":68263,"spinlock_wait_cycles":67209088,"thread_start_us":33788,"threads_started":1,"wal-append.queue_time_us":163394}
I20260620 13:58:04.034564  6029 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:04.007882 11311 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.037824  6033 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 17: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:04.087755  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:04.041651  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.792388 11439 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:03.953154  6031 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:58:04.077236  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:04.079980  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 232379us
I20260620 13:58:04.078068  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:04.092406  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.089612  6025 raft_consensus.cc:2410] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260620 13:58:04.093134  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.086315  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2387) took 1455 ms. Trace:
I20260620 13:58:04.097810  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:04.094202  5958 rpcz_store.cc:276] 0620 13:58:02.630963 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:03.606055 (+975092us) service_pool.cc:224] Handling call
0620 13:58:03.606503 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:03.607295 (+   792us) raft_consensus.cc:1534] Early marking committed up to index 11
0620 13:58:03.608000 (+   705us) log.cc:844] Serialized 14 byte log entry
0620 13:58:04.085876 (+477876us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:04.085949 (+    73us) raft_consensus.cc:1645] Marking committed up to 11
0620 13:58:04.086017 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.086104 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:04.086246 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44242,"prepare.queue_time_us":336,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":53,"raft.queue_time_us":49078,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":61,"thread_start_us":426672,"threads_started":2,"wal-append.queue_time_us":442549}
W20260620 13:58:04.093298  5778 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47386 (request call id 236) took 12434 ms (client timeout 15000 ms). Trace:
I20260620 13:58:04.097923  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:03.994475  5951 rpcz_store.cc:276] 0620 13:58:02.063844 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.199571 (+135727us) service_pool.cc:224] Handling call
0620 13:58:02.199889 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:02.360677 (+160788us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:58:02.360722 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:02.372021 (+ 11299us) log.cc:844] Serialized 26 byte log entry
0620 13:58:02.938097 (+566076us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b4800002dd8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe47261a1 00007f0fe471d237 00007f0fe471d0ca 00007f0fe481496f 00007f0fe4814637 00007f0fe4828c5c 00007f0fe4828c08 00007f0fe4828b88 00007f0fe4828b43 00007f0fe4827dec 00007f0fe3754f76
0620 13:58:03.178809 (+240712us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b2400032fa8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc591614 00007f0fdc58f71b 00007f0fdc74a619 00007f0fdc74a2a5 00007f0fdc749800 00007f0fdf3c3828 00007f0fdf3c3f88 00007f0fdf39b738 00007f0fdf396b0a 00007f0fdf395f56
0620 13:58:03.402722 (+223913us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:58:03.446828 (+ 44106us) log.cc:844] Serialized 14 byte log entry
0620 13:58:03.713709 (+266881us) spinlock_profiling.cc:243] Waited 931 us on lock 0x7b1800126e20. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe55d78f1 00007f0fe55e40c1 00007f0fdc68540a 00007f0fe5dca5d9 00007f0fdc70d240 00007f0fdc707ce4 00007f0fdc707c55 00007f0fdf7f4440 00007f0fdf806af6 00007f0fdf817667 00007f0fdf8175e8
0620 13:58:03.720891 (+  7182us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.728332 (+  7441us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:03.728396 (+    64us) raft_consensus.cc:1685] finished
0620 13:58:03.728414 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:03.737876 (+  9462us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":191522,"prepare.queue_time_us":62165,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":438404,"raft.run_cpu_time_us":2589,"raft.run_wall_time_us":639620,"spinlock_wait_cycles":19821312,"thread_start_us":1042908,"threads_started":2,"wal-append.queue_time_us":629675}
W20260620 13:58:04.094362  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 365700us
W20260620 13:58:04.115617  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.096611  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:04.030517 11419 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.122697  6580 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 12. Current term is 13. Ops: []
I20260620 13:58:04.127761  5956 raft_consensus.cc:2468] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:58:04.096678  6579 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:58:04.085534 11422 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:04.131568  5849 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.097572 11439 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:04.130606  6587 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
I20260620 13:58:04.137431  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:04.137745  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:04.138003  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.085024 11278 raft_consensus.cc:697] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:58:04.134663  6552 leader_election.cc:336] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:04.143816  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.118526 11304 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.142952  5959 raft_consensus.cc:2468] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
W20260620 13:58:04.145593  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.145063  6585 raft_consensus.cc:2410] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260620 13:58:04.149086  6024 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260620 13:58:04.150853  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:04.151153  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:04.151875  5951 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:04.155946  6029 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 LEADER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 19. Current term is 20. Ops: []
I20260620 13:58:04.158164 11406 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:04.158915 11406 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.159716  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:04.160573  5956 raft_consensus.cc:2393] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:04.137503 11210 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.161458  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:04.161859 11406 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.161993  5956 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:04.163187  5955 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:04.164177  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:04.164707  5955 raft_consensus.cc:3060] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:04.168792 11311 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.169921  6028 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260620 13:58:04.170378  6028 pending_rounds.cc:85] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 8
I20260620 13:58:04.170703  6028 pending_rounds.cc:107] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260620 13:58:04.170939  6028 raft_consensus.cc:2889] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:04.162038  6033 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:04.138468 11471 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:04.182619  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 51169.2us
W20260620 13:58:04.184767  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.179899 11404 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:04.189658  5958 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: []
I20260620 13:58:04.190362  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2390) took 1453 ms. Trace:
I20260620 13:58:04.190656  5958 rpcz_store.cc:276] 0620 13:58:02.736727 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:04.163948 (+1427221us) service_pool.cc:224] Handling call
0620 13:58:04.182386 (+ 18438us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b5800003398. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d3222 00007f0fe55f07d9 00007f0fe474b5e0 00007f0fe48147ab 00007f0fe4814831 00007f0fe47d66c0 00007f0fe47c1029 00007f0fe47c0ad2 00007f0fddd35d34
0620 13:58:04.189424 (+  7038us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:04.190094 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.190287 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18154752}
I20260620 13:58:04.191900  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:04.192591  5958 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:58:04.198956  6026 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260620 13:58:04.201659  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2384) took 1791 ms. Trace:
W20260620 13:58:04.202376 11497 log.cc:927] Time spent T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260620 13:58:04.202144  5952 rpcz_store.cc:276] 0620 13:58:02.409812 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:03.594743 (+1184931us) service_pool.cc:224] Handling call
0620 13:58:03.612292 (+ 17549us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:03.613133 (+   841us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:58:03.613173 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:03.614977 (+  1804us) log.cc:844] Serialized 564 byte log entry
0620 13:58:03.721202 (+106225us) raft_consensus.cc:1645] Marking committed up to 13
0620 13:58:03.721261 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:03.721349 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:04.201424 (+480075us) raft_consensus.cc:1685] finished
0620 13:58:04.201443 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:04.201584 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":32481,"threads_started":1,"wal-append.queue_time_us":330011}
I20260620 13:58:04.204433  5952 raft_consensus.cc:1275] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260620 13:58:04.127653 11414 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260620 13:58:04.194940  5958 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260620 13:58:04.214372  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.169497 11419 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.220281  5952 raft_consensus.cc:1240] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 14. Current term is 15. Ops: []
W20260620 13:58:04.214545  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 67195.6us
I20260620 13:58:04.222434  5955 raft_consensus.cc:2468] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
W20260620 13:58:04.235062  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.233703  6551 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:04.150767 11488 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260620 13:58:04.246699  5956 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 10.
I20260620 13:58:04.247427 11300 raft_consensus.cc:2804] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:04.247212 11278 consensus_queue.cc:237] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.248013 11300 raft_consensus.cc:697] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:04.248782 11257 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:04.248993 11300 consensus_queue.cc:237] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.148136 11422 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.257233 11422 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.259796  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.260053  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.260488 11487 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.258198  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:04.261904  6033 raft_consensus.cc:2410] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260620 13:58:04.261111  5777 catalog_manager.cc:5696] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 10 to 11, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 11 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:04.262742  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.263490  6033 raft_consensus.cc:2368] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:58:04.261261  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:04.264904  6024 raft_consensus.cc:2376] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13. Re-sending same reply.
I20260620 13:58:04.270480  5997 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:04.279438 11293 consensus_queue.cc:1059] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260620 13:58:04.280522  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.278972  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:04.281929  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 59528.1us
I20260620 13:58:04.280782  6551 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:04.261330  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.280532 11293 raft_consensus.cc:3055] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:04.287775 11293 raft_consensus.cc:740] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:58:04.292079  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 174541us
I20260620 13:58:04.295316 11293 consensus_queue.cc:260] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.296729 11293 raft_consensus.cc:3060] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:04.297068 11304 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:04.297524 11304 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:04.297900 11304 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:04.303027 11221 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.305357 11221 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.306499  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:04.312497 11501 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260620 13:58:04.320257  5777 catalog_manager.cc:5696] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 8 to 9, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 9 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:04.326277  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:04.335139  6028 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 17: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:04.327499  5953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2377) took 1919 ms. Trace:
I20260620 13:58:04.291471  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.342784  5951 raft_consensus.cc:2468] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:58:04.364289  5950 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:58:04.366480  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.367316  5955 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 11. Current term is 12. Ops: []
I20260620 13:58:04.290935 11257 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:58:04.368815  6551 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:04.386482  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:58:04.404305  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 56740.6us
I20260620 13:58:04.336063  5953 rpcz_store.cc:276] 0620 13:58:02.407766 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.958713 (+550947us) service_pool.cc:224] Handling call
0620 13:58:02.958989 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:02.959210 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 6
0620 13:58:03.453813 (+494603us) log.cc:844] Serialized 14 byte log entry
0620 13:58:04.273825 (+820012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:04.277958 (+  4133us) raft_consensus.cc:1645] Marking committed up to 6
0620 13:58:04.287123 (+  9165us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.327119 (+ 39996us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:04.327305 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185303,"prepare.queue_time_us":504185,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":1648,"raft.queue_time_us":207544,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":148,"thread_start_us":522406,"threads_started":3,"wal-append.queue_time_us":233627}
W20260620 13:58:04.414723  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 123352us
I20260620 13:58:04.292814 11471 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:04.429966  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 56606.2us
I20260620 13:58:04.434921  5951 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:58:04.435632  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.406069 11499 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:04.408777 11404 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:04.409636 11380 raft_consensus.cc:2804] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:58:04.412038 11257 raft_consensus.cc:697] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:58:04.437321  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 340184us
I20260620 13:58:04.441229  5997 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:04.441494  5957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2378) took 2027 ms. Trace:
I20260620 13:58:04.449743  5957 rpcz_store.cc:276] 0620 13:58:02.408025 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.965496 (+557471us) service_pool.cc:224] Handling call
0620 13:58:02.966178 (+   682us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:02.966694 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 9
0620 13:58:03.504189 (+537495us) log.cc:844] Serialized 14 byte log entry
0620 13:58:04.375421 (+871232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:04.385303 (+  9882us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:58:04.408278 (+ 22975us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.430030 (+ 21752us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:04.435318 (+  5288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":536719,"prepare.queue_time_us":521883,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":97984,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":630534,"threads_started":3,"wal-append.queue_time_us":235640}
W20260620 13:58:04.098711  5778 rpcz_store.cc:269] 0620 13:57:51.620359 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:51.620787 (+   428us) service_pool.cc:224] Handling call
0620 13:58:04.054699 (+12433912us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:57:58.145282 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:57:58.292840 (+147558us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:57:58.297762 (+  4922us) write_op.cc:435] Acquired schema lock
0620 13:57:58.320261 (+ 22499us) tablet.cc:662] Decoding operations
0620 13:57:58.369759 (+ 49498us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:57:58.369848 (+    89us) write_op.cc:641] Partition lock acquired for write op
0620 13:57:58.369873 (+    25us) tablet.cc:685] Acquiring locks for 18 operations
0620 13:57:58.870219 (+500346us) tablet.cc:701] Row locks acquired
0620 13:57:58.870243 (+    24us) write_op.cc:260] PREPARE: finished
0620 13:57:58.884094 (+ 13851us) write_op.cc:270] Start()
0620 13:57:58.892458 (+  8364us) write_op.cc:276] Timestamp: P: 1781963878876575 usec, L: 0
0620 13:57:58.897107 (+  4649us) op_driver.cc:348] REPLICATION: starting
0620 13:57:59.051466 (+154359us) log.cc:844] Serialized 7077 byte log entry
0620 13:58:00.350128 (+1298662us) op_driver.cc:464] REPLICATION: finished
0620 13:58:00.371879 (+ 21751us) write_op.cc:301] APPLY: starting
0620 13:58:00.371964 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:01.304369 (+932405us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:01.304471 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:01.318826 (+ 14355us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:01.319171 (+   345us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0620 13:58:01.319218 (+    47us) write_op.cc:312] APPLY: finished
0620 13:58:01.320799 (+  1581us) log.cc:844] Serialized 164 byte log entry
0620 13:58:01.333715 (+ 12916us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:01.333887 (+   172us) write_op.cc:454] Released schema lock
0620 13:58:01.333945 (+    58us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:01.358469 (+ 24524us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:01.358502 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":94753,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":21466,"apply.run_cpu_time_us":32253,"apply.run_wall_time_us":962409,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79439,"num_ops":18,"prepare.queue_time_us":242485,"prepare.run_cpu_time_us":81483,"prepare.run_wall_time_us":1298590,"raft.queue_time_us":443295,"raft.run_cpu_time_us":5095,"raft.run_wall_time_us":38539,"replication_time_us":1443089,"thread_start_us":781234,"threads_started":5,"wal-append.queue_time_us":498454,"wal-append.run_cpu_time_us":35465,"wal-append.run_wall_time_us":2575071}]]}
W20260620 13:58:04.468619  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.471557  6031 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260620 13:58:04.471971  6031 pending_rounds.cc:85] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 11
I20260620 13:58:04.472199  6031 pending_rounds.cc:107] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260620 13:58:04.472442  6031 raft_consensus.cc:2889] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:58:04.474586  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.475610  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.479936  5924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.481396  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:04.478341  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 44880.5us
I20260620 13:58:04.439183 11408 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:04.474200 11422 consensus_queue.cc:1059] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260620 13:58:04.491719  5953 raft_consensus.cc:1275] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260620 13:58:04.485817 11221 consensus_queue.cc:1059] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260620 13:58:04.481228 11416 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:04.495009 11450 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:58:04.495589 11450 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:04.495826 11221 raft_consensus.cc:3055] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Stepping down as leader of term 11
I20260620 13:58:04.495438 11416 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:58:04.496022 11450 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:04.496243 11221 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:04.497305 11221 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.498237 11416 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.498661 11221 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:04.483182  5777 catalog_manager.cc:5696] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 reported cstate change: term changed from 8 to 10, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 10 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:04.477258 11380 raft_consensus.cc:697] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:04.477532 11404 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:04.486742  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 203433us
I20260620 13:58:04.480625 11435 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:04.513098  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 149041us
I20260620 13:58:04.513084 11487 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:04.489822 11507 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:04.525506  6032 raft_consensus.cc:2393] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:58:04.525895  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 77975.7us
I20260620 13:58:04.514956 11416 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260620 13:58:04.503366 11304 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.523207 11293 consensus_queue.cc:1048] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260620 13:58:04.534345  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.529028 11142 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.540683  5954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2381) took 2066 ms. Trace:
I20260620 13:58:04.513521 11408 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.546319 11414 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:04.542894 11419 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:04.523090 11487 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.554854 11499 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:04.555547 11505 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:04.543545  5954 rpcz_store.cc:276] 0620 13:58:02.408786 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:02.976894 (+568108us) service_pool.cc:224] Handling call
0620 13:58:02.992978 (+ 16084us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:02.993443 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 12
0620 13:58:03.448235 (+454792us) log.cc:844] Serialized 14 byte log entry
0620 13:58:03.772722 (+324487us) log.cc:844] Serialized 14 byte log entry
0620 13:58:03.876820 (+104098us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b4800002dd8. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe47261a1 00007f0fe471d237 00007f0fe471d0ca 00007f0fe481496f 00007f0fe4814637 00007f0fe4828c5c 00007f0fe4828c08 00007f0fe4828b88 00007f0fe4828b43 00007f0fe4827dec 00007f0fe3754f76
0620 13:58:04.369468 (+492648us) log.cc:844] Serialized 14 byte log entry
0620 13:58:04.403628 (+ 34160us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:04.440930 (+ 37302us) log.cc:844] Serialized 26 byte log entry
0620 13:58:04.441079 (+   149us) raft_consensus.cc:1645] Marking committed up to 12
0620 13:58:04.441113 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.441326 (+   213us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:04.468334 (+ 27008us) raft_consensus.cc:1685] finished
0620 13:58:04.468363 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:04.475325 (+  6962us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":687221,"prepare.queue_time_us":545932,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":3186,"raft.queue_time_us":257938,"raft.run_cpu_time_us":4907,"raft.run_wall_time_us":150602,"spinlock_wait_cycles":201735552,"thread_start_us":614358,"threads_started":4,"wal-append.queue_time_us":207757}
I20260620 13:58:04.556701 11142 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.556257 11380 consensus_queue.cc:237] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.546550 11488 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:04.568733 11414 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.526332 11507 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:04.585915  6552 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:04.524291 11257 consensus_queue.cc:237] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.601851  6552 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:04.602236  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.609474  5951 raft_consensus.cc:2468] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
W20260620 13:58:04.615265  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.622262  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.630903  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.634523  6551 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:04.635741  5998 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:58:04.584980 11419 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.619220 10831 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260620 13:58:04.655853  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.662436  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.662949  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 88463.3us
I20260620 13:58:04.640869 11471 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:04.664757  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 223609us
I20260620 13:58:04.639734 11506 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:04.659399 11437 consensus_meta.cc:287] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.598s	user 0.003s	sys 0.010s
I20260620 13:58:04.628225 11505 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.661352 11278 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election won for term 15
W20260620 13:58:04.683866  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 154307us
W20260620 13:58:04.682739  6552 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 72 similar messages]
W20260620 13:58:04.699182  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.687593 11514 log.cc:927] Time spent T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260620 13:58:04.665942 11439 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.682646 10831 raft_consensus.cc:2804] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:04.708580 10831 raft_consensus.cc:697] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:04.709538 11471 consensus_queue.cc:1048] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260620 13:58:04.710795  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:04.707978  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 117620us
I20260620 13:58:04.712193 11487 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.710702 11507 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.706830 11450 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.713730  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36000 (request call id 2594) took 1043 ms. Trace:
W20260620 13:58:04.731880 11516 log.cc:927] Time spent T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260620 13:58:04.732635 11450 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.702817 11404 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.736603 11410 raft_consensus.cc:3055] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:58:04.737323 11410 raft_consensus.cc:740] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:04.723713 11419 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:04.739214  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51741.6us
I20260620 13:58:04.739637 11422 consensus_queue.cc:1059] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260620 13:58:04.740978  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.741981 11304 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:04.744202 11408 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.744673  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.748660 11450 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:04.680054 11437 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:04.751379  5998 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.751777  6030 raft_consensus.cc:2393] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 16: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:04.752691 11439 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:04.753539 11439 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260620 13:58:04.700487 11278 raft_consensus.cc:697] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:58:04.755299  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.755182 11278 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.702135 11435 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:04.723596  5848 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.770s (SENT)
I20260620 13:58:04.764547  5848 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.725684  5959 rpcz_store.cc:276] 0620 13:58:03.670106 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:04.177560 (+507454us) service_pool.cc:224] Handling call
0620 13:58:04.185416 (+  7856us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:04.185986 (+   570us) raft_consensus.cc:1534] Early marking committed up to index 7
0620 13:58:04.186390 (+   404us) log.cc:844] Serialized 14 byte log entry
0620 13:58:04.525010 (+338620us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:04.537281 (+ 12271us) log.cc:844] Serialized 26 byte log entry
0620 13:58:04.537428 (+   147us) raft_consensus.cc:1645] Marking committed up to 8
0620 13:58:04.537632 (+   204us) log.cc:844] Serialized 14 byte log entry
0620 13:58:04.540981 (+  3349us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.541058 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:04.713477 (+172419us) raft_consensus.cc:1685] finished
0620 13:58:04.713506 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:04.713666 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25787,"prepare.queue_time_us":20092,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2496,"raft.queue_time_us":33324,"raft.run_cpu_time_us":613,"raft.run_wall_time_us":39293,"spinlock_wait_cycles":3043200,"thread_start_us":325408,"threads_started":1,"wal-append.queue_time_us":461950}
I20260620 13:58:04.770076  6027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46758 (request call id 1209) took 1318 ms. Trace:
I20260620 13:58:04.770612  6027 rpcz_store.cc:276] 0620 13:58:03.459290 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:04.100186 (+640896us) service_pool.cc:224] Handling call
0620 13:58:04.162203 (+ 62017us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:04.162500 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 10
0620 13:58:04.503219 (+340719us) log.cc:844] Serialized 14 byte log entry
0620 13:58:04.768295 (+265076us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0620 13:58:04.768355 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0620 13:58:04.769788 (+  1433us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.769875 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:04.770007 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":582208,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":1899,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":580858,"threads_started":2}
W20260620 13:58:04.774148  5924 leader_election.cc:336] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:04.775655  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:04.775841  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 78291.1us
I20260620 13:58:04.776690 11524 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260620 13:58:04.777424  5848 leader_election.cc:336] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.129s (SENT)
I20260620 13:58:04.777837 11524 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:04.777882  5848 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:04.778429 11524 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:04.778111 11523 consensus_queue.cc:1059] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260620 13:58:04.778803 11524 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Advancing to term 18
W20260620 13:58:04.780829  6552 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:04.783721 11437 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:04.786288 11414 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:04.777601  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:04.774972  5924 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:04.679329 11506 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.794155 11404 raft_consensus.cc:3055] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:58:04.790721 11487 consensus_queue.cc:1059] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260620 13:58:04.795887 11408 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:04.800869 11523 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:04.709568 10831 consensus_queue.cc:237] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.802966 11404 raft_consensus.cc:740] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
W20260620 13:58:04.803779  5848 leader_election.cc:336] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.206s (SENT)
I20260620 13:58:04.806362  5848 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.818039  6030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2914) took 1148 ms. Trace:
I20260620 13:58:04.814607 11524 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.818892  6030 rpcz_store.cc:276] 0620 13:58:03.669329 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:03.757640 (+ 88311us) service_pool.cc:224] Handling call
0620 13:58:04.817747 (+1060107us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54000e56d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:04.817954 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708439936}
I20260620 13:58:04.820609 11524 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.827462  6029 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 15. Current term is 16. Ops: []
I20260620 13:58:04.804473 11505 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.831240  6025 raft_consensus.cc:1240] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 16. Ops: []
I20260620 13:58:04.832365  6024 raft_consensus.cc:1240] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 13. Current term is 14. Ops: []
I20260620 13:58:04.833330  6025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43488 (request call id 2908) took 1298 ms. Trace:
I20260620 13:58:04.833745  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.833985  6025 rpcz_store.cc:276] 0620 13:58:03.534829 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:04.130492 (+595663us) service_pool.cc:224] Handling call
0620 13:58:04.830937 (+700445us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:04.832129 (+  1192us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.833072 (+   943us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54000e56d0. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fbc8d 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:04.833246 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568657280}
W20260620 13:58:04.834713  6552 connection.cc:256] RPC call timeout handler was delayed by -1.1188874409999698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260620 13:58:04.835384  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:04.837735 11521 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260620 13:58:04.840596  5998 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:04.841257 11437 consensus_queue.cc:1048] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260620 13:58:04.805297 11523 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:04.843606  6032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43488 (request call id 2911) took 1218 ms. Trace:
I20260620 13:58:04.868522  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.868759  6032 rpcz_store.cc:276] 0620 13:58:03.651560 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:04.010839 (+359279us) service_pool.cc:224] Handling call
0620 13:58:04.843390 (+832551us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54000e74d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:04.843525 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1118138112}
W20260620 13:58:04.844604  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 69671.9us
W20260620 13:58:04.849586  6552 connection.cc:256] RPC call timeout handler was delayed by -1.0972874410000486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
W20260620 13:58:04.869921  5924 leader_election.cc:336] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:04.870021  6552 connection.cc:256] RPC call timeout handler was delayed by -1.0837874410000268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
I20260620 13:58:04.845774 11404 consensus_queue.cc:260] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:04.845726  6026 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: []
I20260620 13:58:04.844162 11506 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:04.870393  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:04.870405  6552 connection.cc:256] RPC call timeout handler was delayed by -1.0756874410000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260620 13:58:04.882486  6552 connection.cc:256] RPC call timeout handler was delayed by -1.0675874410000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260620 13:58:04.874433  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:04.874672  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:04.885771  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:04.886865  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:04.887681  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 256886us
W20260620 13:58:04.894937  5925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.871083 11523 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
W20260620 13:58:04.914783  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.871575 11416 raft_consensus.cc:3055] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:58:04.917868  5959 raft_consensus.cc:1275] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:58:04.874584 11439 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:04.883823 11142 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:04.919148  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:04.927528  6580 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:58:04.935261  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:04.938225  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 135920us
I20260620 13:58:04.937922  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:04.935866  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.951248 11520 raft_consensus.cc:2764] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260620 13:58:04.951594  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:04.952602  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:04.953445  6587 raft_consensus.cc:2468] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 9.
I20260620 13:58:04.955209  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:04.963532  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:04.949592  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:04.965839 11538 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:04.966418 11538 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:04.966807 11538 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:04.967525  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:04.972669  5849 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:04.976691  6583 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:04.978672  6585 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260620 13:58:04.926177 11300 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:04.983533 11507 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:04.984495  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:04.984632  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 114715us
W20260620 13:58:04.997660  5924 leader_election.cc:336] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:04.926359 11439 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:04.917642 11416 raft_consensus.cc:740] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:04.937024 11506 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:04.985872 11404 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:04.935423 11410 consensus_queue.cc:260] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:04.990661 11518 log.cc:927] Time spent T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.276s	user 0.004s	sys 0.000s
I20260620 13:58:04.991425 11142 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:58:05.002147  5924 leader_election.cc:336] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:05.054926  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 55455.8us
I20260620 13:58:05.001750  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.013163  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:05.013823  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:05.040982  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 97677.6us
I20260620 13:58:04.997653 11507 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:05.007975 11439 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:05.082486  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:05.083129  6585 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 16
I20260620 13:58:05.063866 11414 consensus_queue.cc:1059] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260620 13:58:05.055902  5924 leader_election.cc:336] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:05.088455  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:05.014842  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 311646us
W20260620 13:58:05.093767  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.070485  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:05.071182 11419 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:05.098027 11419 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.073565  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:05.073849 11525 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:05.105034 11525 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.035808 11487 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:05.012993 11300 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.075533 11416 consensus_queue.cc:260] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.078296 11538 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.108340  6582 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260620 13:58:05.080324 11257 consensus_queue.cc:1048] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:05.080976 11499 consensus_queue.cc:1059] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:58:05.109051 11300 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:05.109591 11499 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:05.110081 11499 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.112390  6552 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.114521 11221 consensus_queue.cc:1059] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:05.115955 11142 raft_consensus.cc:3055] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:58:05.116387 11142 raft_consensus.cc:740] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:05.117169 11142 consensus_queue.cc:260] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:05.115942 11419 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:05.097131 11380 consensus_queue.cc:1059] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:58:05.112488 11499 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:05.081809  5958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42078 (request call id 1261) took 1224 ms. Trace:
I20260620 13:58:05.157461  5958 rpcz_store.cc:276] 0620 13:58:03.857381 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:04.233591 (+376210us) service_pool.cc:224] Handling call
0620 13:58:04.233981 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0620 13:58:04.272914 (+ 38933us) raft_consensus.cc:1534] Early marking committed up to index 0
0620 13:58:04.273149 (+   235us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0620 13:58:04.330346 (+ 57197us) log.cc:844] Serialized 26 byte log entry
0620 13:58:04.520600 (+190254us) raft_consensus.cc:1645] Marking committed up to 9
0620 13:58:04.520659 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:04.520747 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0620 13:58:04.871687 (+350940us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b440002250c. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc631485 00007f0fdc631ea2 00007f0fdf3a757b 00007f0fdf3a2e4f 00007f0fdf396c0e 00007f0fdf395f56 00007f0fdf395b78 00007f0fdf39f5c1 00007f0fdf39f579 00007f0fdf39f509
0620 13:58:05.081505 (+209818us) raft_consensus.cc:1685] finished
0620 13:58:05.081526 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0620 13:58:05.081740 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3100,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":130,"spinlock_wait_cycles":22460288,"thread_start_us":189763,"threads_started":1,"wal-append.queue_time_us":334183}
I20260620 13:58:05.036090 11488 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.107s
I20260620 13:58:05.096005  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:05.137948  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.164155  6587 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:58:05.167080  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:05.163025  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 98101.4us
I20260620 13:58:05.168223  5997 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:05.091682 11507 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:05.172614  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:05.173525 11538 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:05.176069  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.051156 11524 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.123s
I20260620 13:58:05.134368 11142 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:05.145744 11410 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:05.180799  5849 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:05.179773  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 65887.4us
I20260620 13:58:05.185853  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:05.186424  6032 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:05.183354  6582 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:58:05.169265 11416 raft_consensus.cc:3060] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:05.186889  6585 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:58:05.210285  6583 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260620 13:58:05.211246  6552 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.212591  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.212837  6552 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:58:05.215222  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 45318.4us
I20260620 13:58:05.188457  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:05.159530 11300 consensus_queue.cc:1059] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260620 13:58:05.223790  6027 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:05.182621 11278 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:58:05.167044 11523 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.254175  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.206853 11380 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260620 13:58:05.252435  5848 leader_election.cc:336] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.671s (SENT)
I20260620 13:58:05.169730 11450 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.057s
I20260620 13:58:05.184696 11525 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:05.269879 11531 log.cc:927] Time spent T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260620 13:58:05.274685  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:05.264101  5848 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.284837  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:05.286324  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.286952  6582 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 9.
I20260620 13:58:05.288864 11546 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:05.289340 11546 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:05.290095 11546 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
W20260620 13:58:05.296140  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 83456us
I20260620 13:58:05.297812  5952 raft_consensus.cc:1240] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: []
I20260620 13:58:05.298131  6027 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
I20260620 13:58:05.255285 11257 raft_consensus.cc:3055] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:05.303442  5955 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:05.327304 11506 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:05.328338 11506 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:05.304376  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 64442.4us
I20260620 13:58:05.302835  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:05.311075  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:05.260151 11278 raft_consensus.cc:697] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:05.327734 11257 raft_consensus.cc:740] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:05.333671 11525 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:58:05.334523 11525 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:05.309165  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:05.332475  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.334610 11257 consensus_queue.cc:260] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.345573  6032 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 18.
I20260620 13:58:05.347405  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:05.341216  5955 raft_consensus.cc:2468] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 10.
I20260620 13:58:05.335424 11525 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:58:05.349819  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.352818  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:05.354121  5955 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:05.356398  6585 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: []
I20260620 13:58:05.343058 11543 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:05.367890  5955 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:05.344187 11450 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:05.345139 11300 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:05.374188  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.379560  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:58:05.381474  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 72425.6us
I20260620 13:58:05.354347 11541 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:05.388912  6578 raft_consensus.cc:1275] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260620 13:58:05.389106  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.389673  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.390621  6587 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:05.392480  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.405254  6583 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:05.392782  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:05.393723 11380 raft_consensus.cc:3055] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:58:05.394449 11534 raft_consensus.cc:3055] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:58:05.371861 11548 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:58:05.399235  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:58:05.432603  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 78031.8us
I20260620 13:58:05.371049 11543 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:05.402367 11487 raft_consensus.cc:3055] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Stepping down as leader of term 15
I20260620 13:58:05.374269 11419 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:05.445951  6552 leader_election.cc:400] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 15. Current term is 16.
I20260620 13:58:05.446251  5952 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:05.411525 11526 log.cc:927] Time spent T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260620 13:58:05.402913 11300 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.424216 11523 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:05.450794 11300 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:05.398373  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.333760 11278 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.446316  6552 leader_election.cc:403] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:58:05.431475 11534 raft_consensus.cc:740] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:05.452231 11419 consensus_queue.cc:1059] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:05.452865  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.380939 11450 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.418448  6582 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:58:05.468771  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:05.457312  5952 raft_consensus.cc:2468] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
W20260620 13:58:05.459034  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:05.465261  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.433523 11257 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:05.408483 11380 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:05.443655 11487 raft_consensus.cc:740] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:05.474406  5955 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 17.
I20260620 13:58:05.443934 11543 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:05.479976  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:05.483568  6582 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:05.466504 10831 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:58:05.494076  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 48301.4us
W20260620 13:58:05.503618  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.504742  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:05.510174  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 113012us
I20260620 13:58:05.508340 11419 raft_consensus.cc:3055] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:05.485154 11506 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:05.554200  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.509861 11541 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:58:05.561153  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 108337us
I20260620 13:58:05.559552  5997 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:58:05.560057  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 78148.8us
I20260620 13:58:05.562865  5924 leader_election.cc:400] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for earlier term 9. Current term is 10.
I20260620 13:58:05.563596  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:05.551703 11419 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
W20260620 13:58:05.578609  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.503623 10831 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.539022 11507 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:05.583806  6582 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 18.
I20260620 13:58:05.545964 11534 consensus_queue.cc:260] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.601713  5955 raft_consensus.cc:1275] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260620 13:58:05.602860  5996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.605737 11419 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.607205 11419 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:05.607896 11450 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:05.611413  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:05.621395  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 58709.7us
I20260620 13:58:05.568557 11487 consensus_queue.cc:260] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:05.629520 11562 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260620 13:58:05.629720 11557 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:58:05.629971 11487 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:05.629570 11553 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493) with higher term. Message: Invalid argument: T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for earlier term 15. Current term is 16.
I20260620 13:58:05.632898 11556 raft_consensus.cc:2804] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 13:58:05.633558 11556 raft_consensus.cc:697] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:58:05.634740  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 96640.9us
I20260620 13:58:05.635834 11534 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:05.637383  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.566680 11439 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.568723 11541 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:05.643262 11541 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:05.583467 11380 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.646354 11546 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.647848  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:05.649864 11525 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.650274  5849 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:05.651237  6579 raft_consensus.cc:1240] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: []
I20260620 13:58:05.651183 11499 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:58:05.652453 11499 consensus_queue.cc:1059] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260620 13:58:05.653654 11499 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:58:05.654897 11416 raft_consensus.cc:3055] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:58:05.655284 11416 raft_consensus.cc:740] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:05.656219 11416 consensus_queue.cc:260] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:05.657554 11416 raft_consensus.cc:3060] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:05.659669 11499 raft_consensus.cc:697] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:05.664690  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:05.683233  6032 raft_consensus.cc:1240] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 15. Current term is 16. Ops: []
W20260620 13:58:05.682842  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 60552us
I20260620 13:58:05.690786  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.693089  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.600672 11221 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:05.689149 11142 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Leader election won for term 18
I20260620 13:58:05.701961 11557 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260620 13:58:05.712363  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.634491 11556 consensus_queue.cc:237] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:05.738560  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 45547.9us
W20260620 13:58:05.740276  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 180662us
I20260620 13:58:05.707479 11439 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:05.741055  5997 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:05.708871 11553 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:05.709919 11507 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:05.737363 10831 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:05.820320  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 79352.8us
I20260620 13:58:05.708334 11293 consensus_queue.cc:1048] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
I20260620 13:58:05.825397  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:05.818023  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:05.826674  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:05.826670  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.828977  6032 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:05.829180  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:05.740644 11142 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 18 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:05.739091 11221 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:05.828377  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:05.840417  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.872511 11557 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:58:05.869458  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:05.871093  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:05.872337  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 45629.6us
W20260620 13:58:05.875756 11561 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260620 13:58:05.874804 11564 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:58:05.892024  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:05.913372  6032 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:05.830212  6584 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 16: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:05.864953 11439 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:05.865893  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:05.910948  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.918967 11142 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.915575 11541 consensus_queue.cc:1059] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260620 13:58:05.915904  6026 raft_consensus.cc:2393] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 16: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:05.741477 11499 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:05.925444  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 123466us
I20260620 13:58:05.907862 11221 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:05.930708  6032 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:05.930634  5924 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:05.876353 11523 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
W20260620 13:58:05.933257  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:05.833818 11553 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.916950 11525 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:05.940225  6551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:05.952222  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 86517.9us
W20260620 13:58:05.955762 11571 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260620 13:58:05.931586 11507 consensus_queue.cc:1059] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260620 13:58:05.959359 11543 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.962989 11543 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:05.963979 11543 raft_consensus.cc:3055] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Stepping down as leader of term 15
I20260620 13:58:05.965446 11543 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:05.966784 11543 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.969254 11543 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:05.971683 11565 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:58:05.973977  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:05.974715  6584 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:58:05.975469  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:05.948942 11546 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:05.979224 11557 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260620 13:58:05.985738  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 348422us
I20260620 13:58:05.980782 11553 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:05.986621  6552 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:05.980988 11543 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:05.987421 11543 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:05.990137 11380 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:58:05.991452  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 60902.5us
I20260620 13:58:06.015875  5924 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:05.993000 11574 log.cc:927] Time spent T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.163s	user 0.003s	sys 0.000s
I20260620 13:58:05.958962  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:06.000633  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:58:06.001264  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 91341.4us
I20260620 13:58:06.001567  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.001679 11439 raft_consensus.cc:697] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
W20260620 13:58:06.001930 11257 consensus_meta.cc:287] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.002s
W20260620 13:58:06.003517  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 79471.2us
W20260620 13:58:06.003892  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.005749 11487 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
W20260620 13:58:06.021432  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:06.023470  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.034345  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:06.020366 11548 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:58:06.027616  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 68751.9us
I20260620 13:58:06.027946  5952 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:06.028395 11435 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:58:06.028419  5997 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:06.035193  6582 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
W20260620 13:58:06.044122  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.046533  6582 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
W20260620 13:58:06.048843  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.048054 11435 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:06.019670 11564 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:06.053757  5924 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:06.054622 11439 consensus_queue.cc:237] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:06.055279 11278 raft_consensus.cc:2804] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:58:06.055545 11585 consensus_queue.cc:1059] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:58:06.048676 11487 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.083985 11487 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.086203  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:06.051008  5849 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:06.087982  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 101439us
I20260620 13:58:06.089264  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:06.072155  5952 raft_consensus.cc:2410] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260620 13:58:06.075253  5956 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: []
I20260620 13:58:06.079659  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:06.091027  5957 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:06.081314 11585 raft_consensus.cc:3055] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 13:58:06.099195  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.037387 11553 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.102435  5849 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:06.099844  5959 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 13.
I20260620 13:58:06.115932  5955 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 15. Current term is 16. Ops: []
I20260620 13:58:06.067447 11435 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
W20260620 13:58:06.094904 11571 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260620 13:58:06.114113  5998 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:58:06.070906 11419 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:06.129839  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 43745.3us
I20260620 13:58:06.093881 11278 raft_consensus.cc:697] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:06.129086 11542 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:58:06.098646 11487 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:58:06.096861 11585 raft_consensus.cc:740] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:06.115643 11557 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:06.105997 11404 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260620 13:58:06.133420  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:06.187426  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:06.195580  6579 raft_consensus.cc:2468] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
W20260620 13:58:06.161983  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.196703  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:06.217007  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 83666.3us
I20260620 13:58:06.192595 11557 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:06.219816 11557 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:06.223505 11437 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:06.223994 11437 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:06.224874 11437 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:06.225291 11563 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:58:06.225785 11563 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:06.226214 11563 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:06.224884  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:06.128525 11553 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.241915  5957 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:58:06.129381 11471 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
W20260620 13:58:06.261718  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 133710us
I20260620 13:58:06.262668  5997 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:58:06.278470  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 164447us
I20260620 13:58:06.264176 11419 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:06.322252  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 59664.7us
W20260620 13:58:06.291095 11534 consensus_meta.cc:287] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.002s
I20260620 13:58:06.280866 11507 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:06.329257  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.323587 11257 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.331910  6552 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:58:06.337667  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 112910us
I20260620 13:58:06.300393 11543 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:06.347028  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 66940.7us
W20260620 13:58:06.348719  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:06.355489  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:06.344761  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 128456us
W20260620 13:58:06.377152  5849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.332474 11257 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.378661  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:06.383666  6027 raft_consensus.cc:2410] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260620 13:58:06.379024  5998 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:06.332878 11542 raft_consensus.cc:697] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 16 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:06.377075  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:06.404585  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 77569.7us
I20260620 13:58:06.337327 11507 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.408564  6579 raft_consensus.cc:2410] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260620 13:58:06.380304 11554 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:58:06.298375 11585 consensus_queue.cc:260] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.416224  5849 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:06.417989  5924 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:06.419601  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.328650 11278 consensus_queue.cc:237] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:06.422104  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:06.443706 11410 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:58:06.444590 11410 raft_consensus.cc:697] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:06.445858 11410 consensus_queue.cc:237] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:06.450750  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:06.480278  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 64060.5us
W20260620 13:58:06.485688  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 99241.8us
I20260620 13:58:06.499617  6027 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260620 13:58:06.416066 11471 consensus_queue.cc:1059] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260620 13:58:06.422469 11554 raft_consensus.cc:697] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:06.413736 11437 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:06.512979  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 93533.8us
W20260620 13:58:06.508716 11221 consensus_meta.cc:287] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.002s
W20260620 13:58:06.519495  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.500329 11543 raft_consensus.cc:2804] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:06.499768 11142 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:06.515125 11603 log.cc:927] Time spent T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260620 13:58:06.513756 11546 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260620 13:58:06.553043  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.557909  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:06.562438  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:06.564610 11257 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:06.565402 11437 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.532550 11471 consensus_queue.cc:1243] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260620 13:58:06.571727  6031 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 13. Current term is 14. Ops: []
I20260620 13:58:06.534986 11529 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260620 13:58:06.576879  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.577085  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:06.575053  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 201213us
I20260620 13:58:06.579916  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:06.553472 11543 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:06.508520 11557 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.584880  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:06.546765 11439 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.588452  6025 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
W20260620 13:58:06.589468  5924 connection.cc:256] RPC call timeout handler was delayed by -1.4108477449999555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260620 13:58:06.592136  5924 connection.cc:256] RPC call timeout handler was delayed by -1.0121477449999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
I20260620 13:58:06.594069  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:06.595996  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.596280  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.598167  5953 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:06.594022  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:06.601859  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.581707 11543 raft_consensus.cc:3060] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:06.551400 11614 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:06.521903 11563 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.576864 11529 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:06.537771 11221 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.607656  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.635291  5956 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:06.609784  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:58:06.592923 11556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.009s	sys 0.024s
I20260620 13:58:06.635769  5959 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:06.553900 11142 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.649119  5953 raft_consensus.cc:1240] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260620 13:58:06.534523 11542 consensus_queue.cc:237] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:06.572718 11559 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.263s
I20260620 13:58:06.662325 11563 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:06.636124 11529 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:06.636992 11619 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.668658 11619 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.610641 11601 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.671931 11601 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.675598  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:06.644642 11556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.009s	sys 0.024s
I20260620 13:58:06.590881 11257 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
W20260620 13:58:06.672969 11594 log.cc:927] Time spent T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.410s	user 0.003s	sys 0.001s
I20260620 13:58:06.605718 11546 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260620 13:58:06.684307  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:06.654263  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 44763.7us
I20260620 13:58:06.686892  5998 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:06.688989  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:06.603698 11439 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.693301  5953 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
W20260620 13:58:06.691921 11610 log.cc:927] Time spent T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260620 13:58:06.647166 11471 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260620 13:58:06.735693  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.694257 11507 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.737907  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.612902 11614 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.718163 11548 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260620 13:58:06.742039  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 45682.5us
W20260620 13:58:06.727516 11590 log.cc:927] Time spent T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260620 13:58:06.719267 11612 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:58:06.748488  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:06.723137 11564 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:06.742817 11629 consensus_queue.cc:1059] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:58:06.727341 11611 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:06.735827 11471 consensus_queue.cc:1243] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer b0ce39342d8c4a64904b30b98de02b9f log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260620 13:58:06.754861  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.723256 11304 consensus_queue.cc:1048] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260620 13:58:06.760483  5952 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:06.653229 11554 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.774953  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.751605 11612 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:06.826910  5951 raft_consensus.cc:1240] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 9. Current term is 10. Ops: []
I20260620 13:58:06.760738 11602 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:06.832851  6582 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 15. Current term is 16. Ops: []
I20260620 13:58:06.833963  5954 raft_consensus.cc:2393] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 14: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:06.765872 11601 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.766793 11471 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 13:58:06.841845  6579 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260620 13:58:06.838402 11488 raft_consensus.cc:3055] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:06.842585  5952 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:06.845099  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:06.846558  6580 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:06.828811 11612 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:06.844907 11488 raft_consensus.cc:740] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:06.766513 11221 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:06.866704  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.838701 11625 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.840665 11557 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.874280  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.876242  5954 raft_consensus.cc:2468] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:58:06.857594 11599 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:06.854792 11559 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:06.897812  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.875605 11619 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.898202  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.887056 11599 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:06.908782  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.857412 11615 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.216s
W20260620 13:58:06.898097 11606 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.251s	user 0.002s	sys 0.000s
I20260620 13:58:06.885761 11142 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.897491 11621 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:06.907825 11609 log.cc:927] Time spent T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.215s	user 0.000s	sys 0.002s
I20260620 13:58:06.931911  5954 raft_consensus.cc:1275] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260620 13:58:06.932260  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.901053 11614 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:06.901952 11599 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:06.941150  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc919ad08d5e4a9d9870a33b6fc425e5" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:06.942685  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:06.944129  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.920543 11563 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.953329  5954 raft_consensus.cc:1275] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260620 13:58:06.926555 11557 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.878675 11625 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.928490 11439 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:06.949950 11617 log.cc:927] Time spent T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260620 13:58:06.929661 11624 raft_consensus.cc:493] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:06.890244 11488 consensus_queue.cc:260] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:06.971066  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:06.975219  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.989979 11619 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:06.990687 11619 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:06.992137  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 253027us
W20260620 13:58:06.993233  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:06.993316 11619 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:06.993813  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:06.975337 11142 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:06.976922  5848 leader_election.cc:336] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.533s (SENT)
I20260620 13:58:06.994549 11142 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.994645  5848 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:06.995082  5951 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
I20260620 13:58:06.986258  6580 raft_consensus.cc:2468] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:06.909389 11559 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.003013  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:06.994689  6552 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:06.997597 11624 raft_consensus.cc:515] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.930845 11621 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:06.999468 11619 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:07.037776  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:07.041735  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:07.042863  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 48212us
W20260620 13:58:07.044817  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:06.965452 11563 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.009477  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:06.978212 11557 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:07.036588 11435 consensus_meta.cc:287] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47: Time spent flushing consensus metadata: real 0.873s	user 0.008s	sys 0.005s
W20260620 13:58:07.027484 11620 log.cc:927] Time spent T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.239s	user 0.000s	sys 0.002s
I20260620 13:58:07.004774 11488 raft_consensus.cc:3060] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:07.027251  5958 raft_consensus.cc:2955] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 10 to 14, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:07.066663  5955 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260620 13:58:07.023380 11221 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:07.032614 11625 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.070174  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:07.068148  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:07.038398 11142 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.047755 11615 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.074738  5951 raft_consensus.cc:1240] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260620 13:58:07.036510 11559 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:07.077179  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:07.079583  5950 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:07.006340 11633 consensus_queue.cc:1048] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260620 13:58:07.040215 11543 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.085466  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.086122  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:58:07.078496  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:07.091678  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.065521 11435 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.096290 11563 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:07.096808 11435 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.100273  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:07.098583  6552 leader_election.cc:336] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.090229 11142 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.080554 11221 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.104482  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.105047  5950 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 12.
I20260620 13:58:07.110448 11221 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:07.110606 11543 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.111790 11557 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.111896 11624 leader_election.cc:290] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.117570 11621 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.120438  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.121963  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.123039  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:07.123589  5955 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:07.083364 11615 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:07.123849  5956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 2427) took 1028 ms. Trace:
I20260620 13:58:07.124306  5956 rpcz_store.cc:276] 0620 13:58:06.095574 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:06.122284 (+ 26710us) service_pool.cc:224] Handling call
0620 13:58:06.122671 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0620 13:58:06.635782 (+513111us) raft_consensus.cc:1697] Filling consensus response to leader.
0620 13:58:07.123607 (+487825us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54003cfd54. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7fd1e1 00007f0fdf7fbc1e 00007f0fe47c0b19 00007f0fddd35d34 00007f0fddd35cc2 00007f0fddd35bf1 00007f0fddd35b6c 00007f0fddd34e22 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:07.123786 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125967104}
W20260620 13:58:07.099529 11380 consensus_meta.cc:287] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Time spent flushing consensus metadata: real 1.067s	user 0.015s	sys 0.000s
I20260620 13:58:07.125249  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:07.128058  5956 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:07.129220  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.107825 11142 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:07.131979 11615 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:07.133090 11602 raft_consensus.cc:2955] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 10 to 14, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:07.140002 11553 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:07.137892 11612 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.141566  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.142202  5953 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 17.
I20260620 13:58:07.144097 11529 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.145107 11585 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:07.146678 11553 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:07.147404  6026 raft_consensus.cc:2393] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 14: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:07.147336 11553 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.143083  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:07.149050  5953 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:07.143086 11612 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:07.153673  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 58924.5us
W20260620 13:58:07.154691  6552 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.155189  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:07.156029  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:07.156925  5950 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:07.170562  5956 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:07.146297 11529 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.131939 11142 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:07.179633  4719 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:07.160624 11565 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:07.140038 11599 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.187016  5848 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.190455 11414 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:07.196192  6551 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.200649  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.200945  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.201095  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.201495  5958 raft_consensus.cc:2468] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
W20260620 13:58:07.202886  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 48226.8us
I20260620 13:58:07.200208  5997 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:07.201552  5954 raft_consensus.cc:2468] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
W20260620 13:58:07.204159  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:07.204645  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.206583  5953 raft_consensus.cc:2468] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 18.
I20260620 13:58:07.208201  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:07.204748  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:07.209427  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:07.209316  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:07.211196  6552 leader_election.cc:336] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.211741  5848 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.212854  5848 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.212989  5955 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:07.218619  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:07.210435  6551 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.219251  5955 raft_consensus.cc:1240] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 12. Current term is 13. Ops: []
I20260620 13:58:07.220099  5956 raft_consensus.cc:1240] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 15. Current term is 16. Ops: []
I20260620 13:58:07.223503  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.197383 11414 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.203238 11554 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:07.250259 11554 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:07.250725 11554 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:07.253935 11221 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election won for term 18
I20260620 13:58:07.254500 11221 raft_consensus.cc:697] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 18 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:58:07.255261  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 44087.3us
W20260620 13:58:07.256018  6552 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:07.249181  5950 raft_consensus.cc:2468] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:07.218449 11437 raft_consensus.cc:2804] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:07.259492  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.231276 11488 raft_consensus.cc:2804] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:07.265681  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.199690 11435 consensus_queue.cc:1048] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260620 13:58:07.264648  5997 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:07.266548  5958 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:07.266387  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.274130  6579 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 20.
I20260620 13:58:07.246701 11142 raft_consensus.cc:3060] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:58:07.267163  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 53119.3us
W20260620 13:58:07.277007  5848 leader_election.cc:336] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 1.961s (SENT)
I20260620 13:58:07.277437  5848 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.278560  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.281272  5954 raft_consensus.cc:1275] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260620 13:58:07.282528  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.283381  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.231505 11529 consensus_queue.cc:1059] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260620 13:58:07.256677 11414 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.272361 11437 raft_consensus.cc:493] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:07.266199 11488 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:07.284323 11588 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:07.231093 11633 consensus_queue.cc:1059] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260620 13:58:07.303522 11599 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.297598  6580 raft_consensus.cc:1275] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260620 13:58:07.285430  6582 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:58:07.300103  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:07.305874  5848 leader_election.cc:336] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Timed out: RequestConsensusVote RPC to 127.4.155.194:38517 timed out after 2.038s (SENT)
I20260620 13:58:07.296445 11612 raft_consensus.cc:2804] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:07.309566 11612 raft_consensus.cc:697] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:07.310556 11612 consensus_queue.cc:237] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.312506 11414 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.306450  5848 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.302661 11488 raft_consensus.cc:3060] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:07.314486  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.316634 11604 raft_consensus.cc:3055] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Stepping down as leader of term 15
I20260620 13:58:07.317039 11604 raft_consensus.cc:740] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:07.317078  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:07.317250 11414 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:07.317942  6579 raft_consensus.cc:2393] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 15: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:07.317066  5848 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.317966 11604 consensus_queue.cc:260] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.319458  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.319649 11414 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:07.320067 11604 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:07.320412  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.319413  5848 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.321010  6582 raft_consensus.cc:2468] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 18.
I20260620 13:58:07.321413 11414 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:07.320065  6580 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
W20260620 13:58:07.325266  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:07.326166  5848 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:07.326972  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 100523us
W20260620 13:58:07.328022  5924 leader_election.cc:336] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171): Timed out: RequestConsensusVote RPC to 127.4.155.196:34171 timed out after 2.987s (SENT)
I20260620 13:58:07.300635 11437 raft_consensus.cc:3060] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:07.328621  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.330511  5848 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.332638 11142 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:07.347391  5848 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.347692  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.278955 11221 consensus_queue.cc:237] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.351682 11554 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.356981  6584 raft_consensus.cc:2393] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 18: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:07.352396 11553 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:07.353957  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:07.358543  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:07.359458  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.360056  6582 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 16.
I20260620 13:58:07.360910 11554 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:07.342476 11588 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:07.343966 11564 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260620 13:58:07.378495  5924 leader_election.cc:336] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.378825  5848 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.379153  5924 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:07.409401  5997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:07.410305  5924 leader_election.cc:336] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.410749  5924 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.411623 11624 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:07.411942  5924 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.412386  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.413113 11624 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260620 13:58:07.413472  5924 leader_election.cc:336] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.413934  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.414628 11557 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:07.372360 11615 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:58:07.403440 11585 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:07.401319 11588 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:07.427909  5924 leader_election.cc:336] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.429872  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.401239 11622 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260620 13:58:07.427806  6552 leader_election.cc:336] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.407387 11414 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260620 13:58:07.438437  6552 leader_election.cc:336] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.443562 11557 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:58:07.446094  5924 leader_election.cc:336] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.446584  5924 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.452368 11613 raft_consensus.cc:3055] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:07.453070 11613 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:07.452929 11488 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.435111 11588 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.487040 11557 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:58:07.488240 11488 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.487388 11588 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.488907 11488 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.489378 11488 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:07.492411 11437 raft_consensus.cc:515] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.493059  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.496124 11627 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:07.496270  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.496670 11627 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.497525  6031 raft_consensus.cc:2410] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260620 13:58:07.498354  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:07.499115 11529 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:07.499293  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:07.499646 11529 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.502089 11529 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.454353 11613 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:07.504561  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:07.509431  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:07.494484 11437 leader_election.cc:290] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.515084  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e2284e793941b4aa9829a72313998c" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.523084  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:07.526796  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 80721.7us
W20260620 13:58:07.527942  5924 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.531764  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.532899  6025 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 18: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:07.511456 11525 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.535028  6027 raft_consensus.cc:3055] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:58:07.535550  6027 raft_consensus.cc:740] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:07.536441  6027 consensus_queue.cc:260] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.537814  6027 raft_consensus.cc:3060] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:07.542166  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:07.543037  6033 raft_consensus.cc:2393] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 10: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:07.543956  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:07.544835  6024 raft_consensus.cc:2410] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260620 13:58:07.545756  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.546387  6029 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:58:07.553900  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.504355 11627 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.558393  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:07.571616  6030 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:07.564322  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.572402  6582 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:07.573751  6582 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260620 13:58:07.565151  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.568600  6027 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260620 13:58:07.550501 11221 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.574980  6027 pending_rounds.cc:85] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 10
I20260620 13:58:07.575302  6027 pending_rounds.cc:107] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260620 13:58:07.576148  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.576144  6025 raft_consensus.cc:1240] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:07.575534  6027 raft_consensus.cc:2889] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:58:07.578063  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:07.578147  5924 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.578634  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.583370  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.584187  6585 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:07.585606  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.586320  6585 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:07.588406  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.589136  6583 raft_consensus.cc:2468] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 9.
I20260620 13:58:07.589443  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.589963  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:07.588478  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.555649 11488 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:07.591413  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:07.592092  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 97882.8us
I20260620 13:58:07.592317  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:07.599839  6033 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 18: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:07.592528  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.592988  6029 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260620 13:58:07.593331  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.601509  6032 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:07.601815  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:07.602968  5924 leader_election.cc:336] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.603669  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.552543 11525 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.600342  6024 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:58:07.608194  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:07.606848  6028 raft_consensus.cc:1240] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 14. Current term is 15. Ops: []
I20260620 13:58:07.591825 11624 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:07.606197 11419 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:07.613121  6579 raft_consensus.cc:3055] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Stepping down as leader of term 16
I20260620 13:58:07.611246  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.614058  5952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36000 (request call id 2599) took 1016 ms. Trace:
W20260620 13:58:07.592816 11569 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260620 13:58:07.616284  6028 raft_consensus.cc:1240] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260620 13:58:07.614439  5952 rpcz_store.cc:276] 0620 13:58:06.597380 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:06.609539 (+ 12159us) service_pool.cc:224] Handling call
0620 13:58:07.613896 (+1004357us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400262fd4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf8006da 00007f0fe47c2217 00007f0fddd3a834 00007f0fddd3a7c2 00007f0fddd3a6f1 00007f0fddd3a66c 00007f0fddd39922 00007f0fddb34c3c 00007f0fddb34076 00007f0fddb33a1f
0620 13:58:07.614004 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285377920}
I20260620 13:58:07.613662  6579 raft_consensus.cc:740] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:07.591694 11607 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:58:07.617411  5924 leader_election.cc:336] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.613323  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.618646  6025 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:07.619568  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.610534 11488 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:07.624244  6025 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
W20260620 13:58:07.624336  5998 leader_election.cc:336] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:07.625468  5998 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.626341  5998 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:07.627172 11520 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:07.625487  6025 raft_consensus.cc:1240] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260620 13:58:07.630748  5998 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.631769  5924 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:07.632397  5998 leader_election.cc:336] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.632540 11419 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:07.632886  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.633666 11520 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260620 13:58:07.635018  5998 leader_election.cc:336] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:07.637274  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:07.638695  5998 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:07.634323  5924 leader_election.cc:336] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.619565 11608 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.640712 11608 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.642627  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.615137  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.646384  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.592226 11221 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.647069  6025 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:58:07.642699  6579 consensus_queue.cc:260] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.648186  5849 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:07.644745  5998 leader_election.cc:336] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.653060  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.654441  6024 pending_rounds.cc:85] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: Aborting all ops after (but not including) 11
I20260620 13:58:07.654831  6024 pending_rounds.cc:107] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260620 13:58:07.655299  6024 raft_consensus.cc:2889] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:07.655447  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.657138  6579 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:07.652776  5998 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:07.653970 11488 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.006s
I20260620 13:58:07.659812  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.658619  5849 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.667874  6578 raft_consensus.cc:2410] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260620 13:58:07.668251 11605 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260620 13:58:07.671978  5924 leader_election.cc:336] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.672839  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.653023 11419 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:07.652788 11541 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:07.668586 11414 raft_consensus.cc:2804] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260620 13:58:07.661978 11588 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:07.683836  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.684674  6025 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:07.685389  6584 raft_consensus.cc:1240] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 17. Current term is 18. Ops: []
I20260620 13:58:07.678777 11520 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:07.686105 11557 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:07.687065 11221 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:07.687090  5998 leader_election.cc:336] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.689029  5849 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.646479 11607 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.668776 11605 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:07.686625 11557 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:07.693441  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:07.697184  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:07.701530  5849 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.709481  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:07.712442  6585 raft_consensus.cc:2368] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
I20260620 13:58:07.688062 11588 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:07.713654  6582 raft_consensus.cc:1240] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260620 13:58:07.683403 11414 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:58:07.716949  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 45009.2us
I20260620 13:58:07.695779 11605 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:07.723359  5998 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
W20260620 13:58:07.697575 11487 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.431s	user 0.012s	sys 0.047s
I20260620 13:58:07.721019  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:07.695057 11608 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.695719 11615 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:07.722512  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:07.723138  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:07.718012  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:07.724764  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:07.769176  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51274.7us
I20260620 13:58:07.769547  6583 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:58:07.697918 11419 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:07.699363 11523 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:07.779690 11523 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:58:07.779951 11659 log.cc:927] Time spent T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260620 13:58:07.713416 11541 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:07.727823  6581 raft_consensus.cc:2955] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 10 to 14, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:07.744903  5922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:07.697749 11404 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260620 13:58:07.719785 11588 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:07.719206 11414 raft_consensus.cc:3060] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 9 FOLLOWER]: Advancing to term 10
I20260620 13:58:07.766101  6030 raft_consensus.cc:2468] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
W20260620 13:58:07.770494  5924 leader_election.cc:336] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.780294 11523 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:07.778581  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:07.808101  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.808727  6583 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 18.
I20260620 13:58:07.700171 11142 consensus_queue.cc:1059] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
W20260620 13:58:07.811373 11661 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260620 13:58:07.811633 11142 raft_consensus.cc:3055] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 13:58:07.812090 11142 raft_consensus.cc:740] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:07.812950 11607 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.813148 11142 consensus_queue.cc:260] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.814568 11142 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:07.726771  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:07.739454 11525 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:07.815896 11658 log.cc:927] Time spent T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260620 13:58:07.729733 11585 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:07.800504  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:07.753801 11487 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.514s	user 0.012s	sys 0.047s
I20260620 13:58:07.800949  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:07.776217  6585 raft_consensus.cc:2393] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 10: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:07.738047 11471 raft_consensus.cc:2804] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:07.818146  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.824642  6579 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260620 13:58:07.825603  6579 pending_rounds.cc:85] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 10
I20260620 13:58:07.825551  5998 leader_election.cc:400] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
I20260620 13:58:07.825970  6579 pending_rounds.cc:107] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260620 13:58:07.826030  5998 leader_election.cc:403] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260620 13:58:07.826323  6579 raft_consensus.cc:2889] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:58:07.827744  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 57272.5us
W20260620 13:58:07.828750  5924 leader_election.cc:336] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.818655 11585 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:07.835186 11585 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:07.836045 11557 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:07.835230 11419 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:07.840869  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 400943us
W20260620 13:58:07.842579  6552 leader_election.cc:336] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.840392 11588 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.846108 11588 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:07.791121 11662 consensus_queue.cc:1059] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.079s
I20260620 13:58:07.847452 11662 raft_consensus.cc:3055] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Stepping down as leader of term 17
I20260620 13:58:07.847800 11662 raft_consensus.cc:740] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:07.848701 11662 consensus_queue.cc:260] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.849932 11662 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:07.850402  6033 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260620 13:58:07.854362  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:07.727823 11604 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260620 13:58:07.822144 11487 raft_consensus.cc:697] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:07.860692 11487 consensus_queue.cc:237] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.799312 11541 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:58:07.869408  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 46074.9us
I20260620 13:58:07.893096  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:07.895605  5956 raft_consensus.cc:1275] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260620 13:58:07.870993  6552 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.871273  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
W20260620 13:58:07.897157  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:07.884009  5953 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 13. Current term is 14. Ops: []
W20260620 13:58:07.890177  5850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:07.897891  6552 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.899317  6552 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:07.896333  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.897125  6586 raft_consensus.cc:3055] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Stepping down as leader of term 13
W20260620 13:58:07.907996  6552 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.904975  6586 raft_consensus.cc:740] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:07.908869  5951 raft_consensus.cc:1240] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 12. Current term is 13. Ops: []
W20260620 13:58:07.908048  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 77683.6us
I20260620 13:58:07.910377  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.912395  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.914397  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:07.908725  6552 leader_election.cc:336] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:07.919031  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.898226 11541 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:07.918644 11611 consensus_queue.cc:1048] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260620 13:58:07.921334  5954 raft_consensus.cc:1275] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260620 13:58:07.923448  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b6ab17fde545f5b655c12383d08351" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:07.924227  5951 raft_consensus.cc:2393] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 18: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:07.869294 11471 raft_consensus.cc:697] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:07.925383 11471 consensus_queue.cc:237] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.927163 11622 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:07.927613 11622 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:07.927992 11622 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:07.918426 11419 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:07.929199 11419 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:07.934620 11419 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:07.918581 11557 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260620 13:58:07.899567 11257 consensus_queue.cc:1048] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260620 13:58:07.940577  6586 consensus_queue.cc:260] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.899434 11553 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.941679  6586 raft_consensus.cc:3060] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:07.942170 11553 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.942839 11557 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:07.943290 11557 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:07.943681 11557 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:07.944599 11553 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:07.899144 11602 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) with higher term. Message: Invalid argument: T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for earlier term 10. Current term is 11.
W20260620 13:58:07.947940  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 51760.1us
I20260620 13:58:07.954792  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:07.956315  5924 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.958385  5924 leader_election.cc:304] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:07.920178 11628 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260620 13:58:07.920372 11551 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:07.953696 11588 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:07.953883 11499 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:08.020254  5957 raft_consensus.cc:1275] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260620 13:58:07.953883 11304 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:07.969483 11520 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260620 13:58:08.033136 11499 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.033624 11520 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:08.034168 11520 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Advancing to term 19
W20260620 13:58:08.035493 11667 log.cc:927] Time spent T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260620 13:58:08.035706 11499 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:08.036198 11665 log.cc:927] Time spent T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260620 13:58:08.039108  5997 leader_election.cc:304] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.039692 11528 consensus_queue.cc:1048] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:58:08.041296 11528 raft_consensus.cc:2749] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260620 13:58:07.960062 11523 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.053010 11613 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:08.052834 11414 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.959482 11564 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:08.055661 11564 raft_consensus.cc:2749] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:08.029516  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 68942.1us
I20260620 13:58:08.032742 11304 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:08.060063  5951 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260620 13:58:08.007838 11628 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:58:08.065454  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 107144us
W20260620 13:58:08.071301  5848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:08.071838 11628 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Advancing to term 21
I20260620 13:58:08.059762 11304 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:07.998706 11585 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:07.959270 11611 consensus_queue.cc:1059] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260620 13:58:07.977764 11541 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:08.063341 11624 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:08.074980  5848 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.085722  5848 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.076303 11414 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.031607 11588 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.080973  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.086953  5848 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.074234 11529 consensus_queue.cc:1048] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260620 13:58:08.095028  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.076603 11605 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.087965 11142 raft_consensus.cc:2804] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:08.089917 11499 raft_consensus.cc:2804] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:58:08.101733  5848 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.105325  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.105906  6031 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:08.106245 11541 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:08.108541 11585 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:08.110100  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:08.110564  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 194062us
W20260620 13:58:08.111186  6552 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.111557  6552 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:08.113363 11564 raft_consensus.cc:3055] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:58:08.113827 11564 raft_consensus.cc:740] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:08.116668 11588 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.102451 11142 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:08.117703 11142 raft_consensus.cc:3060] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:08.120863  6552 leader_election.cc:336] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:08.122743  5847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:08.125191  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.125835  6033 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
W20260620 13:58:08.126509  6553 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:08.128144  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:08.128568  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.129170  5950 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:58:08.130365  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.133930  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.135526 11541 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:58:08.135597  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:08.138471  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.139240  5952 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:08.140256  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.141599  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:08.142298  5952 raft_consensus.cc:2376] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16. Re-sending same reply.
I20260620 13:58:08.145867  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.095487 11414 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:08.151580  5924 leader_election.cc:336] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.152848  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.155629 11419 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.157227  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.103920 11499 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:08.159406 11499 raft_consensus.cc:3060] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:08.159744  6033 raft_consensus.cc:1240] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Rejecting Update request from peer b0ce39342d8c4a64904b30b98de02b9f for earlier term 13. Current term is 14. Ops: []
W20260620 13:58:08.163209  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:08.164821  6552 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:08.170068  6033 raft_consensus.cc:1275] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260620 13:58:08.146523  5848 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.152165  5924 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.171768  5848 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:08.172035  5924 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.172662  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.174342 11419 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.175192 11419 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:08.180157  4719 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:08.183569  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:08.103607 11523 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.196156  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.196640  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:08.110117 11622 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.197656  5950 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260620 13:58:08.198071  5998 leader_election.cc:336] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.151336 11380 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:58:08.203390  6586 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260620 13:58:08.203743  6586 pending_rounds.cc:85] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 10
I20260620 13:58:08.203981  6586 pending_rounds.cc:107] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260620 13:58:08.204171  6031 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:08.209944  5849 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.200263  5998 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.204210  6586 raft_consensus.cc:2889] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:08.216372  6580 raft_consensus.cc:1240] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260620 13:58:08.186486 11404 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 13:58:08.221208  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2378deea24954b2003dda61c1b2c1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:08.114827 11564 consensus_queue.cc:260] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.194586 11414 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:58:08.224970  5998 leader_election.cc:336] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.225461 11523 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:58:08.225939 11488 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:08.235898  5998 leader_election.cc:336] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.228469  5959 raft_consensus.cc:1240] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 12. Current term is 13. Ops: []
I20260620 13:58:08.229266  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:08.236963  5998 leader_election.cc:336] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.237285  6033 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:08.199214 11221 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:08.249341 11488 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:08.250344 11142 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:08.252804 11488 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:08.229948  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.198925 11525 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:08.238341  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.260470  6031 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:08.260661  6027 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:08.263933 11525 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.266067 11525 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:08.239303  5998 leader_election.cc:336] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.242044 11628 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.242465 11557 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.218307 11541 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260620 13:58:08.243191 11564 raft_consensus.cc:3060] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:08.243321  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.290635  6028 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:58:08.243474 11523 raft_consensus.cc:697] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 16 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:08.226742 11627 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:08.227044 11507 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260620 13:58:08.246333 11622 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.270975  6027 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
I20260620 13:58:08.285866  5954 raft_consensus.cc:1240] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 21 FOLLOWER]: Rejecting Update request from peer 663684cf4ae54c929bf8240ca0b63a47 for earlier term 20. Current term is 21. Ops: []
W20260620 13:58:08.270303  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:08.312368  5998 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.289940  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:08.314441  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 116674us
I20260620 13:58:08.315239  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.293358  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.316745  6033 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
W20260620 13:58:08.290935  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 118937us
I20260620 13:58:08.293944 11523 consensus_queue.cc:237] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.295508 11520 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.296734  6031 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:08.307791 11142 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:08.317188  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:08.318996  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 119878us
W20260620 13:58:08.317828  5924 leader_election.cc:336] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.312829  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.318480  6026 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 15.
I20260620 13:58:08.320015  6552 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.324008 11605 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.331302 11553 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 13:58:08.332063 11557 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.285647 11611 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:58:08.348824  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.355687  6032 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 18. Current term is 19. Ops: []
W20260620 13:58:08.357383  5924 leader_election.cc:336] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.332582 11488 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:58:08.357831  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.332227 11499 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:08.361513  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:08.348047 11628 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 21 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:08.364836  5924 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:08.358321  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 44891.7us
W20260620 13:58:08.366544  5998 leader_election.cc:336] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.367421  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:08.366642  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 46715.3us
I20260620 13:58:08.365480  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:08.369850  5924 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.370428  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:08.371948  5924 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.372545  5924 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.356863 11627 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260620 13:58:08.375491  5924 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.362593 11488 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:08.376513  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.359282 11557 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:08.377046  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:08.364369 11624 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:08.365278 11525 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260620 13:58:08.384212  6552 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:08.384713  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:08.376207 11675 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260620 13:58:08.388785 11668 log.cc:927] Time spent T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.592s	user 0.005s	sys 0.000s
I20260620 13:58:08.378149 11257 consensus_queue.cc:1059] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260620 13:58:08.379668 11488 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:08.378398 11553 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.024s
I20260620 13:58:08.381057 11628 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:08.375679 11686 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:08.361675 11687 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260620 13:58:08.399120 11437 consensus_queue.cc:1059] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260620 13:58:08.417280 11437 raft_consensus.cc:3055] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:58:08.417649 11437 raft_consensus.cc:740] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:08.399422 11633 consensus_queue.cc:1059] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260620 13:58:08.421151 11633 raft_consensus.cc:3055] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 LEADER]: Stepping down as leader of term 20
I20260620 13:58:08.421725 11633 raft_consensus.cc:740] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:08.413144 11304 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.426524 11304 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.414394 11605 raft_consensus.cc:493] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:08.427600 11605 raft_consensus.cc:515] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.429643 11605 leader_election.cc:290] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.380745 11602 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260620 13:58:08.445780 11672 log.cc:927] Time spent T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.285s	user 0.002s	sys 0.000s
W20260620 13:58:08.385363  5998 leader_election.cc:336] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.457966  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.462845 11525 raft_consensus.cc:3055] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Stepping down as leader of term 12
I20260620 13:58:08.463376 11525 raft_consensus.cc:740] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:08.463872  5849 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.464190 11525 consensus_queue.cc:260] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.465503 11525 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:08.465734 11541 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:58:08.466225 11541 raft_consensus.cc:697] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:08.466619  5959 raft_consensus.cc:1275] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:58:08.433339 11563 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:08.467077 11541 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.473688 11602 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:08.467278 11404 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:58:08.475311 11404 raft_consensus.cc:697] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:08.476126 11404 consensus_queue.cc:237] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:08.468045 11563 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:08.480130 11563 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:08.454954 11221 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260620 13:58:08.468811 11520 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.469996 11499 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.489527 11605 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260620 13:58:08.422703 11633 consensus_queue.cc:260] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.491391 11633 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Advancing to term 21
I20260620 13:58:08.496865  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.497540  6026 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:08.418509 11437 consensus_queue.cc:260] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.507956 11437 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:08.516762  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.458129  5998 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:08.546698  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:08.555636  6026 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:58:08.563319  5951 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260620 13:58:08.563792  5951 pending_rounds.cc:85] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 9
I20260620 13:58:08.564183  5951 pending_rounds.cc:107] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260620 13:58:08.564589  5951 raft_consensus.cc:2889] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:58:08.573150  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:08.581509  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 196154us
W20260620 13:58:08.582617  5998 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.583245  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.592707  5849 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.573370 11528 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:08.601209  5998 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:08.604580  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 225800us
W20260620 13:58:08.637787  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 253666us
I20260620 13:58:08.640283  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:08.641606  6552 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.643093  6552 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.646056  5848 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:08.646946  5998 leader_election.cc:336] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.599730 11523 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:08.649801  5848 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.650842  5848 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.652210  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.652884  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.651937  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.653802  6026 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:08.653908  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.654551  6027 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:08.656962  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:08.657474  5951 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:08.658257  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.654007  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:08.659459  5959 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:08.662482  6552 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:08.664677  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:08.665367  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:08.655781  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:08.604769 11529 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:58:08.606976 11604 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:08.667789  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:08.648545 11551 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:08.669785 11696 raft_consensus.cc:2804] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:58:08.648175 11687 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:08.674592 11142 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:08.616087 11556 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260620 13:58:08.675186 11487 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:08.676239 11507 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 13:58:08.701850 11507 consensus_queue.cc:1243] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260620 13:58:08.677451  5958 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260620 13:58:08.666608 11605 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:08.710644 11686 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:08.684021  6026 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:58:08.685359  5959 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
W20260620 13:58:08.712190 11704 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260620 13:58:08.686146  6027 raft_consensus.cc:2410] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260620 13:58:08.669140  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.643946 11221 consensus_queue.cc:1048] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260620 13:58:08.694386 11687 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:08.695317 11696 raft_consensus.cc:697] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:08.692224 11604 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.692363 11551 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:08.644106 11257 consensus_queue.cc:1059] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260620 13:58:08.648056 11688 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260620 13:58:08.716095  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 352355us
I20260620 13:58:08.688685 11523 raft_consensus.cc:697] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:08.724534  6551 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:08.728502  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:08.745198  5777 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56594 (request call id 334) took 24868 ms (client timeout 15000 ms). Trace:
I20260620 13:58:08.720336 11551 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:08.720808 11622 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:08.719298 11687 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:08.744441 11703 log.cc:927] Time spent T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260620 13:58:08.757082 11604 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.760555  6031 raft_consensus.cc:2410] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260620 13:58:08.759366  5779 catalog_manager.cc:5696] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 13 to 16, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 16 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:08.761514 11563 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.744417 11523 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.746037 11221 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:08.768124 11696 consensus_queue.cc:237] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.770448  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:08.770519 11701 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260620 13:58:08.777412 11525 raft_consensus.cc:3055] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Stepping down as leader of term 10
W20260620 13:58:08.782151  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:08.732134  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:08.789361  6032 raft_consensus.cc:1240] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 18. Current term is 19. Ops: []
I20260620 13:58:08.815994 11507 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:58:08.826818  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 160936us
I20260620 13:58:08.826653 11507 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:08.827509  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:08.828065  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:08.828537  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:08.828667 11541 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:08.828789 11507 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:08.829077  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:08.826661  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 94637.7us
I20260620 13:58:08.820319  5779 catalog_manager.cc:5696] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 6 to 11, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 11 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:08.831049 11525 raft_consensus.cc:740] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:08.815582 11221 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:08.831766 11221 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:08.832019 11525 consensus_queue.cc:260] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.832551 11687 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:08.833431 11525 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:08.836040  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:08.837487  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:08.838201  5998 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.839052 11605 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:08.839584 11605 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:08.811345 11488 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.835245 11604 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:08.844821 11604 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.841850 11605 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:08.846110  6027 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260620 13:58:08.846216 11605 consensus_queue.cc:1059] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260620 13:58:08.847317  5779 catalog_manager.cc:5696] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:08.848362  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:08.849103  5779 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 14 to 19, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 19 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:08.852847  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.853986  6031 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:08.855899 11221 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.805614  5951 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
W20260620 13:58:08.900363  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260620 13:58:08.899550  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 230610us
I20260620 13:58:08.803618 11404 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:08.901413 11404 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:08.902750  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:08.806722 11257 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:08.856456 11563 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:08.810428 11564 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:58:08.856213 11551 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:08.846894 11604 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:08.863407  5998 leader_election.cc:336] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.864683  6033 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 21.
W20260620 13:58:08.922328  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 58993.8us
I20260620 13:58:08.922583  6583 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 13. Current term is 14. Ops: []
I20260620 13:58:08.865965  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.923460  5958 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
W20260620 13:58:08.795674  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 126641us
I20260620 13:58:08.868461  6031 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
W20260620 13:58:08.786002  5777 rpcz_store.cc:269] 0620 13:57:43.861878 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:43.862373 (+   495us) service_pool.cc:224] Handling call
0620 13:58:08.730391 (+24868018us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:58:05.088900 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:58:05.089778 (+   878us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:58:05.089848 (+    70us) write_op.cc:435] Acquired schema lock
0620 13:58:05.089884 (+    36us) tablet.cc:662] Decoding operations
0620 13:58:05.090653 (+   769us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:58:05.090782 (+   129us) write_op.cc:641] Partition lock acquired for write op
0620 13:58:05.090821 (+    39us) tablet.cc:685] Acquiring locks for 3 operations
0620 13:58:05.208749 (+117928us) tablet.cc:701] Row locks acquired
0620 13:58:05.219785 (+ 11036us) write_op.cc:260] PREPARE: finished
0620 13:58:05.246964 (+ 27179us) write_op.cc:270] Start()
0620 13:58:05.301066 (+ 54102us) write_op.cc:276] Timestamp: P: 1781963885227860 usec, L: 0
0620 13:58:05.336018 (+ 34952us) op_driver.cc:348] REPLICATION: starting
0620 13:58:05.463704 (+127686us) log.cc:844] Serialized 1308 byte log entry
0620 13:58:06.070565 (+606861us) op_driver.cc:464] REPLICATION: finished
0620 13:58:06.754691 (+684126us) write_op.cc:301] APPLY: starting
0620 13:58:06.766900 (+ 12209us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:07.030214 (+263314us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:07.030367 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:07.143166 (+112799us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:07.143449 (+   283us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0620 13:58:07.143515 (+    66us) write_op.cc:312] APPLY: finished
0620 13:58:07.143828 (+   313us) log.cc:844] Serialized 41 byte log entry
0620 13:58:07.248411 (+104583us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:07.258342 (+  9931us) write_op.cc:454] Released schema lock
0620 13:58:07.274426 (+ 16084us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:07.287922 (+ 13496us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:07.287956 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87150,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":618181,"apply.run_cpu_time_us":33632,"apply.run_wall_time_us":541377,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16679,"num_ops":3,"prepare.queue_time_us":297474,"prepare.run_cpu_time_us":11755,"prepare.run_wall_time_us":512789,"raft.queue_time_us":180876,"raft.run_cpu_time_us":44801,"raft.run_wall_time_us":589911,"replication_time_us":696806,"thread_start_us":785695,"threads_started":5,"wal-append.queue_time_us":364025,"wal-append.run_cpu_time_us":35619,"wal-append.run_wall_time_us":2270110}]]}
I20260620 13:58:08.925021  5848 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.926113  5849 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.887900  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:08.889317  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:08.890157  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:08.928627  6585 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:08.846220 11488 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:08.928872  6579 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 10.
I20260620 13:58:08.895381  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:08.903807  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:08.930646  6580 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 17
I20260620 13:58:08.930794  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.901121  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:08.931824  5924 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:58:08.917145  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:08.932780  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.886716  6582 raft_consensus.cc:1275] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260620 13:58:08.927534  5951 raft_consensus.cc:1217] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 9.6->[12.7-16.9]   Dedup: 12.7->[14.8-16.9]
I20260620 13:58:08.928679  6586 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:08.923041  5998 leader_election.cc:336] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.872406 11605 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260620 13:58:08.850987  5779 catalog_manager.cc:5696] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
W20260620 13:58:08.934643  5998 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.933648  5951 pending_rounds.cc:85] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 7
W20260620 13:58:08.938540  5924 leader_election.cc:336] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:08.935873  5998 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:08.939888  5951 pending_rounds.cc:107] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260620 13:58:08.947227  5951 raft_consensus.cc:2889] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:08.945904  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a351afb91f46e2b6e724165bc600c1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:08.915911 11499 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:08.952929  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:08.947247  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.949234  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:08.949306  5848 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:08.953698  6583 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 14: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:08.916780 11414 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:08.951295  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 50264.6us
I20260620 13:58:08.960783  6586 raft_consensus.cc:2410] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260620 13:58:08.961845  5998 leader_election.cc:336] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:08.963443  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:08.964545  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.968216  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:08.968822  6586 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:08.970888  5924 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:08.974123  5779 catalog_manager.cc:5696] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 9 to 12, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 12 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:08.953063 11708 log.cc:927] Time spent T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260620 13:58:08.946102 11686 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:08.997987  6585 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:08.935712 11564 raft_consensus.cc:697] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:08.978605  5779 catalog_manager.cc:5696] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:08.919329 11257 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:09.001261  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 44931us
I20260620 13:58:08.959931 11487 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:09.004879  6578 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260620 13:58:08.971992 11507 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:58:08.972470 11529 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260620 13:58:08.966744 11675 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:09.007072  6586 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 11.
I20260620 13:58:09.020236  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:08.976645 11707 raft_consensus.cc:2764] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260620 13:58:09.038242  6032 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 16: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:58:09.029458  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 54154.1us
W20260620 13:58:09.046154  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 120139us
I20260620 13:58:09.048002  5849 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.004241 11622 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 21 FOLLOWER]: Leader election won for term 21
I20260620 13:58:08.979329 11608 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:58:09.028322  5779 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 14 to 16, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 16 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:58:09.029460  5999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:09.048056  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.049336  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:08.965318 11499 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:09.065157  5779 catalog_manager.cc:5696] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 12 to 13, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 13 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:09.028327 11686 raft_consensus.cc:697] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:09.006951 11696 consensus_queue.cc:1048] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.053s
I20260620 13:58:08.973744 11414 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.007314 11633 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260620 13:58:09.067626 11717 log.cc:927] Time spent T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260620 13:58:09.065296 11541 raft_consensus.cc:3055] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 18 LEADER]: Stepping down as leader of term 18
W20260620 13:58:09.089953  5923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:09.064136 11622 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 21 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:09.069216 11608 raft_consensus.cc:697] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:09.084188  5779 catalog_manager.cc:5696] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 10 to 13, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 13 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
W20260620 13:58:09.108207 11715 log.cc:927] Time spent T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
I20260620 13:58:09.115790 11564 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.125852 11221 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:09.126929 11686 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.130452 11551 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.131927 11257 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.086232 11633 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:09.132644 11633 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
W20260620 13:58:09.139053 11711 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260620 13:58:09.141273 11712 log.cc:927] Time spent T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260620 13:58:09.091434 11404 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.092291 11541 raft_consensus.cc:740] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:09.144462 11541 consensus_queue.cc:260] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.145766 11541 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:09.148433 11608 consensus_queue.cc:237] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.152074 11488 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:09.151722 11622 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.152599 11488 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:09.161314  5779 catalog_manager.cc:5696] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } } }
W20260620 13:58:09.181183  4719 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:09.190153 11633 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.194976  5779 catalog_manager.cc:5696] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 11 to 14, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 14 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:09.154907 11488 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.192781 11612 raft_consensus.cc:493] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:09.207495  5779 catalog_manager.cc:5696] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 9 to 10, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 10 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
W20260620 13:58:09.201653  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 156285us
I20260620 13:58:09.202666 11414 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.051038  6580 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
W20260620 13:58:09.213491  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 264247us
I20260620 13:58:09.214126  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.216292  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:09.210139 11612 raft_consensus.cc:515] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.222491 11499 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.225207  5779 catalog_manager.cc:5696] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:09.228963 11414 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:58:09.229895  5848 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:09.236712 11488 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260620 13:58:09.237555  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 189614us
I20260620 13:58:09.236812 11633 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:09.020987  6552 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.261812  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:09.262771  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 298473us
W20260620 13:58:09.263707  5998 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:09.261462  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 240500us
I20260620 13:58:09.275338 11612 leader_election.cc:290] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.264156  5998 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.245292  5953 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
W20260620 13:58:09.255309  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 284520us
I20260620 13:58:09.281445  5848 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:09.282315  5924 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:09.263880  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 50777us
I20260620 13:58:09.288148  5848 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:09.293354  5924 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.295239  5779 catalog_manager.cc:5696] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 8 to 13, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 13 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:09.297549 11507 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:09.298303 11507 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:09.264009 11722 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:58:09.300372 11722 raft_consensus.cc:697] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:09.300628 11622 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:09.301519 11722 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.298617  5779 catalog_manager.cc:5696] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 11 to 13, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 13 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:58:09.303155 11523 consensus_queue.cc:1059] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260620 13:58:09.305446 11523 raft_consensus.cc:3055] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 13:58:09.305864 11523 raft_consensus.cc:740] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:09.304680  5779 catalog_manager.cc:5696] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 10 to 13, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 13 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:09.263768 11404 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.308560 11304 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260620 13:58:09.309198 11721 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:09.308434 11404 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.312398 11404 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.298870 11507 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.322952 11507 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.328310  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:09.325031  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 61351.2us
I20260620 13:58:09.330125  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.331764  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.334558 11488 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:58:09.332755  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:09.326355  5779 catalog_manager.cc:5696] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 7 to 10, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 10 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:09.339311  5957 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260620 13:58:09.340415  6550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:09.306692 11523 consensus_queue.cc:260] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.335134 11488 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:09.339818  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:09.343063 11488 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.345328  5779 catalog_manager.cc:5696] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:09.347121 11523 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:09.347291  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:09.347389  5998 leader_election.cc:336] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:09.348605  5998 leader_election.cc:336] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.349452 11414 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260620 13:58:09.349767  5998 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.350183  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.350864 11304 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260620 13:58:09.352165  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 68895.5us
I20260620 13:58:09.352849  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.353433  5957 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 18.
I20260620 13:58:09.354269  6580 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260620 13:58:09.354689  6580 pending_rounds.cc:85] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Aborting all ops after (but not including) 9
I20260620 13:58:09.354935  6580 pending_rounds.cc:107] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260620 13:58:09.355244  6580 raft_consensus.cc:2889] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260620 13:58:09.351217  5998 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.360718  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.325784 11507 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.353433  5849 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:09.361820  5998 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:09.365130  5998 leader_election.cc:336] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.365518  5998 leader_election.cc:304] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.358021  5848 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:58:09.367146  5849 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.378657  5953 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
I20260620 13:58:09.387496  5779 catalog_manager.cc:5696] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 10 to 11, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 11 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:58:09.390010  5957 raft_consensus.cc:1240] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 13. Current term is 14. Ops: [11.9-13.10]
W20260620 13:58:09.370023  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:09.363348 11564 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:58:09.401419  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.388388 11541 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:09.398775  6033 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260620 13:58:09.394730 11662 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:58:09.404312  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:09.405622  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.369403 11633 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:58:09.389217 11612 raft_consensus.cc:2749] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:09.389864 11507 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260620 13:58:09.410145  5954 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:09.390537 11608 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260620 13:58:09.410356  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 144642us
I20260620 13:58:09.412184  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:09.412593  6552 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:09.413499  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:09.414536  6032 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260620 13:58:09.375741 11551 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.423677  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.422289  6551 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:09.410475 11507 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:58:09.424079  6552 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.399760 11487 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260620 13:58:09.430048  6587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:09.431033  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:09.435009  6578 raft_consensus.cc:2410] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260620 13:58:09.428426 11507 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:09.432523  6586 raft_consensus.cc:1275] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260620 13:58:09.433425  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:09.436995  6580 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 16: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:09.442206  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:09.442845  6585 raft_consensus.cc:2468] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:09.444211  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:09.444777  6585 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 18.
I20260620 13:58:09.449082  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.422821 11551 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.475765  6583 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:58:09.475198  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.510133  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:09.516374  6033 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 15.
I20260620 13:58:09.516494  6581 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:58:09.483068  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.451936  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:09.518364  6582 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:58:09.435952 11686 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:09.480561  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:09.529336  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 48875.8us
I20260620 13:58:09.482575  6029 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260620 13:58:09.472708 11520 consensus_queue.cc:1048] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
W20260620 13:58:09.448045  6552 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.534003  5849 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:09.490075 11727 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260620 13:58:09.539529  6552 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:09.545115  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 97590.3us
I20260620 13:58:09.490193 11602 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.451690 11414 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.560349 11414 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:09.481760 11528 consensus_queue.cc:1048] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260620 13:58:09.564301 11551 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.564752  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.438788 11608 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.553062  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:09.542757  5954 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 18.
I20260620 13:58:09.539050 11604 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:09.546887 11662 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:09.545475 11686 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.556344  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:09.480746 11631 consensus_queue.cc:1048] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260620 13:58:09.567423  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:09.581192  6585 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:09.459329  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:09.452322  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c27735bbb449a98fab7edad2ba9837" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:09.569286 11488 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:09.569392  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:09.570158 11414 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.597936  5998 leader_election.cc:304] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.568554  5849 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:09.439474 11525 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:09.575578  6581 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:09.547860 11257 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260620 13:58:09.593403  6585 raft_consensus.cc:2468] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 17.
I20260620 13:58:09.600729  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.603049  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.606477  6033 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:58:09.612020  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:09.616281  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.616849  6032 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 14: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:58:09.595939 11142 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.604674 11622 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:09.632879  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d483a507ec73494da65730a6444e1fd6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.573566 11602 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.620831 11525 raft_consensus.cc:697] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:09.608633 11471 raft_consensus.cc:2749] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:09.621671  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 53186.8us
I20260620 13:58:09.646622  5849 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:09.656095  6581 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:58:09.660734  5997 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:09.661695  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:09.662961  5849 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:09.674060  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:09.579352 11608 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.630198 11523 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:09.689812  5998 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 113 similar messages]
I20260620 13:58:09.697305  6024 raft_consensus.cc:1275] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260620 13:58:09.716981  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:09.727783 11738 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260620 13:58:09.723562 11711 log.cc:927] Time spent T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260620 13:58:09.729753 11686 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.667255 11414 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:09.731703 11414 raft_consensus.cc:2804] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:09.732175 11414 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:09.732607 11414 raft_consensus.cc:3060] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:09.699378 11633 raft_consensus.cc:2804] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election won for term 18
I20260620 13:58:09.735702 11633 raft_consensus.cc:697] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 18 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:09.736836 11633 consensus_queue.cc:237] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.665002 11404 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:09.686527 11487 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:09.686429 11721 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.633687 11142 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.697299 11687 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:09.666958 11605 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260620 13:58:09.692236 11499 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260620 13:58:09.661497 11622 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.756419 11487 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:58:09.768612  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 165635us
W20260620 13:58:09.773273  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 56430.7us
I20260620 13:58:09.773365 11487 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:09.761759 11721 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.766314 11687 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.807647  6025 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260620 13:58:09.809384  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.815227  5849 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:09.816444  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.817262  6030 raft_consensus.cc:2393] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:09.818234  6025 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260620 13:58:09.823714 11499 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:09.824951 11608 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.828011  6552 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:09.830335 11563 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:09.834277  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:58:09.836941 11563 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:09.771142 11525 consensus_queue.cc:237] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.837350 11563 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:09.837911 11563 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:09.837352 11602 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.842693 11687 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.843505 11686 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260620 13:58:09.844353 11721 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:09.845239 11737 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260620 13:58:09.845649 11142 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.847252 11563 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.847862 11622 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.849411 11563 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.853892 11605 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:09.854620 11605 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:09.791831 11662 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260620 13:58:09.857228 11605 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.896987  6582 raft_consensus.cc:1240] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Rejecting Update request from peer 192c750f597c43858e1ad09e8d805685 for earlier term 15. Current term is 16. Ops: []
I20260620 13:58:09.864166 11488 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:09.899044  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:09.902520  6582 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
I20260620 13:58:09.900596  6581 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Advancing to term 21
I20260620 13:58:09.907601 11487 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.910127 11487 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.910768  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:09.911199  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:09.911530  6030 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:58:09.911787  6028 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:09.912431 11507 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.908032 11723 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:58:09.918216  6552 leader_election.cc:336] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.914695 11507 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:09.939159  6552 leader_election.cc:336] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.939718  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:09.940971  6552 leader_election.cc:336] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.939580  6028 raft_consensus.cc:2468] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 16.
I20260620 13:58:09.946128  6581 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260620 13:58:09.942122  6552 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:09.954603  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:09.958212  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 318360us
W20260620 13:58:09.955752  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 135350us
I20260620 13:58:09.961833  5956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:09.962633  5956 raft_consensus.cc:2393] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 13: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:58:09.964133  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:09.915619 11488 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:09.974324 11488 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:09.953085 11752 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:58:09.920173 11487 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:09.975310 11414 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.975968 11487 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:09.977483 11414 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.977908 11487 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:09.953717 11723 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:09.981228 11723 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:10.017108  5998 leader_election.cc:336] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.017818  5998 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.018775  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:10.022138  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 80034.1us
W20260620 13:58:10.023494  6552 leader_election.cc:336] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.024063  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.022907 11257 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.022818 11612 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260620 13:58:10.031876 11687 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260620 13:58:10.029825 11752 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:10.043530  6033 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260620 13:58:10.044461 11723 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:10.045040 11723 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:10.050148  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.050593  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.051692  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.052685  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.054579  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.055684  5955 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:10.059021  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:10.061865  5998 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.062472  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.027822 11257 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.064178  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.065683  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:10.067454  5955 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:10.068461  5953 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260620 13:58:10.069537  5924 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.073388  6552 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:10.076305 11564 raft_consensus.cc:2764] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260620 13:58:10.081151 11754 raft_consensus.cc:2804] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:58:10.081422  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.076478 11752 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:10.084499 11752 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:10.084908 11752 raft_consensus.cc:3060] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:10.085484 11687 consensus_queue.cc:1048] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:10.086373 11556 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260620 13:58:10.086493 11754 raft_consensus.cc:697] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:10.094269  6578 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260620 13:58:10.095806  6552 leader_election.cc:336] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.097602  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.060060 11723 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:10.099596  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:10.101226  6552 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.101823  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:10.108062  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:10.111092  6578 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260620 13:58:10.112880  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.058979 11622 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260620 13:58:10.115061  5955 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 19.
I20260620 13:58:10.119544  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.121659  6578 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 13.
I20260620 13:58:10.125195  5848 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:58:10.129599 11487 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:10.130029 11487 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:10.130363 11487 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:10.131431 11751 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:10.131970 11751 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:10.133034 11414 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:10.133996 11751 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:10.140390  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.143219 11754 consensus_queue.cc:237] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.120962 11748 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260620 13:58:10.122205 11564 consensus_queue.cc:1059] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260620 13:58:10.149494 11564 raft_consensus.cc:3055] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Stepping down as leader of term 15
I20260620 13:58:10.149976 11564 raft_consensus.cc:740] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:10.150672 11257 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:10.150873 11564 consensus_queue.cc:260] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.116416 11760 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260620 13:58:10.116132 11722 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:10.118350 11723 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260620 13:58:10.154632 11722 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:58:10.155349 11723 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:10.155849 11723 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Advancing to term 11
I20260620 13:58:10.158908  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.159789  6028 raft_consensus.cc:2393] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 11: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:10.160602  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:10.161478  6024 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260620 13:58:10.162191  5998 leader_election.cc:336] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.164755  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:10.166553  6578 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 16
I20260620 13:58:10.170919  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:10.171573  6025 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260620 13:58:10.175693  6585 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:10.157426 11722 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:10.174706  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.177289  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:10.186002  6032 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:10.186810  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.171485  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:10.181701  4719 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:10.165509 11721 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.189446  6586 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260620 13:58:10.190613  6583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:10.192379  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.194733 11722 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260620 13:58:10.203516  6551 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.204353 11707 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:10.194733 11721 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.193873 11564 raft_consensus.cc:3060] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:10.207798 11721 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:10.210738  6578 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:10.212658 11721 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.215879 11721 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.217473 11752 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.217949 11721 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:10.218251  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 91473.1us
I20260620 13:58:10.218510 11721 raft_consensus.cc:493] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.218951 11721 raft_consensus.cc:515] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.221289 11721 leader_election.cc:290] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:10.222247  5998 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:10.225064  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 52119.1us
I20260620 13:58:10.225905  6585 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 19.
I20260620 13:58:10.239882  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.240576  5959 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
I20260620 13:58:10.243285  6032 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:10.246809  5849 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.246923  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.249502  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.249815  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.251644  5848 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:58:10.255309  5849 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.263262  5849 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.270781 11499 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Leader election won for term 19
I20260620 13:58:10.280145  5951 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260620 13:58:10.270977 11541 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:10.280756  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.282346  5849 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.282680 11608 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:10.283288 11722 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:10.283540 11608 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:10.245944 11622 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260620 13:58:10.288825 11499 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 19 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:10.291414 11541 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.251472 11721 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260620 13:58:10.268294 11753 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:10.278788  5924 leader_election.cc:336] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.316632  5924 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.306492  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.319615  5848 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.319890  6032 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 16: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:10.274426 11751 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
W20260620 13:58:10.332724  5924 leader_election.cc:336] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.340891 11633 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:10.341701 11633 consensus_queue.cc:1243] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Peer 192c750f597c43858e1ad09e8d805685 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260620 13:58:10.343998 11722 raft_consensus.cc:493] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:10.344578 11722 raft_consensus.cc:515] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.346686 11722 leader_election.cc:290] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:10.347744  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
W20260620 13:58:10.352972  6552 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.356472  5951 pending_rounds.cc:85] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 10
I20260620 13:58:10.356948  5951 pending_rounds.cc:107] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260620 13:58:10.357358  5951 raft_consensus.cc:2889] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:10.360497  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.367177 11499 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.372990 11564 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:10.329677 11753 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260620 13:58:10.319825 11723 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.310447 11541 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.377918 11723 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:10.378700 11541 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:10.327040 11745 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:10.374796 11487 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.399333  6029 raft_consensus.cc:2468] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 13.
W20260620 13:58:10.422844  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 140557us
I20260620 13:58:10.428923  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.443285  6579 raft_consensus.cc:3060] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:10.447896  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:10.448704  5959 raft_consensus.cc:2393] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 13: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:58:10.450858  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.411454 11754 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:10.452224  5849 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:10.422492 11541 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:10.481299  6551 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:10.482513  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.481333  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020dbb4b944d4deeba944d1a7c6d5c76" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.474872  6579 raft_consensus.cc:1275] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260620 13:58:10.484220 11709 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260620 13:58:10.484624 11709 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:10.485013 11709 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:10.475880 11754 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.490336 11754 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:10.493399 11774 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260620 13:58:10.493135 11709 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.502856  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.503767  6581 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 16: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:10.453166 11605 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260620 13:58:10.464968 11757 raft_consensus.cc:3060] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Advancing to term 11
W20260620 13:58:10.508761  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 176071us
I20260620 13:58:10.509588  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:10.514518  5924 leader_election.cc:336] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.515225  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.435920 11721 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260620 13:58:10.477015 11487 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:10.504938 11608 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:58:10.513615 11435 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:58:10.527576  5924 leader_election.cc:336] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.479072 11541 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:10.539398  5924 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.520361 11745 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:10.556202  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.557080  6030 raft_consensus.cc:2393] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 19: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:10.527647 11709 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:10.569430  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 54079.7us
I20260620 13:58:10.544799 11487 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.545694 11608 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 16 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:10.592754  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:10.593511  6030 raft_consensus.cc:2393] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 11: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:10.573782 11686 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:10.574795 11752 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:10.639065  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.640456  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:10.641014  5959 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Advancing to term 14
I20260620 13:58:10.592480 11487 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.661849  5959 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
W20260620 13:58:10.675257  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 104845us
I20260620 13:58:10.678346  5848 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
W20260620 13:58:10.682319  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 122129us
I20260620 13:58:10.683138  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:10.683409  6552 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:58:10.684262  5959 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 14: Already voted for candidate 2e82c0c231624695ac5a813230bf5038 in this term.
I20260620 13:58:10.688714  5955 raft_consensus.cc:1275] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260620 13:58:10.686172 11757 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:10.688946 11721 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 13:58:10.694116 11707 raft_consensus.cc:2804] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:58:10.709112 11487 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:10.677537 11608 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:10.723752 11785 log.cc:927] Time spent T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260620 13:58:10.728191 11541 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:10.711946 11721 raft_consensus.cc:697] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:10.730432 11721 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.713318 11707 raft_consensus.cc:697] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:10.756870 11707 consensus_queue.cc:237] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.782897  5849 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.815129  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.816622  5849 leader_election.cc:304] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:10.828194  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.823711 11722 raft_consensus.cc:2749] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:10.833923  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:10.830819  6033 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 19.
I20260620 13:58:10.825636 11563 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.827091 11605 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:10.823953 11662 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:10.842905  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8078a89b618482f8e4978c463747569" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.843315  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:10.846592  6579 raft_consensus.cc:2393] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 14: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:10.855880  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.859723  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:10.860380  6580 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 18.
I20260620 13:58:10.840821 11753 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.874881 11404 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:10.875396 11791 log.cc:927] Time spent T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.165s	user 0.003s	sys 0.002s
I20260620 13:58:10.896629  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.848030 11563 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.888489 11142 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:10.889111 11404 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:10.871032 11753 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:10.926421  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:10.940269 11404 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:10.958554  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.959606 11523 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.960261 11523 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:10.961582 11779 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:10.962302 11779 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:10.974699  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:10.977993  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:10.980818  6552 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.981455  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.962848 11523 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:10.987694  6552 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:10.992410  6586 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 11.
W20260620 13:58:10.993476  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:10.918315 11142 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:10.998571  5924 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:10.995028 11798 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:10.994261 11523 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:10.996798 11779 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:11.001466 11748 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader election won for term 11
I20260620 13:58:11.017241  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.017052 11142 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:11.024680 11605 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:11.038532  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.047485 11563 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:11.048513 11753 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:11.027869 11748 raft_consensus.cc:697] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:11.049814 11748 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.008355 11523 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.065424 11523 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:11.066516  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.067282  5952 raft_consensus.cc:2468] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 14.
I20260620 13:58:11.081470 11523 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:11.044195  6552 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:11.103404  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 59240.5us
I20260620 13:58:11.107749  5848 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038; no voters: 
I20260620 13:58:11.111266 11414 raft_consensus.cc:2804] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:11.111721 11414 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:11.112077 11414 raft_consensus.cc:3060] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:11.116497 11488 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:11.117218 11488 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.117570  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.118824  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.119266 11783 raft_consensus.cc:493] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
W20260620 13:58:11.111302  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 431507us
I20260620 13:58:11.121810  5955 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260620 13:58:11.116521  6033 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260620 13:58:11.120211  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.119849 11783 raft_consensus.cc:515] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.127851  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.129618  6029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.137311  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.144035 11798 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260620 13:58:11.159229 11710 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260620 13:58:11.160569 11633 consensus_queue.cc:1048] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:11.160677 11757 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260620 13:58:11.172701  6551 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:11.177949  5849 leader_election.cc:304] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.180372 11142 raft_consensus.cc:2749] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:11.181674  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:11.183768 11783 leader_election.cc:290] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:11.185105  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 50803.6us
I20260620 13:58:11.185829  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:11.187402 11257 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:11.188602 11257 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:11.189194 11257 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:11.191200  4719 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:11.192588 11257 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:11.097226 11738 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.029s	sys 0.056s
I20260620 13:58:11.196599  5849 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:11.202767  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 19 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.082986 11523 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.213272  5849 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:11.200169 11738 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.029s	sys 0.057s
I20260620 13:58:11.218245  5849 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:11.200619 11541 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260620 13:58:11.227710  5959 raft_consensus.cc:1275] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260620 13:58:11.229126  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14bccd20cc3f44b69eeefefc4f8b72f9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:11.232705  5959 pending_rounds.cc:85] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Aborting all ops after (but not including) 11
I20260620 13:58:11.233186  5959 pending_rounds.cc:107] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260620 13:58:11.233507  5959 raft_consensus.cc:2889] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 13:58:11.230228  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:11.234838 11404 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:11.235268 11802 consensus_queue.cc:1048] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260620 13:58:11.238921 11709 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260620 13:58:11.240216  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f8f8a1b370453aade5f48cd3bedcbd" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 19 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.208947 11753 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:58:11.250237 11815 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038: Append to log took a long time: real 0.130s	user 0.003s	sys 0.000s
I20260620 13:58:11.249245  5959 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260620 13:58:11.232662  5849 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:11.244735 11523 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:11.258800 11721 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:11.225313 11605 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:11.231693 11541 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:11.254802  5849 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:11.265820 11541 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Advancing to term 20
W20260620 13:58:11.305124  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 172557us
I20260620 13:58:11.291406  5849 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.232970 11488 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:11.309661  6551 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:11.311220  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1025714d0b439cb56cc08764cb5fce" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:11.283860 11605 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:11.290271 11757 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:11.312999 11779 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:11.334728  6580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:11.336390  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:11.332000 11757 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:11.338579  5776 catalog_manager.cc:5696] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 13 to 17, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 17 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:11.340818 11757 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:11.340407  5776 catalog_manager.cc:5696] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.343403  6584 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260620 13:58:11.322705 11753 raft_consensus.cc:493] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:11.341997  5776 catalog_manager.cc:5696] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 16 to 17, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 17 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:11.351339  5779 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56610 (request call id 353) took 17523 ms (client timeout 15000 ms). Trace:
I20260620 13:58:11.347980  5776 catalog_manager.cc:5696] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 11 to 13, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 13 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.356412  5959 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260620 13:58:11.356902  5776 catalog_manager.cc:5696] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.358865  5776 catalog_manager.cc:5696] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 10, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 10 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.362273  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.314110 11563 consensus_queue.cc:1048] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260620 13:58:11.369516  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.364898 11788 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260620 13:58:11.352007  5779 rpcz_store.cc:269] 0620 13:57:53.828084 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:57:53.828519 (+   435us) service_pool.cc:224] Handling call
0620 13:57:54.134068 (+305549us) spinlock_profiling.cc:243] Waited 89.3 ms on lock 0x7b540002b7d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf766470 00007f0fdf80531a 00007f0fe55baaac 00007f0fe56b90ae 00007f0fe3b7e4a4 00007f0fe3b7e432 00007f0fe3b7e361 00007f0fe3b7e2dc 00007f0fe3b7d592 00007f0fddb34c3c 00007f0fddb34076
0620 13:57:54.362890 (+228822us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b5400002490. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3e40 00007f0fe55af456 00007f0fe56b996e 00007f0fe3b7e4a4 00007f0fe3b7e432 00007f0fe3b7e361 00007f0fe3b7e2dc 00007f0fe3b7d592 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:11.351241 (+16988351us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:58:09.839159 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:58:09.839735 (+   576us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:58:09.839773 (+    38us) write_op.cc:435] Acquired schema lock
0620 13:58:09.839796 (+    23us) tablet.cc:662] Decoding operations
0620 13:58:09.841384 (+  1588us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:58:09.841441 (+    57us) write_op.cc:641] Partition lock acquired for write op
0620 13:58:09.841472 (+    31us) tablet.cc:685] Acquiring locks for 20 operations
0620 13:58:09.972473 (+131001us) tablet.cc:701] Row locks acquired
0620 13:58:09.972495 (+    22us) write_op.cc:260] PREPARE: finished
0620 13:58:09.972641 (+   146us) write_op.cc:270] Start()
0620 13:58:09.972763 (+   122us) write_op.cc:276] Timestamp: P: 1781963889972594 usec, L: 0
0620 13:58:09.972785 (+    22us) op_driver.cc:348] REPLICATION: starting
0620 13:58:09.973501 (+   716us) log.cc:844] Serialized 7922 byte log entry
0620 13:58:10.531029 (+557528us) op_driver.cc:464] REPLICATION: finished
0620 13:58:10.744511 (+213482us) write_op.cc:301] APPLY: starting
0620 13:58:10.744621 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:10.955086 (+210465us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:10.975915 (+ 20829us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:11.074341 (+ 98426us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:11.074725 (+   384us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0620 13:58:11.074793 (+    68us) write_op.cc:312] APPLY: finished
0620 13:58:11.075376 (+   583us) log.cc:844] Serialized 180 byte log entry
0620 13:58:11.076383 (+  1007us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:11.076642 (+   259us) write_op.cc:454] Released schema lock
0620 13:58:11.076718 (+    76us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:11.077422 (+   704us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:11.077464 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9782,"reported_tablets":46,"spinlock_wait_cycles":248017536,"child_traces":[["op",{"apply.queue_time_us":204944,"apply.run_cpu_time_us":30992,"apply.run_wall_time_us":332861,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87807,"num_ops":20,"prepare.queue_time_us":328381,"prepare.run_cpu_time_us":24128,"prepare.run_wall_time_us":310608,"raft.queue_time_us":261162,"raft.run_cpu_time_us":13099,"raft.run_wall_time_us":186297,"replication_time_us":547592,"thread_start_us":609018,"threads_started":4,"wal-append.queue_time_us":196961}]]}
I20260620 13:58:11.361027  5776 catalog_manager.cc:5696] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:58:11.390373  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 66980us
I20260620 13:58:11.330755 11709 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260620 13:58:11.394122  5776 catalog_manager.cc:5696] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 14, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.396494  5776 catalog_manager.cc:5696] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 14, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:58:11.412389  5848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 49942.7us
I20260620 13:58:11.414594 11499 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260620 13:58:11.426199  5849 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.427986 11507 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:11.363032 11753 raft_consensus.cc:515] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.430781  5849 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.398963  5776 catalog_manager.cc:5696] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.435619 11507 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:11.438268 11507 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260620 13:58:11.439922  5849 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.442564  6032 raft_consensus.cc:1275] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260620 13:58:11.450857  6032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.451728  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:11.433346  5776 catalog_manager.cc:5696] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 15 to 18, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 18 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:11.454396  5776 catalog_manager.cc:5696] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:58:11.464397  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:11.487149  5924 leader_election.cc:336] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:11.496109  5924 leader_election.cc:304] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.452142 11783 raft_consensus.cc:493] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:11.452315 11662 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:11.511314 11783 raft_consensus.cc:515] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.444118 11414 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:11.513602 11783 leader_election.cc:290] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:11.514213 11824 log.cc:927] Time spent T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260620 13:58:11.514524 11414 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:11.487727  5776 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 19 to 20, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 20 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:11.501698 11257 consensus_queue.cc:1048] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260620 13:58:11.502380 11753 leader_election.cc:290] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:11.503461  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:11.503834 11748 raft_consensus.cc:2749] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:58:11.505203  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 61871.7us
I20260620 13:58:11.519345  5776 catalog_manager.cc:5696] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 15 to 18, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 18 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.524394 11753 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:11.523874  5776 catalog_manager.cc:5696] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 11 to 12, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 12 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:11.543248  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:11.537412  5776 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 14, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 14 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:11.549039  6586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:11.545926  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:11.557871  5776 catalog_manager.cc:5696] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.561419  5776 catalog_manager.cc:5696] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:11.563925  6585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd646f84cb04514aa9889ea5f67db81" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:11.564429  6581 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260620 13:58:11.568809  5776 catalog_manager.cc:5696] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.571636  5776 catalog_manager.cc:5696] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 13 to 15, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 15 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:11.578022  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 92892.1us
I20260620 13:58:11.573351  5776 catalog_manager.cc:5696] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: config changed from index 10 to 14, b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:11.593550  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:11.597416  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:11.597472  5776 catalog_manager.cc:5696] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.600878  6582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bab45d487c864870aba1aee58d01ca95" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:11.601841  5776 catalog_manager.cc:5696] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 7 to 9, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 9 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:11.617473  5776 catalog_manager.cc:5696] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:11.619437  5776 catalog_manager.cc:5696] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:11.622141  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 48573.1us
I20260620 13:58:11.642783  5849 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.644047 11605 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:58:11.663478  5849 leader_election.cc:304] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.667711 11605 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
W20260620 13:58:11.679224  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 61473.1us
I20260620 13:58:11.680498  5924 leader_election.cc:304] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:11.676913 11753 raft_consensus.cc:2749] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:11.807435  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 121748us
I20260620 13:58:11.690482 11745 raft_consensus.cc:2749] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:11.846750 11812 log.cc:927] Time spent T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.153s	user 0.011s	sys 0.003s
I20260620 13:58:11.848706 11707 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:11.849056 11826 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
I20260620 13:58:11.849292 11707 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:11.861115 11541 consensus_meta.cc:287] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: Time spent flushing consensus metadata: real 0.551s	user 0.002s	sys 0.006s
I20260620 13:58:11.861616 11541 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:11.885342  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:11.886966  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:11.901816  6552 leader_election.cc:336] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:11.908454 11707 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:11.951547 11541 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 20 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:11.931200 11605 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:11.953076 11605 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:11.971655  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:11.989478 11612 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:11.992985 11612 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:11.996407 11841 log.cc:927] Time spent T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260620 13:58:12.007139 11848 raft_consensus.cc:493] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:12.007743 11848 raft_consensus.cc:515] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:12.009651  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:12.010238  6033 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:58:12.022439  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.023329  6025 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 16.
I20260620 13:58:12.035745  6033 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 20.
I20260620 13:58:12.028956 11612 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:12.084520 11819 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:12.085371 11819 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:12.094116 11435 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:12.095053 11435 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.097992 11435 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:12.191701  4719 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:12.215674 11757 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:12.259449 11848 leader_election.cc:290] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.254572 11757 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:12.262135 11757 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.264060 11819 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:12.302507 11839 log.cc:927] Time spent T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.446s	user 0.009s	sys 0.012s
I20260620 13:58:12.331475  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.338171  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.343057 11802 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:12.343731 11802 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.350992 11854 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:12.363231 11854 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.367659 11854 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.368309 11605 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.369025 11802 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.369266  6033 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260620 13:58:12.374004  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.376403  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.378422  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.378685  6579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:12.379779  6579 raft_consensus.cc:2410] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260620 13:58:12.381045  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:12.396916 11834 log.cc:927] Time spent T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.541s	user 0.005s	sys 0.009s
I20260620 13:58:12.398515  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.403643  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:12.408154  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 435444us
W20260620 13:58:12.408500 11835 log.cc:927] Time spent T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: Append to log took a long time: real 0.479s	user 0.019s	sys 0.000s
I20260620 13:58:12.420688  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.421361  6027 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:58:12.422240  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08f835b507484456a3c708ba0e6fb982" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.427516 11748 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
W20260620 13:58:12.439411 11832 log.cc:927] Time spent T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.588s	user 0.000s	sys 0.015s
I20260620 13:58:12.445056  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:12.445845  6578 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:58:12.453513  6031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53823dabce64d5284772ca73d71ddc9" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:12.453617  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 90262.2us
I20260620 13:58:12.454780  6030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.459088  6028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.459475  5997 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:12.460911  6580 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260620 13:58:12.470222  6578 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 20.
I20260620 13:58:12.430859 11793 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:12.476395  5997 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:12.457567 11760 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:12.479861 11760 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.482045 11760 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.483664 11793 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.485893 11793 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.491197 11844 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:12.492674  5849 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:12.499560 11608 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 20 FOLLOWER]: Leader election won for term 20
I20260620 13:58:12.500087 11608 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 20 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:12.500952 11608 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.511149 11631 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:12.541392  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:12.560422 11803 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:12.560993 11803 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:12.561533 11803 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
W20260620 13:58:12.561040  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 129679us
I20260620 13:58:12.572261  5849 leader_election.cc:304] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.575726 11541 raft_consensus.cc:2749] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:12.577453  5849 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.583720 11753 raft_consensus.cc:493] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:12.584367 11753 raft_consensus.cc:515] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.587908 11608 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:12.588001  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:12.588917 11709 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:12.589320 11709 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:12.589681 11709 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:12.590786  5849 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.589848 11753 leader_election.cc:290] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:12.573716  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:12.600224 11608 raft_consensus.cc:2749] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:12.604763  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.629086  6552 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:12.631502  5924 leader_election.cc:336] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:12.632025  5924 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.632830 11842 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:12.631191 11803 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.648336 11793 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:12.648860  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.649668 11709 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.650036  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.651124 11803 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.661331  6582 raft_consensus.cc:1240] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Rejecting Update request from peer 2e82c0c231624695ac5a813230bf5038 for earlier term 15. Current term is 16. Ops: []
I20260620 13:58:12.661620  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b06407c45954213adfef7604a8c4f21" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:12.666852  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51294.8us
W20260620 13:58:12.673609  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:12.674934 11709 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.681586  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:12.682459  6024 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:12.688405  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:12.691759 11753 consensus_queue.cc:1059] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:12.692952 11608 raft_consensus.cc:3055] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Stepping down as leader of term 15
I20260620 13:58:12.693315 11608 raft_consensus.cc:740] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:12.694057 11608 consensus_queue.cc:260] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.695569 11605 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:12.696084 11605 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:12.697996 11605 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:12.701700  5849 leader_election.cc:304] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:12.702729 11605 raft_consensus.cc:2749] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:12.709946  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.710390 11608 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:12.726050 11819 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:12.727495  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.737861  6024 raft_consensus.cc:2468] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 17.
I20260620 13:58:12.751247  5849 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.748616  6552 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:12.752868 11605 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:12.764030  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:12.756762 11851 raft_consensus.cc:2804] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election won for term 17
W20260620 13:58:12.769371  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:12.770519  6552 leader_election.cc:336] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:12.772202  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:12.772826  6552 leader_election.cc:336] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:12.773129  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.777668 11851 raft_consensus.cc:697] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 17 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:58:12.786291  6552 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:12.786849  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.787665 11710 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:12.764308 11753 raft_consensus.cc:493] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:12.791450  6552 leader_election.cc:336] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:12.789901 11798 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:58:12.779237 11851 consensus_queue.cc:237] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.794276 11753 raft_consensus.cc:515] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:12.803318 11753 leader_election.cc:290] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:12.806355  6552 leader_election.cc:336] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:12.807202  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 62919us
I20260620 13:58:12.825776  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:12.806545  5776 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47386 (request call id 237) took 3361 ms. Trace:
I20260620 13:58:12.832472  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:12.833714  6581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c812d18f2bb4da29c562646eb81deb1" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:12.834066  5777 catalog_manager.cc:5696] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.838654  5777 catalog_manager.cc:5696] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 12 to 14, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 14 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:12.841444  5849 leader_election.cc:304] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:12.843755  5777 catalog_manager.cc:5696] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 13 to 14, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 14 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.846251  5777 catalog_manager.cc:5696] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.848011  5777 catalog_manager.cc:5696] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 12 to 15, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 15 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.849977  5777 catalog_manager.cc:5696] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 13 to 14, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 14 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.838897 11803 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260620 13:58:12.851931  5777 catalog_manager.cc:5696] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.830760  5776 rpcz_store.cc:276] 0620 13:58:09.432969 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:09.472923 (+ 39954us) service_pool.cc:224] Handling call
0620 13:58:12.794325 (+3321402us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:58:11.959610 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:58:11.960193 (+   583us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:58:11.960233 (+    40us) write_op.cc:435] Acquired schema lock
0620 13:58:11.960264 (+    31us) tablet.cc:662] Decoding operations
0620 13:58:11.962136 (+  1872us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:58:11.962209 (+    73us) write_op.cc:641] Partition lock acquired for write op
0620 13:58:11.962244 (+    35us) tablet.cc:685] Acquiring locks for 25 operations
0620 13:58:12.021554 (+ 59310us) tablet.cc:701] Row locks acquired
0620 13:58:12.021582 (+    28us) write_op.cc:260] PREPARE: finished
0620 13:58:12.021770 (+   188us) write_op.cc:270] Start()
0620 13:58:12.021924 (+   154us) write_op.cc:276] Timestamp: P: 1781963892021711 usec, L: 0
0620 13:58:12.021954 (+    30us) op_driver.cc:348] REPLICATION: starting
0620 13:58:12.077567 (+ 55613us) log.cc:844] Serialized 9788 byte log entry
0620 13:58:12.303032 (+225465us) op_driver.cc:464] REPLICATION: finished
0620 13:58:12.352050 (+ 49018us) write_op.cc:301] APPLY: starting
0620 13:58:12.352129 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:12.400096 (+ 47967us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b540002b7d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf765951 00007f0fdf7f8208 00007f0fe3234401 00007f0fe3233bd8 00007f0fe3238871 00007f0fe3238829 00007f0fe32387b9 00007f0fe3238781 00007f0fe32379ad 0000000000389354 0000000000389199
0620 13:58:12.512984 (+112888us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:12.513015 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:12.684176 (+171161us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:12.684510 (+   334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0620 13:58:12.684555 (+    45us) write_op.cc:312] APPLY: finished
0620 13:58:12.725031 (+ 40476us) log.cc:844] Serialized 220 byte log entry
0620 13:58:12.725225 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:12.725457 (+   232us) write_op.cc:454] Released schema lock
0620 13:58:12.725524 (+    67us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:12.736332 (+ 10808us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:12.736368 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23874,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":48642,"apply.run_cpu_time_us":32713,"apply.run_wall_time_us":373980,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108727,"mutex_wait_us":26582,"num_ops":25,"prepare.queue_time_us":85491,"prepare.run_cpu_time_us":18113,"prepare.run_wall_time_us":460795,"raft.queue_time_us":6044,"raft.run_cpu_time_us":46730,"raft.run_wall_time_us":49025,"replication_time_us":280902,"spinlock_wait_cycles":11955584,"thread_start_us":250978,"threads_started":4,"wal-append.queue_time_us":184402}]]}
I20260620 13:58:12.853371  5777 catalog_manager.cc:5696] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:12.856952  5777 catalog_manager.cc:5696] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.861680  5777 catalog_manager.cc:5696] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:12.859411 11608 raft_consensus.cc:2749] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260620 13:58:12.869092  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:12.864681  5777 catalog_manager.cc:5696] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 14 to 15, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 15 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
W20260620 13:58:12.875308  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:12.876443  5777 catalog_manager.cc:5696] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 14 to 15, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 15 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.878504  5777 catalog_manager.cc:5696] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 7 to 12, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 12 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.883307  5777 catalog_manager.cc:5696] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 8 to 12, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 12 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.907048  5777 catalog_manager.cc:5696] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
W20260620 13:58:12.912108  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:12.910094  5777 catalog_manager.cc:5696] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:12.973031 11499 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:12.973574 11499 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:12.977037  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:12.975960 11499 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:13.011130  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:13.024366  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:13.029075 11847 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.041239 11847 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.043489 11847 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.037720 11608 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.077335 11608 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.086089  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.079670 11608 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.118119 11753 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260620 13:58:13.120246  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 73253.4us
I20260620 13:58:13.130008  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:13.136135  6027 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260620 13:58:13.141831 11499 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:13.142422 11499 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:13.119743 11753 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:13.144734 11753 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:13.145573  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:13.146337  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.146845 11499 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:13.150717  5849 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:13.151665 11499 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:13.152774  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.154073  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:13.157364 11499 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260620 13:58:13.169149  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:13.172026  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:13.178018  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:13.179690  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:13.176847  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:13.190716  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:13.192315  4719 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:13.193257 11499 raft_consensus.cc:493] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.194900 11499 raft_consensus.cc:515] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.196746 11874 raft_consensus.cc:493] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.197249 11874 raft_consensus.cc:515] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.197674  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.198385 11753 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:13.197677 11499 leader_election.cc:290] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.199818 11874 leader_election.cc:290] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.200829  5849 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:13.207645 11753 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:13.210166  6024 raft_consensus.cc:1275] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260620 13:58:13.215054  5849 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:13.216197  5849 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:13.216357 11608 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:13.217193  6584 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260620 13:58:13.218914 11499 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:13.228565  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:13.229431  6024 raft_consensus.cc:2393] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e82c0c231624695ac5a813230bf5038 in current term 17: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:13.229063 11877 consensus_queue.cc:1048] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:58:13.230522  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7540e02ee04cdb9365701b0b6a9077" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:13.285041  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:13.292474 11874 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260620 13:58:13.296895  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da14809d5f043db80b3e1639afd8e25" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:13.303642  5849 leader_election.cc:304] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:13.306315 11874 raft_consensus.cc:2749] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:13.311684  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:13.312429  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:13.315973 11499 raft_consensus.cc:493] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.334000 11874 raft_consensus.cc:493] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:13.351256 11608 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.351369 11874 raft_consensus.cc:515] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:13.351810 11608 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.353520 11874 leader_election.cc:290] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:13.353705 11608 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.355921  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.351001 11499 raft_consensus.cc:515] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.356161  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.357985 11499 leader_election.cc:290] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.361725  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.336489  5777 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56624 (request call id 347) took 4014 ms. Trace:
W20260620 13:58:13.379235  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 66841.7us
I20260620 13:58:13.364744  5777 rpcz_store.cc:276] 0620 13:58:09.321923 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:09.322077 (+   154us) service_pool.cc:224] Handling call
0620 13:58:09.330840 (+  8763us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b5400002490. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdc593a01 00007f0fdc6d3371 00007f0fdc6d38b2 00007f0fe5651659 00007f0fe55e98b6 00007f0fe55ba968 00007f0fe56b90ae 00007f0fe3b7e4a4 00007f0fe3b7e432 00007f0fe3b7e361 00007f0fe3b7e2dc
0620 13:58:13.336421 (+4005581us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:58:13.087023 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:58:13.087797 (+   774us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:58:13.087845 (+    48us) write_op.cc:435] Acquired schema lock
0620 13:58:13.087871 (+    26us) tablet.cc:662] Decoding operations
0620 13:58:13.089776 (+  1905us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:58:13.089881 (+   105us) write_op.cc:641] Partition lock acquired for write op
0620 13:58:13.089924 (+    43us) tablet.cc:685] Acquiring locks for 16 operations
0620 13:58:13.099603 (+  9679us) tablet.cc:701] Row locks acquired
0620 13:58:13.099636 (+    33us) write_op.cc:260] PREPARE: finished
0620 13:58:13.099838 (+   202us) write_op.cc:270] Start()
0620 13:58:13.100023 (+   185us) write_op.cc:276] Timestamp: P: 1781963893099770 usec, L: 0
0620 13:58:13.100057 (+    34us) op_driver.cc:348] REPLICATION: starting
0620 13:58:13.101078 (+  1021us) log.cc:844] Serialized 6347 byte log entry
0620 13:58:13.199537 (+ 98459us) op_driver.cc:464] REPLICATION: finished
0620 13:58:13.200513 (+   976us) write_op.cc:301] APPLY: starting
0620 13:58:13.200603 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:13.209757 (+  9154us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:13.209857 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:13.236493 (+ 26636us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:13.236769 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0620 13:58:13.236823 (+    54us) write_op.cc:312] APPLY: finished
0620 13:58:13.237230 (+   407us) log.cc:844] Serialized 148 byte log entry
0620 13:58:13.237404 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:13.237582 (+   178us) write_op.cc:454] Released schema lock
0620 13:58:13.237644 (+    62us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:13.238023 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:13.238056 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2672,"reported_tablets":46,"spinlock_wait_cycles":3180288,"child_traces":[["op",{"apply.queue_time_us":736,"apply.run_cpu_time_us":19324,"apply.run_wall_time_us":37467,"cfile_cache_hit":64,"cfile_cache_hit_bytes":66944,"num_ops":16,"prepare.queue_time_us":114345,"prepare.run_cpu_time_us":6377,"prepare.run_wall_time_us":53142,"replication_time_us":99323,"thread_start_us":98455,"threads_started":1}]]}
I20260620 13:58:13.392100  5780 catalog_manager.cc:5696] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 11 to 16, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 16 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
W20260620 13:58:13.394151  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:13.402091 11499 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.411936 11499 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:13.414381 11499 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:13.402190  5849 leader_election.cc:304] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:13.442723 11753 raft_consensus.cc:3060] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:13.454077 11753 raft_consensus.cc:2749] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:58:13.465678  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:13.488124  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f87066e519439ab8be15dccf1d2493" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:13.488386  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:13.488796  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0120e0a908b041479e2847fb24268985" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:13.489428  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:13.511672  5780 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 20 to 21, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 21 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:13.565737  5849 leader_election.cc:304] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:13.582626  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51551.9us
W20260620 13:58:13.652639  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 85236.8us
I20260620 13:58:13.656371  5849 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:13.522672 11541 raft_consensus.cc:493] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.567412 11874 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:13.701061  5780 catalog_manager.cc:5696] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 14 to 17, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 17 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } }
I20260620 13:58:13.703465 11608 raft_consensus.cc:2749] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:13.745468  5849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 89490.8us
I20260620 13:58:13.758077 11541 raft_consensus.cc:515] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.772553 11541 leader_election.cc:290] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.774293  5780 catalog_manager.cc:5696] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 10 to 14, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 14 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:13.723742 11874 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: NON_VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: true } }
I20260620 13:58:13.787921 11874 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:13.791214 11887 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:13.822830  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 95349.1us
I20260620 13:58:13.899040  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:13.908196  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 63079.8us
I20260620 13:58:13.951820 11889 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:13.952636 11889 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:13.958598 11889 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:13.961621  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:13.963393  6584 raft_consensus.cc:2393] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 16: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:13.979676 11893 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:13.980548 11893 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:13.985247 11893 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:13.997757  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:14.001375  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b97878e9ad465684082e7bf1c482ad" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:14.012753  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:14.016099  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4cd17345f80464287c5952767849dbb" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:14.110436 11887 raft_consensus.cc:493] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:14.111258 11887 raft_consensus.cc:515] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:14.113870 11887 leader_election.cc:290] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:14.115057  5849 leader_election.cc:304] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:14.119701  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:14.122601 11874 raft_consensus.cc:2749] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:14.129545  5849 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:14.148119 11874 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:14.166709  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:14.175745 11874 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:14.176569 11874 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:14.178997 11874 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:14.179569  5957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:14.194839  4719 thread.cc:527] Waited for 8000ms trying to join with heartbeat (tid 5909)
I20260620 13:58:14.201982  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad92842cd6b4c0082afb264bae0ec8d" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:14.226887  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:14.247659  5780 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56610 (request call id 354) took 3747 ms. Trace:
I20260620 13:58:14.248143  5780 rpcz_store.cc:276] 0620 13:58:10.500522 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:10.500790 (+   268us) service_pool.cc:224] Handling call
0620 13:58:10.766604 (+265814us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540002b7d4. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fdf766470 00007f0fdf80531a 00007f0fe55baaac 00007f0fe56b90ae 00007f0fe3b7e4a4 00007f0fe3b7e432 00007f0fe3b7e361 00007f0fe3b7e2dc 00007f0fe3b7d592 00007f0fddb34c3c 00007f0fddb34076
0620 13:58:14.247531 (+3480927us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:58:13.924034 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:58:13.944533 (+ 20499us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:58:13.944588 (+    55us) write_op.cc:435] Acquired schema lock
0620 13:58:13.944624 (+    36us) tablet.cc:662] Decoding operations
0620 13:58:13.945424 (+   800us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:58:13.945537 (+   113us) write_op.cc:641] Partition lock acquired for write op
0620 13:58:13.945572 (+    35us) tablet.cc:685] Acquiring locks for 4 operations
0620 13:58:13.946171 (+   599us) tablet.cc:701] Row locks acquired
0620 13:58:13.946214 (+    43us) write_op.cc:260] PREPARE: finished
0620 13:58:13.946444 (+   230us) write_op.cc:270] Start()
0620 13:58:13.946660 (+   216us) write_op.cc:276] Timestamp: P: 1781963893946355 usec, L: 0
0620 13:58:13.946711 (+    51us) op_driver.cc:348] REPLICATION: starting
0620 13:58:13.947874 (+  1163us) log.cc:844] Serialized 1696 byte log entry
0620 13:58:13.986353 (+ 38479us) op_driver.cc:464] REPLICATION: finished
0620 13:58:14.095485 (+109132us) write_op.cc:301] APPLY: starting
0620 13:58:14.095604 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:14.132769 (+ 37165us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:14.132915 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:14.136368 (+  3453us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:14.136721 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0620 13:58:14.136799 (+    78us) write_op.cc:312] APPLY: finished
0620 13:58:14.137222 (+   423us) log.cc:844] Serialized 49 byte log entry
0620 13:58:14.184389 (+ 47167us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:14.184504 (+   115us) write_op.cc:454] Released schema lock
0620 13:58:14.184569 (+    65us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:14.185124 (+   555us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:14.185167 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":69625,"reported_tablets":46,"spinlock_wait_cycles":380349184,"child_traces":[["op",{"apply.queue_time_us":108791,"apply.run_cpu_time_us":9485,"apply.run_wall_time_us":89563,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20863,"num_ops":4,"prepare.queue_time_us":96075,"prepare.run_cpu_time_us":4647,"prepare.run_wall_time_us":75447,"replication_time_us":39459,"thread_start_us":223285,"threads_started":2}]]}
I20260620 13:58:14.255556  5776 catalog_manager.cc:5696] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 15 to 17, leader changed from <none> to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 17 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.258464  5776 catalog_manager.cc:5696] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 16, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 16 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:14.269558  5849 leader_election.cc:304] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:14.270779 11893 raft_consensus.cc:2749] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:14.275072  5849 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:14.282150 11874 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260620 13:58:14.284274  5776 catalog_manager.cc:5696] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.292423  5849 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:14.293427 11874 raft_consensus.cc:2749] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:14.297089  5776 catalog_manager.cc:5696] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 14 to 16, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 16 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.299031  5776 catalog_manager.cc:5696] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 18, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 18 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.300987  5776 catalog_manager.cc:5696] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 8 to 11, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 11 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.306115  5849 leader_election.cc:304] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:14.308795  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee15f74e3e4771a050c854530121f3" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:14.312685 11893 raft_consensus.cc:2749] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:14.315549  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:14.316429  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:14.317157  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:14.317922  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:14.318436  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:14.323897  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:14.324298  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:14.324574  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:14.325357  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:14.339433  5776 catalog_manager.cc:5696] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:14.342854  5849 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:14.351766 11894 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260620 13:58:14.360095  5998 leader_election.cc:336] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:14.362632  5998 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:14.368016 11896 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:14.373538  5776 catalog_manager.cc:5696] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:14.379905  5776 catalog_manager.cc:5696] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 12 to 13, leader changed from 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 13 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:14.382102  5776 catalog_manager.cc:5696] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 6 to 11, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 11 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:14.392514  5776 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 16 to 19, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 19 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.398736 11896 raft_consensus.cc:2749] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:14.400188  5776 catalog_manager.cc:5696] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:14.423429  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:14.425334  5776 catalog_manager.cc:5696] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 10 to 11, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 11 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.428670  5776 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.473019 11894 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:14.473657 11894 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:14.476192 11894 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:14.479630  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:14.491432  6024 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:14.492835  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:14.479971  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:14.494074  6584 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 16.
I20260620 13:58:14.493777 11894 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:14.497445 11894 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:14.498449 11894 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:14.533317 11874 raft_consensus.cc:493] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:14.534050 11874 raft_consensus.cc:515] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:14.536463 11874 leader_election.cc:290] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:14.540807  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:14.548012  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0ab32eab32415c8e9ea1fda9508733" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:14.563489  5849 leader_election.cc:304] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:14.564517  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:14.566634 11874 raft_consensus.cc:2749] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:14.611550  5776 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47386 (request call id 238) took 1663 ms. Trace:
I20260620 13:58:14.619650  5776 rpcz_store.cc:276] 0620 13:58:12.943220 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:12.943375 (+   155us) service_pool.cc:224] Handling call
0620 13:58:14.606681 (+1663306us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:58:14.438839 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:58:14.439434 (+   595us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:58:14.439489 (+    55us) write_op.cc:435] Acquired schema lock
0620 13:58:14.439511 (+    22us) tablet.cc:662] Decoding operations
0620 13:58:14.440698 (+  1187us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:58:14.440762 (+    64us) write_op.cc:641] Partition lock acquired for write op
0620 13:58:14.440793 (+    31us) tablet.cc:685] Acquiring locks for 14 operations
0620 13:58:14.442024 (+  1231us) tablet.cc:701] Row locks acquired
0620 13:58:14.442040 (+    16us) write_op.cc:260] PREPARE: finished
0620 13:58:14.442249 (+   209us) write_op.cc:270] Start()
0620 13:58:14.442376 (+   127us) write_op.cc:276] Timestamp: P: 1781963894442145 usec, L: 0
0620 13:58:14.442393 (+    17us) op_driver.cc:348] REPLICATION: starting
0620 13:58:14.443128 (+   735us) log.cc:844] Serialized 5575 byte log entry
0620 13:58:14.445714 (+  2586us) op_driver.cc:464] REPLICATION: finished
0620 13:58:14.446040 (+   326us) write_op.cc:301] APPLY: starting
0620 13:58:14.446125 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:14.453738 (+  7613us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:14.453840 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:14.490924 (+ 37084us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:14.496443 (+  5519us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0620 13:58:14.496500 (+    57us) write_op.cc:312] APPLY: finished
0620 13:58:14.496873 (+   373us) log.cc:844] Serialized 129 byte log entry
0620 13:58:14.497695 (+   822us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:14.497855 (+   160us) write_op.cc:454] Released schema lock
0620 13:58:14.497903 (+    48us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:14.547681 (+ 49778us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b540002b628. stack: 00007f0fdc6d8b43 00007f0fdc6d8a40 00007f0fdc066574 00007f0fe5dab6c4 00007f0fe5dab659 00007f0fe5bb9c21 00007f0fe5bb888c 00007f0fe324a27d 00007f0fe3236209 00007f0fe32359d3 00007f0fe3239be1 00007f0fe3239b99 00007f0fe3239b29 00007f0fe3239af1 00007f0fe3238d1d 0000000000389354
0620 13:58:14.558238 (+ 10557us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:14.558272 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3577,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":115,"apply.run_cpu_time_us":21004,"apply.run_wall_time_us":111592,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58576,"num_ops":14,"prepare.queue_time_us":2933,"prepare.run_cpu_time_us":4602,"prepare.run_wall_time_us":4602,"replication_time_us":3176,"spinlock_wait_cycles":88947072}]]}
W20260620 13:58:14.642874  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 43796.6us
I20260620 13:58:14.624046 11894 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:14.704810 11894 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Requested vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:14.708004  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:14.708788  6033 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:14.726511  6033 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
I20260620 13:58:14.737548  5849 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
W20260620 13:58:14.729621  5998 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 234 similar messages]
I20260620 13:58:14.745712 11894 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:58:14.748549 11894 raft_consensus.cc:697] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Becoming Leader. State: Replica: 2e82c0c231624695ac5a813230bf5038, State: Running, Role: LEADER
I20260620 13:58:14.749619 11894 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:14.763686  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:14.764422  6584 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:14.826326  6584 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e82c0c231624695ac5a813230bf5038 in term 17.
W20260620 13:58:14.839562  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 92953.1us
W20260620 13:58:14.886387  6552 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 192949us
W20260620 13:58:14.893070  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 236744us
I20260620 13:58:14.870857  5777 catalog_manager.cc:5696] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 11 to 15, leader changed from b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196) to 2e82c0c231624695ac5a813230bf5038 (127.4.155.193). New cstate: current_term: 15 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.957499  5777 catalog_manager.cc:5696] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:14.999145  5778 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56594 (request call id 335) took 9917 ms. Trace:
I20260620 13:58:14.999642  5778 rpcz_store.cc:276] 0620 13:58:05.068850 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:05.069061 (+   211us) service_pool.cc:224] Handling call
0620 13:58:14.986083 (+9917022us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":585,"reported_tablets":45}
W20260620 13:58:15.007601  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:15.010530  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 57313.9us
I20260620 13:58:15.042788  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:58:15.048388  4719 tablet_replica.cc:333] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.050274  4719 raft_consensus.cc:2243] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 16 LEADER]: Raft consensus shutting down.
W20260620 13:58:15.069169  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:15.071296 11894 raft_consensus.cc:493] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:15.076449 11894 raft_consensus.cc:515] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:15.079675 11894 leader_election.cc:290] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:15.086494  4719 raft_consensus.cc:2272] T d562ae472315433ca373f0a47f931afa P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.092320  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:15.091969  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:15.096366  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:15.112280  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59266d6f1b524a25ac59ce6dd8f39c95" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:15.112493  4719 tablet_replica.cc:333] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.114882  4719 raft_consensus.cc:2243] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.116011  4719 pending_rounds.cc:70] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
W20260620 13:58:15.134897  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:15.145830  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:15.149264  5849 leader_election.cc:304] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:15.152350 11901 raft_consensus.cc:2749] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:15.116572  4719 pending_rounds.cc:77] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 15 index: 9 } timestamp: 7298924030170198016 op_type: NO_OP noop_request { }
I20260620 13:58:15.155923  4719 raft_consensus.cc:2889] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.164496  4719 raft_consensus.cc:2272] T 0120e0a908b041479e2847fb24268985 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:15.182418  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:15.188349  4719 tablet_replica.cc:333] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.190980  4719 raft_consensus.cc:2243] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.192546  4719 raft_consensus.cc:2272] T 71fbe22bd18849f1b94912bb0bdf5bbe P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.195885  4719 tablet_replica.cc:333] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.197499  4719 raft_consensus.cc:2243] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.198315  4719 raft_consensus.cc:2272] T 1f1025714d0b439cb56cc08764cb5fce P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.201758  4719 tablet_replica.cc:333] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.203151  4719 raft_consensus.cc:2243] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 16 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.204313  4719 raft_consensus.cc:2272] T a1bc98eaf2354afeb378f85e462f31ab P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.207975  4719 tablet_replica.cc:333] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.209319  4719 raft_consensus.cc:2243] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.210162  4719 raft_consensus.cc:2272] T 49ee9750110f428fa454f96aaeb360ef P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.213442  4719 tablet_replica.cc:333] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.214704  4719 raft_consensus.cc:2243] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.215621  4719 raft_consensus.cc:2272] T b8a351afb91f46e2b6e724165bc600c1 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.218691  4719 tablet_replica.cc:333] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.219794  4719 raft_consensus.cc:2243] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.221060  4719 pending_rounds.cc:70] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.221364  4719 pending_rounds.cc:77] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 13 index: 10 } timestamp: 7298924084686622720 op_type: NO_OP noop_request { }
I20260620 13:58:15.221937  4719 raft_consensus.cc:2889] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.222368  4719 raft_consensus.cc:2272] T 1a7540e02ee04cdb9365701b0b6a9077 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.226383  4719 tablet_replica.cc:333] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.227433  4719 raft_consensus.cc:2243] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.228586  4719 raft_consensus.cc:2272] T 020dbb4b944d4deeba944d1a7c6d5c76 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.233552  4719 tablet_replica.cc:333] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.234750  4719 raft_consensus.cc:2243] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:15.234989  5767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 51352.9us
I20260620 13:58:15.235426  4719 pending_rounds.cc:70] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.235728  4719 pending_rounds.cc:77] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 9 index: 7 } timestamp: 7298924051582746624 op_type: NO_OP noop_request { }
I20260620 13:58:15.236131  4719 raft_consensus.cc:2889] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.236467  4719 raft_consensus.cc:2272] T 59266d6f1b524a25ac59ce6dd8f39c95 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.239634  4719 tablet_replica.cc:333] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.240625  4719 raft_consensus.cc:2243] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 19 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.243183  4719 raft_consensus.cc:2272] T ba377ed0ce364307bbe22e24ddafa62e P 2e82c0c231624695ac5a813230bf5038 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:15.243989  5767 catalog_manager.cc:4754] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): ChangeConfig:REMOVE_PEER RPC failed for tablet 71fbe22bd18849f1b94912bb0bdf5bbe: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 13:58:15.246264  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:15.248435  4719 tablet_replica.cc:333] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
W20260620 13:58:15.249274  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:15.254056  4719 raft_consensus.cc:2243] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.254889  4719 raft_consensus.cc:2272] T 0e0ab32eab32415c8e9ea1fda9508733 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.258797  4719 tablet_replica.cc:333] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.260046  4719 raft_consensus.cc:2243] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.260788  6584 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Refusing update from remote peer 2e82c0c231624695ac5a813230bf5038: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260620 13:58:15.261230  4719 pending_rounds.cc:70] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.261556  4719 pending_rounds.cc:77] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 12 index: 10 } timestamp: 7298924015162245120 op_type: NO_OP noop_request { }
I20260620 13:58:15.261987  4719 raft_consensus.cc:2889] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.262531  4719 raft_consensus.cc:2272] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.265671 11901 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260620 13:58:15.275215  4719 tablet_replica.cc:333] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.276249  4719 raft_consensus.cc:2243] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.276969  4719 pending_rounds.cc:70] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.277217  4719 pending_rounds.cc:77] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 17 index: 11 } timestamp: 7298924113035751424 op_type: NO_OP noop_request { }
I20260620 13:58:15.277535  4719 raft_consensus.cc:2889] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.277843  4719 raft_consensus.cc:2272] T 923bfc4f20d94a57b0d84d45e40b12ae P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.281559  4719 tablet_replica.cc:333] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.282490  4719 raft_consensus.cc:2243] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.283452  4719 raft_consensus.cc:2272] T a4cd17345f80464287c5952767849dbb P 2e82c0c231624695ac5a813230bf5038 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.286849  4719 tablet_replica.cc:333] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.299800  4719 raft_consensus.cc:2243] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.300498  4719 pending_rounds.cc:70] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.300740  4719 pending_rounds.cc:77] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 12 index: 6 } timestamp: 7298924032944414720 op_type: NO_OP noop_request { }
I20260620 13:58:15.301118  4719 raft_consensus.cc:2889] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.301533  4719 raft_consensus.cc:2272] T b53823dabce64d5284772ca73d71ddc9 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.302904  5780 catalog_manager.cc:5696] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2e82c0c231624695ac5a813230bf5038" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:15.304739  4719 tablet_replica.cc:333] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.311540  4719 raft_consensus.cc:2243] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.313042  4719 raft_consensus.cc:2272] T 8b06407c45954213adfef7604a8c4f21 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.328258  4719 tablet_replica.cc:333] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.329121  4719 raft_consensus.cc:2243] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.329681  4719 pending_rounds.cc:70] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.329945  4719 pending_rounds.cc:77] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 15 index: 9 } timestamp: 7298924035047546880 op_type: NO_OP noop_request { }
I20260620 13:58:15.330339  4719 raft_consensus.cc:2889] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.330917  4719 raft_consensus.cc:2272] T 6ad92842cd6b4c0082afb264bae0ec8d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.333787  4719 tablet_replica.cc:333] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.335081  4719 raft_consensus.cc:2243] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 11 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.339171  4719 raft_consensus.cc:2272] T 99f357751cae4b6b87b5972ef2a1fda4 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.342228  4719 tablet_replica.cc:333] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.343123  4719 raft_consensus.cc:2243] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.343834  4719 raft_consensus.cc:2272] T 4fd646f84cb04514aa9889ea5f67db81 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.347450  4719 tablet_replica.cc:333] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.348371  4719 raft_consensus.cc:2243] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 16 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.349675  4719 raft_consensus.cc:2272] T 735685c84e834b9cbaf7533d6fdf16e6 P 2e82c0c231624695ac5a813230bf5038 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.364989  4719 tablet_replica.cc:333] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.366178  4719 raft_consensus.cc:2243] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.366873  4719 raft_consensus.cc:2272] T c3ee15f74e3e4771a050c854530121f3 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.370447  4719 tablet_replica.cc:333] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.371515  4719 raft_consensus.cc:2243] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.372411  4719 raft_consensus.cc:2272] T fb8edcc5cb024ebebdb3cac403f19bc4 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.375502  5777 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56624 (request call id 348) took 1872 ms. Trace:
I20260620 13:58:15.387851  4719 tablet_replica.cc:333] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.375979  5777 rpcz_store.cc:276] 0620 13:58:13.503550 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:13.504143 (+   593us) service_pool.cc:224] Handling call
0620 13:58:15.375431 (+1871288us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0620 13:58:15.051421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 13:58:15.051987 (+   566us) write_op.cc:432] Acquiring schema lock in shared mode
0620 13:58:15.052021 (+    34us) write_op.cc:435] Acquired schema lock
0620 13:58:15.052043 (+    22us) tablet.cc:662] Decoding operations
0620 13:58:15.061192 (+  9149us) write_op.cc:620] Acquiring the partition lock for write op
0620 13:58:15.061305 (+   113us) write_op.cc:641] Partition lock acquired for write op
0620 13:58:15.061334 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0620 13:58:15.061885 (+   551us) tablet.cc:701] Row locks acquired
0620 13:58:15.061905 (+    20us) write_op.cc:260] PREPARE: finished
0620 13:58:15.062043 (+   138us) write_op.cc:270] Start()
0620 13:58:15.062211 (+   168us) write_op.cc:276] Timestamp: P: 1781963895061998 usec, L: 0
0620 13:58:15.062234 (+    23us) op_driver.cc:348] REPLICATION: starting
0620 13:58:15.062857 (+   623us) log.cc:844] Serialized 919 byte log entry
0620 13:58:15.189559 (+126702us) op_driver.cc:464] REPLICATION: finished
0620 13:58:15.249776 (+ 60217us) write_op.cc:301] APPLY: starting
0620 13:58:15.249865 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0620 13:58:15.258152 (+  8287us) tablet.cc:1370] finished BulkCheckPresence
0620 13:58:15.258264 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0620 13:58:15.263435 (+  5171us) tablet.cc:1383] finished ApplyRowOperation cycle
0620 13:58:15.263631 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0620 13:58:15.263676 (+    45us) write_op.cc:312] APPLY: finished
0620 13:58:15.263863 (+   187us) log.cc:844] Serialized 33 byte log entry
0620 13:58:15.264028 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:15.264115 (+    87us) write_op.cc:454] Released schema lock
0620 13:58:15.264152 (+    37us) write_op.cc:341] FINISH: Updating metrics
0620 13:58:15.296030 (+ 31878us) write_op.cc:489] Releasing partition, row and schema locks
0620 13:58:15.296061 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":182019,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":52292,"apply.run_cpu_time_us":4865,"apply.run_wall_time_us":46168,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12495,"num_ops":2,"prepare.queue_time_us":39983,"prepare.run_cpu_time_us":3112,"prepare.run_wall_time_us":11773,"replication_time_us":127160,"spinlock_wait_cycles":2432,"thread_start_us":89750,"threads_started":2}]]}
I20260620 13:58:15.403283  4719 raft_consensus.cc:2243] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 15 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.404699  4719 raft_consensus.cc:2272] T 0e3e3ff471834714a3885231e648b8ee P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.415164  4719 tablet_replica.cc:333] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.416054  4719 raft_consensus.cc:2243] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 20 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.417414  4719 raft_consensus.cc:2272] T 0fc24d0691404d29bfa069498ec57dd0 P 2e82c0c231624695ac5a813230bf5038 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.420516  4719 tablet_replica.cc:333] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.431713  4719 raft_consensus.cc:2243] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.432394  4719 raft_consensus.cc:2272] T 6c812d18f2bb4da29c562646eb81deb1 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.435437  4719 tablet_replica.cc:333] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.436268  4719 raft_consensus.cc:2243] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.445835  4719 raft_consensus.cc:2272] T fd6ebbc0e9aa474f80952cef69b0ac25 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.448818  4719 tablet_replica.cc:333] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.449749  4719 raft_consensus.cc:2243] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.450390  4719 raft_consensus.cc:2272] T ec20d216461d4414813627ca62e330e4 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.453465  4719 tablet_replica.cc:333] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.454381  4719 raft_consensus.cc:2243] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.455485  4719 raft_consensus.cc:2272] T 50e28625b20048a398049a7734aaeaf8 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.458710  4719 tablet_replica.cc:333] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.459568  4719 raft_consensus.cc:2243] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.460206  4719 raft_consensus.cc:2272] T 90f87066e519439ab8be15dccf1d2493 P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.463225  4719 tablet_replica.cc:333] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.464046  4719 raft_consensus.cc:2243] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.464954  4719 raft_consensus.cc:2272] T 6da14809d5f043db80b3e1639afd8e25 P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.473001  4719 tablet_replica.cc:333] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.488751  4719 raft_consensus.cc:2243] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.498107  4719 raft_consensus.cc:2272] T 115c5e2556794dd8801d1f451aa245fb P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.496331 11901 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:15.498757 11901 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:15.501057  4719 tablet_replica.cc:333] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.501125 11901 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:15.502154  4719 raft_consensus.cc:2243] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.506249  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:15.511979  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c5eb52b96b44f7cb3569bfff54e9b1c" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:15.503050  4719 raft_consensus.cc:2272] T 5119d05dc81b442f8653989b96a3626d P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.519624  4719 tablet_replica.cc:333] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.520565  4719 raft_consensus.cc:2243] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.521147  4719 raft_consensus.cc:2272] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.522792  5849 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:15.523880  5849 raft_consensus.cc:2686] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 2e82c0c231624695ac5a813230bf5038: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 13:58:15.524999  4719 tablet_replica.cc:333] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.526266  4719 raft_consensus.cc:2243] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.526876  4719 raft_consensus.cc:2272] T 8838a101a5e8400c91d053b307be45ed P 2e82c0c231624695ac5a813230bf5038 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.542809  4719 tablet_replica.cc:333] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.543751  4719 raft_consensus.cc:2243] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.544345  4719 pending_rounds.cc:70] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.544569  4719 pending_rounds.cc:77] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 14 index: 10 } timestamp: 7298924031453487104 op_type: NO_OP noop_request { }
I20260620 13:58:15.544919  4719 raft_consensus.cc:2889] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.545248  4719 raft_consensus.cc:2272] T 52b97878e9ad465684082e7bf1c482ad P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.558807  4719 tablet_replica.cc:333] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.559747  4719 raft_consensus.cc:2243] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.560384  4719 pending_rounds.cc:70] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Trying to abort 2 pending ops.
I20260620 13:58:15.560622  4719 pending_rounds.cc:77] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 15 index: 11 } timestamp: 7298924031446654976 op_type: NO_OP noop_request { }
I20260620 13:58:15.561025  4719 raft_consensus.cc:2889] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.573997  4719 pending_rounds.cc:77] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 13 index: 10 } timestamp: 7298923981674422272 op_type: NO_OP noop_request { }
I20260620 13:58:15.574373  4719 raft_consensus.cc:2889] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.574757  4719 raft_consensus.cc:2272] T e8078a89b618482f8e4978c463747569 P 2e82c0c231624695ac5a813230bf5038 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.597966  4719 tablet_replica.cc:333] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.598630 11901 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:15.598875  4719 raft_consensus.cc:2243] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.599622  4719 pending_rounds.cc:70] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.599295 11901 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:15.599925  4719 pending_rounds.cc:77] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 14 index: 9 } timestamp: 7298924031119417344 op_type: NO_OP noop_request { }
I20260620 13:58:15.600322  4719 raft_consensus.cc:2889] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.600781  4719 raft_consensus.cc:2272] T 5757f55132b747db98400dba7b8056df P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.603032  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:15.606786 11901 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:15.608090  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "2e82c0c231624695ac5a813230bf5038" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:15.615481  5849 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e82c0c231624695ac5a813230bf5038; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:15.619699 11901 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:15.628872  4719 tablet_replica.cc:333] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.629792  4719 raft_consensus.cc:2243] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.630935  4719 raft_consensus.cc:2272] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.639312  4719 tablet_replica.cc:333] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.640115  4719 raft_consensus.cc:2243] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:15.641355  4719 raft_consensus.cc:2272] T b870adf0b6e5484ba90ad7b17d35cd52 P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.685981  4719 tablet_replica.cc:333] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.686872  4719 raft_consensus.cc:2243] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.687630  4719 raft_consensus.cc:2272] T 3fc69a9218a64fa6b346021a0d32eaad P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.697127  4719 tablet_replica.cc:333] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.704746  4719 raft_consensus.cc:2243] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.705648  4719 raft_consensus.cc:2272] T d1b89d9f1eec4bfba2f3b0052c49f040 P 2e82c0c231624695ac5a813230bf5038 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.708710  4719 tablet_replica.cc:333] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.709568  4719 raft_consensus.cc:2243] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.711630  4719 pending_rounds.cc:70] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.713335  4719 pending_rounds.cc:77] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 12 index: 7 } timestamp: 7298924032892555264 op_type: NO_OP noop_request { }
I20260620 13:58:15.715219  4719 raft_consensus.cc:2889] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.715649  4719 raft_consensus.cc:2272] T 8dbd1edec8054c1ba05721321572fbbf P 2e82c0c231624695ac5a813230bf5038 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.718752  4719 tablet_replica.cc:333] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.722652  4719 raft_consensus.cc:2243] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.727929  4719 pending_rounds.cc:70] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: Trying to abort 1 pending ops.
I20260620 13:58:15.728266  4719 pending_rounds.cc:77] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038: Aborting op as it isn't in flight: id { term: 13 index: 10 } timestamp: 7298924030041391104 op_type: NO_OP noop_request { }
I20260620 13:58:15.728714  4719 raft_consensus.cc:2889] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:58:15.729128  4719 raft_consensus.cc:2272] T efd3e1f0e5a34ba69029888abcdfb2f1 P 2e82c0c231624695ac5a813230bf5038 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:15.732295  4719 tablet_replica.cc:333] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038: stopping tablet replica
I20260620 13:58:15.734529  4719 raft_consensus.cc:2243] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:15.736472  4719 raft_consensus.cc:2272] T ab83097997ba42219f9a63aad224f786 P 2e82c0c231624695ac5a813230bf5038 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:15.744445  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:15.821699  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:15.848755  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:15.868202  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:15.965823  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:15.972590  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:16.061662 11842 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.062758 11842 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.065404 11842 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.067437  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:16.087145  5924 leader_election.cc:336] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:16.087612  5924 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:16.088845 11842 raft_consensus.cc:2749] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260620 13:58:16.143533  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:16.144234  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:16.144729  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:16.145184  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:16.234144 11910 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.234788 11910 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.237262 11910 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.239539  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:16.240211  5955 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:58:16.241981  5997 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:16.243995 11908 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:16.244423 11908 raft_consensus.cc:493] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.244768 11908 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
W20260620 13:58:16.251348  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:16.252015  5998 leader_election.cc:336] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.253722 11908 raft_consensus.cc:515] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.264602  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d562ae472315433ca373f0a47f931afa" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:16.265233  5955 raft_consensus.cc:3060] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:16.264428 11908 leader_election.cc:290] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:16.271584  5998 leader_election.cc:336] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.272423  5955 raft_consensus.cc:2468] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
I20260620 13:58:16.273675  5997 leader_election.cc:304] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.275059 11908 raft_consensus.cc:2804] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:58:16.276432 11908 raft_consensus.cc:697] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:16.277393 11908 consensus_queue.cc:237] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:16.299754  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:16.311934  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:16.314823  5777 catalog_manager.cc:5696] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 16 to 17, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 17 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:16.448354 11877 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.449049 11877 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.451300 11877 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.455183  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:16.457157  6552 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.458438  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:16.459579 11877 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:58:16.462538 11914 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.463167 11914 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.465564 11914 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.466441 11914 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.467068 11914 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.469421 11914 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:16.475461  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:16.480527  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.484437  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:16.506291  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:16.528874  5924 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.534451  5924 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:16.536485 11914 raft_consensus.cc:2749] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260620 13:58:16.538393  5924 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.542855 11912 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.543746 11912 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:16.552744  6552 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.554057 11912 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.555382  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:16.556089  5955 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 19.
W20260620 13:58:16.542995  5767 catalog_manager.cc:4754] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): ChangeConfig:REMOVE_PEER RPC failed for tablet 71fbe22bd18849f1b94912bb0bdf5bbe: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.558207  5924 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:16.558277  6551 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.559549 11912 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260620 13:58:16.559924 11912 raft_consensus.cc:493] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.560290 11912 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:58:16.560389 11914 raft_consensus.cc:2749] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:16.568862 11912 raft_consensus.cc:515] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:16.579514  6552 leader_election.cc:336] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.582844 11912 leader_election.cc:290] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.583133  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba377ed0ce364307bbe22e24ddafa62e" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:16.583793  5953 raft_consensus.cc:3060] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:58:16.593940 11908 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.594563 11908 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.595096 11912 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.595659 11912 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.597635 11912 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.598125  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:16.600518  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.603523 11910 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.604173 11910 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.606339 11910 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:16.610164  5998 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.610219  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.610745  5998 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.615268 11885 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:16.616710  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.616779 11912 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.618325 11912 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.620617 11912 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:16.620704  6552 leader_election.cc:336] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.621237  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:16.625406  5998 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.626564  5998 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:16.627529 11885 raft_consensus.cc:2749] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:16.597096  5953 raft_consensus.cc:2468] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 20.
I20260620 13:58:16.630533 11908 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.632663  6551 leader_election.cc:304] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.633832 11877 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:58:16.633958 11912 raft_consensus.cc:2804] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Leader election won for term 20
I20260620 13:58:16.634800 11912 raft_consensus.cc:697] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 20 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:16.636248 11912 consensus_queue.cc:237] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:16.641644  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:16.647250 11842 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.647840 11842 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.646896 11914 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.651731 11914 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.653820 11914 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.656320 11889 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.659212  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.650921 11842 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.656883 11889 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.668627 11908 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.668785 11889 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.669282 11908 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.672271  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.672878  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.673400 11877 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.673803  6584 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:58:16.674157  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.674015 11877 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.679001  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:16.679929  5955 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 17.
W20260620 13:58:16.681176  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:16.682142 11908 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.683424 11912 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.684371 11912 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.679358 11877 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.672982  6033 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 17.
I20260620 13:58:16.690778  5777 catalog_manager.cc:5696] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 19 to 20, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 20 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:16.693491  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:16.696940  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.697927  6584 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 17.
I20260620 13:58:16.696911  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.699297  6033 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 17.
I20260620 13:58:16.701687  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:16.704157  5998 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.709681  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:16.710120  5924 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.710439  6584 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:58:16.707285 11912 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.710709 11909 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.711972 11889 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:16.707633  6552 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:16.712430 11889 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.713025 11889 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:16.713099 11912 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:16.715523 11912 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.716212 11912 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:16.711414 11909 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.720618 11909 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.722440  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:16.718271  5998 leader_election.cc:336] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.723701  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:16.714977  6552 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.724634  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:16.710777  5924 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.725858  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:16.727587 11937 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260620 13:58:16.731536 11885 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260620 13:58:16.731964 11909 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260620 13:58:16.733878  5953 raft_consensus.cc:1275] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260620 13:58:16.732043 11885 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.735255 11885 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:16.740306 11910 consensus_queue.cc:1048] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260620 13:58:16.748101  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.750037 11937 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:16.750494 11937 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.750116 11889 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.750893 11937 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:16.752375 11889 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.756505  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bc98eaf2354afeb378f85e462f31ab" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:16.757248  6584 raft_consensus.cc:3060] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:16.760275 11885 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:16.763897  6552 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:16.765548  6552 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:16.766595  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:16.772462  5998 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.772505  6552 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.767531 11908 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.774544  6584 raft_consensus.cc:2468] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
I20260620 13:58:16.773813 11908 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.776329 11877 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:16.777752 11908 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.762900 11885 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:16.781965  5998 leader_election.cc:336] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:16.782536  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:16.768193 11937 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.770545  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735685c84e834b9cbaf7533d6fdf16e6" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:16.771552 11909 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.788389  5998 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.788700 11909 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.788434  6578 raft_consensus.cc:3060] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Advancing to term 17
I20260620 13:58:16.793548 11937 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.790848 11909 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.803560 11912 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.806492 11912 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.810842  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:16.811522  6024 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:16.815593 11909 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.816159 11909 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.818231 11909 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:16.818585  5998 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.819371 11910 raft_consensus.cc:2804] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:58:16.819499  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:16.819907 11910 raft_consensus.cc:697] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:16.820255  5951 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 18: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:58:16.820765 11910 consensus_queue.cc:237] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.821784  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.822343  6584 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 20.
I20260620 13:58:16.824363  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.831302 11940 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.831954 11940 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.834571 11940 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.839706 11885 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260620 13:58:16.840425 11885 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.841005 11885 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Advancing to term 21
W20260620 13:58:16.841272  5924 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.802814  6578 raft_consensus.cc:2468] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
I20260620 13:58:16.843255 11909 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.843815 11909 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:16.844388  6552 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.845000  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.846079 11909 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:16.847482  6024 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 18.
I20260620 13:58:16.848614 11877 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:16.861040 11937 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.861792 11937 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.864337 11937 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:16.874511  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 55956.5us
W20260620 13:58:16.875730  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 51440.8us
I20260620 13:58:16.880120 11908 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.880563 11885 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.880785 11908 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.883184 11908 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.884296 11942 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.885718 11942 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.886385  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.887334  6024 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 17.
W20260620 13:58:16.896400  5924 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.894327  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:16.897842  5998 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.901639  6033 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 18: Already voted for candidate 192c750f597c43858e1ad09e8d805685 in this term.
I20260620 13:58:16.902920 11945 raft_consensus.cc:2804] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader election won for term 17
I20260620 13:58:16.888031 11942 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.907359  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:16.907747  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:16.909161  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.910780  6578 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
I20260620 13:58:16.910936  6033 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 11.
I20260620 13:58:16.900590  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:16.915383  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:16.917910  6578 raft_consensus.cc:2393] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 192c750f597c43858e1ad09e8d805685 in current term 18: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:16.916944  6024 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 17.
I20260620 13:58:16.909888 11945 raft_consensus.cc:697] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:16.912876  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:16.924844  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
I20260620 13:58:16.912793 11885 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 21 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.925664  5951 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
I20260620 13:58:16.927242 11942 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.927831 11942 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.929039 11941 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:16.929471 11941 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.929826 11941 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:16.929946 11942 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.930361  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc24d0691404d29bfa069498ec57dd0" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:16.930963  6584 raft_consensus.cc:3060] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Advancing to term 21
I20260620 13:58:16.932124  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.933117  6578 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 14.
I20260620 13:58:16.944025  5997 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:16.953369  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685" is_pre_election: true
W20260620 13:58:16.954061  5998 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.954201  5951 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 17.
I20260620 13:58:16.954174 11885 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:16.955199 11885 raft_consensus.cc:493] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.956020 11885 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:16.959637  6584 raft_consensus.cc:2468] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 21.
I20260620 13:58:16.959856  5777 catalog_manager.cc:5696] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 16 to 17, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 17 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:16.928583 11945 consensus_queue.cc:237] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.953521  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:16.954994  5998 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.967928  6552 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:16.968783 11909 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:16.969293 11909 raft_consensus.cc:493] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.969801 11909 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:16.970180 11940 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260620 13:58:16.969283 11885 raft_consensus.cc:515] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:16.977509 11885 leader_election.cc:290] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:16.924080 11889 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
W20260620 13:58:16.978366  5998 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:16.978296 11889 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.981105 11889 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:16.981906  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:16.982220  5998 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:16.983343 11909 raft_consensus.cc:515] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.959808  5997 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:16.984617 11889 raft_consensus.cc:2804] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Leader election won for term 21
I20260620 13:58:16.984774 11885 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:16.985342 11885 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:16.986119  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3e3ff471834714a3885231e648b8ee" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:16.986701  5955 raft_consensus.cc:3060] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Advancing to term 16
I20260620 13:58:16.987785 11889 raft_consensus.cc:697] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:16.988948 11889 consensus_queue.cc:237] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:16.996172  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:16.996307  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:16.997692  6584 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:17.002311 11940 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:58:16.985752 11885 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:17.002818 11940 raft_consensus.cc:493] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:17.004864 11940 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:16.998574  5955 raft_consensus.cc:2468] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 16.
I20260620 13:58:17.016954 11909 leader_election.cc:290] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:17.012002  5998 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.021749  5997 leader_election.cc:304] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 
I20260620 13:58:17.022651 11945 raft_consensus.cc:2804] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 13:58:17.024056 11885 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:17.046018 11885 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:17.028970 11945 raft_consensus.cc:697] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:17.032210  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:17.033375  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:17.047006  5955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:16.988082 11941 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.047879  5955 raft_consensus.cc:3060] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:17.047886 11945 consensus_queue.cc:237] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
W20260620 13:58:17.054539  5998 leader_election.cc:336] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.041630  5777 catalog_manager.cc:5696] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 16 to 17, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 17 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:17.026235 11909 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260620 13:58:17.055316 11940 raft_consensus.cc:515] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.055652 11909 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:17.056083  5777 catalog_manager.cc:5696] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 20 to 21, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 21 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:17.069595 11909 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Advancing to term 18
I20260620 13:58:17.070045 11941 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:17.047644  6033 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 14.
W20260620 13:58:17.055348  5998 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.059132  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:17.073729  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:17.074957 11889 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:17.076244 11937 raft_consensus.cc:2749] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260620 13:58:17.081094  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:17.080847 11909 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.061162  5955 raft_consensus.cc:2468] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 18.
I20260620 13:58:17.064353  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923bfc4f20d94a57b0d84d45e40b12ae" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:17.082204  6024 raft_consensus.cc:3060] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Advancing to term 18
W20260620 13:58:17.086609  5998 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:17.087265  5998 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.088342  5997 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:17.089386 11908 raft_consensus.cc:2804] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election won for term 18
I20260620 13:58:17.090040 11908 raft_consensus.cc:697] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:17.090656 11889 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:17.091192 11889 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:17.091140 11908 consensus_queue.cc:237] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:17.097098  6024 raft_consensus.cc:2468] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 18.
I20260620 13:58:17.101693 11914 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:17.102198 11914 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:17.102589 11914 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:17.104108  4719 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 5905)
I20260620 13:58:17.107533  6578 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 18: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:17.109508 11937 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:17.110065 11937 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.112164 11937 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:17.116701  5924 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:17.119266  6552 leader_election.cc:336] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.120007  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:17.121160  6552 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:17.122437  6552 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:17.123799  6552 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:17.124784  6552 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.104225 11940 leader_election.cc:290] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:17.126112 11948 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260620 13:58:17.142782 11889 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.152918  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:17.159579 11912 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:17.160127 11912 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:17.160567 11912 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:17.138375 11909 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:17.168818  6552 leader_election.cc:304] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:17.170339  5955 raft_consensus.cc:1275] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260620 13:58:17.171134  5777 catalog_manager.cc:5696] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 15 to 16, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 16 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:17.172565 11877 raft_consensus.cc:2804] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election won for term 18
I20260620 13:58:17.173084 11877 raft_consensus.cc:697] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 18 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:17.172807  5777 catalog_manager.cc:5696] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 17 to 18, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 18 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:17.173987 11877 consensus_queue.cc:237] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.174945 11940 consensus_queue.cc:1048] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260620 13:58:17.179172  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:17.179916  6552 leader_election.cc:336] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.181609 11914 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.189004  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f357751cae4b6b87b5972ef2a1fda4" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:17.189810  6024 raft_consensus.cc:3060] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:17.192394  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:17.185953  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:17.196960  6033 raft_consensus.cc:2393] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 18: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
I20260620 13:58:17.196882  6578 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 12.
I20260620 13:58:17.201632  6024 raft_consensus.cc:2468] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 12.
I20260620 13:58:17.177000 11912 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.222970 11912 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:17.222865  6552 leader_election.cc:304] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:17.229925 11889 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:17.242419 11914 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:17.244442  5998 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.269992  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:17.277376  6033 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce39342d8c4a64904b30b98de02b9f in current term 15: Already voted for candidate 663684cf4ae54c929bf8240ca0b63a47 in this term.
W20260620 13:58:17.279832  6552 leader_election.cc:336] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:17.286870  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:17.292230  6552 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.292758  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:17.287958  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 98405.1us
I20260620 13:58:17.298259  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:17.282965  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 66168.4us
I20260620 13:58:17.269418 11909 raft_consensus.cc:2804] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:58:17.299609 11909 raft_consensus.cc:697] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
W20260620 13:58:17.300221  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:17.300596 11909 consensus_queue.cc:237] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.301970 11877 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260620 13:58:17.303371 11937 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260620 13:58:17.306770 11937 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2e82c0c231624695ac5a813230bf5038)
I20260620 13:58:17.307199 11937 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:17.310340  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6ebbc0e9aa474f80952cef69b0ac25" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:17.310634  6552 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.310978  6578 raft_consensus.cc:3060] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
I20260620 13:58:17.311043  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:17.312212 11950 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260620 13:58:17.314129  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:17.319566  6578 raft_consensus.cc:2468] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 15.
W20260620 13:58:17.321045  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:17.324440  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:17.324913  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:17.325304  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:17.333407  5777 catalog_manager.cc:5696] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 17 to 18, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 18 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:17.337118  5924 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:17.338131  5924 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.338734 11914 raft_consensus.cc:2804] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:58:17.339304 11914 raft_consensus.cc:697] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:17.340189 11914 consensus_queue.cc:237] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:17.358547  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:17.359584  6578 raft_consensus.cc:2393] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 663684cf4ae54c929bf8240ca0b63a47 in current term 15: Already voted for candidate b0ce39342d8c4a64904b30b98de02b9f in this term.
I20260620 13:58:17.362857  5998 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:17.366103 11885 raft_consensus.cc:2749] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 13:58:17.379388  6582 raft_consensus.cc:1275] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260620 13:58:17.385311 11937 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:17.418673  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:17.425146  5924 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.425726  5777 catalog_manager.cc:5696] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 14 to 15, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 15 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:17.426018 11937 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:17.440292  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b870adf0b6e5484ba90ad7b17d35cd52" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:17.440897  6584 raft_consensus.cc:3060] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Advancing to term 13
I20260620 13:58:17.450241  5955 raft_consensus.cc:1275] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260620 13:58:17.459237  5780 catalog_manager.cc:5696] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 11 to 12, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 12 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:17.463264 11941 consensus_queue.cc:1048] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260620 13:58:17.471870 11941 consensus_queue.cc:1048] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260620 13:58:17.500941  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:17.512965  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:17.514484  6582 raft_consensus.cc:1275] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260620 13:58:17.524320 11941 consensus_queue.cc:1048] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260620 13:58:17.536767  6584 raft_consensus.cc:2468] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 13.
I20260620 13:58:17.577080  5924 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:17.578497 11937 raft_consensus.cc:2804] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 13:58:17.579044 11937 raft_consensus.cc:697] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:17.580039 11937 consensus_queue.cc:237] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:17.590390  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:17.623629  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:17.647135  6584 raft_consensus.cc:1275] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260620 13:58:17.652212  5777 catalog_manager.cc:5696] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 12 to 13, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 13 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:58:17.656755  5767 catalog_manager.cc:4754] TS 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): ChangeConfig:REMOVE_PEER RPC failed for tablet 71fbe22bd18849f1b94912bb0bdf5bbe: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:17.670885  5957 raft_consensus.cc:1275] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260620 13:58:17.672621 11941 consensus_queue.cc:1048] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260620 13:58:17.690376  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:17.691700 11942 consensus_queue.cc:1048] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260620 13:58:17.696175  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:17.721334  6027 raft_consensus.cc:1275] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260620 13:58:17.722675 11965 consensus_queue.cc:1048] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260620 13:58:17.757519  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:17.759405  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:17.765650 11973 log.cc:927] Time spent T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260620 13:58:17.804512  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:17.805243  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:17.893457  6027 raft_consensus.cc:1275] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260620 13:58:17.897357 11912 consensus_queue.cc:1048] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260620 13:58:17.909310  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:17.943328  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:17.949642  6584 raft_consensus.cc:1275] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260620 13:58:17.952682 11957 consensus_queue.cc:1048] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260620 13:58:18.104677  4719 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:18.187258  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:18.199573  6578 raft_consensus.cc:1275] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260620 13:58:18.205581 11957 consensus_queue.cc:1048] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260620 13:58:18.346880  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.387667  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 60033.4us
W20260620 13:58:18.429149  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.440490  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.458397  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.471418  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.562808  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.588778  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:18.620458 11937 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:18.621100 11937 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:18.629357 11937 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:18.635043  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:18.635843  6027 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 18.
I20260620 13:58:18.643688  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:18.644404  5924 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:18.644418  6578 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 18.
I20260620 13:58:18.647403  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:18.647799  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:18.649667 11937 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260620 13:58:18.650612 11937 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:18.651041 11937 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:18.683753 11937 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:18.700693  5924 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:18.703136  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:18.703693  6027 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:18.713181  6027 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 19.
W20260620 13:58:18.714038  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:18.715390  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:18.721122  6578 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:18.722141 11937 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:18.728883  6578 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 192c750f597c43858e1ad09e8d805685 in term 19.
I20260620 13:58:18.730692  5924 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:18.732204 11937 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Leader election won for term 19
I20260620 13:58:18.733085 11937 raft_consensus.cc:697] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Becoming Leader. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:18.734297 11937 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:18.766271  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:18.801882  5778 catalog_manager.cc:5696] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 reported cstate change: term changed from 17 to 19, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 192c750f597c43858e1ad09e8d805685 (127.4.155.194). New cstate: current_term: 19 leader_uuid: "192c750f597c43858e1ad09e8d805685" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:58:18.826242  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.834371  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.877797  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:18.919091  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:18.945359 11912 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:18.946045 11912 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:18.948691 11912 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:18.951365  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:18.952257  6024 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 15.
I20260620 13:58:18.955264  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:18.956491 11909 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260620 13:58:18.956938 11909 raft_consensus.cc:493] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:18.957283 11909 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Advancing to term 16
W20260620 13:58:18.967334  6552 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:18.970417 11909 raft_consensus.cc:515] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:18.980145 11909 leader_election.cc:290] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:19.002887  6024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1d1d20a2be4ceeb9389e7e3dbd2b5b" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:19.003566  6024 raft_consensus.cc:3060] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Advancing to term 16
W20260620 13:58:19.009260  6552 leader_election.cc:336] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:19.017958  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:19.021765  6024 raft_consensus.cc:2468] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 16.
I20260620 13:58:19.027750  6552 leader_election.cc:304] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:19.032683 11909 raft_consensus.cc:2804] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader election won for term 16
W20260620 13:58:19.046494  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 58025.3us
W20260620 13:58:19.061422  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:19.072983  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:19.085218 11909 raft_consensus.cc:697] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:19.102635  5953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56494
I20260620 13:58:19.103574  5953 raft_consensus.cc:606] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Received request to transfer leadership
I20260620 13:58:19.099244 11909 consensus_queue.cc:237] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:19.105270  4719 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 5905)
I20260620 13:58:19.108353  5957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56494
I20260620 13:58:19.109017  5957 raft_consensus.cc:606] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Received request to transfer leadership
I20260620 13:58:19.141916  5957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe"
dest_uuid: "192c750f597c43858e1ad09e8d805685"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56494
I20260620 13:58:19.142556  5957 raft_consensus.cc:606] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Received request to transfer leadership
I20260620 13:58:19.150887  6584 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260620 13:58:19.156862 11937 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260620 13:58:19.193326 11957 raft_consensus.cc:993] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: : Instructing follower b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:58:19.193797 11957 raft_consensus.cc:1081] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Signalling peer b0ce39342d8c4a64904b30b98de02b9f to start an election
I20260620 13:58:19.194033  5778 catalog_manager.cc:5696] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 14 to 16, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 16 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260620 13:58:19.204962  6584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe"
dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
 from {username='slave'} at 127.0.0.1:46864
I20260620 13:58:19.205646  6584 raft_consensus.cc:493] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:58:19.205976  6584 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:58:19.217437  6584 raft_consensus.cc:515] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:19.257880  6024 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Refusing update from remote peer 192c750f597c43858e1ad09e8d805685: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260620 13:58:19.260102 11937 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260620 13:58:19.261794  6584 leader_election.cc:290] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:19.266583  5953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "192c750f597c43858e1ad09e8d805685"
I20260620 13:58:19.276741  5953 raft_consensus.cc:3055] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Stepping down as leader of term 19
W20260620 13:58:19.277791  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:19.279325  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260620 13:58:19.283030  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbe22bd18849f1b94912bb0bdf5bbe" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "663684cf4ae54c929bf8240ca0b63a47"
I20260620 13:58:19.283702  6033 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Advancing to term 20
I20260620 13:58:19.277101  5953 raft_consensus.cc:740] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 192c750f597c43858e1ad09e8d805685, State: Running, Role: LEADER
I20260620 13:58:19.285095  5953 consensus_queue.cc:260] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:19.286291  5953 raft_consensus.cc:3060] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 19 FOLLOWER]: Advancing to term 20
W20260620 13:58:19.298538  6552 leader_election.cc:336] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:19.300770  6033 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 20.
I20260620 13:58:19.301065  5953 raft_consensus.cc:2468] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ce39342d8c4a64904b30b98de02b9f in term 20.
W20260620 13:58:19.306103  5829 auto_rebalancer.cc:855] Removing replace marker failed: Replica 192c750f597c43858e1ad09e8d805685 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:19.306525  5829 auto_rebalancer.cc:863] Could not move replica: Remote error: Service unavailable: leadership transfer for 71fbe22bd18849f1b94912bb0bdf5bbe already in progress
W20260620 13:58:19.306831  5829 auto_rebalancer.cc:301] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 71fbe22bd18849f1b94912bb0bdf5bbe already in progress
I20260620 13:58:19.312456 11945 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:19.313041 11945 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:19.314656  6552 leader_election.cc:304] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:19.317411 11988 raft_consensus.cc:2804] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Leader election won for term 20
I20260620 13:58:19.317973 11988 raft_consensus.cc:697] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 20 LEADER]: Becoming Leader. State: Replica: b0ce39342d8c4a64904b30b98de02b9f, State: Running, Role: LEADER
I20260620 13:58:19.318943 11988 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:19.323010 11945 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:19.325592  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:19.326241  6584 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 18.
I20260620 13:58:19.336102  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:19.339270 11945 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260620 13:58:19.339695 11945 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:19.341612  5778 catalog_manager.cc:5696] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f reported cstate change: term changed from 19 to 20, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196). New cstate: current_term: 20 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260620 13:58:19.347579  5998 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:19.340143 11945 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Advancing to term 19
I20260620 13:58:19.396739 11945 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:19.400408 11945 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 election: Requested vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:19.401758  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50e28625b20048a398049a7734aaeaf8" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:19.402377  6584 raft_consensus.cc:3060] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Advancing to term 19
W20260620 13:58:19.406271  5998 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:19.423669  6584 raft_consensus.cc:2468] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 19.
I20260620 13:58:19.426328  5998 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:19.427016 11994 raft_consensus.cc:2804] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Leader election won for term 19
I20260620 13:58:19.427834 11994 raft_consensus.cc:697] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:19.428762 11994 consensus_queue.cc:237] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:19.458420  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:19.474675  5778 catalog_manager.cc:5696] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 17 to 19, leader changed from 2e82c0c231624695ac5a813230bf5038 (127.4.155.193) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 19 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:19.519424  6024 raft_consensus.cc:1275] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260620 13:58:19.521606 11909 consensus_queue.cc:1048] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260620 13:58:19.534365  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:19.544275  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:19.549060  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:19.623906  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:19.672780  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:19.712538  6024 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260620 13:58:19.714857 11912 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260620 13:58:19.784860  5924 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111) [suppressed 423 similar messages]
I20260620 13:58:19.810145  5957 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260620 13:58:19.811535  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260620 13:58:19.812501 11988 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260620 13:58:19.825752  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 64216.1us
W20260620 13:58:19.867674  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:19.868732  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:19.869467  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:19.880129  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:19.907506  5767 catalog_manager.cc:5226] ChangeConfig:REMOVE_PEER RPC for tablet 71fbe22bd18849f1b94912bb0bdf5bbe with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260620 13:58:19.911222  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 49898.1us
W20260620 13:58:19.926048  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:19.954628  6584 raft_consensus.cc:1275] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260620 13:58:19.970422  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:19.970996  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260620 13:58:19.989900 12005 consensus_queue.cc:1048] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260620 13:58:20.068739  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:20.099857  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:20.106587  4719 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:20.173903  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:20.276417  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:20.291280  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:20.335647  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:20.343794  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:20.352159  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:20.353955  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:20.387339  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:20.628597  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:20.643982  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:20.666546  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:20.845752  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:20.962123  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.109617  4719 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:21.181331  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.187976  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.190474  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.193243  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.193782  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.208027  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.321287  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.335989  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.470304  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.480934  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:21.502365  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.573356  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.704797  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.753752  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.832056  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:21.907552  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.912948  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:21.955436  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.051245  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.109737  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:22.110210  4719 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:22.132949  6551 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 99610us
W20260620 13:58:22.152882  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:22.242769  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.317227  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:22.336095  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:22.437754  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.448881  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.468832  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:22.489051  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.578408  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.605912  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.607693  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.687413  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:22.721342  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:22.826428  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:22.882519  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:22.973296  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:22.988996  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.049105  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:23.111881  4719 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:23.116313  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:23.159421  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:23.209328  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.313004  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:23.411029  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.438529  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.508450  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.523320  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.534442  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.651716  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.654755  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:23.753443  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:24.020084  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:24.020888  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:24.021427  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260620 13:58:24.044579  6582 consensus_queue.cc:237] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:24.094357  6027 raft_consensus.cc:1275] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Refusing update from remote peer b0ce39342d8c4a64904b30b98de02b9f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260620 13:58:24.098333 12020 consensus_queue.cc:1048] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260620 13:58:24.088992  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:24.109124  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:24.112612  4719 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:24.117758  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260620 13:58:24.144315 12019 raft_consensus.cc:2955] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 8 to 14, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:24.159495  6027 raft_consensus.cc:2955] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 8 to 14, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
W20260620 13:58:24.183892  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:24.224378  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260620 13:58:24.274618  5778 catalog_manager.cc:5696] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: config changed from index 8 to 14, VOTER 192c750f597c43858e1ad09e8d805685 (127.4.155.194) evicted. New cstate: current_term: 20 leader_uuid: "b0ce39342d8c4a64904b30b98de02b9f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } } }
I20260620 13:58:24.359474  5767 catalog_manager.cc:5209] ChangeConfig:REMOVE_PEER RPC for tablet 71fbe22bd18849f1b94912bb0bdf5bbe with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
W20260620 13:58:24.398826  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:24.400657  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260620 13:58:24.403579  5949 tablet_service.cc:1558] Processing DeleteTablet for tablet 71fbe22bd18849f1b94912bb0bdf5bbe with delete_type TABLET_DATA_TOMBSTONED (TS 192c750f597c43858e1ad09e8d805685 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:56494
W20260620 13:58:24.441682  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260620 13:58:24.524760 12030 tablet_replica.cc:333] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:24.553256 12030 raft_consensus.cc:2243] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:24.559669 12030 raft_consensus.cc:2272] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:24.586604 12030 ts_tablet_manager.cc:1916] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260620 13:58:24.582432  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:24.605171  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:24.611893  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:24.617553  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:24.618260  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:24.627410  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:24.691799  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:24.726459  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:24.740443 12030 ts_tablet_manager.cc:1929] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.13
I20260620 13:58:24.741285 12030 log.cc:1199] T 71fbe22bd18849f1b94912bb0bdf5bbe P 192c750f597c43858e1ad09e8d805685: Deleting WAL directory at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/wals/71fbe22bd18849f1b94912bb0bdf5bbe
I20260620 13:58:24.743932  5766 catalog_manager.cc:5027] TS 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): tablet 71fbe22bd18849f1b94912bb0bdf5bbe (table test-workload [id=bc35799e3b2249d98d34fa7405c72870]) successfully deleted
W20260620 13:58:24.751722  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:24.777184  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:24.777765  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:24.849149  5998 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111) [suppressed 449 similar messages]
W20260620 13:58:24.875967  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:24.916411  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:24.989089  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:25.031225  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:25.113206  4719 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:25.214633  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:25.261606  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:25.262503  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:25.275012  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:25.282362  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:25.346730  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:25.524688  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:25.568738  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:25.707789  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:25.765190  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:25.960832  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.019255  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:26.041878  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.113466  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:26.113708  4719 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:26.114037  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.132413  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.175251  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 58194.1us
W20260620 13:58:26.212134  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.223325  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.226866  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.397590  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.587450  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.623179  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.687306  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.695964  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:26.723227  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.787618  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.816176  5812 debug-util.cc:398] Leaking SignalData structure 0x7b0800308000 after lost signal to thread 4722
W20260620 13:58:26.817345  5812 debug-util.cc:398] Leaking SignalData structure 0x7b08001948c0 after lost signal to thread 5815
W20260620 13:58:26.818661  5812 debug-util.cc:398] Leaking SignalData structure 0x7b0800035380 after lost signal to thread 5983
W20260620 13:58:26.819810  5812 debug-util.cc:398] Leaking SignalData structure 0x7b0800034d40 after lost signal to thread 6057
W20260620 13:58:26.821324  5812 debug-util.cc:398] Leaking SignalData structure 0x7b08001725a0 after lost signal to thread 6611
W20260620 13:58:26.828399  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:26.972661  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:27.031857  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:27.085577  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:27.114776  4719 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:27.118801  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:27.143612  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:27.173522  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:27.217525  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:27.223919  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.253543  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.301852  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.303920  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:27.320514  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.370146  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.385782  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:27.403410  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:27.410187  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.746675  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:27.759907  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:27.762957  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:27.781060  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.805656  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:27.849509  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.005556  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.009836  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.115312  4719 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:28.298512  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:28.334697  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:28.356916  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.388926  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.459909  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.466511  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.532045  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:28.546291  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.573807  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.676573  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:28.775310  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.815584  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.908795  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:28.919811  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:29.070269  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.079260  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:29.090238  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.115800  4719 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:29.313788  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.371599  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.422955  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.433701  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.491431  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:29.549681  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.587122  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:29.601053  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.618994  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:29.654975  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:29.690016  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.712522  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:29.752080  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:29.801847  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:29.830238  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:29.878881  6552 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111) [suppressed 441 similar messages]
W20260620 13:58:29.891314  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:29.896106  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:29.937305  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:29.974190  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:30.029333  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.116365  4719 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:30.162879  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.284505  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:30.349702  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:30.385330  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.396354  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.502813  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:30.562105  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.657449  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.785882  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.889709  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:30.906824  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:30.926275  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:30.924314  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.002255  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:31.049196  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.070832  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.080200  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.109310  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:31.116981  4719 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:31.180369  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.237552  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.346577  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 77149.5us
W20260620 13:58:31.362918  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.426620  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.446596  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.528671  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260620 13:58:31.566143  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.588680  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:31.632441  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.665544  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.875547  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:31.908579  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:31.940757  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:41493, user_credentials={real_user=slave}} blocked reactor thread for 51959us
W20260620 13:58:32.021153  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:32.060791  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:32.073865  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.079787  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:32.108177  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:32.111884  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260620 13:58:32.117468  4719 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:32.169091  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:32.242837  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:32.262337  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.271541  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.315759  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:32.322211  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.322949  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.443183  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.444128  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:32.607620  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.888542  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:32.930119  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:32.933775  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:32.936564  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:33.025722  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.048575  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.079697  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.117959  4719 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:33.139086  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.215399  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.239842  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:33.292147  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.331665  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:33.460968  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.484815  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:33.491546  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.522518  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.550936  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.559798  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.643694  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.720047  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:33.784821  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 49512.6us
W20260620 13:58:33.795066  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:33.888890  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 73056.9us
W20260620 13:58:33.920437  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.055263  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260620 13:58:34.078720  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:34.115020  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.118669  4719 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:34.155812  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.225785  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.329171  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.365911  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:34.509532  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.512696  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:34.572535  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.574370  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:34.630394  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:34.644611  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:34.695688  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:34.727514  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:34.728479  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:34.747448  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.779811  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:34.797338  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:34.836436  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:34.880479  6552 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111) [suppressed 453 similar messages]
W20260620 13:58:34.907912  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:34.966534  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.012040  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.045720  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:35.119185  4719 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 5905)
W20260620 13:58:35.362258  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:35.437079  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.512944  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.514063  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.514581  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:35.530820  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:35.536854  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.647372  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.815261  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.850651  5924 consensus_peers.cc:597] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:35.881553  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260620 13:58:36.016101  4719 tablet_server.cc:196] TabletServer@127.4.155.193:0 shutdown complete.
W20260620 13:58:36.063259  5924 consensus_peers.cc:597] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:36.076894  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:36.077612  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.098176  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.119257  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.127628  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:36.163156  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:36.164168  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.347841  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.467077  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.527444  5924 consensus_peers.cc:597] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260620 13:58:36.541664  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260620 13:58:36.543498  4719 tablet_server.cc:179] TabletServer@127.4.155.194:0 shutting down...
W20260620 13:58:36.634241  6551 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.694636  6551 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.695647  5997 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.701267  5997 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.706255  5997 consensus_peers.cc:597] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.725521  5997 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.730432  6551 consensus_peers.cc:597] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.731938  6551 consensus_peers.cc:597] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.737546  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.754171  5997 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.755383  5997 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.779731  5924 consensus_peers.cc:597] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:36.785549  6551 consensus_peers.cc:597] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:36.787326  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:58:36.788915  4719 tablet_replica.cc:333] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:36.790019  4719 raft_consensus.cc:2243] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.791081  4719 raft_consensus.cc:2272] T d562ae472315433ca373f0a47f931afa P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:36.799206  4719 tablet_replica.cc:333] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:36.795801  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260620 13:58:36.813166  4719 raft_consensus.cc:2243] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.814278  4719 raft_consensus.cc:2272] T bab45d487c864870aba1aee58d01ca95 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:36.820478  4719 tablet_replica.cc:333] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:36.821568  4719 raft_consensus.cc:2243] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.822628  4719 raft_consensus.cc:2272] T 0120e0a908b041479e2847fb24268985 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:36.826269  6551 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:36.827685  4719 tablet_replica.cc:333] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:36.855533  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.851647  6551 consensus_peers.cc:597] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:36.856182  4719 raft_consensus.cc:2243] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.876569  4719 raft_consensus.cc:2272] T 59b6ab17fde545f5b655c12383d08351 P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:36.845997  5997 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:36.888399  4719 tablet_replica.cc:333] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:36.889978  4719 raft_consensus.cc:2243] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.890997  4719 raft_consensus.cc:2272] T 1f1025714d0b439cb56cc08764cb5fce P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:36.907693  4719 tablet_replica.cc:333] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:36.908706  4719 raft_consensus.cc:2243] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.909605  4719 raft_consensus.cc:2272] T 08f835b507484456a3c708ba0e6fb982 P 192c750f597c43858e1ad09e8d805685 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:36.917435  4719 tablet_replica.cc:333] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:36.918736  4719 raft_consensus.cc:2243] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.923717  4719 raft_consensus.cc:2272] T 59266d6f1b524a25ac59ce6dd8f39c95 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:36.926759  4719 tablet_replica.cc:333] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:36.940938  4719 raft_consensus.cc:2243] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:36.946224  4719 raft_consensus.cc:2272] T d483a507ec73494da65730a6444e1fd6 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:36.951516  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:36.959741  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260620 13:58:36.954758  4719 tablet_replica.cc:333] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:36.972818  5997 consensus_peers.cc:597] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.974920  5997 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:36.995481  5997 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.005008  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260620 13:58:36.973217  4719 raft_consensus.cc:2243] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.006009  4719 raft_consensus.cc:2272] T 29e2284e793941b4aa9829a72313998c P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:37.013954  6551 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.014744  6551 consensus_peers.cc:597] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:37.024017  4719 tablet_replica.cc:333] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.033041  4719 raft_consensus.cc:2243] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.034601  4719 raft_consensus.cc:2272] T 020dbb4b944d4deeba944d1a7c6d5c76 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.043218  4719 tablet_replica.cc:333] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:37.045184  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:37.047464  5997 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.052366  6551 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.054594  5997 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.055281  5997 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.055934  5997 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.056572  5997 consensus_peers.cc:597] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.057199  5997 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.060657  5997 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.062055  5997 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:37.061367  4719 raft_consensus.cc:2243] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 11 LEADER]: Raft consensus shutting down.
I20260620 13:58:37.065369  4719 raft_consensus.cc:2272] T b00b548648e441dbb777699ee0ef3f60 P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:37.065758  5997 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.077626  6551 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.084542  6551 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.085146  6551 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.085748  6551 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.083690  5997 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.087291  5997 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.088627  5997 consensus_peers.cc:597] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:37.072738  4719 tablet_replica.cc:333] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.090590  4719 raft_consensus.cc:2243] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:37.090950  5997 consensus_peers.cc:597] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:37.125912  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:37.132454  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260620 13:58:37.156153  4719 raft_consensus.cc:2272] T 24c27735bbb449a98fab7edad2ba9837 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:37.187160  5997 consensus_peers.cc:597] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:37.188086  4719 tablet_replica.cc:333] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:37.206032  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:37.222337  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:37.219532  4719 raft_consensus.cc:2243] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.225231  4719 raft_consensus.cc:2272] T 1a7540e02ee04cdb9365701b0b6a9077 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.233930  4719 tablet_replica.cc:333] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.234881  4719 raft_consensus.cc:2243] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 21 LEADER]: Raft consensus shutting down.
I20260620 13:58:37.262748  4719 raft_consensus.cc:2272] T 2f67b5ea416143c1a0a6729eaaa909c2 P 192c750f597c43858e1ad09e8d805685 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:37.285740  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260620 13:58:37.287055  4719 tablet_replica.cc:333] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.297911  4719 raft_consensus.cc:2243] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.327251  4719 raft_consensus.cc:2272] T ba377ed0ce364307bbe22e24ddafa62e P 192c750f597c43858e1ad09e8d805685 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.335162  4719 tablet_replica.cc:333] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:37.323272  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:37.344985  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:37.359236  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:37.367929  4719 raft_consensus.cc:2243] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:37.374928  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260620 13:58:37.398983  4719 raft_consensus.cc:2272] T 18f8f8a1b370453aade5f48cd3bedcbd P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.409937  4719 tablet_replica.cc:333] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.433300  4719 raft_consensus.cc:2243] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:37.437115  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:37.445190  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:37.446957  4719 raft_consensus.cc:2272] T 0e0ab32eab32415c8e9ea1fda9508733 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:37.449177  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:37.457267  4719 tablet_replica.cc:333] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.463441  4719 raft_consensus.cc:2243] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:37.466297  4719 raft_consensus.cc:2272] T 14bccd20cc3f44b69eeefefc4f8b72f9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.486791  4719 tablet_replica.cc:333] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.489259  4719 raft_consensus.cc:2243] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:37.539899  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:37.492180  4719 raft_consensus.cc:2272] T 6ad92842cd6b4c0082afb264bae0ec8d P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.575763 12074 raft_consensus.cc:493] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:37.576385 12074 raft_consensus.cc:515] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:37.579293 12074 leader_election.cc:290] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:37.585176  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8edcc5cb024ebebdb3cac403f19bc4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:37.585498  4719 tablet_replica.cc:333] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.588064  4719 raft_consensus.cc:2243] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.589370  4719 raft_consensus.cc:2272] T 81b2378deea24954b2003dda61c1b2c1 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.598372  4719 tablet_replica.cc:333] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.603516  4719 raft_consensus.cc:2243] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:37.604429  5924 leader_election.cc:336] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:37.611629  5924 leader_election.cc:304] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:37.612659 12074 raft_consensus.cc:2749] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:37.607615  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260620 13:58:37.620370  4719 raft_consensus.cc:2272] T a4cd17345f80464287c5952767849dbb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.629137  4719 tablet_replica.cc:333] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.630795  4719 raft_consensus.cc:2243] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.631728  4719 raft_consensus.cc:2272] T 8b06407c45954213adfef7604a8c4f21 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.637739 12074 raft_consensus.cc:493] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.638445  4719 tablet_replica.cc:333] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.638345 12074 raft_consensus.cc:515] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.641494 12074 leader_election.cc:290] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:37.639353  4719 raft_consensus.cc:2243] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 9 LEADER]: Raft consensus shutting down.
I20260620 13:58:37.645227  4719 raft_consensus.cc:2272] T c3ee15f74e3e4771a050c854530121f3 P 192c750f597c43858e1ad09e8d805685 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.646831  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5757f55132b747db98400dba7b8056df" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.654227 12074 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.654824 12074 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:37.656945 12074 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:37.656527  4719 tablet_replica.cc:333] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.658942  4719 raft_consensus.cc:2243] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.662739  4719 raft_consensus.cc:2272] T b53823dabce64d5284772ca73d71ddc9 P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.665814  4719 tablet_replica.cc:333] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.670915  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.672394  4719 raft_consensus.cc:2243] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.673273  4719 raft_consensus.cc:2272] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:37.678666  5924 leader_election.cc:336] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:37.679311  5924 leader_election.cc:304] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:37.680087 12074 raft_consensus.cc:2749] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:37.681206  4719 tablet_replica.cc:333] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.688205  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bd36dee6d64396bfbb86cd90a7bedd" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:37.705973  4719 raft_consensus.cc:2243] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.706971  4719 raft_consensus.cc:2272] T 4fd646f84cb04514aa9889ea5f67db81 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.707535  5924 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
W20260620 13:58:37.708334  5924 raft_consensus.cc:2686] T 86bd36dee6d64396bfbb86cd90a7bedd P 192c750f597c43858e1ad09e8d805685: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 13:58:37.711591 12074 raft_consensus.cc:493] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.712198 12074 raft_consensus.cc:515] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.714293 12074 leader_election.cc:290] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:37.716391  4719 tablet_replica.cc:333] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.719281  4719 raft_consensus.cc:2243] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:37.725098  4719 raft_consensus.cc:2272] T f6d4fcf1f6a541c6ae1a7724f27750eb P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.727747  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5119d05dc81b442f8653989b96a3626d" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.730908  4719 tablet_replica.cc:333] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.735437 12074 raft_consensus.cc:493] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
W20260620 13:58:37.736017  5924 leader_election.cc:336] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:37.736491  5924 leader_election.cc:304] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:37.736166 12074 raft_consensus.cc:515] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.737655  4719 raft_consensus.cc:2243] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.738265 12074 leader_election.cc:290] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:37.738626  4719 raft_consensus.cc:2272] T fb8edcc5cb024ebebdb3cac403f19bc4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.749343 12074 raft_consensus.cc:2749] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260620 13:58:37.751533  4719 tablet_replica.cc:333] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.754575  4719 raft_consensus.cc:2243] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.758548  4719 raft_consensus.cc:2272] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.799825  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115c5e2556794dd8801d1f451aa245fb" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:37.803356  5922 raft_consensus.cc:687] T 0e3e3ff471834714a3885231e648b8ee P 192c750f597c43858e1ad09e8d805685: failed to submit failure detected task: Service unavailable: Thread pool token was shut down
I20260620 13:58:37.803522 12074 raft_consensus.cc:493] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.804239 12074 raft_consensus.cc:515] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.807375 12074 leader_election.cc:290] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:37.809619 12074 raft_consensus.cc:493] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.810473 12074 raft_consensus.cc:515] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.814862  4719 tablet_replica.cc:333] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.826203  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd3e1f0e5a34ba69029888abcdfb2f1" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.827363  4719 raft_consensus.cc:2243] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 15 LEADER]: Raft consensus shutting down.
I20260620 13:58:37.828681  4719 raft_consensus.cc:2272] T fd6ebbc0e9aa474f80952cef69b0ac25 P 192c750f597c43858e1ad09e8d805685 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.833292  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab83097997ba42219f9a63aad224f786" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.819495 12074 leader_election.cc:290] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:37.841435 12074 raft_consensus.cc:493] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.844676 12087 raft_consensus.cc:493] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:37.845275 12087 raft_consensus.cc:515] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:37.842017 12074 raft_consensus.cc:515] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.849611 12074 leader_election.cc:290] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:37.858243 12087 leader_election.cc:290] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:37.858975  4719 tablet_replica.cc:333] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.859894  4719 raft_consensus.cc:2243] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:37.860491  5924 leader_election.cc:336] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:37.860651  4719 raft_consensus.cc:2272] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.869232 12087 raft_consensus.cc:493] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.873229 12087 raft_consensus.cc:515] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.875429 12087 leader_election.cc:290] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:37.875788  4719 tablet_replica.cc:333] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.876670  4719 raft_consensus.cc:2243] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.877739  4719 raft_consensus.cc:2272] T 90f87066e519439ab8be15dccf1d2493 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.881129  5924 leader_election.cc:304] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:37.881922 12087 raft_consensus.cc:2749] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260620 13:58:37.887997 12087 raft_consensus.cc:493] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0ce39342d8c4a64904b30b98de02b9f)
I20260620 13:58:37.888559 12087 raft_consensus.cc:515] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:37.890645 12087 leader_election.cc:290] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:37.894090  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec20d216461d4414813627ca62e330e4" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.897883  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.909078  4719 tablet_replica.cc:333] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:37.910065  4719 raft_consensus.cc:2243] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:37.910810  4719 raft_consensus.cc:2272] T dc919ad08d5e4a9d9870a33b6fc425e5 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:37.912534  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649259d8acc1429d8dddd2677f87f911" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:37.916013  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b89d9f1eec4bfba2f3b0052c49f040" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:37.919373 12087 raft_consensus.cc:493] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:37.920083 12087 raft_consensus.cc:515] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:37.920611  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ee9750110f428fa454f96aaeb360ef" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:37.922127 12087 leader_election.cc:290] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:37.927140  5924 leader_election.cc:336] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:37.927667  5924 leader_election.cc:304] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:37.934983 12087 raft_consensus.cc:2749] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:37.935278  5924 leader_election.cc:336] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:37.935714  5924 leader_election.cc:304] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:37.936457 12087 raft_consensus.cc:2749] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260620 13:58:37.947062  4719 tablet_replica.cc:333] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:37.949975  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:37.950554  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:37.957845  5924 leader_election.cc:304] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:37.958771 12087 raft_consensus.cc:2749] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260620 13:58:37.948439  4719 raft_consensus.cc:2243] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.028555  4719 raft_consensus.cc:2272] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.034960  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8838a101a5e8400c91d053b307be45ed" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:38.037722 12087 raft_consensus.cc:493] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:38.038450 12087 raft_consensus.cc:515] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:38.040757 12087 leader_election.cc:290] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:38.053610  5924 leader_election.cc:336] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:38.054171  5924 leader_election.cc:304] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:38.054845  5924 raft_consensus.cc:2686] T ec20d216461d4414813627ca62e330e4 P 192c750f597c43858e1ad09e8d805685: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 13:58:38.059357  4719 tablet_replica.cc:333] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.060266  4719 raft_consensus.cc:2243] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:38.065877  5924 leader_election.cc:336] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:38.066460  5924 leader_election.cc:304] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:38.067260 12087 raft_consensus.cc:2749] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:38.067500  5924 leader_election.cc:336] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:38.067932  5924 leader_election.cc:304] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, b0ce39342d8c4a64904b30b98de02b9f
I20260620 13:58:38.068907 12087 raft_consensus.cc:2749] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:38.072016  4719 raft_consensus.cc:2272] T 5757f55132b747db98400dba7b8056df P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:38.092357  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260620 13:58:38.127243  4719 tablet_replica.cc:333] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:38.129873  5924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:46177, user_credentials={real_user=slave}} blocked reactor thread for 60690.8us
W20260620 13:58:38.141701  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:38.147505  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260620 13:58:38.162094  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dbd1edec8054c1ba05721321572fbbf" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:38.152263  4719 raft_consensus.cc:2243] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.164661  4719 raft_consensus.cc:2272] T 5119d05dc81b442f8653989b96a3626d P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.165426 12087 raft_consensus.cc:493] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:38.176483 12087 raft_consensus.cc:515] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } }
I20260620 13:58:38.178550 12087 leader_election.cc:290] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:38.166334  5924 leader_election.cc:336] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:38.169699 12080 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.184434  5924 leader_election.cc:304] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:38.185238  5924 raft_consensus.cc:2686] T 8838a101a5e8400c91d053b307be45ed P 192c750f597c43858e1ad09e8d805685: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 13:58:38.184609 12080 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.188398 12080 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:38.197160  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:38.213181  4719 tablet_replica.cc:333] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.221401  4719 raft_consensus.cc:2243] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.225184  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc69a9218a64fa6b346021a0d32eaad" candidate_uuid: "192c750f597c43858e1ad09e8d805685" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:38.237681  4719 raft_consensus.cc:2272] T efd3e1f0e5a34ba69029888abcdfb2f1 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.249598  4719 tablet_replica.cc:333] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
W20260620 13:58:38.229460  5924 leader_election.cc:336] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:38.270566  5924 leader_election.cc:304] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:38.271483 12087 raft_consensus.cc:2749] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:58:38.264881  6551 leader_election.cc:336] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:38.273836  6551 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
W20260620 13:58:38.276089  5924 leader_election.cc:336] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:38.276898  5924 leader_election.cc:304] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 192c750f597c43858e1ad09e8d805685; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:38.287170 12087 raft_consensus.cc:2749] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260620 13:58:38.278530  4719 raft_consensus.cc:2243] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 13 LEADER]: Raft consensus shutting down.
I20260620 13:58:38.280939 12084 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260620 13:58:38.296101  4719 raft_consensus.cc:2272] T b870adf0b6e5484ba90ad7b17d35cd52 P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.302664 12084 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.303294 12084 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.305536 12084 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:38.339015  6033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
I20260620 13:58:38.345669  4719 tablet_replica.cc:333] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.358373  4719 raft_consensus.cc:2243] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.359200  4719 raft_consensus.cc:2272] T 3fc69a9218a64fa6b346021a0d32eaad P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:38.348376  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:38.352591  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:38.386226  4719 tablet_replica.cc:333] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.389526  4719 raft_consensus.cc:2243] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.395027  4719 raft_consensus.cc:2272] T d1b89d9f1eec4bfba2f3b0052c49f040 P 192c750f597c43858e1ad09e8d805685 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.398290  4719 tablet_replica.cc:333] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.398882  4719 raft_consensus.cc:2243] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.399485  4719 raft_consensus.cc:2272] T 8dbd1edec8054c1ba05721321572fbbf P 192c750f597c43858e1ad09e8d805685 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.401651  4719 tablet_replica.cc:333] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.402328  4719 raft_consensus.cc:2243] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260620 13:58:38.387059  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:38.402951  4719 raft_consensus.cc:2272] T ab83097997ba42219f9a63aad224f786 P 192c750f597c43858e1ad09e8d805685 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.406313  4719 tablet_replica.cc:333] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.407033  4719 raft_consensus.cc:2243] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.407874  4719 raft_consensus.cc:2272] T 49ee9750110f428fa454f96aaeb360ef P 192c750f597c43858e1ad09e8d805685 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.410497  4719 tablet_replica.cc:333] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.411242  4719 raft_consensus.cc:2243] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.412298  4719 raft_consensus.cc:2272] T 649259d8acc1429d8dddd2677f87f911 P 192c750f597c43858e1ad09e8d805685 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:38.415035  4719 tablet_replica.cc:333] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685: stopping tablet replica
I20260620 13:58:38.415743  4719 raft_consensus.cc:2243] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:38.416375  4719 raft_consensus.cc:2272] T 115c5e2556794dd8801d1f451aa245fb P 192c750f597c43858e1ad09e8d805685 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:38.430367  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:38.455998 12068 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.456488 12068 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.458518 12068 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:38.462797  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:38.463438  6584 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 11.
W20260620 13:58:38.469787  6551 leader_election.cc:336] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 13:58:38.470371  6551 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:38.471127 12084 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260620 13:58:38.473769  5998 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:38.478175  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:38.485550  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:38.488346 12068 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260620 13:58:38.488725 12068 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.489064 12068 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:38.497174 12068 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.507743 12068 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
I20260620 13:58:38.511935  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b00b548648e441dbb777699ee0ef3f60" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:38.512604  6584 raft_consensus.cc:3060] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Advancing to term 12
I20260620 13:58:38.521171  6584 raft_consensus.cc:2468] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 12.
I20260620 13:58:38.539948  5998 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:38.552258 12068 raft_consensus.cc:2804] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Leader election won for term 12
I20260620 13:58:38.553570 12068 raft_consensus.cc:697] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:38.554569 12068 consensus_queue.cc:237] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:38.582180  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260620 13:58:38.603523 12086 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.605100 12086 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.610379 12086 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:38.648245  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:38.662220  5998 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:38.662828  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
W20260620 13:58:38.673509  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3924) could send its response
I20260620 13:58:38.678803  6578 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 21.
W20260620 13:58:38.679565  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 3925) could send its response
W20260620 13:58:38.680404  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3926) could send its response
W20260620 13:58:38.681149  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 3927) could send its response
W20260620 13:58:38.681916  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3928) could send its response
I20260620 13:58:38.694665  5778 catalog_manager.cc:5696] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 11 to 12, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 12 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:58:38.725709  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3929) could send its response
W20260620 13:58:38.729547  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3930) could send its response
W20260620 13:58:38.736650  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35986 (request call id 3931) could send its response
I20260620 13:58:38.727209  5998 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
I20260620 13:58:38.740676 12090 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260620 13:58:38.742039 12090 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.742673 12090 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Advancing to term 22
W20260620 13:58:38.763392  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3932) could send its response
W20260620 13:58:38.768421  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3933) could send its response
W20260620 13:58:38.775125  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3934) could send its response
W20260620 13:58:38.780037  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3935) could send its response
W20260620 13:58:38.776998  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:38.773319  5998 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:38.789464  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3936) could send its response
W20260620 13:58:38.792557  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3937) could send its response
W20260620 13:58:38.796924  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3938) could send its response
W20260620 13:58:38.799152  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3939) could send its response
W20260620 13:58:38.802961  5923 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3940) could send its response
W20260620 13:58:38.800758  5998 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:38.779076 12090 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.808633 12090 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 22 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:38.812981  5997 connection.cc:573] client connection to 127.4.155.194:38517 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 13:58:38.812887  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f67b5ea416143c1a0a6729eaaa909c2" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
I20260620 13:58:38.813665  6578 raft_consensus.cc:3060] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Advancing to term 22
W20260620 13:58:38.816001  5997 leader_election.cc:336] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 13:58:38.816888  5997 leader_election.cc:336] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 13:58:38.822444  6578 raft_consensus.cc:2468] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 22.
W20260620 13:58:38.840714  6551 connection.cc:573] client connection to 127.4.155.194:38517 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 13:58:38.850582  5997 leader_election.cc:336] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:38.850888  5998 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 
W20260620 13:58:38.852881  4719 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3921) could send its response
W20260620 13:58:38.853731  4719 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3922) could send its response
W20260620 13:58:38.854190  4719 connection.cc:466] server connection from 127.0.0.1:35986 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35986 (request call id 3923) could send its response
I20260620 13:58:38.857692 12076 raft_consensus.cc:2804] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 22 FOLLOWER]: Leader election won for term 22
I20260620 13:58:38.858264 12076 raft_consensus.cc:697] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 22 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:38.864151 12076 consensus_queue.cc:237] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:38.904412  5997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.194:38517, user_credentials={real_user=slave}} blocked reactor thread for 53855.5us
W20260620 13:58:38.907753  5997 leader_election.cc:336] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:38.932389  5778 catalog_manager.cc:5696] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 21 to 22, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 22 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:38.937268 12080 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.937840 12080 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.941462 12080 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:38.952495  6551 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:38.967574  5997 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:38.978742  6552 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:38.979426  6552 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:38.982861 12080 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:38.986243 12084 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:38.986995 12084 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:38.989568 12084 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:38.992208  6027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "b0ce39342d8c4a64904b30b98de02b9f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "663684cf4ae54c929bf8240ca0b63a47" is_pre_election: true
W20260620 13:58:38.994323  6551 leader_election.cc:336] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:38.999094  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:39.002133 12084 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:39.012753  5997 consensus_peers.cc:597] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:39.038890  5998 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:39.040819 12084 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:39.042526 12084 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:39.044593 12084 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:39.054796  6551 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:39.088851  6552 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:39.094569  6552 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:39.099129 12084 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260620 13:58:39.099530  6582 raft_consensus.cc:1275] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260620 13:58:39.103368  5997 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:39.105715 12090 consensus_queue.cc:1048] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260620 13:58:39.112090  5998 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:39.115557 12090 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:39.116226 12090 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:39.118587 12090 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:39.124823  5997 leader_election.cc:336] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:39.126379  6578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f" is_pre_election: true
I20260620 13:58:39.127137  6578 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 14.
I20260620 13:58:39.128479  5998 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:58:39.129436 12090 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260620 13:58:39.129899 12090 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:39.130334 12090 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:39.140884  5997 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.153864  5997 consensus_peers.cc:597] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.154405  5997 consensus_peers.cc:597] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.162954  6551 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.163517  6551 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:39.187577 12090 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:39.212159 12095 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:39.212908 12095 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:39.215358 12095 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:39.212971  5998 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260620 13:58:39.214392 12090 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Requested vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), b0ce39342d8c4a64904b30b98de02b9f (127.4.155.196:34171)
W20260620 13:58:39.225975  6552 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:39.226604  5997 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:39.227895  6584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d4fcf1f6a541c6ae1a7724f27750eb" candidate_uuid: "663684cf4ae54c929bf8240ca0b63a47" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0ce39342d8c4a64904b30b98de02b9f"
W20260620 13:58:39.227538  5997 leader_election.cc:336] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:39.228574  6584 raft_consensus.cc:3060] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Advancing to term 15
W20260620 13:58:39.235854  5997 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.242173  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260620 13:58:39.242918  6551 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:39.243381  6551 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:39.245334 12084 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:39.247246  6584 raft_consensus.cc:2468] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 663684cf4ae54c929bf8240ca0b63a47 in term 15.
W20260620 13:58:39.249969  5998 consensus_peers.cc:597] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260620 13:58:39.251853  5998 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 663684cf4ae54c929bf8240ca0b63a47, b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685
I20260620 13:58:39.252691 12086 raft_consensus.cc:2804] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 13:58:39.253190 12086 raft_consensus.cc:697] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Becoming Leader. State: Replica: 663684cf4ae54c929bf8240ca0b63a47, State: Running, Role: LEADER
I20260620 13:58:39.254081 12086 consensus_queue.cc:237] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:39.263896  5997 consensus_peers.cc:597] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.265308  5997 consensus_peers.cc:597] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.271179  6551 consensus_peers.cc:597] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.273233  5997 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:39.284487  5778 catalog_manager.cc:5696] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 reported cstate change: term changed from 14 to 15, leader changed from 192c750f597c43858e1ad09e8d805685 (127.4.155.194) to 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195). New cstate: current_term: 15 leader_uuid: "663684cf4ae54c929bf8240ca0b63a47" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260620 13:58:39.296700  6551 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.309983  5997 consensus_peers.cc:597] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.319339  5997 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:39.336105  6582 raft_consensus.cc:1275] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 22 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260620 13:58:39.341236  6551 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:39.343466 12068 consensus_queue.cc:1048] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260620 13:58:39.363534  5997 consensus_peers.cc:597] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.378974  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:39.380818  5998 consensus_peers.cc:597] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:39.395272  5997 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.397169  6551 consensus_peers.cc:597] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.397693  6551 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.410759  5997 consensus_peers.cc:597] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:39.434207  5998 consensus_peers.cc:597] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:39.434777  5998 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:39.456257  5997 consensus_peers.cc:597] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.470671  6551 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.470806  5997 consensus_peers.cc:597] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.474349  6551 consensus_peers.cc:597] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.496963  6551 consensus_peers.cc:597] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.500140  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:39.516494  5998 consensus_peers.cc:597] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:39.517815  5997 consensus_peers.cc:597] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.533210  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:39.541538  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:39.548290  5997 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.555229  6551 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.558611  5997 consensus_peers.cc:597] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.600554  5997 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.660005  6551 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.663257  5998 consensus_peers.cc:597] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:39.677350  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:39.678110  6551 consensus_peers.cc:597] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.704437  5997 consensus_peers.cc:597] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.734918  5997 consensus_peers.cc:597] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:58:39.809520 12084 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:39.810096 12084 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:39.812382 12084 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:39.817464  6551 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.821269  6551 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:39.830004  6552 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:39.831139  6552 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:39.831928 12084 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:39.855213  5998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:34171, user_credentials={real_user=slave}} blocked reactor thread for 106461us
I20260620 13:58:39.876149  6578 raft_consensus.cc:1275] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Refusing update from remote peer 663684cf4ae54c929bf8240ca0b63a47: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260620 13:58:39.877841 12068 consensus_queue.cc:1048] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260620 13:58:39.883818  5998 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111) [suppressed 699 similar messages]
W20260620 13:58:39.889883  5997 consensus_peers.cc:597] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:39.902781  5997 consensus_peers.cc:597] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:39.907979  5998 consensus_peers.cc:597] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:39.919528  5997 consensus_peers.cc:597] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:58:40.023269  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260620 13:58:40.054908  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.055425  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.113564  5998 consensus_peers.cc:597] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:40.168144  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:40.210943  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.233105  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.268873  5998 consensus_peers.cc:597] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:40.378186  5998 consensus_peers.cc:597] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260620 13:58:40.500054  4719 tablet_server.cc:196] TabletServer@127.4.155.194:0 shutdown complete.
I20260620 13:58:40.634316  4719 tablet_server.cc:179] TabletServer@127.4.155.195:0 shutting down...
W20260620 13:58:40.641741  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:40.660141  5998 consensus_peers.cc:597] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.674955  5998 consensus_peers.cc:597] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:40.677762  5998 consensus_peers.cc:597] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.697865  5998 consensus_peers.cc:597] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.706166  6552 consensus_peers.cc:597] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:40.715010  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:58:40.716270  4719 tablet_replica.cc:333] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.717314  4719 raft_consensus.cc:2243] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.718098  4719 raft_consensus.cc:2272] T bab45d487c864870aba1aee58d01ca95 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.721462  4719 tablet_replica.cc:333] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.722091  4719 raft_consensus.cc:2243] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.723031  4719 raft_consensus.cc:2272] T d562ae472315433ca373f0a47f931afa P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.725445  4719 tablet_replica.cc:333] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.727219  4719 raft_consensus.cc:2243] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.728200  4719 raft_consensus.cc:2272] T 0120e0a908b041479e2847fb24268985 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.730229  4719 tablet_replica.cc:333] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.730811  4719 raft_consensus.cc:2243] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.731621  4719 raft_consensus.cc:2272] T 08f835b507484456a3c708ba0e6fb982 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.733494  4719 tablet_replica.cc:333] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.734063  4719 raft_consensus.cc:2243] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.734539  4719 raft_consensus.cc:2272] T 59b6ab17fde545f5b655c12383d08351 P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.736449  4719 tablet_replica.cc:333] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.737011  4719 raft_consensus.cc:2243] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.737646  4719 raft_consensus.cc:2272] T 71fbe22bd18849f1b94912bb0bdf5bbe P 663684cf4ae54c929bf8240ca0b63a47 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.741111  4719 tablet_replica.cc:333] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.741961  4719 raft_consensus.cc:2243] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.742868  4719 raft_consensus.cc:2272] T b8a351afb91f46e2b6e724165bc600c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.745263  4719 tablet_replica.cc:333] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.745842  4719 raft_consensus.cc:2243] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.746670  4719 raft_consensus.cc:2272] T 29e2284e793941b4aa9829a72313998c P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.747416 12084 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:40.747977 12084 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:40.749704  4719 tablet_replica.cc:333] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.750612  4719 raft_consensus.cc:2243] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.751235 12084 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:40.752470  4719 raft_consensus.cc:2272] T 59266d6f1b524a25ac59ce6dd8f39c95 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.755267  4719 tablet_replica.cc:333] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
W20260620 13:58:40.755697  6551 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:40.756053  4719 raft_consensus.cc:2243] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.757289  4719 raft_consensus.cc:2272] T d483a507ec73494da65730a6444e1fd6 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.760895  4719 tablet_replica.cc:333] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.761719  4719 raft_consensus.cc:2243] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.762814  4719 raft_consensus.cc:2272] T b00b548648e441dbb777699ee0ef3f60 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.766287  4719 tablet_replica.cc:333] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.767138  4719 raft_consensus.cc:2243] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.767848  4719 raft_consensus.cc:2272] T 24c27735bbb449a98fab7edad2ba9837 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:40.767879  5998 consensus_peers.cc:597] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260620 13:58:40.771238  4719 tablet_replica.cc:333] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
W20260620 13:58:40.771206  5998 consensus_peers.cc:597] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260620 13:58:40.772185  4719 raft_consensus.cc:2243] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 18 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.773350  4719 raft_consensus.cc:2272] T 18f8f8a1b370453aade5f48cd3bedcbd P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.776259  4719 tablet_replica.cc:333] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.777091  4719 raft_consensus.cc:2243] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.777768  4719 raft_consensus.cc:2272] T 923bfc4f20d94a57b0d84d45e40b12ae P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:40.777951  6552 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:40.778499  6552 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
W20260620 13:58:40.779497  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260620 13:58:40.779932 12084 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:40.781536  4719 tablet_replica.cc:333] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.782394  4719 raft_consensus.cc:2243] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.783668  4719 raft_consensus.cc:2272] T 0e0ab32eab32415c8e9ea1fda9508733 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.786398  4719 tablet_replica.cc:333] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.787292  4719 raft_consensus.cc:2243] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.788226  4719 raft_consensus.cc:2272] T 81b2378deea24954b2003dda61c1b2c1 P 663684cf4ae54c929bf8240ca0b63a47 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.790743  4719 tablet_replica.cc:333] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.791436  4719 raft_consensus.cc:2243] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.793074  4719 raft_consensus.cc:2272] T a4cd17345f80464287c5952767849dbb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.795910  4719 tablet_replica.cc:333] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.796658  4719 raft_consensus.cc:2243] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 22 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.797459  4719 raft_consensus.cc:2272] T 2f67b5ea416143c1a0a6729eaaa909c2 P 663684cf4ae54c929bf8240ca0b63a47 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.800377  4719 tablet_replica.cc:333] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.801738  4719 raft_consensus.cc:2243] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.803529  4719 raft_consensus.cc:2272] T 6ad92842cd6b4c0082afb264bae0ec8d P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.806703  4719 tablet_replica.cc:333] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.807730  4719 raft_consensus.cc:2243] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.808750  4719 raft_consensus.cc:2272] T b53823dabce64d5284772ca73d71ddc9 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.811355  4719 tablet_replica.cc:333] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
W20260620 13:58:40.811820  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:40.812167  4719 raft_consensus.cc:2243] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Raft consensus shutting down.
W20260620 13:58:40.812595  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:40.813509  4719 raft_consensus.cc:2272] T 86bd36dee6d64396bfbb86cd90a7bedd P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.816445  4719 tablet_replica.cc:333] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.817261  4719 raft_consensus.cc:2243] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.818754  4719 raft_consensus.cc:2272] T 735685c84e834b9cbaf7533d6fdf16e6 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.821789  4719 tablet_replica.cc:333] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.822510  4719 raft_consensus.cc:2243] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.823251  4719 raft_consensus.cc:2272] T 99f357751cae4b6b87b5972ef2a1fda4 P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.825975  4719 tablet_replica.cc:333] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
W20260620 13:58:40.826237  6552 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260620 13:58:40.826550  4719 raft_consensus.cc:2243] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 LEADER]: Raft consensus shutting down.
W20260620 13:58:40.827183  5998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260620 13:58:40.827651  4719 raft_consensus.cc:2272] T f6d4fcf1f6a541c6ae1a7724f27750eb P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.830657  4719 tablet_replica.cc:333] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.831316  4719 raft_consensus.cc:2243] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.832379  4719 raft_consensus.cc:2272] T 0e3e3ff471834714a3885231e648b8ee P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.835232  4719 tablet_replica.cc:333] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.836072  4719 raft_consensus.cc:2243] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.837028  4719 raft_consensus.cc:2272] T 0fc24d0691404d29bfa069498ec57dd0 P 663684cf4ae54c929bf8240ca0b63a47 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.839617  4719 tablet_replica.cc:333] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.840349  4719 raft_consensus.cc:2243] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.841714  4719 raft_consensus.cc:2272] T 50e28625b20048a398049a7734aaeaf8 P 663684cf4ae54c929bf8240ca0b63a47 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.844363  4719 tablet_replica.cc:333] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
W20260620 13:58:40.844478  6552 consensus_peers.cc:597] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:40.845016  4719 raft_consensus.cc:2243] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.845669  4719 raft_consensus.cc:2272] T 6c812d18f2bb4da29c562646eb81deb1 P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.848520  4719 tablet_replica.cc:333] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.849316  4719 raft_consensus.cc:2243] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.850342  4719 raft_consensus.cc:2272] T ec20d216461d4414813627ca62e330e4 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:40.851166  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:40.852632  4719 tablet_replica.cc:333] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.853291  4719 raft_consensus.cc:2243] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.854161  4719 raft_consensus.cc:2272] T dc919ad08d5e4a9d9870a33b6fc425e5 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.856217  4719 tablet_replica.cc:333] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.856750  4719 raft_consensus.cc:2243] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.857740  4719 raft_consensus.cc:2272] T 5119d05dc81b442f8653989b96a3626d P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.859826  4719 tablet_replica.cc:333] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.860441  4719 raft_consensus.cc:2243] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.861303  4719 raft_consensus.cc:2272] T 8c5eb52b96b44f7cb3569bfff54e9b1c P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.863591  4719 tablet_replica.cc:333] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.864171  4719 raft_consensus.cc:2243] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.864746  4719 raft_consensus.cc:2272] T e8078a89b618482f8e4978c463747569 P 663684cf4ae54c929bf8240ca0b63a47 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.867331  4719 tablet_replica.cc:333] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.867887  4719 raft_consensus.cc:2243] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.868360  4719 raft_consensus.cc:2272] T 52b97878e9ad465684082e7bf1c482ad P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.870357  4719 tablet_replica.cc:333] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.870990  4719 raft_consensus.cc:2243] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.871666  4719 raft_consensus.cc:2272] T 6da14809d5f043db80b3e1639afd8e25 P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.875140  4719 tablet_replica.cc:333] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.875937  4719 raft_consensus.cc:2243] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.877584  4719 raft_consensus.cc:2272] T 115c5e2556794dd8801d1f451aa245fb P 663684cf4ae54c929bf8240ca0b63a47 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.880785  4719 tablet_replica.cc:333] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.881569  4719 raft_consensus.cc:2243] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.882794  4719 raft_consensus.cc:2272] T efd3e1f0e5a34ba69029888abcdfb2f1 P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.885458  4719 tablet_replica.cc:333] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.886353  4719 raft_consensus.cc:2243] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.887248  4719 raft_consensus.cc:2272] T 8dbd1edec8054c1ba05721321572fbbf P 663684cf4ae54c929bf8240ca0b63a47 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:40.888777  6552 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:40.889832  6552 consensus_peers.cc:597] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:40.890031  4719 tablet_replica.cc:333] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.890669  4719 raft_consensus.cc:2243] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 13 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.892351  4719 raft_consensus.cc:2272] T 3fc69a9218a64fa6b346021a0d32eaad P 663684cf4ae54c929bf8240ca0b63a47 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.896517  4719 tablet_replica.cc:333] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.897670  4719 raft_consensus.cc:2243] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.898583  4719 raft_consensus.cc:2272] T d1b89d9f1eec4bfba2f3b0052c49f040 P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.902141  4719 tablet_replica.cc:333] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.902832  4719 raft_consensus.cc:2243] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.903841  4719 raft_consensus.cc:2272] T ab83097997ba42219f9a63aad224f786 P 663684cf4ae54c929bf8240ca0b63a47 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.905745  4719 tablet_replica.cc:333] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.906265  4719 raft_consensus.cc:2243] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.907259  4719 raft_consensus.cc:2272] T a1bc98eaf2354afeb378f85e462f31ab P 663684cf4ae54c929bf8240ca0b63a47 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.909230  4719 tablet_replica.cc:333] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.909759  4719 raft_consensus.cc:2243] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.910223  4719 raft_consensus.cc:2272] T 649259d8acc1429d8dddd2677f87f911 P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.912511  4719 tablet_replica.cc:333] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.913230  4719 raft_consensus.cc:2243] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 11 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.914655  4719 raft_consensus.cc:2272] T 8838a101a5e8400c91d053b307be45ed P 663684cf4ae54c929bf8240ca0b63a47 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.917435  4719 tablet_replica.cc:333] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.917932  4719 raft_consensus.cc:2243] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:40.918735  4719 raft_consensus.cc:2272] T 5757f55132b747db98400dba7b8056df P 663684cf4ae54c929bf8240ca0b63a47 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.920850  4719 tablet_replica.cc:333] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47: stopping tablet replica
I20260620 13:58:40.921315  4719 raft_consensus.cc:2243] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:40.921957  4719 raft_consensus.cc:2272] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P 663684cf4ae54c929bf8240ca0b63a47 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:40.927095 12084 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:40.927762 12084 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:40.930075 12084 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:40.935286  6552 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:40.935819  6551 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:40.936354  6551 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:40.937397 12084 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:40.948386  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4120 after lost signal to thread 4722
W20260620 13:58:40.949653  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb620 after lost signal to thread 5815
W20260620 13:58:40.950958  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003d67c0 after lost signal to thread 6057
W20260620 13:58:40.952193  6054 debug-util.cc:398] Leaking SignalData structure 0x7b08003371e0 after lost signal to thread 6611
W20260620 13:58:40.999677  6552 consensus_peers.cc:597] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:41.035208  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:41.035679  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:41.164930 12084 raft_consensus.cc:493] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:41.165370 12084 raft_consensus.cc:515] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:41.166987 12084 leader_election.cc:290] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:41.175511  6552 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:41.179807  6551 leader_election.cc:336] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:41.180215  6551 leader_election.cc:304] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:41.180794 12084 raft_consensus.cc:2749] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260620 13:58:41.286689  6552 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:41.295253  6552 consensus_peers.cc:597] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260620 13:58:41.295791  6552 consensus_peers.cc:597] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260620 13:58:41.378580  6551 consensus_peers.cc:597] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:41.480312  6551 consensus_peers.cc:597] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:41.642393  6551 consensus_peers.cc:597] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:41.724524  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260620 13:58:41.729844 12095 raft_consensus.cc:493] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:41.730489 12095 raft_consensus.cc:515] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:41.732698 12095 leader_election.cc:290] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:41.736642  6551 leader_election.cc:336] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:41.738847 12095 raft_consensus.cc:493] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:41.739760 12095 raft_consensus.cc:515] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:41.742091 12095 leader_election.cc:290] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:41.748479  6552 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:41.749048  6551 leader_election.cc:336] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:41.749562  6551 leader_election.cc:304] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:41.750545 12095 raft_consensus.cc:2749] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260620 13:58:41.847361  6552 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260620 13:58:41.861400 12095 raft_consensus.cc:493] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:41.861981 12095 raft_consensus.cc:515] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:41.864133 12095 leader_election.cc:290] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:41.868117  6551 leader_election.cc:336] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:41.873238  6551 consensus_peers.cc:597] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:41.883397 12095 raft_consensus.cc:493] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:41.884079 12095 raft_consensus.cc:515] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:41.886577 12095 leader_election.cc:290] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:41.889740 12095 raft_consensus.cc:493] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:41.890286 12095 raft_consensus.cc:515] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:41.890758  6551 leader_election.cc:336] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:41.892513 12095 leader_election.cc:290] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:41.896687  6552 leader_election.cc:336] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:41.906145  6551 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:41.932914  6551 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:41.979873 12095 raft_consensus.cc:493] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:41.980494 12095 raft_consensus.cc:515] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:41.982635 12095 leader_election.cc:290] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:41.986912  6551 leader_election.cc:336] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:41.988054 12095 raft_consensus.cc:493] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:41.988651 12095 raft_consensus.cc:515] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:41.990829 12095 leader_election.cc:290] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:41.993701 12095 raft_consensus.cc:493] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:41.994266 12095 raft_consensus.cc:515] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } attrs { replace: true } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:41.995920  6552 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:41.997241 12095 leader_election.cc:290] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:42.003407  6552 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
W20260620 13:58:42.004053  6551 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:42.004558  6551 leader_election.cc:304] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:42.005266 12095 raft_consensus.cc:2749] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260620 13:58:42.021818  6551 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:42.021703 12095 raft_consensus.cc:493] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.022511 12095 raft_consensus.cc:515] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.025195 12095 leader_election.cc:290] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:42.029166 12095 raft_consensus.cc:493] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.029655 12095 raft_consensus.cc:515] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
W20260620 13:58:42.030216  6551 consensus_peers.cc:597] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:42.031169  6552 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:42.031708 12095 leader_election.cc:290] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:42.036339  6551 leader_election.cc:336] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:42.044445  4719 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 6054)
W20260620 13:58:42.057778  6551 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:42.082697  6552 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260620 13:58:42.101495  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:42.106489  6552 consensus_peers.cc:597] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:42.107084  6552 consensus_peers.cc:597] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:42.107518  6552 consensus_peers.cc:597] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Couldn't send request to peer 663684cf4ae54c929bf8240ca0b63a47. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:42.108631  6552 leader_election.cc:336] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.109010  6552 leader_election.cc:304] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.109730 12095 raft_consensus.cc:2749] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260620 13:58:42.109875  6552 leader_election.cc:336] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.110381  6552 leader_election.cc:304] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.111073 12095 raft_consensus.cc:2749] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:42.111254  6552 leader_election.cc:336] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.111721  6552 leader_election.cc:304] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.112423 12095 raft_consensus.cc:2749] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:42.112572  6552 leader_election.cc:336] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.113036  6552 leader_election.cc:304] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.113680 12095 raft_consensus.cc:2749] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260620 13:58:42.113837  6552 leader_election.cc:336] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.114293  6552 leader_election.cc:304] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.114936 12095 raft_consensus.cc:2749] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260620 13:58:42.115084  6552 leader_election.cc:336] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.115553  6552 leader_election.cc:304] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.116186 12095 raft_consensus.cc:2749] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260620 13:58:42.116353  6552 leader_election.cc:336] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
W20260620 13:58:42.117194  6552 leader_election.cc:336] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.117545  6552 leader_election.cc:304] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.118183 12095 raft_consensus.cc:2749] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260620 13:58:42.118330  6552 leader_election.cc:336] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.118808  6552 leader_election.cc:304] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.119469 12095 raft_consensus.cc:2749] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260620 13:58:42.128454  6552 consensus_peers.cc:597] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260620 13:58:42.138808  6551 consensus_peers.cc:597] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:42.139884 12095 raft_consensus.cc:493] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.140444 12095 raft_consensus.cc:515] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.142961 12095 leader_election.cc:290] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:42.148124  6551 leader_election.cc:336] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:42.148823  6552 leader_election.cc:336] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.148892 12095 raft_consensus.cc:493] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.149238  6552 leader_election.cc:304] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.149942 12115 raft_consensus.cc:2749] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260620 13:58:42.157333 12120 raft_consensus.cc:493] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.159883 12120 raft_consensus.cc:515] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.160905 12115 raft_consensus.cc:493] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.161408 12115 raft_consensus.cc:515] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.161903 12120 leader_election.cc:290] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:42.163760 12115 leader_election.cc:290] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
I20260620 13:58:42.149564 12095 raft_consensus.cc:515] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.167004 12095 leader_election.cc:290] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:42.172206  6551 leader_election.cc:336] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:42.184641  6551 consensus_peers.cc:597] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:42.186241  6552 leader_election.cc:336] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
W20260620 13:58:42.186789  6552 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
W20260620 13:58:42.187222  6552 leader_election.cc:336] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.187564  6552 leader_election.cc:304] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.188359 12119 raft_consensus.cc:2749] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260620 13:58:42.188740  6552 leader_election.cc:336] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:42.189226  6552 leader_election.cc:304] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.189924 12119 raft_consensus.cc:2749] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260620 13:58:42.190083  6552 consensus_peers.cc:597] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260620 13:58:42.190698  6552 leader_election.cc:336] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:42.191056  6552 leader_election.cc:304] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 2e82c0c231624695ac5a813230bf5038, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.191901 12119 raft_consensus.cc:2749] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260620 13:58:42.227522 12119 raft_consensus.cc:493] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.228199 12119 raft_consensus.cc:515] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.234582 12119 leader_election.cc:290] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:42.238278  6551 leader_election.cc:336] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:42.241403  6552 leader_election.cc:336] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.241880  6552 leader_election.cc:304] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.242635 12119 raft_consensus.cc:2749] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260620 13:58:42.256721  6551 consensus_peers.cc:597] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:42.262631  6551 consensus_peers.cc:597] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260620 13:58:42.281621 12119 raft_consensus.cc:493] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 663684cf4ae54c929bf8240ca0b63a47)
I20260620 13:58:42.282182 12119 raft_consensus.cc:515] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "663684cf4ae54c929bf8240ca0b63a47" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 41493 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.284432 12119 leader_election.cc:290] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517), 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493)
W20260620 13:58:42.289322  6551 leader_election.cc:336] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:42.290829  6552 leader_election.cc:336] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 663684cf4ae54c929bf8240ca0b63a47 (127.4.155.195:41493): Network error: Client connection negotiation failed: client connection to 127.4.155.195:41493: connect: Connection refused (error 111)
I20260620 13:58:42.291313  6552 leader_election.cc:304] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 663684cf4ae54c929bf8240ca0b63a47
I20260620 13:58:42.292047 12119 raft_consensus.cc:2749] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260620 13:58:42.295397  6552 consensus_peers.cc:597] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260620 13:58:42.303328  6551 consensus_peers.cc:597] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Couldn't send request to peer 192c750f597c43858e1ad09e8d805685. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260620 13:58:42.396570  6552 consensus_peers.cc:597] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260620 13:58:42.457636  6552 consensus_peers.cc:597] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260620 13:58:42.515949 12095 raft_consensus.cc:493] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:42.516587 12095 raft_consensus.cc:515] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:42.520565 12095 leader_election.cc:290] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
W20260620 13:58:42.526247  6551 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
W20260620 13:58:42.528584  6552 leader_election.cc:336] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:42.529008  6552 leader_election.cc:304] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:42.529711 12095 raft_consensus.cc:2749] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260620 13:58:42.557906  6552 consensus_peers.cc:597] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260620 13:58:42.685565  6552 consensus_peers.cc:597] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260620 13:58:42.722952  6552 consensus_peers.cc:597] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260620 13:58:42.777796  4719 tablet_server.cc:196] TabletServer@127.4.155.195:0 shutdown complete.
I20260620 13:58:42.897694  4719 tablet_server.cc:179] TabletServer@127.4.155.196:0 shutting down...
W20260620 13:58:42.914305  6552 consensus_peers.cc:597] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f -> Peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Couldn't send request to peer 2e82c0c231624695ac5a813230bf5038. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260620 13:58:42.965586  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:58:42.966445  4719 tablet_replica.cc:333] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.967280  4719 raft_consensus.cc:2243] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:42.967875  4719 raft_consensus.cc:2272] T a4cd17345f80464287c5952767849dbb P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.971241  4719 tablet_replica.cc:333] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.972157  4719 raft_consensus.cc:2243] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:42.973263  4719 raft_consensus.cc:2272] T 24c27735bbb449a98fab7edad2ba9837 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.976469  4719 tablet_replica.cc:333] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.977308  4719 raft_consensus.cc:2243] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 20 LEADER]: Raft consensus shutting down.
I20260620 13:58:42.978528  4719 raft_consensus.cc:2272] T 71fbe22bd18849f1b94912bb0bdf5bbe P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.981031  4719 tablet_replica.cc:333] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.981724  4719 raft_consensus.cc:2243] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:42.982625  4719 raft_consensus.cc:2272] T 020dbb4b944d4deeba944d1a7c6d5c76 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.984767  4719 tablet_replica.cc:333] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.985376  4719 raft_consensus.cc:2243] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:42.986021  4719 raft_consensus.cc:2272] T 86bd36dee6d64396bfbb86cd90a7bedd P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.988165  4719 tablet_replica.cc:333] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.988788  4719 raft_consensus.cc:2243] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:42.989682  4719 raft_consensus.cc:2272] T 8b06407c45954213adfef7604a8c4f21 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.991811  4719 tablet_replica.cc:333] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.992375  4719 raft_consensus.cc:2243] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:42.992862  4719 raft_consensus.cc:2272] T a1bc98eaf2354afeb378f85e462f31ab P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.994956  4719 tablet_replica.cc:333] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.995534  4719 raft_consensus.cc:2243] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:42.996372  4719 raft_consensus.cc:2272] T 4fd646f84cb04514aa9889ea5f67db81 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:42.998422  4719 tablet_replica.cc:333] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:42.998998  4719 raft_consensus.cc:2243] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:42.999626  4719 raft_consensus.cc:2272] T 2f67b5ea416143c1a0a6729eaaa909c2 P b0ce39342d8c4a64904b30b98de02b9f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.001577  4719 tablet_replica.cc:333] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.002280  4719 raft_consensus.cc:2243] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.003129  4719 raft_consensus.cc:2272] T 6c812d18f2bb4da29c562646eb81deb1 P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.005179  4719 tablet_replica.cc:333] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.005731  4719 raft_consensus.cc:2243] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 18 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.006551  4719 raft_consensus.cc:2272] T 59b6ab17fde545f5b655c12383d08351 P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.008739  4719 tablet_replica.cc:333] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.009414  4719 raft_consensus.cc:2243] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 20 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.010545  4719 raft_consensus.cc:2272] T ba377ed0ce364307bbe22e24ddafa62e P b0ce39342d8c4a64904b30b98de02b9f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.013646  4719 tablet_replica.cc:333] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.014557  4719 raft_consensus.cc:2243] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.015668  4719 raft_consensus.cc:2272] T 0fc24d0691404d29bfa069498ec57dd0 P b0ce39342d8c4a64904b30b98de02b9f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.018592  4719 tablet_replica.cc:333] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.019460  4719 raft_consensus.cc:2243] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.020087  4719 raft_consensus.cc:2272] T 735685c84e834b9cbaf7533d6fdf16e6 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.022972  4719 tablet_replica.cc:333] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.023480 12095 raft_consensus.cc:493] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 192c750f597c43858e1ad09e8d805685)
I20260620 13:58:43.023824  4719 raft_consensus.cc:2243] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 18 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.024076 12095 raft_consensus.cc:515] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2e82c0c231624695ac5a813230bf5038" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 46177 } } peers { permanent_uuid: "192c750f597c43858e1ad09e8d805685" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38517 } } peers { permanent_uuid: "b0ce39342d8c4a64904b30b98de02b9f" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 34171 } attrs { promote: false } }
I20260620 13:58:43.024952  4719 raft_consensus.cc:2272] T 923bfc4f20d94a57b0d84d45e40b12ae P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.027707  4719 tablet_replica.cc:333] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.028347 12095 leader_election.cc:290] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177), 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517)
I20260620 13:58:43.028528  4719 raft_consensus.cc:2243] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.029297  4719 raft_consensus.cc:2272] T 18f8f8a1b370453aade5f48cd3bedcbd P b0ce39342d8c4a64904b30b98de02b9f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.033164  4719 tablet_replica.cc:333] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
W20260620 13:58:43.033684  6551 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 192c750f597c43858e1ad09e8d805685 (127.4.155.194:38517): Network error: Client connection negotiation failed: client connection to 127.4.155.194:38517: connect: Connection refused (error 111)
I20260620 13:58:43.034181  4719 raft_consensus.cc:2243] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.034977  4719 raft_consensus.cc:2272] T 14bccd20cc3f44b69eeefefc4f8b72f9 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:43.036053  6552 leader_election.cc:336] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2e82c0c231624695ac5a813230bf5038 (127.4.155.193:46177): Network error: Client connection negotiation failed: client connection to 127.4.155.193:46177: connect: Connection refused (error 111)
I20260620 13:58:43.036583  6552 leader_election.cc:304] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce39342d8c4a64904b30b98de02b9f; no voters: 192c750f597c43858e1ad09e8d805685, 2e82c0c231624695ac5a813230bf5038
I20260620 13:58:43.037407 12095 raft_consensus.cc:2749] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260620 13:58:43.038556  4719 tablet_replica.cc:333] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.039513  4719 raft_consensus.cc:2243] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.040253  4719 raft_consensus.cc:2272] T b00b548648e441dbb777699ee0ef3f60 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.043151  4719 tablet_replica.cc:333] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.044087  4719 raft_consensus.cc:2243] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.045444  4719 raft_consensus.cc:2272] T 29e2284e793941b4aa9829a72313998c P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.048058  4719 tablet_replica.cc:333] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.048673  4719 raft_consensus.cc:2243] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.049521  4719 raft_consensus.cc:2272] T b8a351afb91f46e2b6e724165bc600c1 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.051939  4719 tablet_replica.cc:333] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.052636  4719 raft_consensus.cc:2243] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.053529  4719 raft_consensus.cc:2272] T d483a507ec73494da65730a6444e1fd6 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.056299  4719 tablet_replica.cc:333] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.056905  4719 raft_consensus.cc:2243] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.057374  4719 raft_consensus.cc:2272] T fd6ebbc0e9aa474f80952cef69b0ac25 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.059345  4719 tablet_replica.cc:333] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.059875  4719 raft_consensus.cc:2243] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.060329  4719 raft_consensus.cc:2272] T dc919ad08d5e4a9d9870a33b6fc425e5 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.062253  4719 tablet_replica.cc:333] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.062796  4719 raft_consensus.cc:2243] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 10 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.063768  4719 raft_consensus.cc:2272] T 90f87066e519439ab8be15dccf1d2493 P b0ce39342d8c4a64904b30b98de02b9f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.065953  4719 tablet_replica.cc:333] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.066468  4719 raft_consensus.cc:2243] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.067360  4719 raft_consensus.cc:2272] T fb8edcc5cb024ebebdb3cac403f19bc4 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.069332  4719 tablet_replica.cc:333] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.069895  4719 raft_consensus.cc:2243] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.070699  4719 raft_consensus.cc:2272] T ed1d1d20a2be4ceeb9389e7e3dbd2b5b P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.072842  4719 tablet_replica.cc:333] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.073446  4719 raft_consensus.cc:2243] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.073956  4719 raft_consensus.cc:2272] T 08f835b507484456a3c708ba0e6fb982 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.076030  4719 tablet_replica.cc:333] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.076587  4719 raft_consensus.cc:2243] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 16 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.077839  4719 raft_consensus.cc:2272] T 649259d8acc1429d8dddd2677f87f911 P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.080008  4719 tablet_replica.cc:333] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.080587  4719 raft_consensus.cc:2243] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.081564  4719 raft_consensus.cc:2272] T 49ee9750110f428fa454f96aaeb360ef P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.083860  4719 tablet_replica.cc:333] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.084404  4719 raft_consensus.cc:2243] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.085283  4719 raft_consensus.cc:2272] T 99f357751cae4b6b87b5972ef2a1fda4 P b0ce39342d8c4a64904b30b98de02b9f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.087577  4719 tablet_replica.cc:333] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.088245  4719 raft_consensus.cc:2243] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.088698  4719 raft_consensus.cc:2272] T f6d4fcf1f6a541c6ae1a7724f27750eb P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.091025  4719 tablet_replica.cc:333] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.091672  4719 raft_consensus.cc:2243] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 13 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.092478  4719 raft_consensus.cc:2272] T bab45d487c864870aba1aee58d01ca95 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.094817  4719 tablet_replica.cc:333] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.095779  4719 raft_consensus.cc:2243] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.096877  4719 raft_consensus.cc:2272] T 1a7540e02ee04cdb9365701b0b6a9077 P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.100664  4719 tablet_replica.cc:333] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.101706  4719 raft_consensus.cc:2243] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 17 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.103145  4719 raft_consensus.cc:2272] T 6da14809d5f043db80b3e1639afd8e25 P b0ce39342d8c4a64904b30b98de02b9f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.105402  4719 tablet_replica.cc:333] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.105955  4719 raft_consensus.cc:2243] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.106490  4719 raft_consensus.cc:2272] T b870adf0b6e5484ba90ad7b17d35cd52 P b0ce39342d8c4a64904b30b98de02b9f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.108568  4719 tablet_replica.cc:333] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.109187  4719 raft_consensus.cc:2243] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.109670  4719 raft_consensus.cc:2272] T 50e28625b20048a398049a7734aaeaf8 P b0ce39342d8c4a64904b30b98de02b9f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.112118  4719 tablet_replica.cc:333] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.112639  4719 raft_consensus.cc:2243] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 15 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.113677  4719 raft_consensus.cc:2272] T e8078a89b618482f8e4978c463747569 P b0ce39342d8c4a64904b30b98de02b9f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.115970  4719 tablet_replica.cc:333] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.116549  4719 raft_consensus.cc:2243] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 14 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.117341  4719 raft_consensus.cc:2272] T 52b97878e9ad465684082e7bf1c482ad P b0ce39342d8c4a64904b30b98de02b9f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.119639  4719 tablet_replica.cc:333] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.120172  4719 raft_consensus.cc:2243] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.120663  4719 raft_consensus.cc:2272] T 81b2378deea24954b2003dda61c1b2c1 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.122992  4719 tablet_replica.cc:333] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.123696  4719 raft_consensus.cc:2243] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 11 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.124608  4719 raft_consensus.cc:2272] T 1f1025714d0b439cb56cc08764cb5fce P b0ce39342d8c4a64904b30b98de02b9f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.126688  4719 tablet_replica.cc:333] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.127296  4719 raft_consensus.cc:2243] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.127863  4719 raft_consensus.cc:2272] T 8c5eb52b96b44f7cb3569bfff54e9b1c P b0ce39342d8c4a64904b30b98de02b9f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.129819  4719 tablet_replica.cc:333] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f: stopping tablet replica
I20260620 13:58:43.130353  4719 raft_consensus.cc:2243] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:43.130833  4719 raft_consensus.cc:2272] T c3ee15f74e3e4771a050c854530121f3 P b0ce39342d8c4a64904b30b98de02b9f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.651230  4719 tablet_server.cc:196] TabletServer@127.4.155.196:0 shutdown complete.
I20260620 13:58:43.723528  4719 master.cc:562] Master@127.4.155.254:37547 shutting down...
W20260620 13:58:43.760694  5829 auto_rebalancer.cc:835] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260620 13:58:43.760977  5829 auto_rebalancer.cc:863] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260620 13:58:43.761199  5829 auto_rebalancer.cc:301] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260620 13:58:43.764457  4719 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:43.765039  4719 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:43.765314  4719 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7635bbf8f82045f99dd7ac0f4a911859: stopping tablet replica
I20260620 13:58:43.901253  4719 master.cc:584] Master@127.4.155.254:37547 shutdown complete.
I20260620 13:58:43.946276  4719 test_util.cc:182] -----------------------------------------------
I20260620 13:58:43.946509  4719 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1781963654985192-4719-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (208771 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260620 13:58:43.949780  4719 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.155.254:43785
I20260620 13:58:43.951187  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:58:43.957516 12124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:58:43.958216 12127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:58:43.958392 12125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:58:43.959017  4719 server_base.cc:1061] running on GCE node
I20260620 13:58:43.961829  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:58:43.962031  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:58:43.962253  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963923962211 us; error 0 us; skew 500 ppm
I20260620 13:58:43.962852  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:58:43.965723  4719 webserver.cc:533] Webserver started at http://127.4.155.254:34327/ using document root <none> and password file <none>
I20260620 13:58:43.966239  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:58:43.966440  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:58:43.966689  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:58:43.967916  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/master-0-root/instance:
uuid: "8fc3216e21144116aedea0a90c5fd4ea"
format_stamp: "Formatted at 2026-06-20 13:58:43 on dist-test-slave-n70f"
I20260620 13:58:43.973703  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260620 13:58:43.977784 12132 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:58:43.978873  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260620 13:58:43.979274  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/master-0-root
uuid: "8fc3216e21144116aedea0a90c5fd4ea"
format_stamp: "Formatted at 2026-06-20 13:58:43 on dist-test-slave-n70f"
I20260620 13:58:43.979614  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:58:43.998665  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:58:44.000039  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:58:44.044838  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.254:43785
I20260620 13:58:44.044855 12183 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.254:43785 every 8 connection(s)
I20260620 13:58:44.049067 12184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:44.061192 12184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea: Bootstrap starting.
I20260620 13:58:44.067708 12184 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:44.102356 12184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea: No bootstrap required, opened a new log
I20260620 13:58:44.106088 12184 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fc3216e21144116aedea0a90c5fd4ea" member_type: VOTER }
I20260620 13:58:44.106675 12184 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:44.106880 12184 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc3216e21144116aedea0a90c5fd4ea, State: Initialized, Role: FOLLOWER
I20260620 13:58:44.107592 12184 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fc3216e21144116aedea0a90c5fd4ea" member_type: VOTER }
I20260620 13:58:44.108047 12184 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 13:58:44.108255 12184 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 13:58:44.108495 12184 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:44.115528 12184 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fc3216e21144116aedea0a90c5fd4ea" member_type: VOTER }
I20260620 13:58:44.116115 12184 leader_election.cc:304] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8fc3216e21144116aedea0a90c5fd4ea; no voters: 
I20260620 13:58:44.117267 12184 leader_election.cc:290] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 13:58:44.117730 12188 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:44.119272 12188 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [term 1 LEADER]: Becoming Leader. State: Replica: 8fc3216e21144116aedea0a90c5fd4ea, State: Running, Role: LEADER
I20260620 13:58:44.120139 12188 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fc3216e21144116aedea0a90c5fd4ea" member_type: VOTER }
I20260620 13:58:44.121322 12184 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [sys.catalog]: configured and running, proceeding with master startup.
I20260620 13:58:44.128338 12189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8fc3216e21144116aedea0a90c5fd4ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fc3216e21144116aedea0a90c5fd4ea" member_type: VOTER } }
I20260620 13:58:44.128643 12190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fc3216e21144116aedea0a90c5fd4ea. Latest consensus state: current_term: 1 leader_uuid: "8fc3216e21144116aedea0a90c5fd4ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fc3216e21144116aedea0a90c5fd4ea" member_type: VOTER } }
I20260620 13:58:44.129567 12189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [sys.catalog]: This master's current role is: LEADER
I20260620 13:58:44.129681 12190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [sys.catalog]: This master's current role is: LEADER
I20260620 13:58:44.131732 12198 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260620 13:58:44.136722 12198 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260620 13:58:44.139483  4719 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 13:58:44.146803 12198 catalog_manager.cc:1382] Generated new cluster ID: 8e9a2e0422924402ae797db46c7624d4
I20260620 13:58:44.147267 12198 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260620 13:58:44.165607 12198 catalog_manager.cc:1405] Generated new certificate authority record
I20260620 13:58:44.166945 12198 catalog_manager.cc:1539] Loading token signing keys...
I20260620 13:58:44.181396 12198 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea: Generated new TSK 0
I20260620 13:58:44.182116 12198 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260620 13:58:44.207181  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:58:44.215404 12206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:58:44.216326 12207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:58:44.218324 12209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:58:44.219980  4719 server_base.cc:1061] running on GCE node
I20260620 13:58:44.222247  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:58:44.222481  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:58:44.222704  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963924222686 us; error 0 us; skew 500 ppm
I20260620 13:58:44.223358  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:58:44.226382  4719 webserver.cc:533] Webserver started at http://127.4.155.193:45949/ using document root <none> and password file <none>
I20260620 13:58:44.226912  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:58:44.227164  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:58:44.227504  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:58:44.228821  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/instance:
uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
format_stamp: "Formatted at 2026-06-20 13:58:44 on dist-test-slave-n70f"
I20260620 13:58:44.235234  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
I20260620 13:58:44.239176 12214 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:58:44.240521  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260620 13:58:44.240823  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-0-root
uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
format_stamp: "Formatted at 2026-06-20 13:58:44 on dist-test-slave-n70f"
I20260620 13:58:44.241081  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:58:44.261224  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:58:44.262843  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:58:44.264847  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:58:44.267549  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:58:44.267766  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:58:44.268035  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:58:44.268263  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:58:44.314069  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.193:35839
I20260620 13:58:44.314172 12276 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.193:35839 every 8 connection(s)
I20260620 13:58:44.319854  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:58:44.328807 12281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:58:44.329511 12282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:58:44.332760 12285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:58:44.333745  4719 server_base.cc:1061] running on GCE node
I20260620 13:58:44.336203  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:58:44.336400  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:58:44.336628  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963924336592 us; error 0 us; skew 500 ppm
I20260620 13:58:44.337309  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:58:44.340446  4719 webserver.cc:533] Webserver started at http://127.4.155.194:36499/ using document root <none> and password file <none>
I20260620 13:58:44.341018 12277 heartbeater.cc:344] Connected to a master server at 127.4.155.254:43785
I20260620 13:58:44.341077  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:58:44.341490 12277 heartbeater.cc:461] Registering TS with master...
I20260620 13:58:44.341516  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:58:44.342132  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:58:44.342599 12277 heartbeater.cc:507] Master 127.4.155.254:43785 requested a full tablet report, sending...
I20260620 13:58:44.343709  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/instance:
uuid: "fcd1bd5dfea74c378a6154f83707154c"
format_stamp: "Formatted at 2026-06-20 13:58:44 on dist-test-slave-n70f"
I20260620 13:58:44.345180 12149 ts_manager.cc:194] Registered new tserver with Master: 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:44.347098 12149 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45158
I20260620 13:58:44.349128  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260620 13:58:44.353024 12289 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:58:44.354149  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260620 13:58:44.354442  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-1-root
uuid: "fcd1bd5dfea74c378a6154f83707154c"
format_stamp: "Formatted at 2026-06-20 13:58:44 on dist-test-slave-n70f"
I20260620 13:58:44.354780  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:58:44.368872  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:58:44.370054  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:58:44.371573  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:58:44.374028  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:58:44.374213  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:58:44.374532  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:58:44.374673  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:58:44.418612  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.194:37965
I20260620 13:58:44.418740 12351 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.194:37965 every 8 connection(s)
I20260620 13:58:44.424084  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:58:44.432178 12355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:58:44.437565 12356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:58:44.438503 12352 heartbeater.cc:344] Connected to a master server at 127.4.155.254:43785
I20260620 13:58:44.438957  4719 server_base.cc:1061] running on GCE node
I20260620 13:58:44.439039 12352 heartbeater.cc:461] Registering TS with master...
I20260620 13:58:44.440457 12352 heartbeater.cc:507] Master 127.4.155.254:43785 requested a full tablet report, sending...
W20260620 13:58:44.440613 12358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:58:44.441617  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:58:44.441890  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:58:44.442088  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963924442073 us; error 0 us; skew 500 ppm
I20260620 13:58:44.442706  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:58:44.442893 12149 ts_manager.cc:194] Registered new tserver with Master: fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:44.444414 12149 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45162
I20260620 13:58:44.445891  4719 webserver.cc:533] Webserver started at http://127.4.155.195:46745/ using document root <none> and password file <none>
I20260620 13:58:44.446619  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:58:44.446858  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:58:44.447247  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:58:44.449757  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/instance:
uuid: "c51ef915af09435db6046c91bb9d00e0"
format_stamp: "Formatted at 2026-06-20 13:58:44 on dist-test-slave-n70f"
I20260620 13:58:44.455677  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.005s
I20260620 13:58:44.459815 12363 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:58:44.460970  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260620 13:58:44.461273  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-2-root
uuid: "c51ef915af09435db6046c91bb9d00e0"
format_stamp: "Formatted at 2026-06-20 13:58:44 on dist-test-slave-n70f"
I20260620 13:58:44.461532  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:58:44.477793  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:58:44.478999  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:58:44.480289  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:58:44.482803  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:58:44.483022  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:58:44.483325  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:58:44.483487  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:58:44.533958  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.195:37673
I20260620 13:58:44.534137 12425 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.195:37673 every 8 connection(s)
I20260620 13:58:44.541684  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:58:44.551661 12430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:58:44.553763 12429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:58:44.555393 12432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:58:44.555832  4719 server_base.cc:1061] running on GCE node
I20260620 13:58:44.557356  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:58:44.557749  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:58:44.558112  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963924558090 us; error 0 us; skew 500 ppm
I20260620 13:58:44.559619  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:58:44.560207 12426 heartbeater.cc:344] Connected to a master server at 127.4.155.254:43785
I20260620 13:58:44.560654 12426 heartbeater.cc:461] Registering TS with master...
I20260620 13:58:44.561601 12426 heartbeater.cc:507] Master 127.4.155.254:43785 requested a full tablet report, sending...
I20260620 13:58:44.563419  4719 webserver.cc:533] Webserver started at http://127.4.155.196:33539/ using document root <none> and password file <none>
I20260620 13:58:44.564514  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:58:44.564508 12149 ts_manager.cc:194] Registered new tserver with Master: c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:44.565177  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:58:44.565593  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:58:44.566744 12149 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45174
I20260620 13:58:44.567467  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-3-root/instance:
uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
format_stamp: "Formatted at 2026-06-20 13:58:44 on dist-test-slave-n70f"
I20260620 13:58:44.572377  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260620 13:58:44.576762 12437 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:58:44.577642  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260620 13:58:44.577979  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-3-root
uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
format_stamp: "Formatted at 2026-06-20 13:58:44 on dist-test-slave-n70f"
I20260620 13:58:44.578272  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:58:44.600677  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:58:44.602072  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:58:44.603446  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:58:44.606374  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:58:44.606653  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:58:44.607209  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:58:44.607378  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:58:44.662628  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.196:41785
I20260620 13:58:44.662817 12499 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.196:41785 every 8 connection(s)
I20260620 13:58:44.678130 12500 heartbeater.cc:344] Connected to a master server at 127.4.155.254:43785
I20260620 13:58:44.678645 12500 heartbeater.cc:461] Registering TS with master...
I20260620 13:58:44.679824 12500 heartbeater.cc:507] Master 127.4.155.254:43785 requested a full tablet report, sending...
I20260620 13:58:44.682415 12149 ts_manager.cc:194] Registered new tserver with Master: 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:44.683177  4719 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016950599s
I20260620 13:58:44.684191 12149 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45178
I20260620 13:58:44.716425 12149 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45180:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260620 13:58:45.003690 12242 tablet_service.cc:1511] Processing CreateTablet for tablet 85ae493b3ffc48e19f911962029c41e5 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260620 13:58:45.006907 12241 tablet_service.cc:1511] Processing CreateTablet for tablet 97d2754643614cdcb0928c841c0fa0bb (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260620 13:58:45.008474 12239 tablet_service.cc:1511] Processing CreateTablet for tablet 30a0ef32a33f4a609e678abbfa038080 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260620 13:58:45.011173 12240 tablet_service.cc:1511] Processing CreateTablet for tablet 9124333b2aae40e2b813819981e990e5 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260620 13:58:45.017241 12239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a0ef32a33f4a609e678abbfa038080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.027508 12241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97d2754643614cdcb0928c841c0fa0bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.031683 12238 tablet_service.cc:1511] Processing CreateTablet for tablet bc2940ddb8684b88ac43aa54628de34f (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260620 13:58:45.032522 12317 tablet_service.cc:1511] Processing CreateTablet for tablet 85ae493b3ffc48e19f911962029c41e5 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260620 13:58:45.033386 12238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2940ddb8684b88ac43aa54628de34f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.034101 12317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ae493b3ffc48e19f911962029c41e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.037177 12316 tablet_service.cc:1511] Processing CreateTablet for tablet 97d2754643614cdcb0928c841c0fa0bb (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260620 13:58:45.039003 12316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97d2754643614cdcb0928c841c0fa0bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.038793 12315 tablet_service.cc:1511] Processing CreateTablet for tablet 517e043628a84907974c6a2fbf432d08 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260620 13:58:45.040580 12315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 517e043628a84907974c6a2fbf432d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.040304 12313 tablet_service.cc:1511] Processing CreateTablet for tablet bc2940ddb8684b88ac43aa54628de34f (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260620 13:58:45.041699 12313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2940ddb8684b88ac43aa54628de34f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.044994 12237 tablet_service.cc:1511] Processing CreateTablet for tablet efeb9f3004de439280900847880929c6 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260620 13:58:45.038791 12314 tablet_service.cc:1511] Processing CreateTablet for tablet 30a0ef32a33f4a609e678abbfa038080 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260620 13:58:45.050858 12236 tablet_service.cc:1511] Processing CreateTablet for tablet 4fdb1bbde932422ba09645787f9d2446 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260620 13:58:45.055908 12312 tablet_service.cc:1511] Processing CreateTablet for tablet 065fb7373cff4c42b0917abd9199dac5 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260620 13:58:45.057011 12391 tablet_service.cc:1511] Processing CreateTablet for tablet 85ae493b3ffc48e19f911962029c41e5 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260620 13:58:45.058625 12391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ae493b3ffc48e19f911962029c41e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.059266 12311 tablet_service.cc:1511] Processing CreateTablet for tablet 4fdb1bbde932422ba09645787f9d2446 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260620 13:58:45.060679 12387 tablet_service.cc:1511] Processing CreateTablet for tablet efeb9f3004de439280900847880929c6 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260620 13:58:45.062153 12387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efeb9f3004de439280900847880929c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.068048 12235 tablet_service.cc:1511] Processing CreateTablet for tablet 928bd8a07cbe4d58b19f3669419f928d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260620 13:58:45.071827 12234 tablet_service.cc:1511] Processing CreateTablet for tablet 09dbf9acadba454f83e6b30932aa7806 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260620 13:58:45.073271 12390 tablet_service.cc:1511] Processing CreateTablet for tablet 9124333b2aae40e2b813819981e990e5 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260620 13:58:45.076287 12310 tablet_service.cc:1511] Processing CreateTablet for tablet 928bd8a07cbe4d58b19f3669419f928d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260620 13:58:45.077163 12386 tablet_service.cc:1511] Processing CreateTablet for tablet 065fb7373cff4c42b0917abd9199dac5 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260620 13:58:45.080027 12385 tablet_service.cc:1511] Processing CreateTablet for tablet 4fdb1bbde932422ba09645787f9d2446 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260620 13:58:45.080199 12382 tablet_service.cc:1511] Processing CreateTablet for tablet 93da747507134e1699f01078033ae503 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260620 13:58:45.080936 12233 tablet_service.cc:1511] Processing CreateTablet for tablet 93da747507134e1699f01078033ae503 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260620 13:58:45.083390 12388 tablet_service.cc:1511] Processing CreateTablet for tablet 30a0ef32a33f4a609e678abbfa038080 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260620 13:58:45.085320 12240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9124333b2aae40e2b813819981e990e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.086246 12237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efeb9f3004de439280900847880929c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.087512 12234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09dbf9acadba454f83e6b30932aa7806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.084787 12384 tablet_service.cc:1511] Processing CreateTablet for tablet 09dbf9acadba454f83e6b30932aa7806 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260620 13:58:45.089207 12242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ae493b3ffc48e19f911962029c41e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.090808 12235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 928bd8a07cbe4d58b19f3669419f928d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.091637 12383 tablet_service.cc:1511] Processing CreateTablet for tablet 462ac845f28a431eb612b5e09327f55a (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260620 13:58:45.092227 12310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 928bd8a07cbe4d58b19f3669419f928d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.093251 12311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fdb1bbde932422ba09645787f9d2446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.096448 12236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fdb1bbde932422ba09645787f9d2446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.097318 12314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a0ef32a33f4a609e678abbfa038080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.109143 12233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93da747507134e1699f01078033ae503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.111424 12312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065fb7373cff4c42b0917abd9199dac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.119237 12389 tablet_service.cc:1511] Processing CreateTablet for tablet 517e043628a84907974c6a2fbf432d08 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260620 13:58:45.127780 12386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065fb7373cff4c42b0917abd9199dac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.130168 12309 tablet_service.cc:1511] Processing CreateTablet for tablet 462ac845f28a431eb612b5e09327f55a (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260620 13:58:45.133457 12308 tablet_service.cc:1511] Processing CreateTablet for tablet 93da747507134e1699f01078033ae503 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
W20260620 13:58:45.135040 12197 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:58:45.135206 12309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 462ac845f28a431eb612b5e09327f55a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.145337 12308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93da747507134e1699f01078033ae503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.135589 12388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a0ef32a33f4a609e678abbfa038080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.151569 12383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 462ac845f28a431eb612b5e09327f55a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.155484 12382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93da747507134e1699f01078033ae503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.159485 12385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fdb1bbde932422ba09645787f9d2446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.163412 12389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 517e043628a84907974c6a2fbf432d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.167865 12390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9124333b2aae40e2b813819981e990e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.178681 12384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09dbf9acadba454f83e6b30932aa7806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.193558 12461 tablet_service.cc:1511] Processing CreateTablet for tablet efeb9f3004de439280900847880929c6 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260620 13:58:45.195819 12465 tablet_service.cc:1511] Processing CreateTablet for tablet 97d2754643614cdcb0928c841c0fa0bb (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260620 13:58:45.196305 12460 tablet_service.cc:1511] Processing CreateTablet for tablet 065fb7373cff4c42b0917abd9199dac5 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260620 13:58:45.200649 12458 tablet_service.cc:1511] Processing CreateTablet for tablet 09dbf9acadba454f83e6b30932aa7806 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260620 13:58:45.202107 12462 tablet_service.cc:1511] Processing CreateTablet for tablet bc2940ddb8684b88ac43aa54628de34f (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260620 13:58:45.203022 12457 tablet_service.cc:1511] Processing CreateTablet for tablet 462ac845f28a431eb612b5e09327f55a (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260620 13:58:45.204595 12456 tablet_service.cc:1511] Processing CreateTablet for tablet a6c52f04bdd14864afe89398fc3af00c (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260620 13:58:45.198935 12459 tablet_service.cc:1511] Processing CreateTablet for tablet 928bd8a07cbe4d58b19f3669419f928d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260620 13:58:45.200711 12463 tablet_service.cc:1511] Processing CreateTablet for tablet 517e043628a84907974c6a2fbf432d08 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260620 13:58:45.198719 12464 tablet_service.cc:1511] Processing CreateTablet for tablet 9124333b2aae40e2b813819981e990e5 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260620 13:58:45.206584 12461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efeb9f3004de439280900847880929c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.208634 12464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9124333b2aae40e2b813819981e990e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.210544 12460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065fb7373cff4c42b0917abd9199dac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.212551 12457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 462ac845f28a431eb612b5e09327f55a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.214954 12462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2940ddb8684b88ac43aa54628de34f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.216679 12463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 517e043628a84907974c6a2fbf432d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.218338 12456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c52f04bdd14864afe89398fc3af00c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.226227 12459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 928bd8a07cbe4d58b19f3669419f928d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.232956 12458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09dbf9acadba454f83e6b30932aa7806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.239588 12465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97d2754643614cdcb0928c841c0fa0bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.277267 12317 tablet_service.cc:1511] Processing CreateTablet for tablet a6c52f04bdd14864afe89398fc3af00c (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260620 13:58:45.278919 12317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c52f04bdd14864afe89398fc3af00c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.300972 12520 tablet_bootstrap.cc:492] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:45.317487 12315 tablet_service.cc:1511] Processing CreateTablet for tablet 7b6c6d2474cc47d09439ce00490af552 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260620 13:58:45.319312 12315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b6c6d2474cc47d09439ce00490af552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.337749 12391 tablet_service.cc:1511] Processing CreateTablet for tablet 2596bf072bda4ad188dcc3f1438a4d7d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260620 13:58:45.350585 12277 heartbeater.cc:499] Master 127.4.155.254:43785 was elected leader, sending a full tablet report...
I20260620 13:58:45.347415 12312 tablet_service.cc:1511] Processing CreateTablet for tablet 7c1ae3d064cd49309bf086b257c3f664 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260620 13:58:45.368196 12312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c1ae3d064cd49309bf086b257c3f664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.371817 12391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2596bf072bda4ad188dcc3f1438a4d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.371474 12386 tablet_service.cc:1511] Processing CreateTablet for tablet 7b6c6d2474cc47d09439ce00490af552 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260620 13:58:45.374966 12386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b6c6d2474cc47d09439ce00490af552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.386480 12522 tablet_bootstrap.cc:492] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:45.397275 12522 tablet_bootstrap.cc:654] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:45.342173 12241 tablet_service.cc:1511] Processing CreateTablet for tablet 2596bf072bda4ad188dcc3f1438a4d7d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260620 13:58:45.400409 12241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2596bf072bda4ad188dcc3f1438a4d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.403065 12521 tablet_bootstrap.cc:492] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:45.412972 12465 tablet_service.cc:1511] Processing CreateTablet for tablet 2596bf072bda4ad188dcc3f1438a4d7d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260620 13:58:45.414429 12465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2596bf072bda4ad188dcc3f1438a4d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.414502 12463 tablet_service.cc:1511] Processing CreateTablet for tablet 7b6c6d2474cc47d09439ce00490af552 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260620 13:58:45.416577 12463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b6c6d2474cc47d09439ce00490af552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.419646 12235 tablet_service.cc:1511] Processing CreateTablet for tablet 7c1ae3d064cd49309bf086b257c3f664 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260620 13:58:45.421476 12235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c1ae3d064cd49309bf086b257c3f664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.426383 12234 tablet_service.cc:1511] Processing CreateTablet for tablet a6c52f04bdd14864afe89398fc3af00c (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260620 13:58:45.428119 12234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c52f04bdd14864afe89398fc3af00c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.438225 12383 tablet_service.cc:1511] Processing CreateTablet for tablet 7c1ae3d064cd49309bf086b257c3f664 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260620 13:58:45.439823 12383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c1ae3d064cd49309bf086b257c3f664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.443492 12462 tablet_service.cc:1511] Processing CreateTablet for tablet 11868dc915f6412eaed3c2ba56738bfc (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260620 13:58:45.448858 12462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11868dc915f6412eaed3c2ba56738bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.450026 12390 tablet_service.cc:1511] Processing CreateTablet for tablet a6e8c601ed2e4253b8c7f5dceb77f518 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260620 13:58:45.446209 12238 tablet_service.cc:1511] Processing CreateTablet for tablet 11868dc915f6412eaed3c2ba56738bfc (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260620 13:58:45.447352 12352 heartbeater.cc:499] Master 127.4.155.254:43785 was elected leader, sending a full tablet report...
I20260620 13:58:45.451344 12390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e8c601ed2e4253b8c7f5dceb77f518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.459370 12520 tablet_bootstrap.cc:654] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:45.481539 12521 tablet_bootstrap.cc:654] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:45.483567 12238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11868dc915f6412eaed3c2ba56738bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.497752 12239 tablet_service.cc:1511] Processing CreateTablet for tablet a6e8c601ed2e4253b8c7f5dceb77f518 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260620 13:58:45.498289 12310 tablet_service.cc:1511] Processing CreateTablet for tablet b65eb66c55e74ee78340946d691c4e72 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260620 13:58:45.501153 12239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e8c601ed2e4253b8c7f5dceb77f518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.501519 12523 tablet_bootstrap.cc:492] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:45.508160 12310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65eb66c55e74ee78340946d691c4e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.527189 12460 tablet_service.cc:1511] Processing CreateTablet for tablet b65eb66c55e74ee78340946d691c4e72 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260620 13:58:45.521850 12385 tablet_service.cc:1511] Processing CreateTablet for tablet b65eb66c55e74ee78340946d691c4e72 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260620 13:58:45.529546 12460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65eb66c55e74ee78340946d691c4e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.521911 12523 tablet_bootstrap.cc:654] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:45.534368 12385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65eb66c55e74ee78340946d691c4e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.517228 12317 tablet_service.cc:1511] Processing CreateTablet for tablet 11868dc915f6412eaed3c2ba56738bfc (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260620 13:58:45.539916 12317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11868dc915f6412eaed3c2ba56738bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.548026 12463 tablet_service.cc:1511] Processing CreateTablet for tablet a6e8c601ed2e4253b8c7f5dceb77f518 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260620 13:58:45.548853 12522 tablet_bootstrap.cc:492] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:45.549440 12522 ts_tablet_manager.cc:1403] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.163s	user 0.032s	sys 0.042s
I20260620 13:58:45.550163 12463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e8c601ed2e4253b8c7f5dceb77f518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.554229 12522 raft_consensus.cc:359] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:45.556032 12522 raft_consensus.cc:385] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:45.556818 12522 raft_consensus.cc:740] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:45.562932 12522 consensus_queue.cc:260] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:45.574095 12426 heartbeater.cc:499] Master 127.4.155.254:43785 was elected leader, sending a full tablet report...
I20260620 13:58:45.582463 12239 tablet_service.cc:1511] Processing CreateTablet for tablet ff2e933cf7b644e4b893d2e7e85425be (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260620 13:58:45.584291 12520 tablet_bootstrap.cc:492] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:45.584893 12520 ts_tablet_manager.cc:1403] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.284s	user 0.019s	sys 0.025s
I20260620 13:58:45.585964 12239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2e933cf7b644e4b893d2e7e85425be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.588096 12520 raft_consensus.cc:359] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:45.588945 12520 raft_consensus.cc:385] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:45.589264 12520 raft_consensus.cc:740] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:45.590277 12520 consensus_queue.cc:260] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:45.602489 12308 tablet_service.cc:1511] Processing CreateTablet for tablet ff2e933cf7b644e4b893d2e7e85425be (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260620 13:58:45.603929 12308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2e933cf7b644e4b893d2e7e85425be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.608592 12521 tablet_bootstrap.cc:492] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:45.609144 12521 ts_tablet_manager.cc:1403] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.206s	user 0.023s	sys 0.008s
I20260620 13:58:45.612203 12521 raft_consensus.cc:359] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:45.612900 12521 raft_consensus.cc:385] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:45.613199 12521 raft_consensus.cc:740] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:45.617509 12521 consensus_queue.cc:260] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:45.628985 12523 tablet_bootstrap.cc:492] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:45.629568 12523 ts_tablet_manager.cc:1403] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.005s
I20260620 13:58:45.636339 12523 raft_consensus.cc:359] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:45.637095 12523 raft_consensus.cc:385] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:45.637509 12523 raft_consensus.cc:740] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:45.638398 12523 consensus_queue.cc:260] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:45.640506 12522 ts_tablet_manager.cc:1434] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.089s	user 0.019s	sys 0.037s
I20260620 13:58:45.653399 12522 tablet_bootstrap.cc:492] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:45.644948 12461 tablet_service.cc:1511] Processing CreateTablet for tablet 840318536322435dac01a843c641b718 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260620 13:58:45.654552 12461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 840318536322435dac01a843c641b718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.656497 12521 ts_tablet_manager.cc:1434] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.047s	user 0.012s	sys 0.019s
I20260620 13:58:45.657845 12521 tablet_bootstrap.cc:492] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:45.661712 12522 tablet_bootstrap.cc:654] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:45.670354 12390 tablet_service.cc:1511] Processing CreateTablet for tablet ff2e933cf7b644e4b893d2e7e85425be (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
W20260620 13:58:45.673789 12353 tablet.cc:2406] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 13:58:45.671916 12521 tablet_bootstrap.cc:654] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:45.680246 12241 tablet_service.cc:1511] Processing CreateTablet for tablet 840318536322435dac01a843c641b718 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260620 13:58:45.672909 12390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2e933cf7b644e4b893d2e7e85425be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.672832 12520 ts_tablet_manager.cc:1434] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.088s	user 0.014s	sys 0.000s
I20260620 13:58:45.688004 12500 heartbeater.cc:499] Master 127.4.155.254:43785 was elected leader, sending a full tablet report...
I20260620 13:58:45.702107 12241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 840318536322435dac01a843c641b718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.698500 12520 tablet_bootstrap.cc:492] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:45.702124 12523 ts_tablet_manager.cc:1434] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.003s
I20260620 13:58:45.718065 12310 tablet_service.cc:1511] Processing CreateTablet for tablet 840318536322435dac01a843c641b718 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260620 13:58:45.720041 12310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 840318536322435dac01a843c641b718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.720080 12462 tablet_service.cc:1511] Processing CreateTablet for tablet 1d12122a1bf1410bb150a27f3bf46fdf (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260620 13:58:45.721787 12462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d12122a1bf1410bb150a27f3bf46fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.732254 12239 tablet_service.cc:1511] Processing CreateTablet for tablet 1d12122a1bf1410bb150a27f3bf46fdf (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260620 13:58:45.733117 12312 tablet_service.cc:1511] Processing CreateTablet for tablet 56e0ab75d2c84468b813c054386f4b27 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260620 13:58:45.734005 12239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d12122a1bf1410bb150a27f3bf46fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.734500 12312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56e0ab75d2c84468b813c054386f4b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.737645 12523 tablet_bootstrap.cc:492] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:45.700676 12385 tablet_service.cc:1511] Processing CreateTablet for tablet 1d12122a1bf1410bb150a27f3bf46fdf (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260620 13:58:45.740326 12385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d12122a1bf1410bb150a27f3bf46fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.745702 12522 tablet_bootstrap.cc:492] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:45.746387 12522 ts_tablet_manager.cc:1403] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.013s
I20260620 13:58:45.747311 12391 tablet_service.cc:1511] Processing CreateTablet for tablet 56e0ab75d2c84468b813c054386f4b27 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260620 13:58:45.748446 12465 tablet_service.cc:1511] Processing CreateTablet for tablet 56e0ab75d2c84468b813c054386f4b27 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260620 13:58:45.748821 12391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56e0ab75d2c84468b813c054386f4b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.749972 12465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56e0ab75d2c84468b813c054386f4b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.756873 12308 tablet_service.cc:1511] Processing CreateTablet for tablet 62a796c8979c4c2bb4de0ee5e4cd35dc (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260620 13:58:45.758752 12308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a796c8979c4c2bb4de0ee5e4cd35dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.756039 12238 tablet_service.cc:1511] Processing CreateTablet for tablet 62a796c8979c4c2bb4de0ee5e4cd35dc (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260620 13:58:45.759886 12238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a796c8979c4c2bb4de0ee5e4cd35dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.782169 12521 tablet_bootstrap.cc:492] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:45.782794 12521 ts_tablet_manager.cc:1403] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.125s	user 0.017s	sys 0.018s
I20260620 13:58:45.784750 12386 tablet_service.cc:1511] Processing CreateTablet for tablet 62a796c8979c4c2bb4de0ee5e4cd35dc (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260620 13:58:45.785455 12523 tablet_bootstrap.cc:654] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:45.786809 12386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a796c8979c4c2bb4de0ee5e4cd35dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.787343 12463 tablet_service.cc:1511] Processing CreateTablet for tablet d70f84c10ad144b2b4d6bd50567b54ed (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260620 13:58:45.788036 12532 raft_consensus.cc:493] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:45.788543 12532 raft_consensus.cc:515] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:45.789952 12235 tablet_service.cc:1511] Processing CreateTablet for tablet d70f84c10ad144b2b4d6bd50567b54ed (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260620 13:58:45.791399 12235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70f84c10ad144b2b4d6bd50567b54ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.797560 12463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70f84c10ad144b2b4d6bd50567b54ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.799437 12317 tablet_service.cc:1511] Processing CreateTablet for tablet d70f84c10ad144b2b4d6bd50567b54ed (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260620 13:58:45.800940 12317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70f84c10ad144b2b4d6bd50567b54ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.800745 12383 tablet_service.cc:1511] Processing CreateTablet for tablet 86b5f917a39d4ff0bbbc205b4aa941d8 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260620 13:58:45.802203 12383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b5f917a39d4ff0bbbc205b4aa941d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.814124 12521 raft_consensus.cc:359] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:45.749918 12522 raft_consensus.cc:359] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:45.824148 12529 raft_consensus.cc:493] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:45.831127 12529 raft_consensus.cc:515] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:45.819218 12460 tablet_service.cc:1511] Processing CreateTablet for tablet 86b5f917a39d4ff0bbbc205b4aa941d8 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260620 13:58:45.828075 12234 tablet_service.cc:1511] Processing CreateTablet for tablet 86b5f917a39d4ff0bbbc205b4aa941d8 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260620 13:58:45.828809 12315 tablet_service.cc:1511] Processing CreateTablet for tablet 00f805a171a24872a79e07cc3a788290 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260620 13:58:45.830062 12388 tablet_service.cc:1511] Processing CreateTablet for tablet 00f805a171a24872a79e07cc3a788290 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260620 13:58:45.820533 12521 raft_consensus.cc:385] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:45.838768 12460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b5f917a39d4ff0bbbc205b4aa941d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.835137 12522 raft_consensus.cc:385] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:45.838953 12520 tablet_bootstrap.cc:654] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:45.858433 12388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f805a171a24872a79e07cc3a788290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.853603 12521 raft_consensus.cc:740] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:45.867821 12521 consensus_queue.cc:260] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:45.868975 12314 tablet_service.cc:1511] Processing CreateTablet for tablet 1565041017e04674b72abd4fdbab6b1b (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260620 13:58:45.870554 12528 raft_consensus.cc:493] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:45.871234 12528 raft_consensus.cc:515] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:45.874121 12532 leader_election.cc:290] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:45.854506 12522 raft_consensus.cc:740] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:45.876124 12528 leader_election.cc:290] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:45.865422 12241 tablet_service.cc:1511] Processing CreateTablet for tablet 1565041017e04674b72abd4fdbab6b1b (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260620 13:58:45.875586 12522 consensus_queue.cc:260] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:45.863727 12234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b5f917a39d4ff0bbbc205b4aa941d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.877142 12315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f805a171a24872a79e07cc3a788290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.862833 12529 leader_election.cc:290] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:45.905567 12521 ts_tablet_manager.cc:1434] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.122s	user 0.011s	sys 0.004s
I20260620 13:58:45.910089 12314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1565041017e04674b72abd4fdbab6b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.910983 12521 tablet_bootstrap.cc:492] T 517e043628a84907974c6a2fbf432d08 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:45.920116 12241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1565041017e04674b72abd4fdbab6b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:45.968456 12522 ts_tablet_manager.cc:1434] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.222s	user 0.013s	sys 0.000s
I20260620 13:58:45.969580 12522 tablet_bootstrap.cc:492] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:45.990473 12530 raft_consensus.cc:493] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:45.995620 12522 tablet_bootstrap.cc:654] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:46.003959 12235 tablet_service.cc:1511] Processing CreateTablet for tablet 99e449058fb942ddb74eb93a98cb4336 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260620 13:58:46.005363 12521 tablet_bootstrap.cc:654] T 517e043628a84907974c6a2fbf432d08 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:45.996033 12530 raft_consensus.cc:515] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:46.005501 12235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e449058fb942ddb74eb93a98cb4336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.011757 12530 leader_election.cc:290] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:46.017550 12465 tablet_service.cc:1511] Processing CreateTablet for tablet 00f805a171a24872a79e07cc3a788290 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260620 13:58:46.019009 12465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f805a171a24872a79e07cc3a788290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.037621 12463 tablet_service.cc:1511] Processing CreateTablet for tablet 99e449058fb942ddb74eb93a98cb4336 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260620 13:58:46.039093 12463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e449058fb942ddb74eb93a98cb4336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.076161 12383 tablet_service.cc:1511] Processing CreateTablet for tablet 1565041017e04674b72abd4fdbab6b1b (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260620 13:58:46.075994 12386 tablet_service.cc:1511] Processing CreateTablet for tablet 40cf2f63a9574e2098c933116f1700cc (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260620 13:58:46.077797 12383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1565041017e04674b72abd4fdbab6b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.078447 12386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40cf2f63a9574e2098c933116f1700cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.079030 12522 tablet_bootstrap.cc:492] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:46.079860 12522 ts_tablet_manager.cc:1403] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.111s	user 0.018s	sys 0.013s
I20260620 13:58:46.095737 12462 tablet_service.cc:1511] Processing CreateTablet for tablet 40cf2f63a9574e2098c933116f1700cc (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260620 13:58:46.098009 12462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40cf2f63a9574e2098c933116f1700cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.103072 12523 tablet_bootstrap.cc:492] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:46.103854 12523 ts_tablet_manager.cc:1403] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.366s	user 0.012s	sys 0.006s
I20260620 13:58:46.106099 12522 raft_consensus.cc:359] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:46.107653 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517e043628a84907974c6a2fbf432d08" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:46.121891 12522 raft_consensus.cc:385] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:46.122618 12522 raft_consensus.cc:740] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:46.145000 12522 consensus_queue.cc:260] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
W20260620 13:58:46.124138 12441 leader_election.cc:343] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:46.126616 12238 tablet_service.cc:1511] Processing CreateTablet for tablet 40cf2f63a9574e2098c933116f1700cc (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260620 13:58:46.156637 12238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40cf2f63a9574e2098c933116f1700cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.127593 12312 tablet_service.cc:1511] Processing CreateTablet for tablet 15db1e0a1aa646e281b8e1a998d8f6d4 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260620 13:58:46.138885 12385 tablet_service.cc:1511] Processing CreateTablet for tablet 15db1e0a1aa646e281b8e1a998d8f6d4 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260620 13:58:46.159860 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517e043628a84907974c6a2fbf432d08" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:46.140250 12460 tablet_service.cc:1511] Processing CreateTablet for tablet 15db1e0a1aa646e281b8e1a998d8f6d4 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260620 13:58:46.147046 12197 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:58:46.160531 12312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15db1e0a1aa646e281b8e1a998d8f6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.110397 12523 raft_consensus.cc:359] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:46.162835 12520 tablet_bootstrap.cc:492] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
W20260620 13:58:46.168380 12440 leader_election.cc:343] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:46.168685 12400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdb1bbde932422ba09645787f9d2446" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:46.173954 12440 leader_election.cc:304] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:46.165782 12523 raft_consensus.cc:385] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:46.176138 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d2754643614cdcb0928c841c0fa0bb" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:46.176601 12520 ts_tablet_manager.cc:1403] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.479s	user 0.013s	sys 0.017s
I20260620 13:58:46.176029 12310 tablet_service.cc:1511] Processing CreateTablet for tablet d4a422539280460c895f371ef9eb8f4d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260620 13:58:46.178953 12310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a422539280460c895f371ef9eb8f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.177383 12532 raft_consensus.cc:2749] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 13:58:46.182245 12217 leader_election.cc:343] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:46.182564 12391 tablet_service.cc:1511] Processing CreateTablet for tablet d4a422539280460c895f371ef9eb8f4d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260620 13:58:46.183072 12239 tablet_service.cc:1511] Processing CreateTablet for tablet d4a422539280460c895f371ef9eb8f4d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260620 13:58:46.184118 12391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a422539280460c895f371ef9eb8f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.184404 12239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a422539280460c895f371ef9eb8f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.177488 12460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15db1e0a1aa646e281b8e1a998d8f6d4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 13:58:46.187773 12290 leader_election.cc:343] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:46.190764 12520 raft_consensus.cc:359] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:46.191672 12520 raft_consensus.cc:385] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:46.191951 12385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15db1e0a1aa646e281b8e1a998d8f6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.192006 12520 raft_consensus.cc:740] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:46.193136 12520 consensus_queue.cc:260] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:46.202682 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdb1bbde932422ba09645787f9d2446" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:46.203164 12522 ts_tablet_manager.cc:1434] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.123s	user 0.008s	sys 0.003s
I20260620 13:58:46.204412 12522 tablet_bootstrap.cc:492] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
W20260620 13:58:46.204577 12218 leader_election.cc:343] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:46.205128 12218 leader_election.cc:304] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:46.206712 12528 raft_consensus.cc:2749] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:46.207429 12528 raft_consensus.cc:493] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:46.207926 12528 raft_consensus.cc:515] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:46.210722 12528 leader_election.cc:290] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:46.212493 12400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09dbf9acadba454f83e6b30932aa7806" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:46.211871 12522 tablet_bootstrap.cc:654] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
W20260620 13:58:46.215752 12217 leader_election.cc:343] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:46.219378 12308 tablet_service.cc:1511] Processing CreateTablet for tablet 99e449058fb942ddb74eb93a98cb4336 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260620 13:58:46.220847 12308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e449058fb942ddb74eb93a98cb4336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.223373 12521 tablet_bootstrap.cc:492] T 517e043628a84907974c6a2fbf432d08 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:46.176959 12523 raft_consensus.cc:740] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:46.235337 12523 consensus_queue.cc:260] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:46.242452 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09dbf9acadba454f83e6b30932aa7806" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:46.243269 12529 raft_consensus.cc:493] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:46.255657 12529 raft_consensus.cc:515] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:46.261268 12521 ts_tablet_manager.cc:1403] T 517e043628a84907974c6a2fbf432d08 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.351s	user 0.024s	sys 0.033s
I20260620 13:58:46.278393 12529 leader_election.cc:290] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:46.279021 12235 tablet_service.cc:1511] Processing CreateTablet for tablet e34e64f189e740e1bbebd03257e5af90 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260620 13:58:46.281716 12235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e34e64f189e740e1bbebd03257e5af90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.282702 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d2754643614cdcb0928c841c0fa0bb" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:46.283494 12252 raft_consensus.cc:2468] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:46.284793 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ae493b3ffc48e19f911962029c41e5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:46.289194 12293 leader_election.cc:304] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:46.289819 12462 tablet_service.cc:1511] Processing CreateTablet for tablet e34e64f189e740e1bbebd03257e5af90 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260620 13:58:46.295732 12462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e34e64f189e740e1bbebd03257e5af90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.299675 12529 raft_consensus.cc:2804] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:46.300130 12529 raft_consensus.cc:493] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260620 13:58:46.300269 12293 leader_election.cc:343] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:46.300489 12529 raft_consensus.cc:3060] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:46.282771 12521 raft_consensus.cc:359] T 517e043628a84907974c6a2fbf432d08 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:46.307773 12521 raft_consensus.cc:385] T 517e043628a84907974c6a2fbf432d08 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:46.308094 12521 raft_consensus.cc:740] T 517e043628a84907974c6a2fbf432d08 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:46.308938 12521 consensus_queue.cc:260] T 517e043628a84907974c6a2fbf432d08 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:46.311933 12400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ae493b3ffc48e19f911962029c41e5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:46.312564 12400 raft_consensus.cc:2468] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:46.314514 12292 leader_election.cc:304] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:58:46.318984 12521 ts_tablet_manager.cc:1434] T 517e043628a84907974c6a2fbf432d08 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.003s
I20260620 13:58:46.320482 12529 raft_consensus.cc:515] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:46.274721 12475 raft_consensus.cc:2468] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:46.323800 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d2754643614cdcb0928c841c0fa0bb" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:46.323817 12474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d2754643614cdcb0928c841c0fa0bb" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:46.324466 12251 raft_consensus.cc:3060] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:46.289922 12520 ts_tablet_manager.cc:1434] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.003s
I20260620 13:58:46.325796 12520 tablet_bootstrap.cc:492] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:46.325676 12215 leader_election.cc:304] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: c51ef915af09435db6046c91bb9d00e0
W20260620 13:58:46.328719 12290 leader_election.cc:343] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:46.334385 12251 raft_consensus.cc:2468] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:46.335004 12554 raft_consensus.cc:2804] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:46.335512 12554 raft_consensus.cc:493] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:46.335897 12554 raft_consensus.cc:3060] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:46.335700 12293 leader_election.cc:304] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:46.337898 12523 ts_tablet_manager.cc:1434] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.234s	user 0.005s	sys 0.004s
I20260620 13:58:46.340685 12523 tablet_bootstrap.cc:492] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:46.345044 12554 raft_consensus.cc:515] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:46.349051 12521 tablet_bootstrap.cc:492] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:46.349308 12520 tablet_bootstrap.cc:654] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:46.355218 12529 leader_election.cc:290] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
W20260620 13:58:46.355644 12135 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.4.155.195:37673, user_credentials={real_user=slave}} blocked reactor thread for 61822.7us
I20260620 13:58:46.355886 12529 raft_consensus.cc:2804] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:46.356315 12529 raft_consensus.cc:493] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:46.356021 12400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09dbf9acadba454f83e6b30932aa7806" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:46.356668 12529 raft_consensus.cc:3060] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:58:46.357946 12217 leader_election.cc:343] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:46.360715 12474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09dbf9acadba454f83e6b30932aa7806" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:46.361418 12554 leader_election.cc:290] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:46.361467 12474 raft_consensus.cc:3060] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:46.365257 12556 raft_consensus.cc:2804] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:46.365887 12556 raft_consensus.cc:697] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:46.365643 12239 tablet_service.cc:1511] Processing CreateTablet for tablet 61907296334d4a149ab81ba5337a1a27 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260620 13:58:46.366348 12317 tablet_service.cc:1511] Processing CreateTablet for tablet ff3958c528894be19bfada85bc17a4ee (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260620 13:58:46.366770 12556 consensus_queue.cc:237] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:46.367038 12239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61907296334d4a149ab81ba5337a1a27. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 13:58:46.367600 12292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:37673, user_credentials={real_user=slave}} blocked reactor thread for 53318.9us
I20260620 13:58:46.368579 12312 tablet_service.cc:1511] Processing CreateTablet for tablet e34e64f189e740e1bbebd03257e5af90 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260620 13:58:46.371001 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065fb7373cff4c42b0917abd9199dac5" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:46.367612 12317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3958c528894be19bfada85bc17a4ee. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 13:58:46.372983 12367 leader_election.cc:343] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:46.373901 12312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e34e64f189e740e1bbebd03257e5af90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.374511 12383 tablet_service.cc:1511] Processing CreateTablet for tablet ff3958c528894be19bfada85bc17a4ee (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260620 13:58:46.375844 12383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3958c528894be19bfada85bc17a4ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.369052 12385 tablet_service.cc:1511] Processing CreateTablet for tablet 61907296334d4a149ab81ba5337a1a27 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260620 13:58:46.382251 12385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61907296334d4a149ab81ba5337a1a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.383757 12465 tablet_service.cc:1511] Processing CreateTablet for tablet ff3958c528894be19bfada85bc17a4ee (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260620 13:58:46.385068 12465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3958c528894be19bfada85bc17a4ee. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 13:58:46.387732 12293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 52126.6us
I20260620 13:58:46.394217 12522 tablet_bootstrap.cc:492] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:46.394244 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065fb7373cff4c42b0917abd9199dac5" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:46.394987 12522 ts_tablet_manager.cc:1403] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.191s	user 0.029s	sys 0.035s
I20260620 13:58:46.395773 12238 tablet_service.cc:1511] Processing CreateTablet for tablet 0ee8de600a8646df90a272c586e08ae5 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260620 13:58:46.396291 12364 leader_election.cc:343] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:46.396795 12364 leader_election.cc:304] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:46.398013 12530 raft_consensus.cc:2749] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:46.397056 12238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee8de600a8646df90a272c586e08ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.398419 12522 raft_consensus.cc:359] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:46.399228 12522 raft_consensus.cc:385] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:46.399544 12522 raft_consensus.cc:740] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:46.399845 12463 tablet_service.cc:1511] Processing CreateTablet for tablet 369e0ab28a64476cb0e07ab5672b9337 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260620 13:58:46.400388 12522 consensus_queue.cc:260] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:46.401165 12463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369e0ab28a64476cb0e07ab5672b9337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.405624 12314 tablet_service.cc:1511] Processing CreateTablet for tablet 0ee8de600a8646df90a272c586e08ae5 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260620 13:58:46.406833 12522 ts_tablet_manager.cc:1434] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260620 13:58:46.407078 12314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee8de600a8646df90a272c586e08ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.409420 12234 tablet_service.cc:1511] Processing CreateTablet for tablet 369e0ab28a64476cb0e07ab5672b9337 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260620 13:58:46.420503 12234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369e0ab28a64476cb0e07ab5672b9337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.410652 12474 raft_consensus.cc:2468] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:46.415011 12391 tablet_service.cc:1511] Processing CreateTablet for tablet 0ee8de600a8646df90a272c586e08ae5 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260620 13:58:46.423415 12391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee8de600a8646df90a272c586e08ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.411916 12462 tablet_service.cc:1511] Processing CreateTablet for tablet 61907296334d4a149ab81ba5337a1a27 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260620 13:58:46.423305 12215 leader_election.cc:304] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:46.424260 12554 raft_consensus.cc:2804] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:46.424799 12554 raft_consensus.cc:697] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:58:46.425685 12554 consensus_queue.cc:237] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:46.428378 12521 tablet_bootstrap.cc:654] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:46.428483 12461 tablet_service.cc:1511] Processing CreateTablet for tablet 1c50f25282d94111a4d435e85e67af34 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260620 13:58:46.430270 12461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c50f25282d94111a4d435e85e67af34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.431088 12462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61907296334d4a149ab81ba5337a1a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.434604 12241 tablet_service.cc:1511] Processing CreateTablet for tablet 1c50f25282d94111a4d435e85e67af34 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260620 13:58:46.436074 12241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c50f25282d94111a4d435e85e67af34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.407971 12522 tablet_bootstrap.cc:492] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:46.437532 12308 tablet_service.cc:1511] Processing CreateTablet for tablet 369e0ab28a64476cb0e07ab5672b9337 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260620 13:58:46.440344 12386 tablet_service.cc:1511] Processing CreateTablet for tablet 1c50f25282d94111a4d435e85e67af34 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260620 13:58:46.441989 12386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c50f25282d94111a4d435e85e67af34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.445071 12308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369e0ab28a64476cb0e07ab5672b9337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.446440 12523 tablet_bootstrap.cc:654] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:46.471896 12529 raft_consensus.cc:515] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:46.484016 12310 tablet_service.cc:1511] Processing CreateTablet for tablet 51af9cbc1bcc4e1cbd3c5c37e44f865b (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260620 13:58:46.485651 12310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51af9cbc1bcc4e1cbd3c5c37e44f865b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.499047 12388 tablet_service.cc:1511] Processing CreateTablet for tablet 51af9cbc1bcc4e1cbd3c5c37e44f865b (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260620 13:58:46.500468 12388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51af9cbc1bcc4e1cbd3c5c37e44f865b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.505086 12460 tablet_service.cc:1511] Processing CreateTablet for tablet 51af9cbc1bcc4e1cbd3c5c37e44f865b (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260620 13:58:46.506424 12460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51af9cbc1bcc4e1cbd3c5c37e44f865b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.507187 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ae493b3ffc48e19f911962029c41e5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
W20260620 13:58:46.508725 12293 leader_election.cc:343] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:46.509229 12148 catalog_manager.cc:5696] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 1 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:46.510957 12400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ae493b3ffc48e19f911962029c41e5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:46.511610 12400 raft_consensus.cc:3060] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:46.513514 12520 tablet_bootstrap.cc:492] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:46.514083 12520 ts_tablet_manager.cc:1403] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.189s	user 0.016s	sys 0.016s
I20260620 13:58:46.519495 12315 tablet_service.cc:1511] Processing CreateTablet for tablet 7edd30f224ff4b17bc0d671c619c821b (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260620 13:58:46.521754 12315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7edd30f224ff4b17bc0d671c619c821b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.520324 12522 tablet_bootstrap.cc:654] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:46.527299 12390 tablet_service.cc:1511] Processing CreateTablet for tablet 7edd30f224ff4b17bc0d671c619c821b (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260620 13:58:46.536264 12235 tablet_service.cc:1511] Processing CreateTablet for tablet 7edd30f224ff4b17bc0d671c619c821b (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260620 13:58:46.533586 12520 raft_consensus.cc:359] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:46.533994 12149 catalog_manager.cc:5696] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:46.534636 12400 raft_consensus.cc:2468] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:46.523772 12529 leader_election.cc:290] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:46.563695 12456 tablet_service.cc:1511] Processing CreateTablet for tablet 7d587f93178449aa9441f0d350cc166d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260620 13:58:46.565129 12456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d587f93178449aa9441f0d350cc166d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.566226 12390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7edd30f224ff4b17bc0d671c619c821b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.559201 12520 raft_consensus.cc:385] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:46.583273 12292 leader_election.cc:304] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:58:46.583297 12235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7edd30f224ff4b17bc0d671c619c821b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.589051 12238 tablet_service.cc:1511] Processing CreateTablet for tablet 7d587f93178449aa9441f0d350cc166d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260620 13:58:46.591543 12238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d587f93178449aa9441f0d350cc166d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.591791 12529 raft_consensus.cc:2804] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:46.592031 12523 tablet_bootstrap.cc:492] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:46.593065 12521 tablet_bootstrap.cc:492] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:46.595528 12314 tablet_service.cc:1511] Processing CreateTablet for tablet 7d587f93178449aa9441f0d350cc166d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260620 13:58:46.596486 12385 tablet_service.cc:1511] Processing CreateTablet for tablet 918029829d594bafac9e17a30edcacee (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260620 13:58:46.584226 12520 raft_consensus.cc:740] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:46.606176 12521 ts_tablet_manager.cc:1403] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.257s	user 0.016s	sys 0.007s
I20260620 13:58:46.603840 12529 raft_consensus.cc:697] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:46.610675 12385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918029829d594bafac9e17a30edcacee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.611173 12465 tablet_service.cc:1511] Processing CreateTablet for tablet 918029829d594bafac9e17a30edcacee (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260620 13:58:46.611275 12529 consensus_queue.cc:237] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:46.613126 12465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918029829d594bafac9e17a30edcacee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.623271 12314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d587f93178449aa9441f0d350cc166d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.605557 12523 ts_tablet_manager.cc:1403] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.265s	user 0.011s	sys 0.016s
I20260620 13:58:46.619549 12520 consensus_queue.cc:260] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:46.644491 12520 ts_tablet_manager.cc:1434] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.130s	user 0.008s	sys 0.006s
I20260620 13:58:46.645994 12520 tablet_bootstrap.cc:492] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:46.677348 12310 tablet_service.cc:1511] Processing CreateTablet for tablet 1a9724c70f584a9c8aced9cc416e027d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260620 13:58:46.678875 12529 raft_consensus.cc:493] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:46.679517 12529 raft_consensus.cc:515] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:46.680502 12310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a9724c70f584a9c8aced9cc416e027d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.681311 12241 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1f1202d4ad46b49a994c23c7f566c1 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260620 13:58:46.682375 12391 tablet_service.cc:1511] Processing CreateTablet for tablet 1a9724c70f584a9c8aced9cc416e027d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260620 13:58:46.682657 12400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517e043628a84907974c6a2fbf432d08" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:46.682897 12463 tablet_service.cc:1511] Processing CreateTablet for tablet 1a9724c70f584a9c8aced9cc416e027d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260620 13:58:46.693758 12400 raft_consensus.cc:2468] T 517e043628a84907974c6a2fbf432d08 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:46.694346 12463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a9724c70f584a9c8aced9cc416e027d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.694103 12461 tablet_service.cc:1511] Processing CreateTablet for tablet 7aa301d02030498583d201921146bb89 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260620 13:58:46.685632 12308 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1f1202d4ad46b49a994c23c7f566c1 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260620 13:58:46.695215 12292 leader_election.cc:304] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:46.695538 12461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aa301d02030498583d201921146bb89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.696213 12308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1f1202d4ad46b49a994c23c7f566c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.682703 12241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1f1202d4ad46b49a994c23c7f566c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.688548 12529 leader_election.cc:290] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:46.699605 12522 tablet_bootstrap.cc:492] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:46.700161 12522 ts_tablet_manager.cc:1403] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.292s	user 0.033s	sys 0.030s
I20260620 13:58:46.689307 12523 raft_consensus.cc:359] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:46.689807 12474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517e043628a84907974c6a2fbf432d08" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:46.692402 12388 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1f1202d4ad46b49a994c23c7f566c1 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260620 13:58:46.696135 12556 raft_consensus.cc:2804] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:46.686873 12234 tablet_service.cc:1511] Processing CreateTablet for tablet 918029829d594bafac9e17a30edcacee (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260620 13:58:46.714056 12234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918029829d594bafac9e17a30edcacee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.716635 12521 raft_consensus.cc:359] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:46.717139 12242 tablet_service.cc:1511] Processing CreateTablet for tablet 75286f26552b4e788b3844d3aa342b01 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260620 13:58:46.704082 12523 raft_consensus.cc:385] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:46.718057 12523 raft_consensus.cc:740] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:46.706816 12522 raft_consensus.cc:359] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:46.708271 12383 tablet_service.cc:1511] Processing CreateTablet for tablet 75286f26552b4e788b3844d3aa342b01 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260620 13:58:46.718839 12242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75286f26552b4e788b3844d3aa342b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.705960 12474 raft_consensus.cc:2468] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:46.719189 12523 consensus_queue.cc:260] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:46.705253 12391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a9724c70f584a9c8aced9cc416e027d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.704217 12556 raft_consensus.cc:493] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:46.712138 12315 tablet_service.cc:1511] Processing CreateTablet for tablet 7aa301d02030498583d201921146bb89 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260620 13:58:46.706014 12239 tablet_service.cc:1511] Processing CreateTablet for tablet 7aa301d02030498583d201921146bb89 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260620 13:58:46.717530 12521 raft_consensus.cc:385] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:46.710590 12465 tablet_service.cc:1511] Processing CreateTablet for tablet 75286f26552b4e788b3844d3aa342b01 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260620 13:58:46.722824 12556 raft_consensus.cc:3060] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:46.718912 12522 raft_consensus.cc:385] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:46.729156 12239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aa301d02030498583d201921146bb89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.725594 12521 raft_consensus.cc:740] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:46.733629 12465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75286f26552b4e788b3844d3aa342b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.760701 12521 consensus_queue.cc:260] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:46.758047 12556 raft_consensus.cc:515] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:46.733891 12315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aa301d02030498583d201921146bb89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.736817 12386 tablet_service.cc:1511] Processing CreateTablet for tablet 8e74afa4f8b64bf691a223a9eff804d7 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260620 13:58:46.730590 12522 raft_consensus.cc:740] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:46.771088 12522 consensus_queue.cc:260] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:46.730671 12383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75286f26552b4e788b3844d3aa342b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.741456 12317 tablet_service.cc:1511] Processing CreateTablet for tablet 8e74afa4f8b64bf691a223a9eff804d7 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260620 13:58:46.746577 12458 tablet_service.cc:1511] Processing CreateTablet for tablet 8e74afa4f8b64bf691a223a9eff804d7 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260620 13:58:46.747833 12523 ts_tablet_manager.cc:1434] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.117s	user 0.010s	sys 0.000s
I20260620 13:58:46.756778 12240 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe9fd2ff66d4141a2c7f7023278714d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260620 13:58:46.774654 12458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e74afa4f8b64bf691a223a9eff804d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.774698 12240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe9fd2ff66d4141a2c7f7023278714d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.777340 12317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e74afa4f8b64bf691a223a9eff804d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.772665 12388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1f1202d4ad46b49a994c23c7f566c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.787774 12312 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe9fd2ff66d4141a2c7f7023278714d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260620 13:58:46.789156 12400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517e043628a84907974c6a2fbf432d08" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:46.789808 12400 raft_consensus.cc:3060] T 517e043628a84907974c6a2fbf432d08 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:46.791561 12521 ts_tablet_manager.cc:1434] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.185s	user 0.010s	sys 0.000s
I20260620 13:58:46.792691 12521 tablet_bootstrap.cc:492] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:46.789211 12312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe9fd2ff66d4141a2c7f7023278714d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.799314 12386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e74afa4f8b64bf691a223a9eff804d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.807425 12523 tablet_bootstrap.cc:492] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:46.808182 12529 consensus_queue.cc:1048] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:46.815132 12522 ts_tablet_manager.cc:1434] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.115s	user 0.008s	sys 0.002s
I20260620 13:58:46.816362 12522 tablet_bootstrap.cc:492] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:46.829102 12474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517e043628a84907974c6a2fbf432d08" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:46.829777 12474 raft_consensus.cc:3060] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:46.838258 12474 raft_consensus.cc:2468] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:46.839671 12290 leader_election.cc:304] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:46.841701 12529 raft_consensus.cc:2804] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:46.842367 12529 raft_consensus.cc:697] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:46.844156 12554 raft_consensus.cc:493] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:46.844923 12554 raft_consensus.cc:515] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:46.843729 12529 consensus_queue.cc:237] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:46.852201 12520 tablet_bootstrap.cc:654] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:46.853085 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928bd8a07cbe4d58b19f3669419f928d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
W20260620 13:58:46.857867 12218 leader_election.cc:343] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:46.858661 12523 tablet_bootstrap.cc:654] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:46.860381 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928bd8a07cbe4d58b19f3669419f928d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:46.862059 12554 leader_election.cc:290] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
W20260620 13:58:46.863559 12215 leader_election.cc:343] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:46.864254 12215 leader_election.cc:304] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:46.868865 12475 raft_consensus.cc:3060] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:46.873108 12554 raft_consensus.cc:2749] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:46.877512 12385 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe9fd2ff66d4141a2c7f7023278714d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260620 13:58:46.878050 12400 raft_consensus.cc:2468] T 517e043628a84907974c6a2fbf432d08 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:46.878991 12385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe9fd2ff66d4141a2c7f7023278714d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.879242 12461 tablet_service.cc:1511] Processing CreateTablet for tablet 17521c552cad497e9ae59a332d156c0e (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260620 13:58:46.879716 12556 leader_election.cc:290] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:46.880529 12461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17521c552cad497e9ae59a332d156c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.880764 12240 tablet_service.cc:1511] Processing CreateTablet for tablet 17521c552cad497e9ae59a332d156c0e (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260620 13:58:46.882025 12240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17521c552cad497e9ae59a332d156c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.893590 12314 tablet_service.cc:1511] Processing CreateTablet for tablet 17521c552cad497e9ae59a332d156c0e (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260620 13:58:46.895083 12314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17521c552cad497e9ae59a332d156c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.916271 12390 tablet_service.cc:1511] Processing CreateTablet for tablet 786cabf18ace418e912751ea7c5cc45d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260620 13:58:46.917815 12521 tablet_bootstrap.cc:654] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:46.918143 12390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 786cabf18ace418e912751ea7c5cc45d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.924798 12554 consensus_queue.cc:1048] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:46.924918 12463 tablet_service.cc:1511] Processing CreateTablet for tablet 786cabf18ace418e912751ea7c5cc45d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260620 13:58:46.926436 12463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 786cabf18ace418e912751ea7c5cc45d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.941614 12532 raft_consensus.cc:493] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:46.942248 12532 raft_consensus.cc:515] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:46.942159 12234 tablet_service.cc:1511] Processing CreateTablet for tablet 786cabf18ace418e912751ea7c5cc45d (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260620 13:58:46.945775 12234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 786cabf18ace418e912751ea7c5cc45d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.946190 12532 leader_election.cc:290] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:46.944463 12529 consensus_queue.cc:1048] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:46.963555 12315 tablet_service.cc:1511] Processing CreateTablet for tablet fad12197ae0a40fe8dff265afe9d96af (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260620 13:58:46.964618 12384 tablet_service.cc:1511] Processing CreateTablet for tablet fad12197ae0a40fe8dff265afe9d96af (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260620 13:58:46.967381 12384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad12197ae0a40fe8dff265afe9d96af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.971501 12315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad12197ae0a40fe8dff265afe9d96af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:46.978781 12522 tablet_bootstrap.cc:654] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.002489 12465 tablet_service.cc:1511] Processing CreateTablet for tablet fad12197ae0a40fe8dff265afe9d96af (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260620 13:58:47.003971 12465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad12197ae0a40fe8dff265afe9d96af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.003702 12308 tablet_service.cc:1511] Processing CreateTablet for tablet 98b83072f19644f5806c4391cbb1bce5 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260620 13:58:47.005125 12308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b83072f19644f5806c4391cbb1bce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.012001 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d2754643614cdcb0928c841c0fa0bb" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:47.030009 12462 tablet_service.cc:1511] Processing CreateTablet for tablet a0dff624788f433e88274d14f0db3c4c (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260620 13:58:47.031433 12462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0dff624788f433e88274d14f0db3c4c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 13:58:47.031697 12217 consensus_peers.cc:597] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f -> Peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Couldn't send request to peer c51ef915af09435db6046c91bb9d00e0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:47.032294 12242 tablet_service.cc:1511] Processing CreateTablet for tablet 98b83072f19644f5806c4391cbb1bce5 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260620 13:58:47.033416 12382 tablet_service.cc:1511] Processing CreateTablet for tablet 98b83072f19644f5806c4391cbb1bce5 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260620 13:58:47.034694 12382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b83072f19644f5806c4391cbb1bce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.040463 12557 consensus_queue.cc:1048] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:47.049192 12242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b83072f19644f5806c4391cbb1bce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.068608 12520 tablet_bootstrap.cc:492] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:47.088778 12520 ts_tablet_manager.cc:1403] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.443s	user 0.014s	sys 0.009s
I20260620 13:58:47.123091 12241 tablet_service.cc:1511] Processing CreateTablet for tablet a0dff624788f433e88274d14f0db3c4c (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260620 13:58:47.125010 12241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0dff624788f433e88274d14f0db3c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.124606 12520 raft_consensus.cc:359] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.125582 12520 raft_consensus.cc:385] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.126180 12520 raft_consensus.cc:740] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
W20260620 13:58:47.126979 12293 consensus_peers.cc:597] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:47.128181 12554 raft_consensus.cc:493] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:47.127971 12310 tablet_service.cc:1511] Processing CreateTablet for tablet a0dff624788f433e88274d14f0db3c4c (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260620 13:58:47.128680 12554 raft_consensus.cc:515] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.129298 12310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0dff624788f433e88274d14f0db3c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.126967 12520 consensus_queue.cc:260] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.149901 12523 tablet_bootstrap.cc:492] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:47.150436 12523 ts_tablet_manager.cc:1403] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.343s	user 0.029s	sys 0.010s
I20260620 13:58:47.151757 12520 ts_tablet_manager.cc:1434] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260620 13:58:47.152804 12520 tablet_bootstrap.cc:492] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:47.152899 12521 tablet_bootstrap.cc:492] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:47.153457 12521 ts_tablet_manager.cc:1403] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.361s	user 0.019s	sys 0.015s
I20260620 13:58:47.153374 12523 raft_consensus.cc:359] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.154242 12523 raft_consensus.cc:385] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.154536 12523 raft_consensus.cc:740] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.155431 12523 consensus_queue.cc:260] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.156172 12383 tablet_service.cc:1511] Processing CreateTablet for tablet 4b27c67d5c9b4e2dbc82e90717ebbf9e (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260620 13:58:47.157454 12383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b27c67d5c9b4e2dbc82e90717ebbf9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.157605 12523 ts_tablet_manager.cc:1434] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260620 13:58:47.158874 12523 tablet_bootstrap.cc:492] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:47.163143 12520 tablet_bootstrap.cc:654] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
W20260620 13:58:47.166158 12197 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:58:47.176010 12530 raft_consensus.cc:493] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:47.180550 12530 raft_consensus.cc:515] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.180888 12146 catalog_manager.cc:5696] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 1 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } }
I20260620 13:58:47.204227 12312 tablet_service.cc:1511] Processing CreateTablet for tablet 100d2b85fd4c4959bfbb5df7beb05915 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260620 13:58:47.205578 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efeb9f3004de439280900847880929c6" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:47.198711 12384 tablet_service.cc:1511] Processing CreateTablet for tablet 100d2b85fd4c4959bfbb5df7beb05915 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260620 13:58:47.206903 12384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100d2b85fd4c4959bfbb5df7beb05915. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 13:58:47.207293 12217 leader_election.cc:343] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:47.209005 12521 raft_consensus.cc:359] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.209805 12521 raft_consensus.cc:385] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.210107 12521 raft_consensus.cc:740] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.210211 12530 leader_election.cc:290] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:47.210736 12522 tablet_bootstrap.cc:492] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:47.211316 12522 ts_tablet_manager.cc:1403] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.395s	user 0.020s	sys 0.016s
I20260620 13:58:47.214323 12522 raft_consensus.cc:359] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.205650 12312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100d2b85fd4c4959bfbb5df7beb05915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.208979 12554 leader_election.cc:290] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:47.228503 12313 tablet_service.cc:1511] Processing CreateTablet for tablet d3b45b565aa74abfad3579abc6ed2e56 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260620 13:58:47.215051 12522 raft_consensus.cc:385] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.229892 12313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b45b565aa74abfad3579abc6ed2e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.230505 12388 tablet_service.cc:1511] Processing CreateTablet for tablet d3b45b565aa74abfad3579abc6ed2e56 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260620 13:58:47.247633 12463 tablet_service.cc:1511] Processing CreateTablet for tablet 4b27c67d5c9b4e2dbc82e90717ebbf9e (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260620 13:58:47.248097 12240 tablet_service.cc:1511] Processing CreateTablet for tablet d3b45b565aa74abfad3579abc6ed2e56 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260620 13:58:47.248466 12458 tablet_service.cc:1511] Processing CreateTablet for tablet 100d2b85fd4c4959bfbb5df7beb05915 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260620 13:58:47.249032 12463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b27c67d5c9b4e2dbc82e90717ebbf9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.249462 12240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b45b565aa74abfad3579abc6ed2e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.249656 12458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100d2b85fd4c4959bfbb5df7beb05915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.251897 12465 tablet_service.cc:1511] Processing CreateTablet for tablet c8c659d02f1647c7b404779d983439ca (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260620 13:58:47.253042 12465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c659d02f1647c7b404779d983439ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.253154 12147 catalog_manager.cc:5696] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 1 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:47.255374 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efeb9f3004de439280900847880929c6" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
W20260620 13:58:47.257125 12215 leader_election.cc:343] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:47.257611 12215 leader_election.cc:304] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:47.259347 12584 raft_consensus.cc:2749] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:47.262933 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9124333b2aae40e2b813819981e990e5" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
W20260620 13:58:47.264504 12364 leader_election.cc:343] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:47.265749 12556 consensus_queue.cc:1048] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:47.276839 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d2754643614cdcb0928c841c0fa0bb" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:47.278566 12441 leader_election.cc:304] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:47.279795 12532 raft_consensus.cc:2749] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:58:47.280462 12388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b45b565aa74abfad3579abc6ed2e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.210852 12521 consensus_queue.cc:260] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.285293 12521 ts_tablet_manager.cc:1434] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.131s	user 0.006s	sys 0.002s
I20260620 13:58:47.286369 12521 tablet_bootstrap.cc:492] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:47.231765 12522 raft_consensus.cc:740] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.301220 12522 consensus_queue.cc:260] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.303856 12522 ts_tablet_manager.cc:1434] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.092s	user 0.003s	sys 0.004s
I20260620 13:58:47.304924 12522 tablet_bootstrap.cc:492] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:47.309166 12523 tablet_bootstrap.cc:700] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent opening tablet: real 0.143s	user 0.005s	sys 0.000s
I20260620 13:58:47.332803 12520 tablet_bootstrap.cc:492] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:47.346807 12242 tablet_service.cc:1511] Processing CreateTablet for tablet 4b27c67d5c9b4e2dbc82e90717ebbf9e (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260620 13:58:47.348183 12242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b27c67d5c9b4e2dbc82e90717ebbf9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.350363 12240 tablet_service.cc:1511] Processing CreateTablet for tablet c8c659d02f1647c7b404779d983439ca (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260620 13:58:47.344903 12523 tablet_bootstrap.cc:654] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.351662 12240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c659d02f1647c7b404779d983439ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.353207 12521 tablet_bootstrap.cc:654] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.341090 12520 ts_tablet_manager.cc:1403] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.188s	user 0.015s	sys 0.040s
I20260620 13:58:47.361606 12556 consensus_queue.cc:1048] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:47.363408 12584 raft_consensus.cc:493] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:47.363945 12584 raft_consensus.cc:515] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.367642 12584 leader_election.cc:290] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:47.369159 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2940ddb8684b88ac43aa54628de34f" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
W20260620 13:58:47.370658 12218 leader_election.cc:343] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:47.372335 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2940ddb8684b88ac43aa54628de34f" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:47.373039 12475 raft_consensus.cc:2468] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:47.374260 12215 leader_election.cc:304] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:47.376611 12584 raft_consensus.cc:2804] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:47.377003 12584 raft_consensus.cc:493] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:47.377329 12584 raft_consensus.cc:3060] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.379827 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9124333b2aae40e2b813819981e990e5" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
W20260620 13:58:47.381764 12367 leader_election.cc:343] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:47.382342 12367 leader_election.cc:304] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:47.383337 12530 raft_consensus.cc:2749] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:47.390450 12315 tablet_service.cc:1511] Processing CreateTablet for tablet c8c659d02f1647c7b404779d983439ca (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260620 13:58:47.392191 12315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c659d02f1647c7b404779d983439ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.403966 12388 tablet_service.cc:1511] Processing CreateTablet for tablet c5a169ed363546d282eb265bd36bc136 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260620 13:58:47.404953 12462 tablet_service.cc:1511] Processing CreateTablet for tablet c5a169ed363546d282eb265bd36bc136 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260620 13:58:47.405524 12388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a169ed363546d282eb265bd36bc136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.406224 12462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a169ed363546d282eb265bd36bc136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.406085 12584 raft_consensus.cc:515] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.409916 12520 raft_consensus.cc:359] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.410851 12520 raft_consensus.cc:385] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.416306 12520 raft_consensus.cc:740] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.417109 12520 consensus_queue.cc:260] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.415999 12522 tablet_bootstrap.cc:654] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.437320 12241 tablet_service.cc:1511] Processing CreateTablet for tablet c5a169ed363546d282eb265bd36bc136 (DEFAULT_TABLE table=test-workload [id=611e2c4adaf8441d9bca09f6b9fd7b6a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260620 13:58:47.438604 12241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a169ed363546d282eb265bd36bc136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:58:47.443976 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2940ddb8684b88ac43aa54628de34f" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:47.444700 12473 raft_consensus.cc:3060] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.447774 12523 tablet_bootstrap.cc:492] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:47.448457 12523 ts_tablet_manager.cc:1403] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.290s	user 0.022s	sys 0.009s
I20260620 13:58:47.452677 12473 raft_consensus.cc:2468] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:47.455706 12215 leader_election.cc:304] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:47.456645 12554 raft_consensus.cc:2804] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:47.457142 12554 raft_consensus.cc:697] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:58:47.457816 12523 raft_consensus.cc:359] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.457994 12554 consensus_queue.cc:237] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.458702 12523 raft_consensus.cc:385] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.459038 12523 raft_consensus.cc:740] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.460367 12556 raft_consensus.cc:493] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:47.460788 12520 ts_tablet_manager.cc:1434] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.095s	user 0.003s	sys 0.004s
I20260620 13:58:47.460502 12523 consensus_queue.cc:260] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.460918 12556 raft_consensus.cc:515] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.461896 12520 tablet_bootstrap.cc:492] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:47.463549 12584 leader_election.cc:290] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:47.463629 12523 ts_tablet_manager.cc:1434] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260620 13:58:47.464820 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065fb7373cff4c42b0917abd9199dac5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:47.465022 12523 tablet_bootstrap.cc:492] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:47.465452 12401 raft_consensus.cc:2468] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:47.466912 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2940ddb8684b88ac43aa54628de34f" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:47.468343 12292 leader_election.cc:304] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:47.469187 12557 raft_consensus.cc:2804] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:47.469509 12557 raft_consensus.cc:493] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:47.469805 12557 raft_consensus.cc:3060] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:58:47.471844 12218 leader_election.cc:343] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:47.472070 12523 tablet_bootstrap.cc:654] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.475147 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065fb7373cff4c42b0917abd9199dac5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:47.475729 12556 leader_election.cc:290] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
W20260620 13:58:47.485782 12290 leader_election.cc:343] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:47.489636 12522 tablet_bootstrap.cc:492] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:47.490185 12522 ts_tablet_manager.cc:1403] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.185s	user 0.010s	sys 0.008s
I20260620 13:58:47.490456 12530 raft_consensus.cc:493] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:47.490978 12530 raft_consensus.cc:515] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.493244 12530 leader_election.cc:290] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:47.493269 12522 raft_consensus.cc:359] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.493969 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac845f28a431eb612b5e09327f55a" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:47.494424 12522 raft_consensus.cc:385] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.494693 12327 raft_consensus.cc:2468] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:47.494832 12522 raft_consensus.cc:740] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.496093 12367 leader_election.cc:304] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:47.496383 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac845f28a431eb612b5e09327f55a" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:47.495769 12522 consensus_queue.cc:260] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.497052 12530 raft_consensus.cc:2804] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:47.497424 12530 raft_consensus.cc:493] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:47.497725 12530 raft_consensus.cc:3060] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:58:47.498103 12364 leader_election.cc:343] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:47.500151 12522 ts_tablet_manager.cc:1434] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260620 13:58:47.500818 12520 tablet_bootstrap.cc:654] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.501384 12557 raft_consensus.cc:515] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.504405 12522 tablet_bootstrap.cc:492] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:47.506023 12521 tablet_bootstrap.cc:492] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:47.509734 12523 tablet_bootstrap.cc:492] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:47.507524 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065fb7373cff4c42b0917abd9199dac5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:47.509896 12521 ts_tablet_manager.cc:1403] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.224s	user 0.015s	sys 0.003s
I20260620 13:58:47.510385 12523 ts_tablet_manager.cc:1403] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.013s
I20260620 13:58:47.507078 12149 catalog_manager.cc:5696] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:47.506534 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065fb7373cff4c42b0917abd9199dac5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:47.510350 12401 raft_consensus.cc:3060] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.513533 12523 raft_consensus.cc:359] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.514285 12523 raft_consensus.cc:385] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.504033 12557 leader_election.cc:290] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
W20260620 13:58:47.514415 12290 leader_election.cc:343] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:47.514577 12523 raft_consensus.cc:740] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.515978 12523 consensus_queue.cc:260] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.516812 12521 raft_consensus.cc:359] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.517776 12521 raft_consensus.cc:385] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.518142 12521 raft_consensus.cc:740] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.520804 12401 raft_consensus.cc:2468] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:47.521175 12523 ts_tablet_manager.cc:1434] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260620 13:58:47.519268 12521 consensus_queue.cc:260] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.524216 12520 tablet_bootstrap.cc:492] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:47.526656 12523 tablet_bootstrap.cc:492] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:47.527062 12520 ts_tablet_manager.cc:1403] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.007s
I20260620 13:58:47.528834 12522 tablet_bootstrap.cc:654] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.532527 12292 leader_election.cc:304] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:47.509393 12530 raft_consensus.cc:515] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.533852 12557 raft_consensus.cc:2804] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:47.534345 12557 raft_consensus.cc:697] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:47.535619 12557 consensus_queue.cc:237] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.537746 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac845f28a431eb612b5e09327f55a" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:47.538448 12473 raft_consensus.cc:3060] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.530428 12520 raft_consensus.cc:359] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.539610 12520 raft_consensus.cc:385] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.540051 12520 raft_consensus.cc:740] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.540136 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac845f28a431eb612b5e09327f55a" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:47.541235 12327 raft_consensus.cc:3060] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.541304 12520 consensus_queue.cc:260] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.548434 12520 ts_tablet_manager.cc:1434] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260620 13:58:47.549860 12520 tablet_bootstrap.cc:492] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:47.550588 12530 leader_election.cc:290] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:47.559135 12523 tablet_bootstrap.cc:654] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.547031 12473 raft_consensus.cc:2468] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:47.560833 12364 leader_election.cc:304] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:47.561745 12601 raft_consensus.cc:2804] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:47.562774 12521 ts_tablet_manager.cc:1434] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.052s	user 0.014s	sys 0.005s
I20260620 13:58:47.563400 12601 raft_consensus.cc:697] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:47.564332 12521 tablet_bootstrap.cc:492] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:47.564589 12601 consensus_queue.cc:237] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.569667 12532 raft_consensus.cc:493] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:47.573802 12521 tablet_bootstrap.cc:654] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.570338 12532 raft_consensus.cc:515] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.558810 12327 raft_consensus.cc:2468] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:47.578871 12532 leader_election.cc:290] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:47.583292 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928bd8a07cbe4d58b19f3669419f928d" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:47.584013 12520 tablet_bootstrap.cc:654] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.584367 12251 raft_consensus.cc:2468] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 0.
I20260620 13:58:47.586225 12441 leader_election.cc:304] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:47.587333 12532 raft_consensus.cc:2804] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:47.587837 12532 raft_consensus.cc:493] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:47.588274 12532 raft_consensus.cc:3060] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.588728 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928bd8a07cbe4d58b19f3669419f928d" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
W20260620 13:58:47.590516 12441 leader_election.cc:343] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:47.603991 12522 tablet_bootstrap.cc:492] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:47.604593 12522 ts_tablet_manager.cc:1403] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.104s	user 0.040s	sys 0.037s
I20260620 13:58:47.605607 12251 raft_consensus.cc:3060] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.607579 12522 raft_consensus.cc:359] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.608335 12522 raft_consensus.cc:385] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.608644 12522 raft_consensus.cc:740] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.608013 12532 raft_consensus.cc:515] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.611904 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928bd8a07cbe4d58b19f3669419f928d" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:47.612587 12252 raft_consensus.cc:3060] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.613197 12522 consensus_queue.cc:260] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.614959 12149 catalog_manager.cc:5696] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:47.615741 12522 ts_tablet_manager.cc:1434] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260620 13:58:47.617503 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928bd8a07cbe4d58b19f3669419f928d" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:47.619084 12522 tablet_bootstrap.cc:492] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
W20260620 13:58:47.620468 12441 leader_election.cc:343] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:47.622080 12532 leader_election.cc:290] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:47.622356 12145 catalog_manager.cc:5696] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 1 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:47.625670 12522 tablet_bootstrap.cc:654] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.628695 12521 tablet_bootstrap.cc:492] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:47.629225 12521 ts_tablet_manager.cc:1403] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.004s
I20260620 13:58:47.632948 12521 raft_consensus.cc:359] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.633837 12521 raft_consensus.cc:385] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.637300 12523 tablet_bootstrap.cc:492] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:47.637842 12523 ts_tablet_manager.cc:1403] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.002s
I20260620 13:58:47.640842 12523 raft_consensus.cc:359] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.641577 12523 raft_consensus.cc:385] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.641894 12523 raft_consensus.cc:740] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.634112 12521 raft_consensus.cc:740] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.643234 12521 consensus_queue.cc:260] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.646550 12252 raft_consensus.cc:2468] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:58:47.647625 12520 tablet_bootstrap.cc:492] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:47.648231 12520 ts_tablet_manager.cc:1403] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.099s	user 0.017s	sys 0.008s
I20260620 13:58:47.649312 12441 leader_election.cc:304] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:47.651585 12520 raft_consensus.cc:359] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.652277 12532 raft_consensus.cc:2804] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:47.653772 12521 ts_tablet_manager.cc:1434] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.001s
I20260620 13:58:47.654897 12521 tablet_bootstrap.cc:492] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:47.656031 12523 consensus_queue.cc:260] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.659487 12522 tablet_bootstrap.cc:492] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:47.660166 12522 ts_tablet_manager.cc:1403] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.041s	user 0.032s	sys 0.006s
I20260620 13:58:47.663968 12522 raft_consensus.cc:359] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.664472 12523 ts_tablet_manager.cc:1434] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260620 13:58:47.664790 12522 raft_consensus.cc:385] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.665124 12522 raft_consensus.cc:740] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.666512 12522 consensus_queue.cc:260] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.670641 12523 tablet_bootstrap.cc:492] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:47.670835 12521 tablet_bootstrap.cc:654] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.671079 12522 ts_tablet_manager.cc:1434] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260620 13:58:47.672489 12522 tablet_bootstrap.cc:492] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:47.652441 12520 raft_consensus.cc:385] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.673998 12520 raft_consensus.cc:740] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.675086 12520 consensus_queue.cc:260] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.678916 12520 ts_tablet_manager.cc:1434] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260620 13:58:47.680624 12520 tablet_bootstrap.cc:492] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:47.683727 12523 tablet_bootstrap.cc:654] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.684995 12532 raft_consensus.cc:697] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:58:47.688830 12532 consensus_queue.cc:237] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.695183 12522 tablet_bootstrap.cc:654] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.702414 12521 tablet_bootstrap.cc:492] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:47.703073 12521 ts_tablet_manager.cc:1403] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.011s
I20260620 13:58:47.703486 12523 tablet_bootstrap.cc:492] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:47.703984 12523 ts_tablet_manager.cc:1403] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260620 13:58:47.711560 12521 raft_consensus.cc:359] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.712514 12520 tablet_bootstrap.cc:654] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.712702 12521 raft_consensus.cc:385] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.713353 12521 raft_consensus.cc:740] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.714533 12521 consensus_queue.cc:260] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.710462 12523 raft_consensus.cc:359] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.716233 12523 raft_consensus.cc:385] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.716588 12523 raft_consensus.cc:740] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.717713 12522 tablet_bootstrap.cc:492] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:47.718230 12522 ts_tablet_manager.cc:1403] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.009s
I20260620 13:58:47.717336 12523 consensus_queue.cc:260] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.720564 12601 raft_consensus.cc:493] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:47.721055 12601 raft_consensus.cc:515] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.721459 12521 ts_tablet_manager.cc:1434] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260620 13:58:47.722800 12530 raft_consensus.cc:493] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:47.723294 12601 leader_election.cc:290] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:47.724601 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efeb9f3004de439280900847880929c6" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:47.723306 12530 raft_consensus.cc:515] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.725292 12251 raft_consensus.cc:2468] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:47.721010 12522 raft_consensus.cc:359] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.726806 12522 raft_consensus.cc:385] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.727350 12522 raft_consensus.cc:740] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.728101 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efeb9f3004de439280900847880929c6" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:47.728894 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09dbf9acadba454f83e6b30932aa7806" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:47.728060 12522 consensus_queue.cc:260] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.730355 12367 leader_election.cc:304] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:47.731580 12601 raft_consensus.cc:2804] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:47.731982 12601 raft_consensus.cc:493] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:47.732357 12601 raft_consensus.cc:3060] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.732697 12522 ts_tablet_manager.cc:1434] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260620 13:58:47.733798 12522 tablet_bootstrap.cc:492] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
W20260620 13:58:47.735632 12364 leader_election.cc:343] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:47.736996 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09dbf9acadba454f83e6b30932aa7806" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:47.726792 12530 leader_election.cc:290] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:47.739845 12364 leader_election.cc:304] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:47.740552 12522 tablet_bootstrap.cc:654] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.745424 12601 raft_consensus.cc:515] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.747365 12530 raft_consensus.cc:2749] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:47.747473 12521 tablet_bootstrap.cc:492] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:47.747056 12523 ts_tablet_manager.cc:1434] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260620 13:58:47.751173 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efeb9f3004de439280900847880929c6" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:47.751761 12251 raft_consensus.cc:3060] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.752547 12523 tablet_bootstrap.cc:492] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:47.756840 12530 raft_consensus.cc:493] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:47.757404 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efeb9f3004de439280900847880929c6" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:47.758116 12522 tablet_bootstrap.cc:492] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:47.757526 12530 raft_consensus.cc:515] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.758648 12522 ts_tablet_manager.cc:1403] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.008s
I20260620 13:58:47.761132 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93da747507134e1699f01078033ae503" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:47.767444 12252 raft_consensus.cc:2468] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:47.768909 12367 leader_election.cc:304] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:47.769733 12522 raft_consensus.cc:359] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.770632 12522 raft_consensus.cc:385] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.770987 12522 raft_consensus.cc:740] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
W20260620 13:58:47.771944 12364 leader_election.cc:343] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:47.762512 12530 leader_election.cc:290] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:47.763152 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93da747507134e1699f01078033ae503" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:47.774027 12530 raft_consensus.cc:2804] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:47.766637 12251 raft_consensus.cc:2468] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:47.772186 12522 consensus_queue.cc:260] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.776351 12530 raft_consensus.cc:493] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:47.776731 12601 leader_election.cc:290] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:47.782352 12522 ts_tablet_manager.cc:1434] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260620 13:58:47.783401 12522 tablet_bootstrap.cc:492] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:47.785678 12521 tablet_bootstrap.cc:654] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.778555 12530 raft_consensus.cc:3060] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.794612 12522 tablet_bootstrap.cc:654] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
W20260620 13:58:47.787719 12367 leader_election.cc:343] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:47.794116 12146 catalog_manager.cc:5696] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 1 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:47.800091 12523 tablet_bootstrap.cc:654] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.803501 12521 tablet_bootstrap.cc:492] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:47.804073 12521 ts_tablet_manager.cc:1403] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.001s
I20260620 13:58:47.800894 12367 leader_election.cc:304] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:47.807768 12530 raft_consensus.cc:515] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.809813 12520 tablet_bootstrap.cc:492] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:47.810309 12520 ts_tablet_manager.cc:1403] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.130s	user 0.016s	sys 0.000s
I20260620 13:58:47.810964 12618 raft_consensus.cc:2804] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:47.811614 12618 raft_consensus.cc:697] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:47.812054 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93da747507134e1699f01078033ae503" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:47.812520 12251 raft_consensus.cc:3060] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.812526 12618 consensus_queue.cc:237] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.814936 12530 leader_election.cc:290] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:47.817518 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93da747507134e1699f01078033ae503" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
W20260620 13:58:47.819231 12367 leader_election.cc:343] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:47.821061 12521 raft_consensus.cc:359] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.821800 12521 raft_consensus.cc:385] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.822012 12521 raft_consensus.cc:740] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.825843 12251 raft_consensus.cc:2468] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:47.826152 12523 tablet_bootstrap.cc:492] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:47.826809 12523 ts_tablet_manager.cc:1403] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.000s
I20260620 13:58:47.827051 12520 raft_consensus.cc:359] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.827296 12367 leader_election.cc:304] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:47.827836 12520 raft_consensus.cc:385] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.828159 12520 raft_consensus.cc:740] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.828625 12530 raft_consensus.cc:2804] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:47.828845 12520 consensus_queue.cc:260] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.829424 12530 raft_consensus.cc:697] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:47.831034 12520 ts_tablet_manager.cc:1434] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.004s
I20260620 13:58:47.840126 12520 tablet_bootstrap.cc:492] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:47.831369 12521 consensus_queue.cc:260] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.844347 12521 ts_tablet_manager.cc:1434] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.002s
I20260620 13:58:47.845422 12521 tablet_bootstrap.cc:492] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:47.845492 12149 catalog_manager.cc:5696] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:47.854116 12520 tablet_bootstrap.cc:654] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.856189 12530 consensus_queue.cc:237] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.837018 12522 tablet_bootstrap.cc:492] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:47.859416 12521 tablet_bootstrap.cc:654] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.830200 12523 raft_consensus.cc:359] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.860019 12523 raft_consensus.cc:385] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.860356 12523 raft_consensus.cc:740] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.861173 12523 consensus_queue.cc:260] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.863219 12523 ts_tablet_manager.cc:1434] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.002s
I20260620 13:58:47.869174 12522 ts_tablet_manager.cc:1403] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.086s	user 0.007s	sys 0.009s
I20260620 13:58:47.872288 12522 raft_consensus.cc:359] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.872969 12522 raft_consensus.cc:385] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.873096 12520 tablet_bootstrap.cc:492] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:47.873726 12520 ts_tablet_manager.cc:1403] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.008s
I20260620 13:58:47.874231 12523 tablet_bootstrap.cc:492] T 065fb7373cff4c42b0917abd9199dac5 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:47.876608 12520 raft_consensus.cc:359] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.877303 12520 raft_consensus.cc:385] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.877583 12520 raft_consensus.cc:740] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.879081 12520 consensus_queue.cc:260] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.880766 12523 tablet_bootstrap.cc:654] T 065fb7373cff4c42b0917abd9199dac5 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.881282 12149 catalog_manager.cc:5696] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:47.882283 12520 ts_tablet_manager.cc:1434] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.005s
I20260620 13:58:47.873252 12522 raft_consensus.cc:740] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.883941 12522 consensus_queue.cc:260] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.884749 12521 tablet_bootstrap.cc:492] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:47.885252 12521 ts_tablet_manager.cc:1403] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.004s
I20260620 13:58:47.885990 12522 ts_tablet_manager.cc:1434] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260620 13:58:47.887230 12522 tablet_bootstrap.cc:492] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:47.888203 12521 raft_consensus.cc:359] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.889158 12521 raft_consensus.cc:385] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.889457 12521 raft_consensus.cc:740] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.890209 12521 consensus_queue.cc:260] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.892459 12521 ts_tablet_manager.cc:1434] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260620 13:58:47.893570 12521 tablet_bootstrap.cc:492] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:47.894273 12522 tablet_bootstrap.cc:654] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.895897 12520 tablet_bootstrap.cc:492] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:47.899092 12523 tablet_bootstrap.cc:492] T 065fb7373cff4c42b0917abd9199dac5 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:47.899638 12523 ts_tablet_manager.cc:1403] T 065fb7373cff4c42b0917abd9199dac5 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.003s
I20260620 13:58:47.902118 12520 tablet_bootstrap.cc:654] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.902501 12523 raft_consensus.cc:359] T 065fb7373cff4c42b0917abd9199dac5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.903414 12523 raft_consensus.cc:385] T 065fb7373cff4c42b0917abd9199dac5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.903728 12523 raft_consensus.cc:740] T 065fb7373cff4c42b0917abd9199dac5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.904558 12523 consensus_queue.cc:260] T 065fb7373cff4c42b0917abd9199dac5 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:47.909453 12521 tablet_bootstrap.cc:654] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.915490 12523 ts_tablet_manager.cc:1434] T 065fb7373cff4c42b0917abd9199dac5 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260620 13:58:47.921089 12523 tablet_bootstrap.cc:492] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:47.922549 12521 tablet_bootstrap.cc:492] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:47.923141 12521 ts_tablet_manager.cc:1403] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.007s
I20260620 13:58:47.923983 12520 tablet_bootstrap.cc:492] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:47.924502 12520 ts_tablet_manager.cc:1403] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.012s
I20260620 13:58:47.925932 12521 raft_consensus.cc:359] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.926849 12521 raft_consensus.cc:385] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.927210 12521 raft_consensus.cc:740] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.927621 12520 raft_consensus.cc:359] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.928277 12523 tablet_bootstrap.cc:654] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.927987 12521 consensus_queue.cc:260] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.928514 12520 raft_consensus.cc:385] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.930702 12521 ts_tablet_manager.cc:1434] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 13:58:47.932135 12521 tablet_bootstrap.cc:492] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:47.928915 12520 raft_consensus.cc:740] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.933772 12557 raft_consensus.cc:493] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:47.934311 12557 raft_consensus.cc:515] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.934535 12520 consensus_queue.cc:260] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.935693 12529 raft_consensus.cc:493] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:47.936141 12529 raft_consensus.cc:515] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.938349 12529 leader_election.cc:290] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:47.939858 12523 tablet_bootstrap.cc:492] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:47.940085 12584 raft_consensus.cc:493] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:47.940378 12523 ts_tablet_manager.cc:1403] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260620 13:58:47.940754 12521 tablet_bootstrap.cc:654] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:47.940593 12584 raft_consensus.cc:515] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.941337 12557 leader_election.cc:290] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:47.942152 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2940ddb8684b88ac43aa54628de34f" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:47.944195 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2940ddb8684b88ac43aa54628de34f" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:47.945003 12473 raft_consensus.cc:2393] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcd1bd5dfea74c378a6154f83707154c in current term 1: Already voted for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in this term.
I20260620 13:58:47.944886 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a0ef32a33f4a609e678abbfa038080" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:47.945962 12401 raft_consensus.cc:2468] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:47.943564 12523 raft_consensus.cc:359] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.948077 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdb1bbde932422ba09645787f9d2446" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:47.949026 12327 raft_consensus.cc:2468] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:47.950860 12218 leader_election.cc:304] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:47.952216 12554 raft_consensus.cc:2804] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:47.952919 12554 raft_consensus.cc:493] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:47.953454 12554 raft_consensus.cc:3060] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.954890 12473 raft_consensus.cc:3060] T 065fb7373cff4c42b0917abd9199dac5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.942965 12584 leader_election.cc:290] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:47.957126 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdb1bbde932422ba09645787f9d2446" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:47.958069 12292 leader_election.cc:304] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:47.958169 12401 raft_consensus.cc:2468] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:47.959215 12556 raft_consensus.cc:2804] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:47.959617 12556 raft_consensus.cc:493] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:47.959942 12556 raft_consensus.cc:3060] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.964087 12293 leader_election.cc:304] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:47.965099 12529 raft_consensus.cc:3060] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.965912 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a0ef32a33f4a609e678abbfa038080" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:47.966672 12251 raft_consensus.cc:2468] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:47.947311 12523 raft_consensus.cc:385] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:47.967367 12523 raft_consensus.cc:740] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:47.952452 12532 raft_consensus.cc:493] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:47.968613 12523 consensus_queue.cc:260] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.971078 12532 raft_consensus.cc:515] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:47.974457 12523 ts_tablet_manager.cc:1434] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260620 13:58:47.964439 12520 ts_tablet_manager.cc:1434] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260620 13:58:47.975770 12520 tablet_bootstrap.cc:492] T 93da747507134e1699f01078033ae503 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:47.975958 12523 tablet_bootstrap.cc:492] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:47.973969 12532 leader_election.cc:290] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:47.980499 12554 raft_consensus.cc:515] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:47.981294 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c52f04bdd14864afe89398fc3af00c" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:47.982143 12327 raft_consensus.cc:2468] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 0.
I20260620 13:58:47.983511 12441 leader_election.cc:304] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:47.984829 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdb1bbde932422ba09645787f9d2446" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:47.985903 12327 raft_consensus.cc:3060] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.986791 12529 raft_consensus.cc:2749] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:47.985003 12584 consensus_queue.cc:1048] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:47.989099 12529 consensus_queue.cc:1048] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:47.990674 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c52f04bdd14864afe89398fc3af00c" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:47.991029 12583 raft_consensus.cc:493] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:47.991515 12251 raft_consensus.cc:2468] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 0.
I20260620 13:58:47.991634 12583 raft_consensus.cc:515] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:47.993112 12610 raft_consensus.cc:2804] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:47.993513 12610 raft_consensus.cc:493] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:47.993852 12610 raft_consensus.cc:3060] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:47.994015 12583 leader_election.cc:290] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:47.996281 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9124333b2aae40e2b813819981e990e5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:47.996970 12401 raft_consensus.cc:2468] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:47.997969 12474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9124333b2aae40e2b813819981e990e5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:47.998610 12474 raft_consensus.cc:2468] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:47.999553 12532 raft_consensus.cc:493] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:48.000536 12554 leader_election.cc:290] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:48.000280 12215 leader_election.cc:304] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:48.001966 12554 raft_consensus.cc:2804] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:48.002354 12554 raft_consensus.cc:493] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:48.002700 12554 raft_consensus.cc:3060] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.003504 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdb1bbde932422ba09645787f9d2446" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:48.004105 12401 raft_consensus.cc:3060] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.000177 12532 raft_consensus.cc:515] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.007606 12521 tablet_bootstrap.cc:492] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:48.009299 12521 ts_tablet_manager.cc:1403] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.077s	user 0.035s	sys 0.028s
I20260620 13:58:48.008535 12327 raft_consensus.cc:2468] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:48.008147 12530 raft_consensus.cc:493] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:48.012981 12530 raft_consensus.cc:515] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.015827 12530 leader_election.cc:290] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:48.012547 12522 tablet_bootstrap.cc:492] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:48.016721 12522 ts_tablet_manager.cc:1403] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.005s
I20260620 13:58:48.016407 12521 raft_consensus.cc:359] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.017377 12521 raft_consensus.cc:385] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.017726 12521 raft_consensus.cc:740] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.018501 12521 consensus_queue.cc:260] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.019811 12218 leader_election.cc:304] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:48.020491 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efeb9f3004de439280900847880929c6" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:48.020756 12521 ts_tablet_manager.cc:1434] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260620 13:58:48.020998 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1ae3d064cd49309bf086b257c3f664" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:48.021361 12252 raft_consensus.cc:2393] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69a98f1d9eda4cd9bdd2287823f798f6 in current term 1: Already voted for candidate c51ef915af09435db6046c91bb9d00e0 in this term.
I20260620 13:58:48.020730 12583 raft_consensus.cc:2804] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:48.020525 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1ae3d064cd49309bf086b257c3f664" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:48.022203 12521 tablet_bootstrap.cc:492] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:48.022157 12583 raft_consensus.cc:697] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:58:48.021862 12400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efeb9f3004de439280900847880929c6" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:48.027451 12440 leader_election.cc:304] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:48.023972 12583 consensus_queue.cc:237] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.030135 12611 raft_consensus.cc:3060] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.031507 12521 tablet_bootstrap.cc:654] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.022444 12532 leader_election.cc:290] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:48.037074 12584 raft_consensus.cc:493] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:48.037348 12556 raft_consensus.cc:515] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.037631 12584 raft_consensus.cc:515] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.039762 12556 leader_election.cc:290] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:48.040052 12584 leader_election.cc:290] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:48.024861 12554 raft_consensus.cc:515] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.036123 12610 raft_consensus.cc:515] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
W20260620 13:58:48.025723 12367 leader_election.cc:343] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:48.041559 12400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a0ef32a33f4a609e678abbfa038080" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
W20260620 13:58:48.041870 12367 leader_election.cc:343] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:48.042266 12400 raft_consensus.cc:3060] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.042342 12367 leader_election.cc:304] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:48.043350 12522 raft_consensus.cc:359] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.044077 12522 raft_consensus.cc:385] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.044370 12522 raft_consensus.cc:740] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.045225 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c52f04bdd14864afe89398fc3af00c" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:48.045969 12251 raft_consensus.cc:3060] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.046694 12601 raft_consensus.cc:2749] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:48.047946 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9124333b2aae40e2b813819981e990e5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:48.048589 12398 raft_consensus.cc:3060] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.012058 12523 tablet_bootstrap.cc:654] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.051453 12601 consensus_queue.cc:1048] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:48.052397 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a0ef32a33f4a609e678abbfa038080" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:48.051640 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e8c601ed2e4253b8c7f5dceb77f518" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:48.052992 12252 raft_consensus.cc:3060] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.054095 12400 raft_consensus.cc:2468] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:48.055575 12474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e8c601ed2e4253b8c7f5dceb77f518" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
W20260620 13:58:48.056663 12217 leader_election.cc:343] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:48.058868 12557 raft_consensus.cc:493] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:48.038913 12520 tablet_bootstrap.cc:654] T 93da747507134e1699f01078033ae503 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.045197 12522 consensus_queue.cc:260] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.030737 12401 raft_consensus.cc:2468] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:48.070469 12557 raft_consensus.cc:515] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:48.082641 12292 leader_election.cc:304] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:48.084137 12529 raft_consensus.cc:2804] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:48.084676 12529 raft_consensus.cc:697] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:48.085616 12529 consensus_queue.cc:237] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.087400 12252 raft_consensus.cc:2468] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
W20260620 13:58:48.070297 12215 leader_election.cc:343] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:48.093359 12215 leader_election.cc:304] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:48.094936 12584 raft_consensus.cc:2749] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:48.095721 12584 consensus_queue.cc:1048] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:48.099138 12610 leader_election.cc:290] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:48.100313 12398 raft_consensus.cc:2468] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:48.100441 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c52f04bdd14864afe89398fc3af00c" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:48.101082 12327 raft_consensus.cc:3060] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.101468 12149 catalog_manager.cc:5696] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:48.077061 12554 leader_election.cc:290] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:48.106740 12474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9124333b2aae40e2b813819981e990e5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:48.107736 12474 raft_consensus.cc:3060] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.103430 12611 raft_consensus.cc:2749] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:48.118287 12557 leader_election.cc:290] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:48.121888 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928bd8a07cbe4d58b19f3669419f928d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:48.124274 12251 raft_consensus.cc:2468] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:58:48.127425 12618 consensus_queue.cc:1048] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:48.128656 12327 raft_consensus.cc:2468] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:58:48.129485 12521 tablet_bootstrap.cc:492] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:48.130086 12441 leader_election.cc:304] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:48.130117 12521 ts_tablet_manager.cc:1403] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.008s
I20260620 13:58:48.131716 12532 raft_consensus.cc:2804] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:48.132182 12610 raft_consensus.cc:493] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:48.133049 12556 consensus_queue.cc:1048] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:48.134438 12610 raft_consensus.cc:515] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.136056 12521 raft_consensus.cc:359] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.136848 12521 raft_consensus.cc:385] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.137168 12521 raft_consensus.cc:740] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.144121 12521 consensus_queue.cc:260] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.172744 12521 ts_tablet_manager.cc:1434] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
W20260620 13:58:48.179069 12197 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:58:48.180516 12610 leader_election.cc:290] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:48.195029 12522 ts_tablet_manager.cc:1434] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.178s	user 0.008s	sys 0.007s
I20260620 13:58:48.184634 12532 raft_consensus.cc:697] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:58:48.197777 12522 tablet_bootstrap.cc:492] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:48.187589 12474 raft_consensus.cc:2468] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:48.203414 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928bd8a07cbe4d58b19f3669419f928d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:48.226202 12520 tablet_bootstrap.cc:492] T 93da747507134e1699f01078033ae503 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:48.226905 12520 ts_tablet_manager.cc:1403] T 93da747507134e1699f01078033ae503 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.251s	user 0.018s	sys 0.023s
I20260620 13:58:48.227927 12215 leader_election.cc:304] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:48.228315 12601 raft_consensus.cc:493] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:48.229049 12645 raft_consensus.cc:2804] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:48.229005 12601 raft_consensus.cc:515] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.229763 12645 raft_consensus.cc:697] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:58:48.227923 12521 tablet_bootstrap.cc:492] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:48.230935 12645 consensus_queue.cc:237] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.218322 12401 raft_consensus.cc:3060] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.253104 12326 raft_consensus.cc:3060] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.245414 12251 raft_consensus.cc:2393] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcd1bd5dfea74c378a6154f83707154c in current term 1: Already voted for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in this term.
I20260620 13:58:48.220440 12325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6c6d2474cc47d09439ce00490af552" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:48.234541 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6c6d2474cc47d09439ce00490af552" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:48.257962 12399 raft_consensus.cc:2468] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 0.
W20260620 13:58:48.259339 12441 leader_election.cc:343] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:48.260164 12440 leader_election.cc:304] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:48.260385 12293 leader_election.cc:304] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:48.261969 12610 raft_consensus.cc:2804] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:48.274935 12601 leader_election.cc:290] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:48.277357 12523 tablet_bootstrap.cc:492] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:48.262982 12610 raft_consensus.cc:493] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:48.278281 12523 ts_tablet_manager.cc:1403] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.303s	user 0.014s	sys 0.009s
I20260620 13:58:48.278867 12325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6c6d2474cc47d09439ce00490af552" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
W20260620 13:58:48.282209 12367 leader_election.cc:343] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:48.282042 12523 raft_consensus.cc:359] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.284873 12520 raft_consensus.cc:359] T 93da747507134e1699f01078033ae503 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.285890 12520 raft_consensus.cc:385] T 93da747507134e1699f01078033ae503 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.285943 12610 raft_consensus.cc:3060] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.286437 12520 raft_consensus.cc:740] T 93da747507134e1699f01078033ae503 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.289247 12532 consensus_queue.cc:237] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:48.290853 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6c6d2474cc47d09439ce00490af552" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:48.291369 12521 tablet_bootstrap.cc:654] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.298144 12520 consensus_queue.cc:260] T 93da747507134e1699f01078033ae503 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.249640 12522 tablet_bootstrap.cc:654] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.299750 12523 raft_consensus.cc:385] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.300259 12523 raft_consensus.cc:740] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.303748 12523 consensus_queue.cc:260] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.306403 12523 ts_tablet_manager.cc:1434] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260620 13:58:48.307863 12523 tablet_bootstrap.cc:492] T a6e8c601ed2e4253b8c7f5dceb77f518 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:48.317209 12523 tablet_bootstrap.cc:654] T a6e8c601ed2e4253b8c7f5dceb77f518 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.317761 12325 raft_consensus.cc:3060] T 93da747507134e1699f01078033ae503 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.322944 12646 consensus_queue.cc:1048] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:48.324093 12610 raft_consensus.cc:515] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.326152 12475 raft_consensus.cc:2393] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c51ef915af09435db6046c91bb9d00e0 in current term 1: Already voted for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in this term.
I20260620 13:58:48.326337 12610 leader_election.cc:290] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:48.330675 12364 leader_election.cc:304] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:48.330725 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6c6d2474cc47d09439ce00490af552" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:48.333356 12556 raft_consensus.cc:2749] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:48.332501 12520 ts_tablet_manager.cc:1434] T 93da747507134e1699f01078033ae503 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.000s
I20260620 13:58:48.333911 12399 raft_consensus.cc:3060] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.341488 12520 tablet_bootstrap.cc:492] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:48.295771 12145 catalog_manager.cc:5696] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 1 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:48.326924 12610 consensus_queue.cc:1048] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260620 13:58:48.347222 12601 consensus_queue.cc:1048] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260620 13:58:48.368227 12520 tablet_bootstrap.cc:654] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.382829 12326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6c6d2474cc47d09439ce00490af552" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
W20260620 13:58:48.388224 12441 leader_election.cc:343] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:48.389683 12645 raft_consensus.cc:493] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:48.390244 12645 raft_consensus.cc:515] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.393875 12601 consensus_queue.cc:1048] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:48.397074 12399 raft_consensus.cc:2468] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:58:48.405823 12618 raft_consensus.cc:2749] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:48.429817 12645 leader_election.cc:290] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:48.423169 12440 leader_election.cc:304] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:48.437577 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2596bf072bda4ad188dcc3f1438a4d7d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:48.437999 12532 raft_consensus.cc:2804] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:48.438563 12532 raft_consensus.cc:697] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:58:48.439431 12532 consensus_queue.cc:237] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.440626 12521 tablet_bootstrap.cc:492] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
W20260620 13:58:48.441910 12215 leader_election.cc:343] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:48.441607 12522 tablet_bootstrap.cc:492] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:48.442901 12521 ts_tablet_manager.cc:1403] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.218s	user 0.009s	sys 0.011s
I20260620 13:58:48.443009 12522 ts_tablet_manager.cc:1403] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.247s	user 0.018s	sys 0.000s
I20260620 13:58:48.445322 12520 tablet_bootstrap.cc:492] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:48.448230 12520 ts_tablet_manager.cc:1403] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.004s
I20260620 13:58:48.448510 12149 catalog_manager.cc:5696] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:48.453523 12523 tablet_bootstrap.cc:492] T a6e8c601ed2e4253b8c7f5dceb77f518 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:48.454263 12523 ts_tablet_manager.cc:1403] T a6e8c601ed2e4253b8c7f5dceb77f518 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.147s	user 0.023s	sys 0.020s
I20260620 13:58:48.456822 12522 raft_consensus.cc:359] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.457563 12522 raft_consensus.cc:385] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.453313 12146 catalog_manager.cc:5696] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 1 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:48.457827 12522 raft_consensus.cc:740] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.449729 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2596bf072bda4ad188dcc3f1438a4d7d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:48.462414 12520 raft_consensus.cc:359] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.463229 12520 raft_consensus.cc:385] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.463516 12520 raft_consensus.cc:740] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.464197 12520 consensus_queue.cc:260] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.466987 12523 raft_consensus.cc:359] T a6e8c601ed2e4253b8c7f5dceb77f518 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.468088 12523 raft_consensus.cc:385] T a6e8c601ed2e4253b8c7f5dceb77f518 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.468506 12523 raft_consensus.cc:740] T a6e8c601ed2e4253b8c7f5dceb77f518 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.469643 12523 consensus_queue.cc:260] T a6e8c601ed2e4253b8c7f5dceb77f518 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.458549 12522 consensus_queue.cc:260] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.473959 12522 ts_tablet_manager.cc:1434] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260620 13:58:48.477443 12618 consensus_queue.cc:1048] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:48.479749 12530 consensus_queue.cc:1048] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:48.481678 12521 raft_consensus.cc:359] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.482455 12521 raft_consensus.cc:385] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.482748 12521 raft_consensus.cc:740] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
W20260620 13:58:48.485268 12217 leader_election.cc:343] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:48.485807 12217 leader_election.cc:304] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:48.488487 12584 raft_consensus.cc:2749] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:48.489279 12584 consensus_queue.cc:1048] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:48.495083 12520 ts_tablet_manager.cc:1434] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.004s
I20260620 13:58:48.504606 12520 tablet_bootstrap.cc:492] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:48.505550 12584 consensus_queue.cc:1048] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:48.497061 12523 ts_tablet_manager.cc:1434] T a6e8c601ed2e4253b8c7f5dceb77f518 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.042s	user 0.002s	sys 0.007s
I20260620 13:58:48.499019 12521 consensus_queue.cc:260] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.518573 12523 tablet_bootstrap.cc:492] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:48.518608 12521 ts_tablet_manager.cc:1434] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.073s	user 0.003s	sys 0.003s
I20260620 13:58:48.529062 12521 tablet_bootstrap.cc:492] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:48.534308 12520 tablet_bootstrap.cc:654] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.520761 12522 tablet_bootstrap.cc:492] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:48.534888 12521 tablet_bootstrap.cc:654] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.547857 12523 tablet_bootstrap.cc:654] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.552871 12522 tablet_bootstrap.cc:654] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.559980 12523 tablet_bootstrap.cc:492] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:48.563126 12523 ts_tablet_manager.cc:1403] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.001s
I20260620 13:58:48.567049 12523 raft_consensus.cc:359] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:48.572420 12523 raft_consensus.cc:385] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.573454 12523 raft_consensus.cc:740] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.574723 12523 consensus_queue.cc:260] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:48.569871 12520 tablet_bootstrap.cc:492] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:48.577203 12520 ts_tablet_manager.cc:1403] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.004s
I20260620 13:58:48.580344 12520 raft_consensus.cc:359] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.581117 12520 raft_consensus.cc:385] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.580478 12147 catalog_manager.cc:5696] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 1 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:48.576196 12618 raft_consensus.cc:493] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:48.583967 12521 tablet_bootstrap.cc:492] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:48.570477 12522 tablet_bootstrap.cc:492] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:48.582891 12523 ts_tablet_manager.cc:1434] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260620 13:58:48.583527 12618 raft_consensus.cc:515] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.585933 12523 tablet_bootstrap.cc:492] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:48.581444 12520 raft_consensus.cc:740] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.584617 12522 ts_tablet_manager.cc:1403] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.005s
I20260620 13:58:48.587884 12520 consensus_queue.cc:260] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.586866 12618 leader_election.cc:290] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:48.588588 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e8c601ed2e4253b8c7f5dceb77f518" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:48.589251 12475 raft_consensus.cc:2468] T a6e8c601ed2e4253b8c7f5dceb77f518 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:48.584616 12521 ts_tablet_manager.cc:1403] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.013s
I20260620 13:58:48.589483 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e8c601ed2e4253b8c7f5dceb77f518" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:48.590360 12520 ts_tablet_manager.cc:1434] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260620 13:58:48.590323 12252 raft_consensus.cc:2468] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:48.590729 12364 leader_election.cc:304] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:48.591498 12520 tablet_bootstrap.cc:492] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:48.591606 12618 raft_consensus.cc:2804] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:48.592168 12618 raft_consensus.cc:493] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:48.592707 12618 raft_consensus.cc:3060] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.595144 12521 raft_consensus.cc:359] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.595954 12521 raft_consensus.cc:385] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.596266 12521 raft_consensus.cc:740] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.597070 12521 consensus_queue.cc:260] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.591009 12522 raft_consensus.cc:359] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.598608 12520 tablet_bootstrap.cc:654] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.604964 12521 ts_tablet_manager.cc:1434] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260620 13:58:48.606324 12521 tablet_bootstrap.cc:492] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:48.598568 12522 raft_consensus.cc:385] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.607169 12522 raft_consensus.cc:740] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.608196 12522 consensus_queue.cc:260] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.617445 12601 raft_consensus.cc:493] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:48.619036 12601 raft_consensus.cc:515] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.621459 12601 leader_election.cc:290] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:48.622326 12325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65eb66c55e74ee78340946d691c4e72" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:48.623363 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65eb66c55e74ee78340946d691c4e72" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
W20260620 13:58:48.623993 12367 leader_election.cc:343] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:48.624092 12475 raft_consensus.cc:2468] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:48.625947 12364 leader_election.cc:304] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:48.627429 12601 raft_consensus.cc:2804] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:48.627954 12601 raft_consensus.cc:493] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:48.628407 12601 raft_consensus.cc:3060] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.634310 12521 tablet_bootstrap.cc:654] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.638639 12522 ts_tablet_manager.cc:1434] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260620 13:58:48.640087 12618 raft_consensus.cc:515] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.644486 12522 tablet_bootstrap.cc:492] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:48.647935 12521 tablet_bootstrap.cc:492] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:48.648499 12521 ts_tablet_manager.cc:1403] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.001s
I20260620 13:58:48.650029 12601 raft_consensus.cc:515] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.605069 12523 tablet_bootstrap.cc:654] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.651984 12529 consensus_queue.cc:1048] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:48.657114 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e8c601ed2e4253b8c7f5dceb77f518" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:48.657034 12618 leader_election.cc:290] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:48.659264 12475 raft_consensus.cc:3060] T a6e8c601ed2e4253b8c7f5dceb77f518 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.660416 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e8c601ed2e4253b8c7f5dceb77f518" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:48.661063 12252 raft_consensus.cc:3060] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.678884 12252 raft_consensus.cc:2468] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:48.680601 12367 leader_election.cc:304] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:48.681524 12618 raft_consensus.cc:2804] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:48.682061 12618 raft_consensus.cc:697] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:48.682917 12618 consensus_queue.cc:237] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.684612 12532 consensus_queue.cc:1048] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:48.692545 12521 raft_consensus.cc:359] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.693450 12521 raft_consensus.cc:385] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.693140 12325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65eb66c55e74ee78340946d691c4e72" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:48.695154 12475 raft_consensus.cc:2468] T a6e8c601ed2e4253b8c7f5dceb77f518 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:48.697121 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65eb66c55e74ee78340946d691c4e72" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:48.697844 12472 raft_consensus.cc:3060] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.698233 12522 tablet_bootstrap.cc:654] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.695385 12521 raft_consensus.cc:740] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
W20260620 13:58:48.695314 12367 leader_election.cc:343] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:48.695967 12601 leader_election.cc:290] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:48.716984 12521 consensus_queue.cc:260] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.717757 12472 raft_consensus.cc:2468] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:48.720659 12521 ts_tablet_manager.cc:1434] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.072s	user 0.009s	sys 0.000s
I20260620 13:58:48.722208 12364 leader_election.cc:304] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:48.723287 12618 raft_consensus.cc:2804] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:48.723932 12618 raft_consensus.cc:697] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:48.724103 12529 consensus_queue.cc:1048] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:48.726624 12521 tablet_bootstrap.cc:492] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:48.733409 12521 tablet_bootstrap.cc:654] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.733484 12520 tablet_bootstrap.cc:492] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:48.733979 12520 ts_tablet_manager.cc:1403] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.143s	user 0.035s	sys 0.042s
I20260620 13:58:48.737285 12520 raft_consensus.cc:359] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.738394 12520 raft_consensus.cc:385] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.738967 12520 raft_consensus.cc:740] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.740571 12520 consensus_queue.cc:260] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.748888 12639 consensus_queue.cc:1048] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260620 13:58:48.759093 12520 ts_tablet_manager.cc:1434] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260620 13:58:48.760017 12520 tablet_bootstrap.cc:492] T 11868dc915f6412eaed3c2ba56738bfc P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:48.725390 12618 consensus_queue.cc:237] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.768679 12532 consensus_queue.cc:1048] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:48.775844 12530 raft_consensus.cc:493] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:48.774884 12523 tablet_bootstrap.cc:492] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:48.777117 12523 ts_tablet_manager.cc:1403] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.191s	user 0.029s	sys 0.014s
I20260620 13:58:48.776369 12530 raft_consensus.cc:515] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.812680 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e933cf7b644e4b893d2e7e85425be" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
W20260620 13:58:48.814627 12367 leader_election.cc:343] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:48.810761 12530 leader_election.cc:290] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:48.815876 12250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e933cf7b644e4b893d2e7e85425be" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:48.818463 12522 tablet_bootstrap.cc:492] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:48.819096 12522 ts_tablet_manager.cc:1403] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.175s	user 0.014s	sys 0.007s
I20260620 13:58:48.819280 12250 raft_consensus.cc:2468] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:48.821950 12521 tablet_bootstrap.cc:492] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:48.822136 12367 leader_election.cc:304] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:48.822477 12521 ts_tablet_manager.cc:1403] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.021s
I20260620 13:58:48.824111 12522 raft_consensus.cc:359] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:48.824819 12522 raft_consensus.cc:385] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.825086 12522 raft_consensus.cc:740] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.824944 12521 raft_consensus.cc:359] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.825618 12521 raft_consensus.cc:385] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.825954 12521 raft_consensus.cc:740] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.825793 12522 consensus_queue.cc:260] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:48.826638 12521 consensus_queue.cc:260] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.827419 12530 raft_consensus.cc:2804] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:48.827878 12530 raft_consensus.cc:493] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:48.828233 12530 raft_consensus.cc:3060] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.829303 12521 ts_tablet_manager.cc:1434] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260620 13:58:48.830256 12521 tablet_bootstrap.cc:492] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:48.833871 12523 raft_consensus.cc:359] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.834704 12523 raft_consensus.cc:385] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.831185 12148 catalog_manager.cc:5696] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:48.836051 12530 raft_consensus.cc:515] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.836061 12522 ts_tablet_manager.cc:1434] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260620 13:58:48.834977 12523 raft_consensus.cc:740] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.849328 12523 consensus_queue.cc:260] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.852217 12523 ts_tablet_manager.cc:1434] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260620 13:58:48.852653 12530 leader_election.cc:290] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:48.841995 12520 tablet_bootstrap.cc:654] T 11868dc915f6412eaed3c2ba56738bfc P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.842136 12645 consensus_queue.cc:1048] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:48.844163 12521 tablet_bootstrap.cc:654] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.857870 12522 tablet_bootstrap.cc:492] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:48.864174 12522 tablet_bootstrap.cc:654] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.864583 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e933cf7b644e4b893d2e7e85425be" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:48.865239 12252 raft_consensus.cc:3060] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.866168 12521 tablet_bootstrap.cc:492] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:48.866254 12557 raft_consensus.cc:493] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:48.866757 12521 ts_tablet_manager.cc:1403] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.000s
I20260620 13:58:48.866935 12557 raft_consensus.cc:515] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.869117 12325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e933cf7b644e4b893d2e7e85425be" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:48.869587 12521 raft_consensus.cc:359] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.870260 12521 raft_consensus.cc:385] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.870522 12521 raft_consensus.cc:740] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
W20260620 13:58:48.871402 12367 leader_election.cc:343] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:48.873389 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6c6d2474cc47d09439ce00490af552" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:48.873451 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6c6d2474cc47d09439ce00490af552" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:48.874322 12401 raft_consensus.cc:2393] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcd1bd5dfea74c378a6154f83707154c in current term 1: Already voted for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in this term.
I20260620 13:58:48.876180 12290 leader_election.cc:304] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:48.877641 12633 raft_consensus.cc:3060] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.871301 12521 consensus_queue.cc:260] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.871287 12557 leader_election.cc:290] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:48.883944 12252 raft_consensus.cc:2468] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:48.884814 12521 ts_tablet_manager.cc:1434] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260620 13:58:48.885285 12367 leader_election.cc:304] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:48.886219 12618 raft_consensus.cc:2804] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:48.886706 12618 raft_consensus.cc:697] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:48.887748 12618 consensus_queue.cc:237] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.853521 12523 tablet_bootstrap.cc:492] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:48.889740 12554 raft_consensus.cc:493] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:48.890391 12554 raft_consensus.cc:515] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:48.890967 12532 consensus_queue.cc:1048] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:48.886224 12521 tablet_bootstrap.cc:492] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:48.896996 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1ae3d064cd49309bf086b257c3f664" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:48.898505 12327 raft_consensus.cc:2468] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:48.902143 12218 leader_election.cc:304] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:48.906181 12645 raft_consensus.cc:2804] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:48.906772 12645 raft_consensus.cc:493] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:48.907349 12645 raft_consensus.cc:3060] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:48.910106 12633 raft_consensus.cc:2749] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:48.897285 12522 tablet_bootstrap.cc:492] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:48.914690 12522 ts_tablet_manager.cc:1403] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.002s
I20260620 13:58:48.924108 12646 consensus_queue.cc:1048] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:48.927700 12522 raft_consensus.cc:359] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:48.928560 12522 raft_consensus.cc:385] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.933167 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1ae3d064cd49309bf086b257c3f664" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:48.934140 12522 raft_consensus.cc:740] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.934346 12399 raft_consensus.cc:2468] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:48.934948 12554 leader_election.cc:290] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:48.938017 12522 consensus_queue.cc:260] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:48.940743 12522 ts_tablet_manager.cc:1434] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260620 13:58:48.941807 12522 tablet_bootstrap.cc:492] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:48.922173 12521 tablet_bootstrap.cc:654] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.954623 12522 tablet_bootstrap.cc:654] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:48.957010 12521 tablet_bootstrap.cc:492] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:48.957576 12521 ts_tablet_manager.cc:1403] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.001s
I20260620 13:58:48.961230 12521 raft_consensus.cc:359] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.962141 12521 raft_consensus.cc:385] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.962486 12521 raft_consensus.cc:740] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.963833 12521 consensus_queue.cc:260] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:48.968837 12532 raft_consensus.cc:493] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:48.969085 12521 ts_tablet_manager.cc:1434] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260620 13:58:48.969743 12532 raft_consensus.cc:515] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:48.971252 12521 tablet_bootstrap.cc:492] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:48.977887 12532 leader_election.cc:290] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:48.980921 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11868dc915f6412eaed3c2ba56738bfc" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:48.981904 12252 raft_consensus.cc:2468] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 0.
I20260620 13:58:48.982072 12522 tablet_bootstrap.cc:492] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:48.982936 12522 ts_tablet_manager.cc:1403] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.003s
I20260620 13:58:48.983857 12441 leader_election.cc:304] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:48.986837 12325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11868dc915f6412eaed3c2ba56738bfc" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
W20260620 13:58:48.989506 12441 leader_election.cc:343] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:48.987313 12522 raft_consensus.cc:359] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:48.993273 12522 raft_consensus.cc:385] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:48.993723 12522 raft_consensus.cc:740] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:48.994786 12530 raft_consensus.cc:493] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:48.996644 12532 raft_consensus.cc:2804] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:48.996346 12530 raft_consensus.cc:515] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:48.997460 12532 raft_consensus.cc:493] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:48.998307 12532 raft_consensus.cc:3060] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.001194 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2596bf072bda4ad188dcc3f1438a4d7d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:49.002271 12475 raft_consensus.cc:2468] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:49.006928 12364 leader_election.cc:304] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:49.007881 12618 raft_consensus.cc:2804] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:49.008298 12618 raft_consensus.cc:493] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:49.008642 12618 raft_consensus.cc:3060] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.003741 12530 leader_election.cc:290] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:49.025837 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2596bf072bda4ad188dcc3f1438a4d7d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:49.026607 12252 raft_consensus.cc:2468] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:49.030259 12618 raft_consensus.cc:515] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:49.034209 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2596bf072bda4ad188dcc3f1438a4d7d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:49.035153 12475 raft_consensus.cc:3060] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.035689 12530 raft_consensus.cc:493] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:49.036440 12530 raft_consensus.cc:515] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:49.031280 12522 consensus_queue.cc:260] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:48.992806 12521 tablet_bootstrap.cc:654] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:49.037693 12584 raft_consensus.cc:493] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:49.038389 12584 raft_consensus.cc:515] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:49.040933 12522 ts_tablet_manager.cc:1434] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260620 13:58:49.050338 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2596bf072bda4ad188dcc3f1438a4d7d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:49.050891 12618 leader_election.cc:290] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:49.046653 12325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56e0ab75d2c84468b813c054386f4b27" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:49.046008 12530 leader_election.cc:290] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:49.049540 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70f84c10ad144b2b4d6bd50567b54ed" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:49.052764 12584 leader_election.cc:290] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
W20260620 13:58:49.053517 12367 leader_election.cc:343] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:49.050907 12252 raft_consensus.cc:3060] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:58:49.054014 12215 leader_election.cc:343] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:49.051994 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70f84c10ad144b2b4d6bd50567b54ed" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
W20260620 13:58:49.056602 12218 leader_election.cc:343] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:49.057269 12218 leader_election.cc:304] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:49.059054 12521 tablet_bootstrap.cc:492] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:49.059656 12521 ts_tablet_manager.cc:1403] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.000s
I20260620 13:58:49.063684 12252 raft_consensus.cc:2468] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:49.047042 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56e0ab75d2c84468b813c054386f4b27" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
W20260620 13:58:49.065878 12364 leader_election.cc:343] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:49.066484 12364 leader_election.cc:304] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:49.068465 12367 leader_election.cc:304] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:49.069923 12618 raft_consensus.cc:2749] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:49.070676 12618 raft_consensus.cc:2804] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:49.071327 12584 raft_consensus.cc:2749] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:49.072018 12618 raft_consensus.cc:697] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:49.073493 12618 consensus_queue.cc:237] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:49.051743 12522 tablet_bootstrap.cc:492] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:49.082307 12475 raft_consensus.cc:2468] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:49.083572 12521 raft_consensus.cc:359] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:49.090868 12521 raft_consensus.cc:385] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:49.091289 12521 raft_consensus.cc:740] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:49.092350 12521 consensus_queue.cc:260] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:49.093178 12530 consensus_queue.cc:1048] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:49.102294 12522 tablet_bootstrap.cc:654] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:49.104789 12520 tablet_bootstrap.cc:492] T 11868dc915f6412eaed3c2ba56738bfc P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:49.105330 12520 ts_tablet_manager.cc:1403] T 11868dc915f6412eaed3c2ba56738bfc P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.345s	user 0.113s	sys 0.113s
I20260620 13:58:49.110421 12520 raft_consensus.cc:359] T 11868dc915f6412eaed3c2ba56738bfc P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:49.111233 12520 raft_consensus.cc:385] T 11868dc915f6412eaed3c2ba56738bfc P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:49.111531 12520 raft_consensus.cc:740] T 11868dc915f6412eaed3c2ba56738bfc P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:49.112351 12520 consensus_queue.cc:260] T 11868dc915f6412eaed3c2ba56738bfc P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:49.115219 12520 ts_tablet_manager.cc:1434] T 11868dc915f6412eaed3c2ba56738bfc P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260620 13:58:49.116276 12520 tablet_bootstrap.cc:492] T ff2e933cf7b644e4b893d2e7e85425be P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:49.118438 12645 raft_consensus.cc:515] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.124357 12523 tablet_bootstrap.cc:654] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:49.127337 12520 tablet_bootstrap.cc:654] T ff2e933cf7b644e4b893d2e7e85425be P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:49.114639 12532 raft_consensus.cc:515] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:49.133306 12521 ts_tablet_manager.cc:1434] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260620 13:58:49.134738 12521 tablet_bootstrap.cc:492] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:49.137550 12633 raft_consensus.cc:493] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:49.141409 12523 tablet_bootstrap.cc:492] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:49.141238 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1ae3d064cd49309bf086b257c3f664" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:49.142329 12523 ts_tablet_manager.cc:1403] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.289s	user 0.011s	sys 0.008s
I20260620 13:58:49.144170 12633 raft_consensus.cc:515] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:49.144587 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1ae3d064cd49309bf086b257c3f664" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:49.145278 12399 raft_consensus.cc:3060] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.147179 12633 leader_election.cc:290] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:49.147971 12327 raft_consensus.cc:3060] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.149277 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65eb66c55e74ee78340946d691c4e72" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:49.150601 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65eb66c55e74ee78340946d691c4e72" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:49.151412 12472 raft_consensus.cc:2393] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcd1bd5dfea74c378a6154f83707154c in current term 1: Already voted for candidate c51ef915af09435db6046c91bb9d00e0 in this term.
I20260620 13:58:49.153294 12292 leader_election.cc:304] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:49.155376 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11868dc915f6412eaed3c2ba56738bfc" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:49.155663 12532 leader_election.cc:290] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:49.156038 12252 raft_consensus.cc:3060] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.160287 12399 raft_consensus.cc:2468] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:49.161424 12327 raft_consensus.cc:2468] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:49.143635 12645 leader_election.cc:290] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:49.166460 12218 leader_election.cc:304] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:49.167548 12645 raft_consensus.cc:2804] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:49.167969 12325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11868dc915f6412eaed3c2ba56738bfc" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:49.168614 12325 raft_consensus.cc:3060] T 11868dc915f6412eaed3c2ba56738bfc P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.168500 12645 raft_consensus.cc:697] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:58:49.155444 12633 raft_consensus.cc:3060] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.170215 12645 consensus_queue.cc:237] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.163601 12523 raft_consensus.cc:359] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:49.175683 12523 raft_consensus.cc:385] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:49.176159 12523 raft_consensus.cc:740] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:49.177318 12523 consensus_queue.cc:260] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:49.178509 12633 raft_consensus.cc:2749] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:49.181036 12523 ts_tablet_manager.cc:1434] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260620 13:58:49.183180 12522 tablet_bootstrap.cc:492] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:49.180234 12149 catalog_manager.cc:5696] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:49.183665 12522 ts_tablet_manager.cc:1403] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.133s	user 0.020s	sys 0.001s
I20260620 13:58:49.187292 12252 raft_consensus.cc:2468] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:58:49.186692 12149 catalog_manager.cc:5696] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:49.188699 12441 leader_election.cc:304] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:49.189677 12532 raft_consensus.cc:2804] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:49.190214 12532 raft_consensus.cc:697] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:58:49.191139 12532 consensus_queue.cc:237] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:49.196868 12530 consensus_queue.cc:1048] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:49.192384 12522 raft_consensus.cc:359] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:49.199896 12611 raft_consensus.cc:493] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:49.201089 12611 raft_consensus.cc:515] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:49.203249 12611 leader_election.cc:290] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:49.203528 12520 tablet_bootstrap.cc:492] T ff2e933cf7b644e4b893d2e7e85425be P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:49.204018 12520 ts_tablet_manager.cc:1403] T ff2e933cf7b644e4b893d2e7e85425be P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.088s	user 0.005s	sys 0.027s
I20260620 13:58:49.204921 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840318536322435dac01a843c641b718" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:49.205564 12251 raft_consensus.cc:2468] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 0.
I20260620 13:58:49.206894 12520 raft_consensus.cc:359] T ff2e933cf7b644e4b893d2e7e85425be P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.207623 12520 raft_consensus.cc:385] T ff2e933cf7b644e4b893d2e7e85425be P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:49.207919 12520 raft_consensus.cc:740] T ff2e933cf7b644e4b893d2e7e85425be P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:49.207239 12441 leader_election.cc:304] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:49.208585 12520 consensus_queue.cc:260] T ff2e933cf7b644e4b893d2e7e85425be P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.209069 12611 raft_consensus.cc:2804] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:49.209429 12611 raft_consensus.cc:493] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:49.209746 12611 raft_consensus.cc:3060] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.210810 12520 ts_tablet_manager.cc:1434] T ff2e933cf7b644e4b893d2e7e85425be P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260620 13:58:49.213224 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840318536322435dac01a843c641b718" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:49.219990 12520 tablet_bootstrap.cc:492] T 840318536322435dac01a843c641b718 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
W20260620 13:58:49.220352 12441 leader_election.cc:343] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:49.184268 12325 raft_consensus.cc:2468] T 11868dc915f6412eaed3c2ba56738bfc P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:58:49.216480 12148 catalog_manager.cc:5696] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:49.229832 12522 raft_consensus.cc:385] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:49.230221 12522 raft_consensus.cc:740] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:49.230919 12520 tablet_bootstrap.cc:654] T 840318536322435dac01a843c641b718 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
W20260620 13:58:49.231599 12197 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:58:49.231055 12522 consensus_queue.cc:260] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:49.232828 12530 raft_consensus.cc:493] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:49.233259 12530 raft_consensus.cc:515] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:49.234052 12522 ts_tablet_manager.cc:1434] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.000s
I20260620 13:58:49.235088 12522 tablet_bootstrap.cc:492] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:49.236251 12530 leader_election.cc:290] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:49.236953 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d12122a1bf1410bb150a27f3bf46fdf" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:49.229422 12611 raft_consensus.cc:515] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
W20260620 13:58:49.238996 12364 leader_election.cc:343] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:49.241417 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d12122a1bf1410bb150a27f3bf46fdf" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:49.242213 12252 raft_consensus.cc:2468] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:49.168196 12521 tablet_bootstrap.cc:654] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:49.241497 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840318536322435dac01a843c641b718" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:49.243171 12251 raft_consensus.cc:3060] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.246428 12520 tablet_bootstrap.cc:492] T 840318536322435dac01a843c641b718 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:49.246999 12520 ts_tablet_manager.cc:1403] T 840318536322435dac01a843c641b718 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.027s	user 0.002s	sys 0.009s
I20260620 13:58:49.183364 12523 tablet_bootstrap.cc:492] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:49.251571 12520 raft_consensus.cc:359] T 840318536322435dac01a843c641b718 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:49.254009 12520 raft_consensus.cc:385] T 840318536322435dac01a843c641b718 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:49.254102 12367 leader_election.cc:304] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:49.254711 12520 raft_consensus.cc:740] T 840318536322435dac01a843c641b718 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:49.255842 12618 raft_consensus.cc:2804] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:49.255780 12520 consensus_queue.cc:260] T 840318536322435dac01a843c641b718 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:49.256496 12618 raft_consensus.cc:493] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:49.257202 12325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840318536322435dac01a843c641b718" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:49.257392 12665 consensus_queue.cc:1048] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:49.257985 12325 raft_consensus.cc:3060] T 840318536322435dac01a843c641b718 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.258265 12520 ts_tablet_manager.cc:1434] T 840318536322435dac01a843c641b718 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260620 13:58:49.259400 12520 tablet_bootstrap.cc:492] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:49.263478 12618 raft_consensus.cc:3060] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.266330 12611 leader_election.cc:290] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:49.266688 12520 tablet_bootstrap.cc:654] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:49.276363 12251 raft_consensus.cc:2468] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:58:49.277866 12441 leader_election.cc:304] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:49.278756 12611 raft_consensus.cc:2804] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:49.278962 12520 tablet_bootstrap.cc:492] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:49.279296 12523 tablet_bootstrap.cc:654] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:49.279774 12520 ts_tablet_manager.cc:1403] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260620 13:58:49.279433 12611 raft_consensus.cc:697] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:58:49.282047 12611 consensus_queue.cc:237] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:49.283213 12522 tablet_bootstrap.cc:654] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:49.282857 12520 raft_consensus.cc:359] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:49.283671 12520 raft_consensus.cc:385] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:49.283968 12520 raft_consensus.cc:740] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:49.282815 12147 catalog_manager.cc:5696] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 1 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:49.284914 12520 consensus_queue.cc:260] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:49.287639 12520 ts_tablet_manager.cc:1434] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260620 13:58:49.288759 12520 tablet_bootstrap.cc:492] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:49.291920 12325 raft_consensus.cc:2468] T 840318536322435dac01a843c641b718 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:58:49.292114 12522 tablet_bootstrap.cc:492] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:49.294090 12522 ts_tablet_manager.cc:1403] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.007s
I20260620 13:58:49.294951 12520 tablet_bootstrap.cc:654] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:49.297580 12327 raft_consensus.cc:3060] T ff2e933cf7b644e4b893d2e7e85425be P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.302740 12601 raft_consensus.cc:493] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:49.311157 12522 raft_consensus.cc:359] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.312172 12522 raft_consensus.cc:385] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:49.312525 12522 raft_consensus.cc:740] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:49.303323 12601 raft_consensus.cc:515] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.313687 12522 consensus_queue.cc:260] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.322589 12530 raft_consensus.cc:493] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:49.325376 12618 raft_consensus.cc:515] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:49.326601 12522 ts_tablet_manager.cc:1434] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260620 13:58:49.345382 12523 tablet_bootstrap.cc:492] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:49.347788 12523 ts_tablet_manager.cc:1403] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.165s	user 0.013s	sys 0.004s
I20260620 13:58:49.349732 12522 tablet_bootstrap.cc:492] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:49.344529 12530 raft_consensus.cc:515] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:49.362826 12148 catalog_manager.cc:5696] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 1 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:49.372613 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a796c8979c4c2bb4de0ee5e4cd35dc" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:49.373492 12601 leader_election.cc:290] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:49.374434 12325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a796c8979c4c2bb4de0ee5e4cd35dc" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:49.376358 12523 raft_consensus.cc:359] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
W20260620 13:58:49.378019 12711 log.cc:927] Time spent T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260620 13:58:49.394917 12523 raft_consensus.cc:385] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:49.396054 12523 raft_consensus.cc:740] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:49.396667 12251 raft_consensus.cc:2468] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
W20260620 13:58:49.398536 12367 leader_election.cc:343] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:49.398705 12530 leader_election.cc:290] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:49.399441 12530 consensus_queue.cc:1048] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:49.400285 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d12122a1bf1410bb150a27f3bf46fdf" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:49.401234 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
W20260620 13:58:49.402335 12364 leader_election.cc:343] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:49.403731 12367 leader_election.cc:304] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:49.404327 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
W20260620 13:58:49.405771 12367 leader_election.cc:343] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:49.405637 12618 leader_election.cc:290] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:49.406513 12367 leader_election.cc:304] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:49.406762 12618 raft_consensus.cc:2804] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:49.410915 12523 consensus_queue.cc:260] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:49.408062 12618 raft_consensus.cc:493] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:49.413125 12472 raft_consensus.cc:3060] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.414598 12618 raft_consensus.cc:3060] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.416337 12521 tablet_bootstrap.cc:492] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:49.416829 12521 ts_tablet_manager.cc:1403] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.282s	user 0.021s	sys 0.032s
I20260620 13:58:49.419963 12472 raft_consensus.cc:2468] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:49.419827 12521 raft_consensus.cc:359] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:49.422195 12521 raft_consensus.cc:385] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:49.422348 12520 tablet_bootstrap.cc:492] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:49.422513 12521 raft_consensus.cc:740] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:49.422633 12364 leader_election.cc:304] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:49.423010 12520 ts_tablet_manager.cc:1403] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.134s	user 0.040s	sys 0.042s
I20260620 13:58:49.426119 12251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d12122a1bf1410bb150a27f3bf46fdf" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:49.426740 12251 raft_consensus.cc:3060] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.428264 12520 raft_consensus.cc:359] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.428983 12520 raft_consensus.cc:385] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:49.429231 12520 raft_consensus.cc:740] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:49.429860 12520 consensus_queue.cc:260] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.423533 12521 consensus_queue.cc:260] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:49.433339 12523 ts_tablet_manager.cc:1434] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260620 13:58:49.423848 12712 raft_consensus.cc:2804] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:49.438091 12520 ts_tablet_manager.cc:1434] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260620 13:58:49.439700 12712 raft_consensus.cc:697] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:49.440636 12712 consensus_queue.cc:237] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:49.444226 12714 raft_consensus.cc:2749] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:49.444628 12713 consensus_queue.cc:1048] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:49.447940 12520 tablet_bootstrap.cc:492] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:49.450788 12521 ts_tablet_manager.cc:1434] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260620 13:58:49.451670 12521 tablet_bootstrap.cc:492] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:49.424091 12618 raft_consensus.cc:515] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.462308 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a796c8979c4c2bb4de0ee5e4cd35dc" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:49.463201 12252 raft_consensus.cc:3060] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.464787 12251 raft_consensus.cc:2468] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:49.468256 12522 tablet_bootstrap.cc:654] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:49.478222 12520 tablet_bootstrap.cc:654] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:49.479203 12557 raft_consensus.cc:493] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:49.479909 12557 raft_consensus.cc:515] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.481019 12633 raft_consensus.cc:493] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:49.481587 12633 raft_consensus.cc:515] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:49.483101 12633 leader_election.cc:290] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:49.484409 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a796c8979c4c2bb4de0ee5e4cd35dc" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:49.484469 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56e0ab75d2c84468b813c054386f4b27" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:49.485395 12398 raft_consensus.cc:2393] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcd1bd5dfea74c378a6154f83707154c in current term 1: Already voted for candidate c51ef915af09435db6046c91bb9d00e0 in this term.
I20260620 13:58:49.486764 12249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a796c8979c4c2bb4de0ee5e4cd35dc" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
W20260620 13:58:49.487192 12290 leader_election.cc:343] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:49.488112 12149 catalog_manager.cc:5696] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:49.488982 12293 leader_election.cc:304] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:49.490191 12556 raft_consensus.cc:3060] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.493688 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56e0ab75d2c84468b813c054386f4b27" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:49.494372 12399 raft_consensus.cc:2468] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:49.494709 12523 tablet_bootstrap.cc:492] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:49.495728 12292 leader_election.cc:304] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:49.496618 12633 raft_consensus.cc:2804] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:49.497197 12633 raft_consensus.cc:493] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:49.497635 12633 raft_consensus.cc:3060] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.477499 12713 consensus_queue.cc:1048] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:49.484561 12557 leader_election.cc:290] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:49.506201 12530 consensus_queue.cc:1048] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:49.512753 12523 tablet_bootstrap.cc:654] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:49.515921 12618 leader_election.cc:290] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:49.518818 12252 raft_consensus.cc:2468] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:49.510926 12556 raft_consensus.cc:2749] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:49.538229 12521 tablet_bootstrap.cc:654] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
W20260620 13:58:49.555960 12292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:37673, user_credentials={real_user=slave}} blocked reactor thread for 60338.1us
I20260620 13:58:49.555747 12367 leader_election.cc:304] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:49.583457 12618 raft_consensus.cc:2804] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:49.584059 12618 raft_consensus.cc:697] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:49.584889 12618 consensus_queue.cc:237] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.588222 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a796c8979c4c2bb4de0ee5e4cd35dc" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
W20260620 13:58:49.617007 12718 log.cc:927] Time spent T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.004s
I20260620 13:58:49.624501 12633 raft_consensus.cc:515] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:49.631059 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56e0ab75d2c84468b813c054386f4b27" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:49.633917 12633 leader_election.cc:290] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:49.635033 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56e0ab75d2c84468b813c054386f4b27" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:49.635908 12399 raft_consensus.cc:3060] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:49.651291 12327 raft_consensus.cc:2468] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:49.659009 12520 tablet_bootstrap.cc:492] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:49.660437 12520 ts_tablet_manager.cc:1403] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.213s	user 0.026s	sys 0.043s
W20260620 13:58:49.661929 12290 leader_election.cc:343] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:49.695513 12520 raft_consensus.cc:359] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:49.696303 12520 raft_consensus.cc:385] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:49.696568 12520 raft_consensus.cc:740] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:49.697352 12611 consensus_queue.cc:1048] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:49.701210 12520 consensus_queue.cc:260] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:49.704640 12520 ts_tablet_manager.cc:1434] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.002s
I20260620 13:58:49.706032 12520 tablet_bootstrap.cc:492] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:49.700757 12532 consensus_queue.cc:1048] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260620 13:58:49.727187 12399 raft_consensus.cc:2468] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:49.728210 12521 tablet_bootstrap.cc:492] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:49.728734 12521 ts_tablet_manager.cc:1403] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.277s	user 0.008s	sys 0.018s
I20260620 13:58:49.728840 12292 leader_election.cc:304] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:49.730610 12633 raft_consensus.cc:2804] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:49.731195 12633 raft_consensus.cc:697] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:49.732378 12633 consensus_queue.cc:237] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:49.734980 12530 consensus_queue.cc:1048] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:49.721513 12611 consensus_queue.cc:1048] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260620 13:58:49.768599 12520 tablet_bootstrap.cc:654] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:49.762609 12521 raft_consensus.cc:359] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.782033 12521 raft_consensus.cc:385] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:49.782645 12521 raft_consensus.cc:740] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:49.799222 12521 consensus_queue.cc:260] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.800105 12523 tablet_bootstrap.cc:492] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:49.800588 12523 ts_tablet_manager.cc:1403] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.306s	user 0.017s	sys 0.003s
I20260620 13:58:49.806366 12522 tablet_bootstrap.cc:492] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:49.808442 12521 ts_tablet_manager.cc:1434] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.079s	user 0.010s	sys 0.000s
I20260620 13:58:49.788053 12713 raft_consensus.cc:493] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:49.813262 12522 ts_tablet_manager.cc:1403] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.458s	user 0.024s	sys 0.014s
I20260620 13:58:49.838474 12520 tablet_bootstrap.cc:492] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:49.839133 12520 ts_tablet_manager.cc:1403] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.133s	user 0.024s	sys 0.014s
I20260620 13:58:49.816785 12713 raft_consensus.cc:515] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:49.843979 12520 raft_consensus.cc:359] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.845144 12520 raft_consensus.cc:385] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:49.845505 12520 raft_consensus.cc:740] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:49.846429 12520 consensus_queue.cc:260] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:49.848984 12520 ts_tablet_manager.cc:1434] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260620 13:58:49.852043 12523 raft_consensus.cc:359] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:49.854549 12523 raft_consensus.cc:385] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:49.854902 12523 raft_consensus.cc:740] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:49.858045 12523 consensus_queue.cc:260] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
W20260620 13:58:50.429239 12726 log.cc:927] Time spent T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0: Append to log took a long time: real 0.612s	user 0.002s	sys 0.008s
I20260620 13:58:50.432968 12530 consensus_queue.cc:1048] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:50.433673 12665 raft_consensus.cc:493] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:50.434159 12665 raft_consensus.cc:515] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:50.436178 12665 leader_election.cc:290] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:50.441105 12245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a422539280460c895f371ef9eb8f4d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
W20260620 13:58:50.452354 12367 leader_election.cc:343] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:50.496176 12665 consensus_queue.cc:1048] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260620 13:58:50.532075 12522 raft_consensus.cc:359] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:50.533008 12522 raft_consensus.cc:385] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:50.533341 12522 raft_consensus.cc:740] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:50.534338 12530 raft_consensus.cc:493] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:58:50.538146 12530 raft_consensus.cc:515] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:50.538180 12522 consensus_queue.cc:260] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:50.540817 12530 leader_election.cc:290] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:50.534320 12557 raft_consensus.cc:493] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:50.541893 12557 raft_consensus.cc:515] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:50.544907 12557 leader_election.cc:290] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:50.550166 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f805a171a24872a79e07cc3a788290" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:50.550963 12399 raft_consensus.cc:2468] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:50.544938 12522 ts_tablet_manager.cc:1434] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.731s	user 0.015s	sys 0.000s
W20260620 13:58:50.560547 12522 ts_tablet_manager.cc:1467] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f: Tablet startup took 746ms
W20260620 13:58:50.560842 12522 ts_tablet_manager.cc:1469] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f: Trace:
0620 13:58:45.864337 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:45.864524 (+   187us) service_pool.cc:224] Handling call
0620 13:58:45.885699 (+ 21175us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0620 13:58:45.885805 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0620 13:58:46.047340 (+161535us) tablet_metadata.cc:665] Metadata flushed
0620 13:58:46.196838 (+149498us) tablet_replica.cc:206] Creating consensus instance
0620 13:58:46.197398 (+   560us) inbound_call.cc:177] Queueing success response
0620 13:58:49.349298 (+3151900us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0620 13:58:49.813806 (+464508us) ts_tablet_manager.cc:1435] Starting tablet replica
0620 13:58:49.856600 (+ 42794us) tablet_replica.cc:261] Starting instrumentation
0620 13:58:49.857415 (+   815us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":1233,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"tablet-open.queue_time_us":3152006}
I20260620 13:58:50.564425 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09dbf9acadba454f83e6b30932aa7806" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
W20260620 13:58:50.577075 12633 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.000s	sys 0.024s
W20260620 13:58:50.577595 12633 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.000s	sys 0.025s
I20260620 13:58:50.581734 12522 tablet_bootstrap.cc:492] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:50.597998 12292 leader_election.cc:304] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:50.599258 12557 raft_consensus.cc:2804] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:50.604441 12557 raft_consensus.cc:493] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:50.604940 12557 raft_consensus.cc:3060] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:58:50.621007 12327 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.035s	sys 0.026s
W20260620 13:58:50.621740 12327 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.035s	sys 0.026s
W20260620 13:58:50.634730 12441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 109458us
I20260620 13:58:50.640780 12713 leader_election.cc:290] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:50.648937 12645 consensus_queue.cc:1048] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:50.651634 12557 raft_consensus.cc:515] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:50.659243 12557 leader_election.cc:290] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
W20260620 13:58:50.660297 12250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.018s	sys 0.011s
W20260620 13:58:50.661121 12250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.018s	sys 0.011s
I20260620 13:58:50.663697 12523 ts_tablet_manager.cc:1434] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.863s	user 0.012s	sys 0.005s
W20260620 13:58:50.664062 12523 ts_tablet_manager.cc:1467] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6: Tablet startup took 863ms
I20260620 13:58:50.664845 12522 tablet_bootstrap.cc:654] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
W20260620 13:58:50.664590 12523 ts_tablet_manager.cc:1469] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6: Trace:
0620 13:58:45.786111 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:45.786304 (+   193us) service_pool.cc:224] Handling call
0620 13:58:45.788250 (+  1946us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0620 13:58:45.788351 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0620 13:58:45.814944 (+ 26593us) tablet_metadata.cc:665] Metadata flushed
0620 13:58:45.932529 (+117585us) tablet_replica.cc:206] Creating consensus instance
0620 13:58:45.978373 (+ 45844us) inbound_call.cc:177] Queueing success response
0620 13:58:49.494386 (+3516013us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0620 13:58:49.800822 (+306436us) ts_tablet_manager.cc:1435] Starting tablet replica
0620 13:58:49.842143 (+ 41321us) tablet_replica.cc:261] Starting instrumentation
0620 13:58:49.843394 (+  1251us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":320,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":176,"tablet-open.queue_time_us":3521949}
I20260620 13:58:50.641937 12633 consensus_queue.cc:1048] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260620 13:58:50.670722 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f805a171a24872a79e07cc3a788290" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:50.672435 12398 raft_consensus.cc:3060] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:50.676579 12523 tablet_bootstrap.cc:492] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:50.681170 12327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f805a171a24872a79e07cc3a788290" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:50.682065 12327 raft_consensus.cc:2393] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c51ef915af09435db6046c91bb9d00e0 in current term 1: Already voted for candidate fcd1bd5dfea74c378a6154f83707154c in this term.
I20260620 13:58:50.683538 12746 raft_consensus.cc:493] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:58:50.684091 12746 raft_consensus.cc:515] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:50.687150 12400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09dbf9acadba454f83e6b30932aa7806" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:50.688040 12398 raft_consensus.cc:2468] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:50.690135 12520 tablet_bootstrap.cc:492] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:50.691651 12747 consensus_queue.cc:1048] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:50.692746 12532 raft_consensus.cc:493] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c51ef915af09435db6046c91bb9d00e0)
I20260620 13:58:50.693279 12532 raft_consensus.cc:515] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:50.696605 12532 leader_election.cc:290] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:50.698565 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac845f28a431eb612b5e09327f55a" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:50.721122 12746 leader_election.cc:290] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:50.722456 12633 raft_consensus.cc:493] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 69a98f1d9eda4cd9bdd2287823f798f6)
I20260620 13:58:50.724617 12633 raft_consensus.cc:515] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:50.722613 12645 raft_consensus.cc:493] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:50.728554 12523 tablet_bootstrap.cc:654] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:50.731757 12532 raft_consensus.cc:493] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:50.732357 12532 raft_consensus.cc:515] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:50.732977 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f805a171a24872a79e07cc3a788290" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:50.734411 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f805a171a24872a79e07cc3a788290" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:50.734671 12532 leader_election.cc:290] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:50.732992 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c52f04bdd14864afe89398fc3af00c" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:50.737730 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f805a171a24872a79e07cc3a788290" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
W20260620 13:58:50.741382 12364 leader_election.cc:343] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:50.742002 12364 leader_election.cc:304] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:50.743151 12713 raft_consensus.cc:2749] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:50.744176 12468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09dbf9acadba454f83e6b30932aa7806" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
W20260620 13:58:50.746376 12290 leader_election.cc:343] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:50.746812 12468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c52f04bdd14864afe89398fc3af00c" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
W20260620 13:58:50.747460 12290 leader_election.cc:343] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:50.757431 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70f84c10ad144b2b4d6bd50567b54ed" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:50.758181 12252 raft_consensus.cc:2468] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 0.
I20260620 13:58:50.759934 12441 leader_election.cc:304] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:50.761003 12744 raft_consensus.cc:2804] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:50.761365 12744 raft_consensus.cc:493] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:50.761426 12145 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45162 (request call id 34) took 1185 ms. Trace:
I20260620 13:58:50.761761 12744 raft_consensus.cc:3060] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:50.761861 12145 rpcz_store.cc:276] 0620 13:58:49.576162 (+     0us) service_pool.cc:167] Inserting onto call queue
0620 13:58:49.577202 (+  1040us) service_pool.cc:224] Handling call
0620 13:58:50.761338 (+1184136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":931088,"reported_tablets":7}
I20260620 13:58:50.769723 12293 leader_election.cc:304] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
W20260620 13:58:50.770515 12197 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:58:50.770862 12556 raft_consensus.cc:493] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:50.771204 12645 raft_consensus.cc:515] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:50.772066 12556 raft_consensus.cc:515] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:50.774947 12645 leader_election.cc:290] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:50.775911 12249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09dbf9acadba454f83e6b30932aa7806" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:50.770860 12557 raft_consensus.cc:2749] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:58:50.781148 12325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1565041017e04674b72abd4fdbab6b1b" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:50.781039 12441 leader_election.cc:304] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:50.782469 12747 raft_consensus.cc:2749] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 13:58:50.783697 12218 leader_election.cc:343] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:50.786618 12556 leader_election.cc:290] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:50.786352 12744 raft_consensus.cc:515] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:50.789042 12248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a422539280460c895f371ef9eb8f4d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:50.789691 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70f84c10ad144b2b4d6bd50567b54ed" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:50.790330 12252 raft_consensus.cc:3060] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:58:50.790678 12293 leader_election.cc:343] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:50.793354 12521 tablet_bootstrap.cc:492] T 1565041017e04674b72abd4fdbab6b1b P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:50.798573 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a422539280460c895f371ef9eb8f4d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:50.799474 12252 raft_consensus.cc:2468] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:58:50.801548 12744 leader_election.cc:290] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:50.802433 12734 consensus_queue.cc:1048] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:50.805708 12292 leader_election.cc:304] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:50.807067 12320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac845f28a431eb612b5e09327f55a" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:50.808393 12318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70f84c10ad144b2b4d6bd50567b54ed" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:50.809737 12324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70f84c10ad144b2b4d6bd50567b54ed" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:50.726996 12633 leader_election.cc:290] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:50.818178 12556 raft_consensus.cc:2804] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:50.820331 12556 raft_consensus.cc:697] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:50.820488 12713 consensus_queue.cc:1048] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:50.821439 12556 consensus_queue.cc:237] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:50.817183 12323 raft_consensus.cc:2468] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
W20260620 13:58:50.825296 12364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 83953.6us
I20260620 13:58:50.826606 12441 leader_election.cc:304] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:50.827917 12744 raft_consensus.cc:2749] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:58:50.829758 12441 leader_election.cc:304] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:50.830685 12744 raft_consensus.cc:2804] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:50.831185 12744 raft_consensus.cc:697] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:58:50.839196 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a422539280460c895f371ef9eb8f4d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:50.847524 12401 raft_consensus.cc:2468] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:50.849647 12364 leader_election.cc:304] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:50.850687 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1565041017e04674b72abd4fdbab6b1b" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:50.851329 12147 catalog_manager.cc:5696] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } }
I20260620 13:58:50.856220 12665 raft_consensus.cc:2749] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 13:58:50.858527 12441 leader_election.cc:343] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:58:50.862442 12441 leader_election.cc:343] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:50.863786 12521 tablet_bootstrap.cc:654] T 1565041017e04674b72abd4fdbab6b1b P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:50.866120 12714 consensus_queue.cc:1048] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260620 13:58:50.866220 12217 leader_election.cc:343] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:50.867378 12217 leader_election.cc:304] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:50.868517 12734 raft_consensus.cc:2749] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:50.831962 12744 consensus_queue.cc:237] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:50.853349 12147 catalog_manager.cc:5696] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } }
I20260620 13:58:50.908473 12367 leader_election.cc:304] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:58:50.909742 12601 raft_consensus.cc:2804] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:50.910195 12601 raft_consensus.cc:493] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:50.915833 12522 tablet_bootstrap.cc:492] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:50.916509 12522 ts_tablet_manager.cc:1403] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.335s	user 0.055s	sys 0.111s
I20260620 13:58:50.919868 12522 raft_consensus.cc:359] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:50.920641 12522 raft_consensus.cc:385] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:50.920939 12522 raft_consensus.cc:740] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:50.921953 12522 consensus_queue.cc:260] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:50.910714 12601 raft_consensus.cc:3060] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:50.938761 12292 leader_election.cc:304] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:58:50.944545 12522 ts_tablet_manager.cc:1434] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
I20260620 13:58:50.945636 12522 tablet_bootstrap.cc:492] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:50.957604 12523 tablet_bootstrap.cc:492] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:50.958163 12523 ts_tablet_manager.cc:1403] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.291s	user 0.015s	sys 0.006s
I20260620 13:58:50.949687 12633 raft_consensus.cc:2804] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:50.960299 12633 raft_consensus.cc:493] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:50.960803 12633 raft_consensus.cc:3060] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:50.962083 12523 raft_consensus.cc:359] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:50.962812 12523 raft_consensus.cc:385] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:50.963692 12523 raft_consensus.cc:740] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
W20260620 13:58:50.948921 12290 consensus_peers.cc:597] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c -> Peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Couldn't send request to peer 69a98f1d9eda4cd9bdd2287823f798f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:50.982756 12523 consensus_queue.cc:260] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:50.985458 12523 ts_tablet_manager.cc:1434] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.012s
I20260620 13:58:50.986450 12523 tablet_bootstrap.cc:492] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:50.992405 12520 tablet_bootstrap.cc:654] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:50.992874 12523 tablet_bootstrap.cc:654] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:50.999217 12601 raft_consensus.cc:515] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:51.004246 12601 leader_election.cc:290] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:51.005368 12249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a422539280460c895f371ef9eb8f4d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
W20260620 13:58:51.008270 12367 leader_election.cc:343] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:51.010532 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a422539280460c895f371ef9eb8f4d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:51.013106 12522 tablet_bootstrap.cc:654] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.024629 12633 raft_consensus.cc:515] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:51.033368 12249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a422539280460c895f371ef9eb8f4d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
W20260620 13:58:51.034192 12180 debug-util.cc:398] Leaking SignalData structure 0x7b08001e9d00 after lost signal to thread 4722
I20260620 13:58:51.035449 12319 raft_consensus.cc:2393] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c51ef915af09435db6046c91bb9d00e0 in current term 1: Already voted for candidate fcd1bd5dfea74c378a6154f83707154c in this term.
W20260620 13:58:51.035607 12293 leader_election.cc:343] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:51.037628 12633 leader_election.cc:290] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:51.039593 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a422539280460c895f371ef9eb8f4d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:51.040529 12397 raft_consensus.cc:2393] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fcd1bd5dfea74c378a6154f83707154c in current term 1: Already voted for candidate c51ef915af09435db6046c91bb9d00e0 in this term.
I20260620 13:58:51.043417 12521 tablet_bootstrap.cc:492] T 1565041017e04674b72abd4fdbab6b1b P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:51.045370 12521 ts_tablet_manager.cc:1403] T 1565041017e04674b72abd4fdbab6b1b P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.252s	user 0.025s	sys 0.006s
I20260620 13:58:51.051043 12292 leader_election.cc:304] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0
W20260620 13:58:51.053027 12180 debug-util.cc:398] Leaking SignalData structure 0x7b08003590a0 after lost signal to thread 12183
I20260620 13:58:51.052757 12367 leader_election.cc:304] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c
W20260620 13:58:51.054441 12180 debug-util.cc:398] Leaking SignalData structure 0x7b080024fee0 after lost signal to thread 12276
W20260620 13:58:51.055583 12180 debug-util.cc:398] Leaking SignalData structure 0x7b080024f780 after lost signal to thread 12351
I20260620 13:58:51.055470 12601 raft_consensus.cc:2749] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260620 13:58:51.058139 12180 debug-util.cc:398] Leaking SignalData structure 0x7b08000cc760 after lost signal to thread 12425
I20260620 13:58:51.058317 12523 tablet_bootstrap.cc:492] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:51.058845 12523 ts_tablet_manager.cc:1403] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.014s
W20260620 13:58:51.059350 12180 debug-util.cc:398] Leaking SignalData structure 0x7b0800151940 after lost signal to thread 12499
I20260620 13:58:51.061137 12633 raft_consensus.cc:2749] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260620 13:58:51.066133 12523 raft_consensus.cc:359] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.068966 12523 raft_consensus.cc:385] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.069514 12523 raft_consensus.cc:740] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.072139 12521 raft_consensus.cc:359] T 1565041017e04674b72abd4fdbab6b1b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:51.072999 12521 raft_consensus.cc:385] T 1565041017e04674b72abd4fdbab6b1b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.073325 12521 raft_consensus.cc:740] T 1565041017e04674b72abd4fdbab6b1b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.074174 12521 consensus_queue.cc:260] T 1565041017e04674b72abd4fdbab6b1b P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:51.079025 12520 tablet_bootstrap.cc:492] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:51.086491 12520 ts_tablet_manager.cc:1403] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.397s	user 0.017s	sys 0.030s
I20260620 13:58:51.089185 12523 consensus_queue.cc:260] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.097137 12523 ts_tablet_manager.cc:1434] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260620 13:58:51.098338 12523 tablet_bootstrap.cc:492] T 40cf2f63a9574e2098c933116f1700cc P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:51.089704 12520 raft_consensus.cc:359] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:51.103322 12520 raft_consensus.cc:385] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.103968 12520 raft_consensus.cc:740] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.104866 12520 consensus_queue.cc:260] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:51.079087 12521 ts_tablet_manager.cc:1434] T 1565041017e04674b72abd4fdbab6b1b P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260620 13:58:51.103193 12744 raft_consensus.cc:493] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:51.107903 12744 raft_consensus.cc:515] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.110543 12744 leader_election.cc:290] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:51.111836 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56e0ab75d2c84468b813c054386f4b27" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:51.093663 12522 tablet_bootstrap.cc:492] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:51.112795 12522 ts_tablet_manager.cc:1403] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.167s	user 0.016s	sys 0.005s
I20260620 13:58:51.114315 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56e0ab75d2c84468b813c054386f4b27" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:51.115552 12440 leader_election.cc:304] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:51.115969 12522 raft_consensus.cc:359] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.116587 12744 raft_consensus.cc:2749] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:51.116835 12522 raft_consensus.cc:385] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.117244 12522 raft_consensus.cc:740] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.118076 12522 consensus_queue.cc:260] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.119469 12521 tablet_bootstrap.cc:492] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:51.123396 12520 ts_tablet_manager.cc:1434] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260620 13:58:51.124426 12520 tablet_bootstrap.cc:492] T d70f84c10ad144b2b4d6bd50567b54ed P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:51.129791 12520 tablet_bootstrap.cc:654] T d70f84c10ad144b2b4d6bd50567b54ed P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.137575 12522 ts_tablet_manager.cc:1434] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260620 13:58:51.138747 12522 tablet_bootstrap.cc:492] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:51.139688 12148 catalog_manager.cc:5696] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 1 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:51.141947 12148 catalog_manager.cc:5696] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 1 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:51.146721 12523 tablet_bootstrap.cc:654] T 40cf2f63a9574e2098c933116f1700cc P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.149853 12521 tablet_bootstrap.cc:654] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.165344 12522 tablet_bootstrap.cc:654] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.188419 12520 tablet_bootstrap.cc:492] T d70f84c10ad144b2b4d6bd50567b54ed P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:51.189040 12520 ts_tablet_manager.cc:1403] T d70f84c10ad144b2b4d6bd50567b54ed P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.023s
I20260620 13:58:51.191996 12520 raft_consensus.cc:359] T d70f84c10ad144b2b4d6bd50567b54ed P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.192665 12520 raft_consensus.cc:385] T d70f84c10ad144b2b4d6bd50567b54ed P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.192940 12520 raft_consensus.cc:740] T d70f84c10ad144b2b4d6bd50567b54ed P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.193578 12520 consensus_queue.cc:260] T d70f84c10ad144b2b4d6bd50567b54ed P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.195771 12520 ts_tablet_manager.cc:1434] T d70f84c10ad144b2b4d6bd50567b54ed P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260620 13:58:51.196635 12520 tablet_bootstrap.cc:492] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:51.199999 12584 raft_consensus.cc:493] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:51.200556 12584 raft_consensus.cc:515] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.201094 12523 tablet_bootstrap.cc:492] T 40cf2f63a9574e2098c933116f1700cc P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:51.201613 12523 ts_tablet_manager.cc:1403] T 40cf2f63a9574e2098c933116f1700cc P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.104s	user 0.015s	sys 0.003s
I20260620 13:58:51.203133 12556 raft_consensus.cc:493] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:51.207300 12556 raft_consensus.cc:515] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:51.210821 12520 tablet_bootstrap.cc:654] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.202561 12584 leader_election.cc:290] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:51.217732 12556 leader_election.cc:290] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:51.218400 12521 tablet_bootstrap.cc:492] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:51.218916 12521 ts_tablet_manager.cc:1403] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.100s	user 0.009s	sys 0.008s
I20260620 13:58:51.219964 12248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1565041017e04674b72abd4fdbab6b1b" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:51.222177 12523 raft_consensus.cc:359] T 40cf2f63a9574e2098c933116f1700cc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.222877 12523 raft_consensus.cc:385] T 40cf2f63a9574e2098c933116f1700cc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.223208 12523 raft_consensus.cc:740] T 40cf2f63a9574e2098c933116f1700cc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.224207 12523 consensus_queue.cc:260] T 40cf2f63a9574e2098c933116f1700cc P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.224957 12248 raft_consensus.cc:2468] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:51.226276 12293 leader_election.cc:304] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:51.226915 12523 ts_tablet_manager.cc:1434] T 40cf2f63a9574e2098c933116f1700cc P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260620 13:58:51.227123 12556 raft_consensus.cc:2804] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:51.227484 12556 raft_consensus.cc:493] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:51.227799 12556 raft_consensus.cc:3060] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.227901 12523 tablet_bootstrap.cc:492] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:51.231416 12521 raft_consensus.cc:359] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.232345 12521 raft_consensus.cc:385] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.232677 12521 raft_consensus.cc:740] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.233964 12471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:51.234864 12471 raft_consensus.cc:2468] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:51.237504 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1565041017e04674b72abd4fdbab6b1b" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:51.238247 12397 raft_consensus.cc:2468] T 1565041017e04674b72abd4fdbab6b1b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:51.238824 12521 consensus_queue.cc:260] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.242291 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:51.242976 12397 raft_consensus.cc:2468] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:51.244664 12523 tablet_bootstrap.cc:654] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.246097 12215 leader_election.cc:304] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:51.247138 12645 raft_consensus.cc:2804] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:51.247632 12645 raft_consensus.cc:493] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:51.248008 12645 raft_consensus.cc:3060] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.241909 12521 ts_tablet_manager.cc:1434] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260620 13:58:51.265568 12521 tablet_bootstrap.cc:492] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
W20260620 13:58:51.271899 12290 consensus_peers.cc:597] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c -> Peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Couldn't send request to peer 69a98f1d9eda4cd9bdd2287823f798f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:51.288528 12556 raft_consensus.cc:515] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:51.291858 12645 raft_consensus.cc:515] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.293236 12521 tablet_bootstrap.cc:654] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.293375 12633 consensus_queue.cc:1048] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:51.295812 12249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1565041017e04674b72abd4fdbab6b1b" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:51.296492 12249 raft_consensus.cc:3060] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.306576 12145 catalog_manager.cc:5696] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 1 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:51.314800 12556 leader_election.cc:290] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:51.316818 12471 raft_consensus.cc:3060] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.316902 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:51.317709 12399 raft_consensus.cc:3060] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.318876 12645 leader_election.cc:290] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:51.322039 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:51.326805 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1565041017e04674b72abd4fdbab6b1b" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:51.347065 12401 raft_consensus.cc:3060] T 1565041017e04674b72abd4fdbab6b1b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.330528 12521 tablet_bootstrap.cc:492] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:51.347777 12521 ts_tablet_manager.cc:1403] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.002s
I20260620 13:58:51.350489 12521 raft_consensus.cc:359] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.351191 12521 raft_consensus.cc:385] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.351467 12521 raft_consensus.cc:740] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.341465 12324 raft_consensus.cc:3060] T d70f84c10ad144b2b4d6bd50567b54ed P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.355609 12401 raft_consensus.cc:2468] T 1565041017e04674b72abd4fdbab6b1b P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:51.358042 12292 leader_election.cc:304] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:51.322726 12473 raft_consensus.cc:3060] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.359385 12556 raft_consensus.cc:2804] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:51.360229 12556 raft_consensus.cc:697] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:51.361517 12556 consensus_queue.cc:237] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:51.328550 12399 raft_consensus.cc:2468] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:51.346060 12520 tablet_bootstrap.cc:492] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:51.364125 12520 ts_tablet_manager.cc:1403] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.168s	user 0.043s	sys 0.014s
I20260620 13:58:51.367075 12520 raft_consensus.cc:359] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.367797 12520 raft_consensus.cc:385] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.368047 12520 raft_consensus.cc:740] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.368292 12217 leader_election.cc:304] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:51.368680 12520 consensus_queue.cc:260] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.369238 12645 raft_consensus.cc:2804] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:51.370667 12645 raft_consensus.cc:697] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:58:51.346226 12522 tablet_bootstrap.cc:492] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:51.371486 12522 ts_tablet_manager.cc:1403] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.233s	user 0.034s	sys 0.056s
I20260620 13:58:51.371512 12521 consensus_queue.cc:260] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.372483 12618 raft_consensus.cc:493] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:51.372928 12618 raft_consensus.cc:515] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.373796 12521 ts_tablet_manager.cc:1434] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260620 13:58:51.374747 12521 tablet_bootstrap.cc:492] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:51.374504 12522 raft_consensus.cc:359] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.370913 12520 ts_tablet_manager.cc:1434] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260620 13:58:51.322441 12249 raft_consensus.cc:2468] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:51.375193 12522 raft_consensus.cc:385] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.376585 12522 raft_consensus.cc:740] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.377260 12522 consensus_queue.cc:260] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.377489 12473 raft_consensus.cc:2468] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:51.378149 12744 consensus_queue.cc:1048] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:51.377560 12248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40cf2f63a9574e2098c933116f1700cc" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:51.379401 12522 ts_tablet_manager.cc:1434] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260620 13:58:51.379673 12248 raft_consensus.cc:2468] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:51.380357 12522 tablet_bootstrap.cc:492] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:51.380942 12367 leader_election.cc:304] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:51.376020 12520 tablet_bootstrap.cc:492] T 99e449058fb942ddb74eb93a98cb4336 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:51.375064 12618 leader_election.cc:290] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:51.383076 12665 raft_consensus.cc:2804] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:51.389753 12665 raft_consensus.cc:493] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:51.393790 12665 raft_consensus.cc:3060] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.372262 12645 consensus_queue.cc:237] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.411557 12618 raft_consensus.cc:493] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:51.412426 12471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40cf2f63a9574e2098c933116f1700cc" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:51.414083 12618 raft_consensus.cc:515] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.414907 12471 raft_consensus.cc:2468] T 40cf2f63a9574e2098c933116f1700cc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:51.416494 12584 raft_consensus.cc:493] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:51.417035 12618 leader_election.cc:290] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:51.416991 12584 raft_consensus.cc:515] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.418150 12522 tablet_bootstrap.cc:654] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.420720 12744 consensus_queue.cc:1048] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:51.422140 12520 tablet_bootstrap.cc:654] T 99e449058fb942ddb74eb93a98cb4336 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.420709 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e449058fb942ddb74eb93a98cb4336" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:51.424840 12584 leader_election.cc:290] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:51.424872 12324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15db1e0a1aa646e281b8e1a998d8f6d4" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:51.425805 12324 raft_consensus.cc:2468] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
W20260620 13:58:51.426204 12215 leader_election.cc:343] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:51.426730 12321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e449058fb942ddb74eb93a98cb4336" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
W20260620 13:58:51.433313 12218 leader_election.cc:343] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:51.433893 12218 leader_election.cc:304] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:51.434731 12584 raft_consensus.cc:2749] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:51.435643 12367 leader_election.cc:304] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:51.436517 12618 raft_consensus.cc:2804] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:51.437006 12618 raft_consensus.cc:493] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:51.437438 12618 raft_consensus.cc:3060] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.442196 12665 raft_consensus.cc:515] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.445982 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15db1e0a1aa646e281b8e1a998d8f6d4" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:51.449527 12523 tablet_bootstrap.cc:492] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
W20260620 13:58:51.452807 12364 leader_election.cc:343] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:51.453158 12523 ts_tablet_manager.cc:1403] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.225s	user 0.014s	sys 0.000s
I20260620 13:58:51.461061 12523 raft_consensus.cc:359] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.464421 12147 catalog_manager.cc:5696] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 1 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:51.465571 12523 raft_consensus.cc:385] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.466135 12523 raft_consensus.cc:740] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.467686 12523 consensus_queue.cc:260] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.463289 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40cf2f63a9574e2098c933116f1700cc" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:51.473567 12523 ts_tablet_manager.cc:1434] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260620 13:58:51.474287 12523 tablet_bootstrap.cc:492] T 00f805a171a24872a79e07cc3a788290 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:51.474956 12475 raft_consensus.cc:3060] T 40cf2f63a9574e2098c933116f1700cc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.477588 12248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40cf2f63a9574e2098c933116f1700cc" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:51.466770 12665 leader_election.cc:290] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:51.478221 12248 raft_consensus.cc:3060] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.482108 12475 raft_consensus.cc:2468] T 40cf2f63a9574e2098c933116f1700cc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:51.483515 12364 leader_election.cc:304] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:51.492545 12665 raft_consensus.cc:2804] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:51.497773 12520 tablet_bootstrap.cc:492] T 99e449058fb942ddb74eb93a98cb4336 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:51.498425 12520 ts_tablet_manager.cc:1403] T 99e449058fb942ddb74eb93a98cb4336 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.123s	user 0.007s	sys 0.009s
I20260620 13:58:51.505440 12522 tablet_bootstrap.cc:492] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:51.505955 12522 ts_tablet_manager.cc:1403] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.126s	user 0.017s	sys 0.002s
I20260620 13:58:51.506942 12521 tablet_bootstrap.cc:654] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.507575 12248 raft_consensus.cc:2468] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:51.508823 12522 raft_consensus.cc:359] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:51.509627 12522 raft_consensus.cc:385] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.509896 12522 raft_consensus.cc:740] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.499928 12665 raft_consensus.cc:697] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:51.510530 12522 consensus_queue.cc:260] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:51.511353 12665 consensus_queue.cc:237] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.518797 12522 ts_tablet_manager.cc:1434] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260620 13:58:51.519672 12522 tablet_bootstrap.cc:492] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:51.527859 12520 raft_consensus.cc:359] T 99e449058fb942ddb74eb93a98cb4336 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.528566 12520 raft_consensus.cc:385] T 99e449058fb942ddb74eb93a98cb4336 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.528828 12520 raft_consensus.cc:740] T 99e449058fb942ddb74eb93a98cb4336 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.529446 12520 consensus_queue.cc:260] T 99e449058fb942ddb74eb93a98cb4336 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.531010 12520 ts_tablet_manager.cc:1434] T 99e449058fb942ddb74eb93a98cb4336 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.032s	user 0.000s	sys 0.003s
I20260620 13:58:51.531844 12520 tablet_bootstrap.cc:492] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:51.532059 12523 tablet_bootstrap.cc:654] T 00f805a171a24872a79e07cc3a788290 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.536461 12148 catalog_manager.cc:5696] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:51.553663 12520 tablet_bootstrap.cc:654] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.569442 12521 tablet_bootstrap.cc:492] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:51.569617 12523 tablet_bootstrap.cc:492] T 00f805a171a24872a79e07cc3a788290 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:51.570046 12521 ts_tablet_manager.cc:1403] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.196s	user 0.023s	sys 0.006s
I20260620 13:58:51.570149 12523 ts_tablet_manager.cc:1403] T 00f805a171a24872a79e07cc3a788290 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.026s
I20260620 13:58:51.573480 12521 raft_consensus.cc:359] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.574195 12521 raft_consensus.cc:385] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.576958 12523 raft_consensus.cc:359] T 00f805a171a24872a79e07cc3a788290 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.578621 12523 raft_consensus.cc:385] T 00f805a171a24872a79e07cc3a788290 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.578863 12523 raft_consensus.cc:740] T 00f805a171a24872a79e07cc3a788290 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.577719 12521 raft_consensus.cc:740] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.579718 12523 consensus_queue.cc:260] T 00f805a171a24872a79e07cc3a788290 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.582186 12521 consensus_queue.cc:260] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.599346 12521 ts_tablet_manager.cc:1434] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260620 13:58:51.599787 12522 tablet_bootstrap.cc:654] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.555425 12618 raft_consensus.cc:515] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.604355 12618 leader_election.cc:290] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:51.605263 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15db1e0a1aa646e281b8e1a998d8f6d4" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:51.606063 12319 raft_consensus.cc:3060] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.614017 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15db1e0a1aa646e281b8e1a998d8f6d4" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
W20260620 13:58:51.617332 12364 leader_election.cc:343] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:51.601171 12147 catalog_manager.cc:5696] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:51.604970 12618 raft_consensus.cc:493] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:51.637852 12521 tablet_bootstrap.cc:492] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:51.645156 12471 raft_consensus.cc:3060] T 00f805a171a24872a79e07cc3a788290 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.645861 12319 raft_consensus.cc:2468] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:51.647476 12367 leader_election.cc:304] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:51.648767 12713 raft_consensus.cc:2804] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:51.649293 12713 raft_consensus.cc:697] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:51.650187 12713 consensus_queue.cc:237] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.670042 12520 tablet_bootstrap.cc:492] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:51.670773 12520 ts_tablet_manager.cc:1403] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.139s	user 0.026s	sys 0.020s
I20260620 13:58:51.638800 12618 raft_consensus.cc:515] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:51.673552 12522 tablet_bootstrap.cc:492] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:51.677352 12522 ts_tablet_manager.cc:1403] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.158s	user 0.011s	sys 0.002s
I20260620 13:58:51.679783 12523 ts_tablet_manager.cc:1434] T 00f805a171a24872a79e07cc3a788290 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.010s
I20260620 13:58:51.681237 12523 tablet_bootstrap.cc:492] T e34e64f189e740e1bbebd03257e5af90 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:51.689941 12520 raft_consensus.cc:359] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.696015 12793 raft_consensus.cc:493] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:51.696899 12793 raft_consensus.cc:515] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.699229 12793 leader_election.cc:290] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:51.695959 12520 raft_consensus.cc:385] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.701628 12520 raft_consensus.cc:740] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.712237 12521 tablet_bootstrap.cc:654] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.711997 12522 raft_consensus.cc:359] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.712777 12522 raft_consensus.cc:385] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.713752 12520 consensus_queue.cc:260] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.713075 12522 raft_consensus.cc:740] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.713109 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61907296334d4a149ab81ba5337a1a27" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:51.722114 12520 ts_tablet_manager.cc:1434] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260620 13:58:51.723798 12520 tablet_bootstrap.cc:492] T ff3958c528894be19bfada85bc17a4ee P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:51.718590 12522 consensus_queue.cc:260] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.728410 12248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e449058fb942ddb74eb93a98cb4336" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:51.729100 12149 catalog_manager.cc:5696] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:51.729101 12248 raft_consensus.cc:2468] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 0.
I20260620 13:58:51.730947 12249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61907296334d4a149ab81ba5337a1a27" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
W20260620 13:58:51.732872 12364 leader_election.cc:343] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:51.725672 12618 leader_election.cc:290] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
W20260620 13:58:51.740918 12367 leader_election.cc:343] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:51.741415 12367 leader_election.cc:304] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:51.742386 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e449058fb942ddb74eb93a98cb4336" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:51.747985 12319 raft_consensus.cc:2468] T 99e449058fb942ddb74eb93a98cb4336 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 0.
I20260620 13:58:51.748524 12520 tablet_bootstrap.cc:654] T ff3958c528894be19bfada85bc17a4ee P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.743999 12665 raft_consensus.cc:2749] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:51.750298 12441 leader_election.cc:304] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:51.754796 12523 tablet_bootstrap.cc:654] T e34e64f189e740e1bbebd03257e5af90 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.769881 12532 raft_consensus.cc:2804] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:51.770354 12532 raft_consensus.cc:493] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:51.770699 12532 raft_consensus.cc:3060] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.774704 12522 ts_tablet_manager.cc:1434] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.000s
I20260620 13:58:51.776062 12522 tablet_bootstrap.cc:492] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:51.782974 12532 raft_consensus.cc:515] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.786335 12532 leader_election.cc:290] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:51.789958 12248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e449058fb942ddb74eb93a98cb4336" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:51.790640 12248 raft_consensus.cc:3060] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.791250 12520 tablet_bootstrap.cc:492] T ff3958c528894be19bfada85bc17a4ee P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:51.792163 12520 ts_tablet_manager.cc:1403] T ff3958c528894be19bfada85bc17a4ee P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.010s
I20260620 13:58:51.799759 12321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e449058fb942ddb74eb93a98cb4336" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:51.800881 12321 raft_consensus.cc:3060] T 99e449058fb942ddb74eb93a98cb4336 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.806423 12520 raft_consensus.cc:359] T ff3958c528894be19bfada85bc17a4ee P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.807701 12520 raft_consensus.cc:385] T ff3958c528894be19bfada85bc17a4ee P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.807986 12520 raft_consensus.cc:740] T ff3958c528894be19bfada85bc17a4ee P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.808706 12520 consensus_queue.cc:260] T ff3958c528894be19bfada85bc17a4ee P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.810907 12520 ts_tablet_manager.cc:1434] T ff3958c528894be19bfada85bc17a4ee P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.000s
I20260620 13:58:51.814688 12522 tablet_bootstrap.cc:654] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.818403 12520 tablet_bootstrap.cc:492] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:51.824249 12523 tablet_bootstrap.cc:492] T e34e64f189e740e1bbebd03257e5af90 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:51.824844 12523 ts_tablet_manager.cc:1403] T e34e64f189e740e1bbebd03257e5af90 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.144s	user 0.011s	sys 0.012s
I20260620 13:58:51.825887 12556 consensus_queue.cc:1048] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:51.840102 12584 raft_consensus.cc:493] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:51.840660 12584 raft_consensus.cc:515] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:51.843621 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a422539280460c895f371ef9eb8f4d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:51.844480 12319 raft_consensus.cc:2393] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d43d0ad579244c0a3ebb71069c1ab4f in current term 1: Already voted for candidate fcd1bd5dfea74c378a6154f83707154c in this term.
I20260620 13:58:51.844657 12520 tablet_bootstrap.cc:654] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.845985 12523 raft_consensus.cc:359] T e34e64f189e740e1bbebd03257e5af90 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.847455 12523 raft_consensus.cc:385] T e34e64f189e740e1bbebd03257e5af90 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.847723 12523 raft_consensus.cc:740] T e34e64f189e740e1bbebd03257e5af90 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.853540 12584 leader_election.cc:290] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:51.854771 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a422539280460c895f371ef9eb8f4d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:51.855580 12397 raft_consensus.cc:2393] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d43d0ad579244c0a3ebb71069c1ab4f in current term 1: Already voted for candidate c51ef915af09435db6046c91bb9d00e0 in this term.
I20260620 13:58:51.860400 12217 leader_election.cc:304] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:51.861629 12584 raft_consensus.cc:3060] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.851507 12523 consensus_queue.cc:260] T e34e64f189e740e1bbebd03257e5af90 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.873585 12321 raft_consensus.cc:2468] T 99e449058fb942ddb74eb93a98cb4336 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:58:51.875320 12523 ts_tablet_manager.cc:1434] T e34e64f189e740e1bbebd03257e5af90 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.002s
I20260620 13:58:51.875432 12441 leader_election.cc:304] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:51.876410 12523 tablet_bootstrap.cc:492] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:51.876436 12532 raft_consensus.cc:2804] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:51.877331 12532 raft_consensus.cc:697] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:58:51.878144 12532 consensus_queue.cc:237] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.881232 12521 tablet_bootstrap.cc:492] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:51.881812 12521 ts_tablet_manager.cc:1403] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.247s	user 0.019s	sys 0.016s
W20260620 13:58:51.884459 12197 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:58:51.888643 12523 tablet_bootstrap.cc:654] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:51.901659 12645 consensus_queue.cc:1048] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260620 13:58:51.912487 12523 tablet_bootstrap.cc:492] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:51.913130 12523 ts_tablet_manager.cc:1403] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.014s
I20260620 13:58:51.916074 12523 raft_consensus.cc:359] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.917469 12523 raft_consensus.cc:385] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.917831 12523 raft_consensus.cc:740] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.883458 12248 raft_consensus.cc:2468] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:58:51.919193 12147 catalog_manager.cc:5696] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 1 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:51.923358 12521 raft_consensus.cc:359] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.925297 12521 raft_consensus.cc:385] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.925688 12521 raft_consensus.cc:740] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.926787 12521 consensus_queue.cc:260] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.919178 12523 consensus_queue.cc:260] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:51.930037 12521 ts_tablet_manager.cc:1434] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260620 13:58:51.934659 12521 tablet_bootstrap.cc:492] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:51.939248 12522 tablet_bootstrap.cc:492] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:51.939934 12522 ts_tablet_manager.cc:1403] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.164s	user 0.021s	sys 0.016s
I20260620 13:58:51.942819 12522 raft_consensus.cc:359] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:51.943717 12522 raft_consensus.cc:385] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:51.944044 12522 raft_consensus.cc:740] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:51.946666 12523 ts_tablet_manager.cc:1434] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260620 13:58:51.950027 12522 consensus_queue.cc:260] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:51.962641 12522 ts_tablet_manager.cc:1434] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260620 13:58:51.964895 12522 tablet_bootstrap.cc:492] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:51.967432 12523 tablet_bootstrap.cc:492] T ff3958c528894be19bfada85bc17a4ee P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:51.973693 12556 raft_consensus.cc:493] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:51.974277 12556 raft_consensus.cc:515] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:51.977044 12471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e34e64f189e740e1bbebd03257e5af90" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:51.977671 12471 raft_consensus.cc:2468] T e34e64f189e740e1bbebd03257e5af90 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:51.979858 12249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e34e64f189e740e1bbebd03257e5af90" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:51.980518 12290 leader_election.cc:304] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:51.977706 12556 leader_election.cc:290] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:51.980587 12249 raft_consensus.cc:2468] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:51.981870 12556 raft_consensus.cc:2804] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:51.985412 12556 raft_consensus.cc:493] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:51.986222 12556 raft_consensus.cc:3060] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:51.987706 12584 raft_consensus.cc:2749] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:52.004300 12749 consensus_queue.cc:1048] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:52.009593 12556 raft_consensus.cc:515] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:52.029223 12520 tablet_bootstrap.cc:492] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:52.029795 12520 ts_tablet_manager.cc:1403] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.212s	user 0.021s	sys 0.009s
I20260620 13:58:52.035912 12618 raft_consensus.cc:493] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:52.036880 12618 raft_consensus.cc:515] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:52.042479 12618 leader_election.cc:290] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:52.045471 12521 tablet_bootstrap.cc:654] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.050173 12321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3958c528894be19bfada85bc17a4ee" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:52.050896 12321 raft_consensus.cc:2468] T ff3958c528894be19bfada85bc17a4ee P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:52.051496 12520 raft_consensus.cc:359] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:52.052170 12520 raft_consensus.cc:385] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:52.052428 12520 raft_consensus.cc:740] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:52.056151 12471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3958c528894be19bfada85bc17a4ee" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
W20260620 13:58:52.057482 12364 leader_election.cc:343] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:52.058866 12601 consensus_queue.cc:1048] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:52.061424 12367 leader_election.cc:304] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:52.065199 12601 raft_consensus.cc:2804] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:52.065627 12601 raft_consensus.cc:493] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:52.065968 12601 raft_consensus.cc:3060] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.067251 12734 consensus_queue.cc:1048] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:52.069202 12523 tablet_bootstrap.cc:654] T ff3958c528894be19bfada85bc17a4ee P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.083952 12713 consensus_queue.cc:1048] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:52.085685 12522 tablet_bootstrap.cc:654] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.087029 12520 consensus_queue.cc:260] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:52.075184 12556 leader_election.cc:290] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:52.092111 12520 ts_tablet_manager.cc:1434] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.002s
I20260620 13:58:52.093233 12520 tablet_bootstrap.cc:492] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:52.094257 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e34e64f189e740e1bbebd03257e5af90" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:52.094895 12473 raft_consensus.cc:3060] T e34e64f189e740e1bbebd03257e5af90 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.098052 12248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e34e64f189e740e1bbebd03257e5af90" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:52.098778 12248 raft_consensus.cc:3060] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.128115 12521 tablet_bootstrap.cc:492] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:52.128746 12521 ts_tablet_manager.cc:1403] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.198s	user 0.018s	sys 0.009s
I20260620 13:58:52.148286 12744 raft_consensus.cc:493] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:52.151042 12520 tablet_bootstrap.cc:654] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.143204 12473 raft_consensus.cc:2468] T e34e64f189e740e1bbebd03257e5af90 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:52.153664 12523 tablet_bootstrap.cc:492] T ff3958c528894be19bfada85bc17a4ee P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:52.154452 12523 ts_tablet_manager.cc:1403] T ff3958c528894be19bfada85bc17a4ee P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.187s	user 0.019s	sys 0.004s
I20260620 13:58:52.155292 12744 raft_consensus.cc:515] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:52.160780 12744 leader_election.cc:290] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:52.161681 12321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15db1e0a1aa646e281b8e1a998d8f6d4" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:52.162523 12321 raft_consensus.cc:2393] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69a98f1d9eda4cd9bdd2287823f798f6 in current term 1: Already voted for candidate c51ef915af09435db6046c91bb9d00e0 in this term.
I20260620 13:58:52.164633 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15db1e0a1aa646e281b8e1a998d8f6d4" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:52.167034 12440 leader_election.cc:304] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:52.168133 12793 raft_consensus.cc:3060] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.185478 12601 raft_consensus.cc:515] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:52.186728 12290 leader_election.cc:304] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:52.191975 12521 raft_consensus.cc:359] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:52.193974 12523 raft_consensus.cc:359] T ff3958c528894be19bfada85bc17a4ee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:52.194828 12521 raft_consensus.cc:385] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:52.194893 12523 raft_consensus.cc:385] T ff3958c528894be19bfada85bc17a4ee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:52.195261 12521 raft_consensus.cc:740] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:52.196075 12808 raft_consensus.cc:2804] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:52.196557 12808 raft_consensus.cc:697] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:52.197311 12248 raft_consensus.cc:2468] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:52.197407 12808 consensus_queue.cc:237] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:52.195341 12523 raft_consensus.cc:740] T ff3958c528894be19bfada85bc17a4ee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:52.199380 12523 consensus_queue.cc:260] T ff3958c528894be19bfada85bc17a4ee P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:52.201419 12523 ts_tablet_manager.cc:1434] T ff3958c528894be19bfada85bc17a4ee P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.047s	user 0.002s	sys 0.003s
I20260620 13:58:52.202442 12523 tablet_bootstrap.cc:492] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:52.207808 12522 tablet_bootstrap.cc:492] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:52.208353 12522 ts_tablet_manager.cc:1403] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.244s	user 0.005s	sys 0.010s
I20260620 13:58:52.205641 12521 consensus_queue.cc:260] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:52.223683 12522 raft_consensus.cc:359] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:52.224512 12522 raft_consensus.cc:385] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:52.224818 12522 raft_consensus.cc:740] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:52.225522 12522 consensus_queue.cc:260] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:52.227809 12522 ts_tablet_manager.cc:1434] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260620 13:58:52.228202 12521 ts_tablet_manager.cc:1434] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.001s
I20260620 13:58:52.229266 12521 tablet_bootstrap.cc:492] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:52.232151 12523 tablet_bootstrap.cc:654] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.240707 12522 tablet_bootstrap.cc:492] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:52.244831 12793 raft_consensus.cc:2749] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:52.249325 12321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3958c528894be19bfada85bc17a4ee" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:52.250007 12321 raft_consensus.cc:3060] T ff3958c528894be19bfada85bc17a4ee P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.255460 12601 leader_election.cc:290] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:52.260147 12520 tablet_bootstrap.cc:492] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:52.260751 12520 ts_tablet_manager.cc:1403] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.168s	user 0.018s	sys 0.012s
I20260620 13:58:52.261224 12321 raft_consensus.cc:2468] T ff3958c528894be19bfada85bc17a4ee P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:52.262728 12367 leader_election.cc:304] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:52.261734 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3958c528894be19bfada85bc17a4ee" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:52.264703 12475 raft_consensus.cc:3060] T ff3958c528894be19bfada85bc17a4ee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.266145 12521 tablet_bootstrap.cc:654] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.264325 12520 raft_consensus.cc:359] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:52.266745 12520 raft_consensus.cc:385] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:52.267081 12520 raft_consensus.cc:740] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:52.269605 12520 consensus_queue.cc:260] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:52.264143 12601 raft_consensus.cc:2804] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:52.275229 12601 raft_consensus.cc:697] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:52.275811 12146 catalog_manager.cc:5696] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 1 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:52.277446 12601 consensus_queue.cc:237] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:52.276463 12520 ts_tablet_manager.cc:1434] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260620 13:58:52.278293 12522 tablet_bootstrap.cc:654] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.285393 12520 tablet_bootstrap.cc:492] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:52.296908 12665 consensus_queue.cc:1048] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:52.305509 12475 raft_consensus.cc:2468] T ff3958c528894be19bfada85bc17a4ee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:52.319767 12713 consensus_queue.cc:1048] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:52.340487 12147 catalog_manager.cc:5696] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:52.345937 12809 raft_consensus.cc:493] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:52.346678 12809 raft_consensus.cc:515] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:52.351043 12248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee8de600a8646df90a272c586e08ae5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:52.351722 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee8de600a8646df90a272c586e08ae5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:52.352078 12248 raft_consensus.cc:2468] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:52.353981 12293 leader_election.cc:304] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
W20260620 13:58:52.355060 12292 leader_election.cc:343] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:52.356516 12556 raft_consensus.cc:2804] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:52.357028 12809 leader_election.cc:290] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:52.357056 12556 raft_consensus.cc:493] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:52.358711 12556 raft_consensus.cc:3060] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.365404 12520 tablet_bootstrap.cc:654] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.360162 12523 tablet_bootstrap.cc:492] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:52.367504 12523 ts_tablet_manager.cc:1403] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.165s	user 0.018s	sys 0.000s
I20260620 13:58:52.351341 12808 raft_consensus.cc:493] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:52.373682 12808 raft_consensus.cc:515] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:52.376545 12808 leader_election.cc:290] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:52.378648 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369e0ab28a64476cb0e07ab5672b9337" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:52.387602 12248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369e0ab28a64476cb0e07ab5672b9337" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
W20260620 13:58:52.389971 12293 leader_election.cc:343] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:52.394464 12793 consensus_queue.cc:1048] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:52.422266 12521 tablet_bootstrap.cc:492] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:52.422919 12521 ts_tablet_manager.cc:1403] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.194s	user 0.015s	sys 0.025s
I20260620 13:58:52.433115 12556 raft_consensus.cc:515] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:52.439766 12523 raft_consensus.cc:359] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:52.472043 12523 raft_consensus.cc:385] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:52.472385 12523 raft_consensus.cc:740] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:52.472919 12248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee8de600a8646df90a272c586e08ae5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:52.473064 12523 consensus_queue.cc:260] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:52.473569 12248 raft_consensus.cc:3060] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.475690 12556 leader_election.cc:290] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:52.469141 12521 raft_consensus.cc:359] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:52.476310 12521 raft_consensus.cc:385] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:52.476608 12521 raft_consensus.cc:740] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:52.476642 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee8de600a8646df90a272c586e08ae5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:52.477370 12521 consensus_queue.cc:260] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:52.478228 12398 raft_consensus.cc:3060] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.478961 12521 ts_tablet_manager.cc:1434] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.055s	user 0.002s	sys 0.009s
I20260620 13:58:52.479974 12521 tablet_bootstrap.cc:492] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:52.480769 12522 tablet_bootstrap.cc:492] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:52.481292 12522 ts_tablet_manager.cc:1403] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.241s	user 0.020s	sys 0.007s
I20260620 13:58:52.484042 12522 raft_consensus.cc:359] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
W20260620 13:58:52.485566 12290 leader_election.cc:343] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:52.489032 12521 tablet_bootstrap.cc:654] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.489171 12523 ts_tablet_manager.cc:1434] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.121s	user 0.009s	sys 0.005s
I20260620 13:58:52.501590 12523 tablet_bootstrap.cc:492] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:52.489765 12522 raft_consensus.cc:385] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:52.502432 12522 raft_consensus.cc:740] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:52.490816 12398 raft_consensus.cc:2468] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:52.505533 12522 consensus_queue.cc:260] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:52.512518 12532 consensus_queue.cc:1048] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:52.516613 12522 ts_tablet_manager.cc:1434] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
I20260620 13:58:52.517823 12522 tablet_bootstrap.cc:492] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:52.505692 12290 leader_election.cc:304] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:52.524823 12523 tablet_bootstrap.cc:654] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.534060 12556 raft_consensus.cc:2749] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 13:58:52.538509 12290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 52970.2us
I20260620 13:58:52.563141 12520 tablet_bootstrap.cc:492] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:52.563644 12520 ts_tablet_manager.cc:1403] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.279s	user 0.024s	sys 0.013s
I20260620 13:58:52.565181 12292 leader_election.cc:304] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:52.566759 12556 raft_consensus.cc:2804] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:52.567497 12556 raft_consensus.cc:697] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:52.566599 12520 raft_consensus.cc:359] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:52.569031 12520 raft_consensus.cc:385] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:52.568653 12556 consensus_queue.cc:237] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:52.569347 12520 raft_consensus.cc:740] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:52.570050 12520 consensus_queue.cc:260] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:52.574967 12520 ts_tablet_manager.cc:1434] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260620 13:58:52.575176 12248 raft_consensus.cc:2468] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:52.583685 12522 tablet_bootstrap.cc:654] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.591917 12520 tablet_bootstrap.cc:492] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:52.598752 12749 raft_consensus.cc:493] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:52.603780 12749 raft_consensus.cc:515] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:52.606096 12749 leader_election.cc:290] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:52.607852 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a422539280460c895f371ef9eb8f4d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:52.608569 12398 raft_consensus.cc:2468] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:52.610792 12292 leader_election.cc:304] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:52.615155 12247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a422539280460c895f371ef9eb8f4d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:52.615769 12809 raft_consensus.cc:2804] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:58:52.615885 12247 raft_consensus.cc:2468] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:52.616226 12809 raft_consensus.cc:493] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:52.616593 12809 raft_consensus.cc:3060] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:58:52.619236 12520 tablet_bootstrap.cc:654] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.620172 12601 raft_consensus.cc:493] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:52.623165 12734 raft_consensus.cc:493] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:52.630718 12601 raft_consensus.cc:515] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:52.644131 12601 leader_election.cc:290] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:52.648321 12471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51af9cbc1bcc4e1cbd3c5c37e44f865b" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:52.635607 12734 raft_consensus.cc:515] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
W20260620 13:58:52.651705 12364 leader_election.cc:343] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:52.652854 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61907296334d4a149ab81ba5337a1a27" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:52.653538 12397 raft_consensus.cc:2468] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:52.654892 12217 leader_election.cc:304] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:52.657008 12734 leader_election.cc:290] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:52.657348 12471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61907296334d4a149ab81ba5337a1a27" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:52.661523 12734 raft_consensus.cc:2804] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:52.668478 12523 tablet_bootstrap.cc:492] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:52.669220 12523 ts_tablet_manager.cc:1403] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.168s	user 0.016s	sys 0.002s
W20260620 13:58:52.663388 12215 leader_election.cc:343] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:52.695202 12523 raft_consensus.cc:359] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:52.700064 12523 raft_consensus.cc:385] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:52.703750 12523 raft_consensus.cc:740] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:52.702873 12521 tablet_bootstrap.cc:492] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:52.711684 12521 ts_tablet_manager.cc:1403] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.232s	user 0.012s	sys 0.012s
I20260620 13:58:52.709193 12809 raft_consensus.cc:515] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:52.663746 12734 raft_consensus.cc:493] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:52.696086 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51af9cbc1bcc4e1cbd3c5c37e44f865b" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:52.714623 12522 tablet_bootstrap.cc:492] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:52.717921 12584 raft_consensus.cc:493] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:52.718453 12584 raft_consensus.cc:515] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:52.717944 12319 raft_consensus.cc:2468] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:52.720902 12584 leader_election.cc:290] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:52.721131 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369e0ab28a64476cb0e07ab5672b9337" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:52.716068 12734 raft_consensus.cc:3060] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.721949 12475 raft_consensus.cc:2468] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:52.723479 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369e0ab28a64476cb0e07ab5672b9337" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:52.724443 12323 raft_consensus.cc:2468] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:52.726262 12218 leader_election.cc:304] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:52.730810 12367 leader_election.cc:304] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:52.731839 12584 raft_consensus.cc:2804] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:52.732235 12522 ts_tablet_manager.cc:1403] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.215s	user 0.015s	sys 0.004s
I20260620 13:58:52.732115 12601 raft_consensus.cc:2804] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:52.732748 12601 raft_consensus.cc:493] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:52.733107 12601 raft_consensus.cc:3060] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.739327 12521 raft_consensus.cc:359] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:52.740176 12521 raft_consensus.cc:385] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:52.738960 12584 raft_consensus.cc:493] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:52.741504 12584 raft_consensus.cc:3060] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.742044 12734 raft_consensus.cc:515] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:52.740543 12521 raft_consensus.cc:740] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:52.716753 12523 consensus_queue.cc:260] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:52.747180 12521 consensus_queue.cc:260] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:52.756069 12521 ts_tablet_manager.cc:1434] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260620 13:58:52.757763 12523 ts_tablet_manager.cc:1434] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.088s	user 0.010s	sys 0.000s
I20260620 13:58:52.759955 12523 tablet_bootstrap.cc:492] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:52.750914 12734 leader_election.cc:290] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:52.753207 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61907296334d4a149ab81ba5337a1a27" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:52.752506 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a422539280460c895f371ef9eb8f4d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:52.763028 12397 raft_consensus.cc:3060] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:58:52.767766 12215 leader_election.cc:343] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:58:52.739432 12217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.195:37673, user_credentials={real_user=slave}} blocked reactor thread for 84627.5us
I20260620 13:58:52.748545 12809 leader_election.cc:290] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:52.787598 12618 consensus_queue.cc:1048] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:52.798627 12601 raft_consensus.cc:515] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:52.786494 12522 raft_consensus.cc:359] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:52.799777 12523 tablet_bootstrap.cc:654] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.804385 12522 raft_consensus.cc:385] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:52.803489 12521 tablet_bootstrap.cc:492] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:52.804754 12522 raft_consensus.cc:740] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:52.802495 12148 catalog_manager.cc:5696] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 1 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
W20260620 13:58:52.746531 12293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 120414us
I20260620 13:58:52.813800 12601 leader_election.cc:290] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:52.814843 12471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51af9cbc1bcc4e1cbd3c5c37e44f865b" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
W20260620 13:58:52.816540 12364 leader_election.cc:343] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:52.818451 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51af9cbc1bcc4e1cbd3c5c37e44f865b" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:52.819137 12323 raft_consensus.cc:3060] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.831494 12522 consensus_queue.cc:260] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:52.832746 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61907296334d4a149ab81ba5337a1a27" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:52.833422 12399 raft_consensus.cc:3060] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.834103 12522 ts_tablet_manager.cc:1434] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.099s	user 0.005s	sys 0.001s
I20260620 13:58:52.834528 12520 tablet_bootstrap.cc:492] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:52.835012 12520 ts_tablet_manager.cc:1403] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.246s	user 0.029s	sys 0.039s
I20260620 13:58:52.836695 12397 raft_consensus.cc:2468] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 2.
I20260620 13:58:52.838042 12520 raft_consensus.cc:359] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:52.839641 12520 raft_consensus.cc:385] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:52.839924 12520 raft_consensus.cc:740] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:52.840297 12834 raft_consensus.cc:493] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:52.840752 12520 consensus_queue.cc:260] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:52.841055 12834 raft_consensus.cc:515] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:52.835062 12522 tablet_bootstrap.cc:492] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:52.843734 12520 ts_tablet_manager.cc:1434] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260620 13:58:52.844287 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918029829d594bafac9e17a30edcacee" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:52.844707 12520 tablet_bootstrap.cc:492] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
W20260620 13:58:52.846482 12440 leader_election.cc:343] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:52.850204 12522 tablet_bootstrap.cc:654] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.850608 12521 tablet_bootstrap.cc:654] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.851439 12520 tablet_bootstrap.cc:654] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:52.851558 12292 leader_election.cc:304] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:52.852463 12809 raft_consensus.cc:2804] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:58:52.853040 12809 raft_consensus.cc:697] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:52.865628 12837 consensus_queue.cc:1048] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260620 13:58:52.853895 12809 consensus_queue.cc:237] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:52.881016 12584 raft_consensus.cc:515] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:52.873687 12323 raft_consensus.cc:2468] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:52.892221 12720 raft_consensus.cc:493] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:52.892807 12720 raft_consensus.cc:515] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:52.884919 12834 leader_election.cc:290] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:52.899561 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edd30f224ff4b17bc0d671c619c821b" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:52.901859 12399 raft_consensus.cc:2468] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
W20260620 13:58:52.906883 12292 leader_election.cc:343] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:52.895215 12367 leader_election.cc:304] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:52.913517 12321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369e0ab28a64476cb0e07ab5672b9337" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:52.914186 12321 raft_consensus.cc:3060] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.915251 12618 raft_consensus.cc:2804] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:52.915812 12618 raft_consensus.cc:697] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:52.916620 12618 consensus_queue.cc:237] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:52.918498 12584 leader_election.cc:290] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:52.926025 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a422539280460c895f371ef9eb8f4d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:52.926733 12252 raft_consensus.cc:3060] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:58:52.903067 12720 leader_election.cc:290] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:52.933350 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369e0ab28a64476cb0e07ab5672b9337" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:52.934041 12469 raft_consensus.cc:3060] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:52.938712 12252 raft_consensus.cc:2468] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 2.
I20260620 13:58:52.940245 12321 raft_consensus.cc:2468] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:52.941248 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918029829d594bafac9e17a30edcacee" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:52.941435 12218 leader_election.cc:304] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:52.942556 12584 raft_consensus.cc:2804] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
W20260620 13:58:52.943019 12441 leader_election.cc:343] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:52.943327 12584 raft_consensus.cc:697] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:58:52.943579 12441 leader_election.cc:304] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:52.944959 12834 raft_consensus.cc:2749] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:52.946646 12523 tablet_bootstrap.cc:492] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:52.951673 12523 ts_tablet_manager.cc:1403] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.192s	user 0.010s	sys 0.009s
I20260620 13:58:52.944727 12584 consensus_queue.cc:237] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:52.950409 12713 consensus_queue.cc:1048] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:52.962735 12520 tablet_bootstrap.cc:492] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:52.963286 12520 ts_tablet_manager.cc:1403] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.119s	user 0.016s	sys 0.012s
I20260620 13:58:52.966046 12520 raft_consensus.cc:359] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:52.966707 12520 raft_consensus.cc:385] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:52.967509 12217 leader_election.cc:304] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:52.969720 12522 tablet_bootstrap.cc:492] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:52.970494 12522 ts_tablet_manager.cc:1403] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.136s	user 0.023s	sys 0.023s
I20260620 13:58:52.966979 12520 raft_consensus.cc:740] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:52.976784 12734 raft_consensus.cc:2804] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:52.977370 12734 raft_consensus.cc:697] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:58:52.978065 12520 consensus_queue.cc:260] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:52.979945 12734 consensus_queue.cc:237] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:52.984309 12522 raft_consensus.cc:359] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:52.985073 12522 raft_consensus.cc:385] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:52.985329 12522 raft_consensus.cc:740] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:52.991381 12522 consensus_queue.cc:260] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:52.998651 12248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edd30f224ff4b17bc0d671c619c821b" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:53.005373 12523 raft_consensus.cc:359] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:53.006145 12523 raft_consensus.cc:385] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:53.006422 12523 raft_consensus.cc:740] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:53.007058 12523 consensus_queue.cc:260] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:53.008267 12520 ts_tablet_manager.cc:1434] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260620 13:58:53.009649 12520 tablet_bootstrap.cc:492] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:53.005023 12149 catalog_manager.cc:5696] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 0 to 2, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 2 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:53.028558 12521 tablet_bootstrap.cc:492] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:53.029106 12521 ts_tablet_manager.cc:1403] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.226s	user 0.010s	sys 0.002s
W20260620 13:58:53.038864 12293 leader_election.cc:343] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:53.039489 12293 leader_election.cc:304] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:53.040230 12809 consensus_queue.cc:1048] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:53.040864 12839 raft_consensus.cc:493] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:53.041400 12839 raft_consensus.cc:515] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:53.041993 12520 tablet_bootstrap.cc:654] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:53.044446 12809 raft_consensus.cc:2749] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260620 13:58:53.046281 12197 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:58:53.046686 12522 ts_tablet_manager.cc:1434] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.001s
I20260620 13:58:53.046384 12521 raft_consensus.cc:359] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:53.047196 12521 raft_consensus.cc:385] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:53.047508 12521 raft_consensus.cc:740] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:53.047699 12522 tablet_bootstrap.cc:492] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:53.048241 12521 consensus_queue.cc:260] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:53.050741 12521 ts_tablet_manager.cc:1434] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260620 13:58:53.051661 12521 tablet_bootstrap.cc:492] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:53.054557 12469 raft_consensus.cc:2468] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:53.057236 12523 ts_tablet_manager.cc:1434] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.105s	user 0.006s	sys 0.001s
I20260620 13:58:53.060824 12521 tablet_bootstrap.cc:654] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:53.065778 12523 tablet_bootstrap.cc:492] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:53.091671 12839 leader_election.cc:290] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:53.096082 12149 catalog_manager.cc:5696] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:53.099366 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c50f25282d94111a4d435e85e67af34" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:53.105847 12469 raft_consensus.cc:2468] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:53.091719 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c50f25282d94111a4d435e85e67af34" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:53.107542 12397 raft_consensus.cc:2468] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:53.108959 12215 leader_election.cc:304] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:53.111986 12645 raft_consensus.cc:2804] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:53.112560 12645 raft_consensus.cc:493] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:53.112950 12645 raft_consensus.cc:3060] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:53.149322 12523 tablet_bootstrap.cc:654] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:53.183562 12809 consensus_queue.cc:1048] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:53.188755 12842 raft_consensus.cc:493] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:53.193804 12148 catalog_manager.cc:5696] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:53.199514 12842 raft_consensus.cc:515] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:53.201853 12842 leader_election.cc:290] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:53.190156 12522 tablet_bootstrap.cc:654] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:53.203346 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe9fd2ff66d4141a2c7f7023278714d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:53.203801 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe9fd2ff66d4141a2c7f7023278714d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
W20260620 13:58:53.204797 12293 leader_election.cc:343] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:53.207376 12842 consensus_queue.cc:1048] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 13:58:53.207600 12292 leader_election.cc:343] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:53.208464 12292 leader_election.cc:304] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:53.191046 12645 raft_consensus.cc:515] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:53.190994 12521 tablet_bootstrap.cc:492] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:53.210130 12521 ts_tablet_manager.cc:1403] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.159s	user 0.008s	sys 0.005s
I20260620 13:58:53.198596 12520 tablet_bootstrap.cc:492] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:53.209465 12837 raft_consensus.cc:2749] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:53.211212 12520 ts_tablet_manager.cc:1403] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.202s	user 0.011s	sys 0.003s
I20260620 13:58:53.212980 12521 raft_consensus.cc:359] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:53.212235 12148 catalog_manager.cc:5696] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:53.213675 12521 raft_consensus.cc:385] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:53.214017 12521 raft_consensus.cc:740] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:53.213939 12520 raft_consensus.cc:359] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:53.214773 12520 raft_consensus.cc:385] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:53.215138 12520 raft_consensus.cc:740] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:53.216468 12520 consensus_queue.cc:260] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:53.218556 12645 leader_election.cc:290] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:53.214841 12521 consensus_queue.cc:260] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:53.221462 12521 ts_tablet_manager.cc:1434] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260620 13:58:53.225625 12521 tablet_bootstrap.cc:492] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:53.231492 12520 ts_tablet_manager.cc:1434] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260620 13:58:53.232915 12520 tablet_bootstrap.cc:492] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:53.222409 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c50f25282d94111a4d435e85e67af34" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:53.235585 12399 raft_consensus.cc:3060] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:53.235713 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c50f25282d94111a4d435e85e67af34" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:53.236353 12469 raft_consensus.cc:3060] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:53.243326 12399 raft_consensus.cc:2468] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:53.259641 12521 tablet_bootstrap.cc:654] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:53.267655 12217 leader_election.cc:304] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:53.268764 12734 raft_consensus.cc:2804] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:53.269292 12734 raft_consensus.cc:697] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:58:53.270131 12734 consensus_queue.cc:237] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:53.280242 12618 raft_consensus.cc:493] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:53.280764 12618 raft_consensus.cc:515] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:53.282727 12469 raft_consensus.cc:2468] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:53.284216 12247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918029829d594bafac9e17a30edcacee" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:53.285745 12618 leader_election.cc:290] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
W20260620 13:58:53.286568 12367 leader_election.cc:343] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:53.289106 12523 tablet_bootstrap.cc:492] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:53.289813 12523 ts_tablet_manager.cc:1403] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.224s	user 0.012s	sys 0.002s
I20260620 13:58:53.293314 12523 raft_consensus.cc:359] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:53.294662 12523 raft_consensus.cc:385] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:53.294947 12523 raft_consensus.cc:740] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:53.297098 12522 tablet_bootstrap.cc:492] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:53.297791 12522 ts_tablet_manager.cc:1403] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.250s	user 0.017s	sys 0.005s
I20260620 13:58:53.301093 12522 raft_consensus.cc:359] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:53.301779 12522 raft_consensus.cc:385] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:53.302045 12522 raft_consensus.cc:740] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:53.302711 12522 consensus_queue.cc:260] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:53.304255 12523 consensus_queue.cc:260] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:53.306222 12522 ts_tablet_manager.cc:1434] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260620 13:58:53.307257 12522 tablet_bootstrap.cc:492] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:53.323182 12523 ts_tablet_manager.cc:1434] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260620 13:58:53.324332 12523 tablet_bootstrap.cc:492] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:53.318845 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918029829d594bafac9e17a30edcacee" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:53.329303 12471 raft_consensus.cc:3060] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:53.331022 12523 tablet_bootstrap.cc:654] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:53.334693 12469 raft_consensus.cc:2468] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:53.339293 12364 leader_election.cc:304] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:58:53.340155 12618 raft_consensus.cc:2804] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:53.340492 12618 raft_consensus.cc:493] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:53.340818 12618 raft_consensus.cc:3060] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:53.341907 12520 tablet_bootstrap.cc:654] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:53.347713 12252 raft_consensus.cc:1275] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Refusing update from remote peer fcd1bd5dfea74c378a6154f83707154c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260620 13:58:53.351394 12809 consensus_queue.cc:1048] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:53.360884 12820 consensus_queue.cc:1048] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:53.363432 12734 raft_consensus.cc:493] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:53.363973 12734 raft_consensus.cc:515] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:53.366182 12734 leader_election.cc:290] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:53.359062 12149 catalog_manager.cc:5696] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:53.366957 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d587f93178449aa9441f0d350cc166d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:53.367762 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d587f93178449aa9441f0d350cc166d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:53.368479 12323 raft_consensus.cc:2468] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
W20260620 13:58:53.368870 12215 leader_election.cc:343] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:53.370055 12218 leader_election.cc:304] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:53.371368 12734 raft_consensus.cc:2804] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:53.371924 12734 raft_consensus.cc:493] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:53.372427 12734 raft_consensus.cc:3060] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:53.380018 12713 raft_consensus.cc:493] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:53.380756 12713 raft_consensus.cc:515] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:53.383203 12713 leader_election.cc:290] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:53.387907 12247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edd30f224ff4b17bc0d671c619c821b" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:53.388855 12247 raft_consensus.cc:2468] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:53.389892 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edd30f224ff4b17bc0d671c619c821b" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:53.390561 12323 raft_consensus.cc:2468] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:53.392066 12367 leader_election.cc:304] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:53.400607 12522 tablet_bootstrap.cc:654] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:53.407327 12713 raft_consensus.cc:2804] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:53.412439 12713 raft_consensus.cc:493] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:53.412907 12713 raft_consensus.cc:3060] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:53.390889 12618 raft_consensus.cc:515] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:53.442840 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918029829d594bafac9e17a30edcacee" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:53.443699 12469 raft_consensus.cc:3060] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:58:53.457875 12864 log.cc:927] Time spent T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260620 13:58:53.470105 12523 tablet_bootstrap.cc:492] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:53.470580 12521 tablet_bootstrap.cc:492] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:53.470726 12523 ts_tablet_manager.cc:1403] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.147s	user 0.012s	sys 0.019s
I20260620 13:58:53.471601 12521 ts_tablet_manager.cc:1403] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.248s	user 0.033s	sys 0.030s
I20260620 13:58:53.472617 12520 tablet_bootstrap.cc:492] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:53.473275 12520 ts_tablet_manager.cc:1403] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.241s	user 0.009s	sys 0.012s
W20260620 13:58:53.474844 12367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 82890.3us
I20260620 13:58:53.477137 12618 leader_election.cc:290] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:53.489534 12248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918029829d594bafac9e17a30edcacee" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:53.495028 12840 consensus_queue.cc:1048] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:53.497020 12734 raft_consensus.cc:515] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
W20260620 13:58:53.495427 12367 leader_election.cc:343] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:58:53.503326 12770 log.cc:927] Time spent T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea: Append to log took a long time: real 0.091s	user 0.006s	sys 0.014s
I20260620 13:58:53.532128 12734 leader_election.cc:290] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:53.563499 12521 raft_consensus.cc:359] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:53.564006 12471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d587f93178449aa9441f0d350cc166d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:53.564471 12521 raft_consensus.cc:385] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:53.471290 12713 raft_consensus.cc:515] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:53.569024 12870 consensus_queue.cc:1048] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:53.571094 12247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edd30f224ff4b17bc0d671c619c821b" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:53.571852 12247 raft_consensus.cc:3060] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:53.530092 12520 raft_consensus.cc:359] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:53.572918 12520 raft_consensus.cc:385] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:53.573231 12520 raft_consensus.cc:740] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:53.581063 12397 raft_consensus.cc:1275] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer fcd1bd5dfea74c378a6154f83707154c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260620 13:58:53.582190 12522 tablet_bootstrap.cc:492] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:53.582700 12522 ts_tablet_manager.cc:1403] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.276s	user 0.027s	sys 0.029s
I20260620 13:58:53.587257 12247 raft_consensus.cc:2468] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:53.564800 12521 raft_consensus.cc:740] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:53.588502 12367 leader_election.cc:304] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:53.589623 12584 consensus_queue.cc:1048] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:53.590281 12469 raft_consensus.cc:2468] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:53.590512 12324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edd30f224ff4b17bc0d671c619c821b" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:53.574723 12321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d587f93178449aa9441f0d350cc166d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:53.592454 12321 raft_consensus.cc:3060] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:53.588512 12521 consensus_queue.cc:260] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:53.548058 12523 raft_consensus.cc:359] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:53.593398 12523 raft_consensus.cc:385] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:53.589478 12872 raft_consensus.cc:2804] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:53.593816 12523 raft_consensus.cc:740] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:53.594120 12872 raft_consensus.cc:697] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:53.595796 12521 ts_tablet_manager.cc:1434] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.124s	user 0.006s	sys 0.002s
I20260620 13:58:53.597779 12521 tablet_bootstrap.cc:492] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:53.598742 12584 consensus_queue.cc:1048] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:53.599874 12872 consensus_queue.cc:237] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:53.594789 12523 consensus_queue.cc:260] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:53.601645 12471 raft_consensus.cc:3060] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:53.601574 12837 consensus_queue.cc:1048] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:53.603631 12521 tablet_bootstrap.cc:654] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:53.609462 12523 ts_tablet_manager.cc:1434] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.138s	user 0.007s	sys 0.000s
I20260620 13:58:53.610469 12523 tablet_bootstrap.cc:492] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:53.631989 12364 leader_election.cc:304] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
W20260620 13:58:53.632154 12215 consensus_peers.cc:597] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f -> Peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Couldn't send request to peer 69a98f1d9eda4cd9bdd2287823f798f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:53.636029 12870 raft_consensus.cc:2804] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:53.637547 12870 raft_consensus.cc:697] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:53.573860 12520 consensus_queue.cc:260] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:53.585422 12522 raft_consensus.cc:359] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:53.591501 12713 leader_election.cc:290] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:53.591356 12324 raft_consensus.cc:3060] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:53.644222 12522 raft_consensus.cc:385] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:53.675443 12522 raft_consensus.cc:740] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:53.638607 12870 consensus_queue.cc:237] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:53.689215 12520 ts_tablet_manager.cc:1434] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.216s	user 0.007s	sys 0.002s
I20260620 13:58:53.691941 12523 tablet_bootstrap.cc:654] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:53.688370 12522 consensus_queue.cc:260] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:53.695641 12713 raft_consensus.cc:493] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:53.696197 12713 raft_consensus.cc:515] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:53.701709 12520 tablet_bootstrap.cc:492] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:53.709468 12522 ts_tablet_manager.cc:1434] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.126s	user 0.007s	sys 0.006s
I20260620 13:58:53.710914 12522 tablet_bootstrap.cc:492] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:53.717536 12521 tablet_bootstrap.cc:492] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:53.725107 12521 ts_tablet_manager.cc:1403] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.128s	user 0.036s	sys 0.041s
I20260620 13:58:53.739171 12645 raft_consensus.cc:493] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:53.739774 12645 raft_consensus.cc:515] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:53.740726 12713 leader_election.cc:290] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:53.741760 12645 leader_election.cc:290] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:53.746379 12321 raft_consensus.cc:2468] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:53.757614 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75286f26552b4e788b3844d3aa342b01" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
W20260620 13:58:53.764329 12367 leader_election.cc:343] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:53.767824 12218 leader_election.cc:304] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:53.768985 12840 raft_consensus.cc:2804] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:53.769505 12840 raft_consensus.cc:697] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:58:53.770399 12840 consensus_queue.cc:237] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:53.764531 12471 raft_consensus.cc:2468] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:53.825623 12720 raft_consensus.cc:493] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:53.852450 12522 tablet_bootstrap.cc:654] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:53.866190 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75286f26552b4e788b3844d3aa342b01" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:53.843231 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa301d02030498583d201921146bb89" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:53.842276 12720 raft_consensus.cc:515] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
W20260620 13:58:53.889945 12364 leader_election.cc:343] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:53.890440 12364 leader_election.cc:304] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:53.895669 12713 raft_consensus.cc:2749] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:53.897891 12324 raft_consensus.cc:2468] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:53.906311 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa301d02030498583d201921146bb89" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:53.913048 12720 leader_election.cc:290] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:53.914667 12521 raft_consensus.cc:359] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:53.915397 12521 raft_consensus.cc:385] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:53.915673 12521 raft_consensus.cc:740] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:53.916347 12521 consensus_queue.cc:260] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:53.918759 12521 ts_tablet_manager.cc:1434] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.193s	user 0.000s	sys 0.006s
I20260620 13:58:53.925628 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9724c70f584a9c8aced9cc416e027d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
W20260620 13:58:53.932078 12215 leader_election.cc:343] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:53.937147 12734 consensus_queue.cc:1048] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:53.932080 12520 tablet_bootstrap.cc:654] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:53.942898 12521 tablet_bootstrap.cc:492] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
W20260620 13:58:53.942833 12292 leader_election.cc:343] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:53.946563 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9724c70f584a9c8aced9cc416e027d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:53.982120 12584 consensus_queue.cc:1048] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260620 13:58:53.989246 12523 tablet_bootstrap.cc:492] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:53.989944 12523 ts_tablet_manager.cc:1403] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.380s	user 0.023s	sys 0.057s
W20260620 13:58:53.985127 12290 leader_election.cc:343] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:54.008482 12523 raft_consensus.cc:359] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:54.012698 12520 tablet_bootstrap.cc:492] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:54.012591 12523 raft_consensus.cc:385] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:54.013353 12520 ts_tablet_manager.cc:1403] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.312s	user 0.018s	sys 0.010s
I20260620 13:58:54.013302 12523 raft_consensus.cc:740] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:54.022096 12522 tablet_bootstrap.cc:492] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:54.026255 12522 ts_tablet_manager.cc:1403] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.316s	user 0.041s	sys 0.020s
I20260620 13:58:54.027618 12523 consensus_queue.cc:260] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:54.029855 12523 ts_tablet_manager.cc:1434] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.000s
I20260620 13:58:54.030791 12523 tablet_bootstrap.cc:492] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:54.014461 12290 leader_election.cc:304] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0
W20260620 13:58:54.033190 12290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 51526.1us
I20260620 13:58:54.032738 12146 catalog_manager.cc:5696] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:54.033538 12720 raft_consensus.cc:2749] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:54.040351 12522 raft_consensus.cc:359] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:54.041137 12522 raft_consensus.cc:385] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:54.041412 12522 raft_consensus.cc:740] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:54.042066 12521 tablet_bootstrap.cc:654] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:54.042100 12522 consensus_queue.cc:260] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:54.047679 12469 raft_consensus.cc:3060] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:54.049106 12522 ts_tablet_manager.cc:1434] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260620 13:58:54.050045 12522 tablet_bootstrap.cc:492] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:54.053022 12523 tablet_bootstrap.cc:654] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:54.060544 12522 tablet_bootstrap.cc:654] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:54.062009 12147 catalog_manager.cc:5696] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } }
W20260620 13:58:54.065774 12218 leader_election.cc:343] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:54.066326 12218 leader_election.cc:304] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:54.067307 12734 raft_consensus.cc:2749] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:54.034500 12146 catalog_manager.cc:5696] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:54.093339 12883 raft_consensus.cc:493] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:54.132447 12870 consensus_queue.cc:1048] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:54.127581 12883 raft_consensus.cc:515] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:54.173523 12872 consensus_queue.cc:1048] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:54.175479 12883 leader_election.cc:290] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:54.180078 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe9fd2ff66d4141a2c7f7023278714d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:54.158270 12520 raft_consensus.cc:359] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:54.184132 12520 raft_consensus.cc:385] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:54.184535 12520 raft_consensus.cc:740] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:54.185237 12520 consensus_queue.cc:260] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
W20260620 13:58:54.187700 12217 leader_election.cc:343] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:54.190883 12520 ts_tablet_manager.cc:1434] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.177s	user 0.006s	sys 0.001s
I20260620 13:58:54.191879 12520 tablet_bootstrap.cc:492] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
W20260620 13:58:54.194674 12197 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:58:54.200170 12870 raft_consensus.cc:493] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:54.200731 12870 raft_consensus.cc:515] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:54.206555 12523 tablet_bootstrap.cc:492] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:54.207093 12523 ts_tablet_manager.cc:1403] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.176s	user 0.008s	sys 0.010s
I20260620 13:58:54.209563 12870 leader_election.cc:290] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:54.210035 12523 raft_consensus.cc:359] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:54.210780 12523 raft_consensus.cc:385] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:54.211213 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e74afa4f8b64bf691a223a9eff804d7" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:54.211059 12523 raft_consensus.cc:740] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:54.212425 12523 consensus_queue.cc:260] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
W20260620 13:58:54.212826 12367 leader_election.cc:343] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:54.213178 12880 raft_consensus.cc:493] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:54.213683 12880 raft_consensus.cc:515] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:54.215735 12523 ts_tablet_manager.cc:1434] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260620 13:58:54.216415 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e74afa4f8b64bf691a223a9eff804d7" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:54.216668 12523 tablet_bootstrap.cc:492] T 1a9724c70f584a9c8aced9cc416e027d P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
W20260620 13:58:54.218353 12364 leader_election.cc:343] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:54.223444 12364 leader_election.cc:304] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:54.223769 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe9fd2ff66d4141a2c7f7023278714d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:54.224738 12319 raft_consensus.cc:2468] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:54.224911 12872 raft_consensus.cc:2749] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:54.234959 12249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa301d02030498583d201921146bb89" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:54.235575 12218 leader_election.cc:304] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:54.235845 12249 raft_consensus.cc:2468] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 0.
I20260620 13:58:54.236449 12886 raft_consensus.cc:2804] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:54.236868 12886 raft_consensus.cc:493] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:54.237198 12886 raft_consensus.cc:3060] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:54.237914 12441 leader_election.cc:304] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:54.239015 12744 raft_consensus.cc:2804] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:54.239426 12744 raft_consensus.cc:493] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:54.239779 12744 raft_consensus.cc:3060] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:54.246359 12870 consensus_queue.cc:1048] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260620 13:58:54.255152 12367 consensus_peers.cc:597] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:54.256126 12880 leader_election.cc:290] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:54.256677 12324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa301d02030498583d201921146bb89" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:54.257104 12521 tablet_bootstrap.cc:492] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:54.257582 12521 ts_tablet_manager.cc:1403] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.315s	user 0.008s	sys 0.005s
W20260620 13:58:54.260056 12441 leader_election.cc:343] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:54.262054 12522 tablet_bootstrap.cc:492] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:54.274683 12886 raft_consensus.cc:515] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:54.276508 12744 raft_consensus.cc:515] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:54.271297 12522 ts_tablet_manager.cc:1403] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.221s	user 0.055s	sys 0.036s
I20260620 13:58:54.291026 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa301d02030498583d201921146bb89" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:54.291800 12252 raft_consensus.cc:3060] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:54.301489 12522 raft_consensus.cc:359] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:54.306617 12883 consensus_queue.cc:1048] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:54.309986 12324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa301d02030498583d201921146bb89" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
W20260620 13:58:54.314803 12441 leader_election.cc:343] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:54.310638 12744 leader_election.cc:290] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:54.321798 12522 raft_consensus.cc:385] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:54.322149 12522 raft_consensus.cc:740] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:54.322722 12522 consensus_queue.cc:260] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:54.324859 12252 raft_consensus.cc:2468] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:58:54.325134 12520 tablet_bootstrap.cc:654] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:54.326470 12441 leader_election.cc:304] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:54.327737 12880 raft_consensus.cc:2804] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:54.328306 12880 raft_consensus.cc:697] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:58:54.329134 12880 consensus_queue.cc:237] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:54.329988 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe9fd2ff66d4141a2c7f7023278714d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:54.330612 12319 raft_consensus.cc:3060] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:54.333237 12522 ts_tablet_manager.cc:1434] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260620 13:58:54.337559 12842 raft_consensus.cc:493] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:54.338116 12842 raft_consensus.cc:515] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:54.334052 12521 raft_consensus.cc:359] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:54.339788 12521 raft_consensus.cc:385] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:54.340090 12521 raft_consensus.cc:740] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:54.340755 12521 consensus_queue.cc:260] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:54.343654 12522 tablet_bootstrap.cc:492] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:54.350695 12886 leader_election.cc:290] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:54.352653 12520 tablet_bootstrap.cc:492] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:54.353199 12520 ts_tablet_manager.cc:1403] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.162s	user 0.009s	sys 0.005s
I20260620 13:58:54.358109 12520 raft_consensus.cc:359] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:54.358748 12520 raft_consensus.cc:385] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:54.359040 12520 raft_consensus.cc:740] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:54.359825 12520 consensus_queue.cc:260] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:54.360368 12523 tablet_bootstrap.cc:654] T 1a9724c70f584a9c8aced9cc416e027d P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:54.362164 12520 ts_tablet_manager.cc:1434] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260620 13:58:54.363183 12520 tablet_bootstrap.cc:492] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:54.366729 12522 tablet_bootstrap.cc:654] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:54.441066 12146 catalog_manager.cc:5696] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 1 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:54.456120 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe9fd2ff66d4141a2c7f7023278714d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:54.502349 12521 ts_tablet_manager.cc:1434] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.244s	user 0.006s	sys 0.002s
W20260620 13:58:54.521615 12217 leader_election.cc:343] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:54.526229 12249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1f1202d4ad46b49a994c23c7f566c1" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:54.527647 12249 raft_consensus.cc:2468] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:54.532927 12842 leader_election.cc:290] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:54.490286 12520 tablet_bootstrap.cc:654] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:54.533633 12523 tablet_bootstrap.cc:492] T 1a9724c70f584a9c8aced9cc416e027d P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:54.558532 12523 ts_tablet_manager.cc:1403] T 1a9724c70f584a9c8aced9cc416e027d P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.342s	user 0.007s	sys 0.006s
I20260620 13:58:54.557374 12293 leader_election.cc:304] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:54.570127 12319 raft_consensus.cc:2468] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:54.572721 12720 raft_consensus.cc:2804] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:54.554847 12521 tablet_bootstrap.cc:492] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:54.582665 12720 raft_consensus.cc:493] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:54.594861 12720 raft_consensus.cc:3060] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:54.598135 12842 raft_consensus.cc:493] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:54.609726 12886 consensus_queue.cc:1048] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:54.599306 12842 raft_consensus.cc:515] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:54.637428 12218 leader_election.cc:304] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:54.638657 12522 tablet_bootstrap.cc:492] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:54.638769 12584 raft_consensus.cc:2804] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:54.639705 12522 ts_tablet_manager.cc:1403] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.303s	user 0.018s	sys 0.014s
I20260620 13:58:54.639535 12584 raft_consensus.cc:697] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:58:54.641718 12584 consensus_queue.cc:237] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:54.653688 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1f1202d4ad46b49a994c23c7f566c1" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:54.662449 12842 leader_election.cc:290] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:54.667392 12520 tablet_bootstrap.cc:492] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:54.668368 12520 ts_tablet_manager.cc:1403] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.305s	user 0.036s	sys 0.014s
I20260620 13:58:54.668723 12249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa301d02030498583d201921146bb89" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:54.670248 12249 raft_consensus.cc:2393] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcd1bd5dfea74c378a6154f83707154c in current term 1: Already voted for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in this term.
W20260620 13:58:54.676937 12292 leader_election.cc:343] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:54.627952 12523 raft_consensus.cc:359] T 1a9724c70f584a9c8aced9cc416e027d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:54.680032 12523 raft_consensus.cc:385] T 1a9724c70f584a9c8aced9cc416e027d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:54.680424 12523 raft_consensus.cc:740] T 1a9724c70f584a9c8aced9cc416e027d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:54.680078 12522 raft_consensus.cc:359] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:54.681218 12522 raft_consensus.cc:385] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:54.681926 12522 raft_consensus.cc:740] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:54.681582 12523 consensus_queue.cc:260] T 1a9724c70f584a9c8aced9cc416e027d P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:54.704672 12720 raft_consensus.cc:515] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:54.733191 12720 leader_election.cc:290] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:54.741029 12247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1f1202d4ad46b49a994c23c7f566c1" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:54.741921 12247 raft_consensus.cc:3060] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:54.750552 12522 consensus_queue.cc:260] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:54.751986 12880 consensus_queue.cc:1048] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:54.752604 12522 ts_tablet_manager.cc:1434] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.112s	user 0.011s	sys 0.001s
I20260620 13:58:54.756004 12523 ts_tablet_manager.cc:1434] T 1a9724c70f584a9c8aced9cc416e027d P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.186s	user 0.011s	sys 0.005s
I20260620 13:58:54.756953 12872 raft_consensus.cc:493] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:54.757982 12523 tablet_bootstrap.cc:492] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:54.757864 12872 raft_consensus.cc:515] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:54.674340 12520 raft_consensus.cc:359] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:54.759389 12520 raft_consensus.cc:385] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:54.759757 12520 raft_consensus.cc:740] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:54.760663 12520 consensus_queue.cc:260] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:54.761911 12872 leader_election.cc:290] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:54.764410 12522 tablet_bootstrap.cc:492] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:54.764011 12520 ts_tablet_manager.cc:1434] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.095s	user 0.005s	sys 0.003s
I20260620 13:58:54.785929 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9724c70f584a9c8aced9cc416e027d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:54.787798 12319 raft_consensus.cc:2468] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:54.791004 12367 leader_election.cc:304] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:54.781594 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1f1202d4ad46b49a994c23c7f566c1" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:54.801435 12871 raft_consensus.cc:2804] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:54.802002 12871 raft_consensus.cc:493] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:54.802407 12871 raft_consensus.cc:3060] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:54.805212 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9724c70f584a9c8aced9cc416e027d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:54.806146 12469 raft_consensus.cc:2468] T 1a9724c70f584a9c8aced9cc416e027d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:54.809140 12247 raft_consensus.cc:2468] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
W20260620 13:58:54.822888 12292 leader_election.cc:343] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:54.825415 12521 tablet_bootstrap.cc:654] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:54.831780 12520 tablet_bootstrap.cc:492] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:54.837456 12293 leader_election.cc:304] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:54.856775 12871 raft_consensus.cc:515] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:54.862190 12522 tablet_bootstrap.cc:654] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
W20260620 13:58:54.796869 12290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 103602us
I20260620 13:58:54.870628 12837 raft_consensus.cc:2804] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:54.871349 12837 raft_consensus.cc:697] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:54.872524 12837 consensus_queue.cc:237] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:54.888106 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa301d02030498583d201921146bb89" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:54.908881 12290 leader_election.cc:304] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:54.911270 12319 raft_consensus.cc:3060] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:54.916815 12523 tablet_bootstrap.cc:654] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:54.925443 12521 tablet_bootstrap.cc:492] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:54.926034 12521 ts_tablet_manager.cc:1403] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.372s	user 0.021s	sys 0.008s
I20260620 13:58:54.929061 12521 raft_consensus.cc:359] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:54.929917 12521 raft_consensus.cc:385] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:54.930219 12521 raft_consensus.cc:740] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:54.936069 12521 consensus_queue.cc:260] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:54.928021 12520 tablet_bootstrap.cc:654] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:54.941095 12871 leader_election.cc:290] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:54.942245 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9724c70f584a9c8aced9cc416e027d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:54.942968 12472 raft_consensus.cc:3060] T 1a9724c70f584a9c8aced9cc416e027d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:54.940575 12521 ts_tablet_manager.cc:1434] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260620 13:58:54.944561 12521 tablet_bootstrap.cc:492] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:54.944994 12720 raft_consensus.cc:2749] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:54.954449 12834 consensus_queue.cc:1048] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:54.960036 12520 tablet_bootstrap.cc:492] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:54.961179 12520 ts_tablet_manager.cc:1403] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.130s	user 0.014s	sys 0.000s
I20260620 13:58:54.964056 12520 raft_consensus.cc:359] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:54.964813 12520 raft_consensus.cc:385] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:54.965097 12520 raft_consensus.cc:740] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:54.970153 12521 tablet_bootstrap.cc:654] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:54.974954 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9724c70f584a9c8aced9cc416e027d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:54.975840 12319 raft_consensus.cc:3060] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:54.982532 12520 consensus_queue.cc:260] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:54.980191 12149 catalog_manager.cc:5696] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 1 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:54.986584 12472 raft_consensus.cc:2468] T 1a9724c70f584a9c8aced9cc416e027d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:54.993006 12840 raft_consensus.cc:493] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:54.997198 12319 raft_consensus.cc:2468] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:55.000866 12840 raft_consensus.cc:515] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.006201 12364 leader_election.cc:304] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:54.999902 12523 tablet_bootstrap.cc:492] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:55.007095 12523 ts_tablet_manager.cc:1403] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.250s	user 0.018s	sys 0.001s
I20260620 13:58:55.006358 12522 tablet_bootstrap.cc:492] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:55.007961 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918029829d594bafac9e17a30edcacee" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:55.008452 12522 ts_tablet_manager.cc:1403] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.253s	user 0.016s	sys 0.014s
I20260620 13:58:55.009891 12840 leader_election.cc:290] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:54.998509 12520 ts_tablet_manager.cc:1434] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260620 13:58:55.010244 12523 raft_consensus.cc:359] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.011029 12523 raft_consensus.cc:385] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.011615 12523 raft_consensus.cc:740] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.012554 12520 tablet_bootstrap.cc:492] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:55.012449 12523 consensus_queue.cc:260] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.016202 12523 ts_tablet_manager.cc:1434] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260620 13:58:55.017670 12523 tablet_bootstrap.cc:492] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:55.022490 12618 raft_consensus.cc:2804] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:55.023032 12618 raft_consensus.cc:697] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:55.023906 12618 consensus_queue.cc:237] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.046968 12840 consensus_queue.cc:1048] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:55.057288 12523 tablet_bootstrap.cc:654] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.044694 12520 tablet_bootstrap.cc:654] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.061175 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918029829d594bafac9e17a30edcacee" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:55.064762 12217 leader_election.cc:304] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:55.066217 12886 raft_consensus.cc:2749] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:55.072952 12148 catalog_manager.cc:5696] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:55.079209 12618 raft_consensus.cc:493] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:55.080549 12618 raft_consensus.cc:515] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:55.083088 12618 leader_election.cc:290] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:55.083784 12247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe9fd2ff66d4141a2c7f7023278714d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:55.093184 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe9fd2ff66d4141a2c7f7023278714d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:55.097285 12367 leader_election.cc:304] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:55.097282 12522 raft_consensus.cc:359] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.099654 12522 raft_consensus.cc:385] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.099927 12522 raft_consensus.cc:740] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.100013 12872 raft_consensus.cc:2749] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:55.101158 12522 consensus_queue.cc:260] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.104771 12522 ts_tablet_manager.cc:1434] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.096s	user 0.005s	sys 0.004s
I20260620 13:58:55.106665 12522 tablet_bootstrap.cc:492] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:55.114342 12398 raft_consensus.cc:3060] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.116312 12522 tablet_bootstrap.cc:654] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.129448 12521 tablet_bootstrap.cc:492] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:55.129931 12521 ts_tablet_manager.cc:1403] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.186s	user 0.028s	sys 0.032s
I20260620 13:58:55.132799 12521 raft_consensus.cc:359] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.134923 12521 raft_consensus.cc:385] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.136353 12521 raft_consensus.cc:740] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.155448 12521 consensus_queue.cc:260] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.164484 12146 catalog_manager.cc:5696] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:55.164542 12521 ts_tablet_manager.cc:1434] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260620 13:58:55.173502 12523 tablet_bootstrap.cc:492] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:55.174252 12523 ts_tablet_manager.cc:1403] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.157s	user 0.033s	sys 0.011s
I20260620 13:58:55.185245 12520 tablet_bootstrap.cc:492] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:55.185811 12520 ts_tablet_manager.cc:1403] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.174s	user 0.019s	sys 0.026s
I20260620 13:58:55.189560 12521 tablet_bootstrap.cc:492] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:55.205596 12883 consensus_queue.cc:1048] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:55.213408 12520 raft_consensus.cc:359] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.216212 12520 raft_consensus.cc:385] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.216575 12520 raft_consensus.cc:740] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.214377 12523 raft_consensus.cc:359] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.217530 12523 raft_consensus.cc:385] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.217897 12523 raft_consensus.cc:740] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.219398 12520 consensus_queue.cc:260] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.218797 12523 consensus_queue.cc:260] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.232059 12523 ts_tablet_manager.cc:1434] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
I20260620 13:58:55.240573 12522 tablet_bootstrap.cc:492] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:55.241101 12522 ts_tablet_manager.cc:1403] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.135s	user 0.013s	sys 0.018s
I20260620 13:58:55.243324 12523 tablet_bootstrap.cc:492] T 8e74afa4f8b64bf691a223a9eff804d7 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:55.246733 12522 raft_consensus.cc:359] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.247473 12522 raft_consensus.cc:385] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.247743 12522 raft_consensus.cc:740] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.248494 12522 consensus_queue.cc:260] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.255954 12522 ts_tablet_manager.cc:1434] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260620 13:58:55.257108 12522 tablet_bootstrap.cc:492] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:55.269032 12522 tablet_bootstrap.cc:654] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.264612 12520 ts_tablet_manager.cc:1434] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.001s
I20260620 13:58:55.272302 12247 raft_consensus.cc:3060] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.273619 12523 tablet_bootstrap.cc:654] T 8e74afa4f8b64bf691a223a9eff804d7 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.275944 12840 raft_consensus.cc:493] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:55.276603 12520 tablet_bootstrap.cc:492] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:55.276491 12840 raft_consensus.cc:515] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.281172 12521 tablet_bootstrap.cc:654] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.280956 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75286f26552b4e788b3844d3aa342b01" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:55.281814 12398 raft_consensus.cc:2468] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:55.283174 12217 leader_election.cc:304] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:55.283861 12584 raft_consensus.cc:2804] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:55.284307 12584 raft_consensus.cc:493] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:55.284633 12584 raft_consensus.cc:3060] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.292166 12837 raft_consensus.cc:493] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:55.295506 12837 raft_consensus.cc:515] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:55.297839 12837 leader_election.cc:290] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
W20260620 13:58:55.299297 12197 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:58:55.300958 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b83072f19644f5806c4391cbb1bce5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:55.302393 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b83072f19644f5806c4391cbb1bce5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:55.304045 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75286f26552b4e788b3844d3aa342b01" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:55.305037 12472 raft_consensus.cc:2468] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:55.306339 12840 leader_election.cc:290] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
W20260620 13:58:55.308691 12292 leader_election.cc:343] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:58:55.319878 12293 leader_election.cc:343] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:55.320418 12293 leader_election.cc:304] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:55.333259 12837 raft_consensus.cc:2749] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:55.336196 12523 tablet_bootstrap.cc:492] T 8e74afa4f8b64bf691a223a9eff804d7 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:55.336809 12523 ts_tablet_manager.cc:1403] T 8e74afa4f8b64bf691a223a9eff804d7 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.099s	user 0.028s	sys 0.011s
I20260620 13:58:55.340843 12523 raft_consensus.cc:359] T 8e74afa4f8b64bf691a223a9eff804d7 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.341662 12523 raft_consensus.cc:385] T 8e74afa4f8b64bf691a223a9eff804d7 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.341982 12523 raft_consensus.cc:740] T 8e74afa4f8b64bf691a223a9eff804d7 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.342725 12523 consensus_queue.cc:260] T 8e74afa4f8b64bf691a223a9eff804d7 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.345578 12523 ts_tablet_manager.cc:1434] T 8e74afa4f8b64bf691a223a9eff804d7 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260620 13:58:55.346979 12523 tablet_bootstrap.cc:492] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:55.352974 12523 tablet_bootstrap.cc:654] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.356611 12837 raft_consensus.cc:493] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:55.357191 12837 raft_consensus.cc:515] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.358690 12522 tablet_bootstrap.cc:492] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:55.359346 12522 ts_tablet_manager.cc:1403] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.103s	user 0.019s	sys 0.020s
I20260620 13:58:55.353349 12584 raft_consensus.cc:515] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.365801 12520 tablet_bootstrap.cc:654] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.367682 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75286f26552b4e788b3844d3aa342b01" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:55.368316 12398 raft_consensus.cc:3060] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.368690 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75286f26552b4e788b3844d3aa342b01" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:55.369390 12472 raft_consensus.cc:3060] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.371217 12584 leader_election.cc:290] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:55.374810 12837 leader_election.cc:290] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:55.376168 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e74afa4f8b64bf691a223a9eff804d7" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:55.376914 12401 raft_consensus.cc:2468] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:55.378269 12292 leader_election.cc:304] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:55.379127 12837 raft_consensus.cc:2804] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:55.379494 12837 raft_consensus.cc:493] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:55.379788 12521 tablet_bootstrap.cc:492] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:55.380429 12521 ts_tablet_manager.cc:1403] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.191s	user 0.031s	sys 0.039s
W20260620 13:58:55.381196 12292 consensus_peers.cc:597] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c -> Peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Couldn't send request to peer c51ef915af09435db6046c91bb9d00e0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:55.379971 12837 raft_consensus.cc:3060] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.383235 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e74afa4f8b64bf691a223a9eff804d7" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:55.383927 12469 raft_consensus.cc:2468] T 8e74afa4f8b64bf691a223a9eff804d7 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:55.393831 12521 raft_consensus.cc:359] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:55.394809 12521 raft_consensus.cc:385] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.395120 12521 raft_consensus.cc:740] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.398304 12521 consensus_queue.cc:260] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:55.400319 12521 ts_tablet_manager.cc:1434] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260620 13:58:55.390863 12398 raft_consensus.cc:2468] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:55.362844 12522 raft_consensus.cc:359] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.410199 12522 raft_consensus.cc:385] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.453816 12522 raft_consensus.cc:740] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.454514 12522 consensus_queue.cc:260] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.419909 12872 consensus_queue.cc:1048] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260620 13:58:55.456015 12522 ts_tablet_manager.cc:1434] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
I20260620 13:58:55.422170 12217 leader_election.cc:304] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:55.458338 12584 raft_consensus.cc:2804] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:55.458782 12584 raft_consensus.cc:697] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:58:55.459514 12584 consensus_queue.cc:237] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.461171 12886 raft_consensus.cc:493] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:55.461697 12886 raft_consensus.cc:515] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.463848 12886 leader_election.cc:290] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:55.406598 12521 tablet_bootstrap.cc:492] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:55.405063 12837 raft_consensus.cc:515] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.457086 12522 tablet_bootstrap.cc:492] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:55.469915 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17521c552cad497e9ae59a332d156c0e" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:55.471720 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17521c552cad497e9ae59a332d156c0e" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:55.471563 12837 leader_election.cc:290] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:55.472365 12323 raft_consensus.cc:2468] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:55.472708 12837 consensus_queue.cc:1048] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 13:58:55.473111 12215 leader_election.cc:343] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:55.474046 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e74afa4f8b64bf691a223a9eff804d7" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:55.474720 12470 raft_consensus.cc:3060] T 8e74afa4f8b64bf691a223a9eff804d7 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.477103 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e74afa4f8b64bf691a223a9eff804d7" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:55.477900 12398 raft_consensus.cc:3060] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.478387 12218 leader_election.cc:304] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:55.479964 12883 raft_consensus.cc:2804] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:55.480365 12883 raft_consensus.cc:493] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:55.480691 12883 raft_consensus.cc:3060] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.482244 12521 tablet_bootstrap.cc:654] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.423147 12523 tablet_bootstrap.cc:492] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:55.485042 12523 ts_tablet_manager.cc:1403] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.138s	user 0.016s	sys 0.001s
I20260620 13:58:55.485816 12872 consensus_queue.cc:1048] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:55.487366 12871 raft_consensus.cc:493] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:55.487874 12871 raft_consensus.cc:515] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.489970 12871 leader_election.cc:290] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:55.492396 12318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad12197ae0a40fe8dff265afe9d96af" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
W20260620 13:58:55.495085 12367 leader_election.cc:343] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:55.490890 12398 raft_consensus.cc:2468] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:55.502842 12470 raft_consensus.cc:2468] T 8e74afa4f8b64bf691a223a9eff804d7 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:55.515291 12290 leader_election.cc:304] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:55.521876 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad12197ae0a40fe8dff265afe9d96af" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:55.536697 12469 raft_consensus.cc:2468] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:55.534349 12523 raft_consensus.cc:359] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.538627 12523 raft_consensus.cc:385] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.453115 12472 raft_consensus.cc:2468] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:55.539031 12523 raft_consensus.cc:740] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.545475 12523 consensus_queue.cc:260] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.541132 12883 raft_consensus.cc:515] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.547869 12523 ts_tablet_manager.cc:1434] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260620 13:58:55.549137 12523 tablet_bootstrap.cc:492] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:55.549152 12883 leader_election.cc:290] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:55.552642 12915 raft_consensus.cc:2804] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:55.553218 12915 raft_consensus.cc:697] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:55.554064 12915 consensus_queue.cc:237] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.557402 12522 tablet_bootstrap.cc:654] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.562314 12523 tablet_bootstrap.cc:654] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.567052 12318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17521c552cad497e9ae59a332d156c0e" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:55.567938 12318 raft_consensus.cc:3060] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.578579 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17521c552cad497e9ae59a332d156c0e" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:55.578826 12364 leader_election.cc:304] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:55.581557 12872 raft_consensus.cc:2804] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:55.581964 12872 raft_consensus.cc:493] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:55.582288 12872 raft_consensus.cc:3060] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:58:55.594625 12215 leader_election.cc:343] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:55.613008 12520 tablet_bootstrap.cc:492] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:55.613572 12520 ts_tablet_manager.cc:1403] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.337s	user 0.037s	sys 0.030s
I20260620 13:58:55.616065 12148 catalog_manager.cc:5696] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:55.617544 12520 raft_consensus.cc:359] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.618209 12520 raft_consensus.cc:385] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.618458 12520 raft_consensus.cc:740] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.624430 12521 tablet_bootstrap.cc:492] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:55.624578 12872 raft_consensus.cc:515] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.627862 12872 leader_election.cc:290] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:55.631614 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad12197ae0a40fe8dff265afe9d96af" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:55.632336 12473 raft_consensus.cc:3060] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.643072 12324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad12197ae0a40fe8dff265afe9d96af" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:55.643251 12318 raft_consensus.cc:2468] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:55.645128 12218 leader_election.cc:304] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:55.646339 12886 raft_consensus.cc:2804] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:55.647086 12886 raft_consensus.cc:697] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
W20260620 13:58:55.647432 12367 leader_election.cc:343] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:55.648340 12886 consensus_queue.cc:237] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.648175 12520 consensus_queue.cc:260] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.625048 12521 ts_tablet_manager.cc:1403] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.219s	user 0.015s	sys 0.006s
I20260620 13:58:55.663842 12146 catalog_manager.cc:5696] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 1 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:55.665416 12584 raft_consensus.cc:493] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:55.675273 12520 ts_tablet_manager.cc:1434] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260620 13:58:55.668879 12584 raft_consensus.cc:515] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.683627 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786cabf18ace418e912751ea7c5cc45d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:55.691672 12584 leader_election.cc:290] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:55.693543 12520 tablet_bootstrap.cc:492] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:55.701035 12522 tablet_bootstrap.cc:492] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:55.701640 12522 ts_tablet_manager.cc:1403] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.245s	user 0.016s	sys 0.002s
I20260620 13:58:55.700959 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786cabf18ace418e912751ea7c5cc45d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:55.704504 12470 raft_consensus.cc:2468] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:55.710074 12215 leader_election.cc:304] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:55.711050 12886 raft_consensus.cc:2804] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:55.712461 12886 raft_consensus.cc:493] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:55.712837 12886 raft_consensus.cc:3060] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.716372 12521 raft_consensus.cc:359] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.717396 12521 raft_consensus.cc:385] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.718055 12521 raft_consensus.cc:740] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.718834 12521 consensus_queue.cc:260] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.721086 12521 ts_tablet_manager.cc:1434] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.067s	user 0.003s	sys 0.003s
I20260620 13:58:55.721289 12397 raft_consensus.cc:2468] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:55.721642 12522 raft_consensus.cc:359] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:55.722465 12522 raft_consensus.cc:385] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.722757 12522 raft_consensus.cc:740] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.722162 12521 tablet_bootstrap.cc:492] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:55.724069 12473 raft_consensus.cc:2468] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:55.720789 12147 catalog_manager.cc:5696] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:55.726034 12364 leader_election.cc:304] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:55.727146 12872 raft_consensus.cc:493] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:55.727329 12618 raft_consensus.cc:2804] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:55.727661 12872 raft_consensus.cc:515] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:55.729867 12872 leader_election.cc:290] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:55.731889 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1f1202d4ad46b49a994c23c7f566c1" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:55.732256 12247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1f1202d4ad46b49a994c23c7f566c1" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:55.732026 12522 consensus_queue.cc:260] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:55.733282 12886 raft_consensus.cc:515] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.734694 12522 ts_tablet_manager.cc:1434] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260620 13:58:55.737224 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786cabf18ace418e912751ea7c5cc45d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:55.737900 12469 raft_consensus.cc:3060] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.738312 12521 tablet_bootstrap.cc:654] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.738504 12523 tablet_bootstrap.cc:492] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:55.739092 12523 ts_tablet_manager.cc:1403] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.190s	user 0.008s	sys 0.008s
I20260620 13:58:55.739253 12367 leader_election.cc:304] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:55.739924 12522 tablet_bootstrap.cc:492] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:55.742079 12523 raft_consensus.cc:359] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.742765 12523 raft_consensus.cc:385] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.743037 12523 raft_consensus.cc:740] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.744525 12523 consensus_queue.cc:260] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.750602 12523 ts_tablet_manager.cc:1434] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260620 13:58:55.746471 12522 tablet_bootstrap.cc:654] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.746868 12469 raft_consensus.cc:2468] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:55.748209 12618 raft_consensus.cc:697] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:55.756047 12618 consensus_queue.cc:237] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.748646 12520 tablet_bootstrap.cc:654] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.744863 12886 leader_election.cc:290] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:55.752082 12871 raft_consensus.cc:2749] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:55.758284 12215 leader_election.cc:304] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:58:55.759208 12886 raft_consensus.cc:2804] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:55.759670 12886 raft_consensus.cc:697] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:58:55.758606 12523 tablet_bootstrap.cc:492] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:55.762387 12886 consensus_queue.cc:237] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.752816 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786cabf18ace418e912751ea7c5cc45d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:55.770816 12397 raft_consensus.cc:3060] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.778560 12523 tablet_bootstrap.cc:654] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.788938 12834 raft_consensus.cc:493] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:55.789669 12834 raft_consensus.cc:515] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.799609 12834 leader_election.cc:290] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:55.800860 12247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17521c552cad497e9ae59a332d156c0e" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:55.803201 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17521c552cad497e9ae59a332d156c0e" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:55.804004 12319 raft_consensus.cc:2393] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69a98f1d9eda4cd9bdd2287823f798f6 in current term 1: Already voted for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in this term.
I20260620 13:58:55.805971 12397 raft_consensus.cc:2468] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:55.806150 12441 leader_election.cc:304] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:55.807271 12834 raft_consensus.cc:3060] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.821887 12522 tablet_bootstrap.cc:492] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:55.822598 12522 ts_tablet_manager.cc:1403] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.015s
I20260620 13:58:55.823698 12149 catalog_manager.cc:5696] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:55.829650 12521 tablet_bootstrap.cc:492] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:55.830217 12521 ts_tablet_manager.cc:1403] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.108s	user 0.021s	sys 0.010s
I20260620 13:58:55.831059 12520 tablet_bootstrap.cc:492] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:55.826799 12834 raft_consensus.cc:2749] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:55.835372 12521 raft_consensus.cc:359] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.836135 12521 raft_consensus.cc:385] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.836431 12521 raft_consensus.cc:740] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.831630 12520 ts_tablet_manager.cc:1403] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.138s	user 0.016s	sys 0.004s
I20260620 13:58:55.838467 12522 raft_consensus.cc:359] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:55.839404 12522 raft_consensus.cc:385] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.839686 12522 raft_consensus.cc:740] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.840473 12521 consensus_queue.cc:260] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.840339 12520 raft_consensus.cc:359] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.841463 12520 raft_consensus.cc:385] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.842655 12520 raft_consensus.cc:740] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.845001 12523 tablet_bootstrap.cc:492] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:55.845559 12523 ts_tablet_manager.cc:1403] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.003s
I20260620 13:58:55.848552 12523 raft_consensus.cc:359] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.849202 12523 raft_consensus.cc:385] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.849454 12523 raft_consensus.cc:740] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.843618 12520 consensus_queue.cc:260] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.852643 12523 consensus_queue.cc:260] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.856003 12520 ts_tablet_manager.cc:1434] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260620 13:58:55.851333 12521 ts_tablet_manager.cc:1434] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260620 13:58:55.857219 12520 tablet_bootstrap.cc:492] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:55.857728 12521 tablet_bootstrap.cc:492] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:55.851797 12522 consensus_queue.cc:260] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:55.863946 12522 ts_tablet_manager.cc:1434] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.001s
I20260620 13:58:55.864090 12520 tablet_bootstrap.cc:654] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.865075 12522 tablet_bootstrap.cc:492] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:55.867690 12870 raft_consensus.cc:493] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:55.868278 12870 raft_consensus.cc:515] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:55.871845 12870 leader_election.cc:290] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:55.875021 12521 tablet_bootstrap.cc:654] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.876538 12520 tablet_bootstrap.cc:492] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:55.877121 12520 ts_tablet_manager.cc:1403] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260620 13:58:55.877213 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100d2b85fd4c4959bfbb5df7beb05915" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:55.878161 12523 ts_tablet_manager.cc:1434] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.002s
I20260620 13:58:55.879221 12523 tablet_bootstrap.cc:492] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
W20260620 13:58:55.881423 12367 leader_election.cc:343] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:55.881812 12886 raft_consensus.cc:493] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:55.881842 12840 raft_consensus.cc:493] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:55.882485 12886 raft_consensus.cc:515] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:55.884945 12886 leader_election.cc:290] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:55.882505 12840 raft_consensus.cc:515] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:55.887867 12523 tablet_bootstrap.cc:654] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.888527 12840 leader_election.cc:290] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:55.891247 12522 tablet_bootstrap.cc:654] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.892491 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100d2b85fd4c4959bfbb5df7beb05915" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:55.892602 12324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b83072f19644f5806c4391cbb1bce5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:55.893364 12324 raft_consensus.cc:2468] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:55.894594 12318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b45b565aa74abfad3579abc6ed2e56" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:55.896171 12218 leader_election.cc:304] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:55.897557 12840 raft_consensus.cc:2804] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:55.898023 12840 raft_consensus.cc:493] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:55.900840 12840 raft_consensus.cc:3060] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.903846 12523 tablet_bootstrap.cc:492] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:55.904413 12523 ts_tablet_manager.cc:1403] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.000s
I20260620 13:58:55.907385 12522 tablet_bootstrap.cc:492] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:55.907922 12522 ts_tablet_manager.cc:1403] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.004s
I20260620 13:58:55.916179 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b83072f19644f5806c4391cbb1bce5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:55.918427 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b45b565aa74abfad3579abc6ed2e56" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:55.920950 12842 raft_consensus.cc:493] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:55.880278 12520 raft_consensus.cc:359] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:55.923955 12520 raft_consensus.cc:385] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.924367 12520 raft_consensus.cc:740] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.921545 12842 raft_consensus.cc:515] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.927772 12520 consensus_queue.cc:260] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:55.910753 12522 raft_consensus.cc:359] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.929414 12522 raft_consensus.cc:385] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.929705 12522 raft_consensus.cc:740] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.931805 12523 raft_consensus.cc:359] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.932561 12523 raft_consensus.cc:385] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.932825 12523 raft_consensus.cc:740] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.933578 12318 raft_consensus.cc:2468] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 0.
I20260620 13:58:55.933497 12523 consensus_queue.cc:260] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.935734 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dff624788f433e88274d14f0db3c4c" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:55.937269 12218 leader_election.cc:304] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:55.938496 12842 leader_election.cc:290] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:55.939038 12146 catalog_manager.cc:5696] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } }
W20260620 13:58:55.940785 12290 leader_election.cc:343] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:55.942058 12886 raft_consensus.cc:2804] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:55.942602 12886 raft_consensus.cc:493] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:55.941973 12249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dff624788f433e88274d14f0db3c4c" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:55.943337 12886 raft_consensus.cc:3060] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:58:55.944679 12364 leader_election.cc:343] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:55.945152 12364 leader_election.cc:304] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:55.945849 12618 raft_consensus.cc:2749] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:55.945887 12523 ts_tablet_manager.cc:1434] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260620 13:58:55.948581 12523 tablet_bootstrap.cc:492] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
W20260620 13:58:55.951440 12217 leader_election.cc:343] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:58:55.952436 12217 leader_election.cc:343] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:55.957347 12886 raft_consensus.cc:515] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:55.959327 12840 raft_consensus.cc:515] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:55.961428 12840 leader_election.cc:290] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:55.962728 12520 ts_tablet_manager.cc:1434] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260620 13:58:55.963915 12520 tablet_bootstrap.cc:492] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:55.968729 12318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b83072f19644f5806c4391cbb1bce5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:55.973371 12521 tablet_bootstrap.cc:492] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:55.973709 12318 raft_consensus.cc:3060] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.973915 12521 ts_tablet_manager.cc:1403] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.116s	user 0.007s	sys 0.017s
I20260620 13:58:55.977025 12521 raft_consensus.cc:359] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.977728 12521 raft_consensus.cc:385] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:55.977990 12521 raft_consensus.cc:740] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:55.979810 12521 consensus_queue.cc:260] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:55.982396 12521 ts_tablet_manager.cc:1434] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260620 13:58:55.983839 12521 tablet_bootstrap.cc:492] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:55.986399 12520 tablet_bootstrap.cc:654] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.987947 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b83072f19644f5806c4391cbb1bce5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
W20260620 13:58:55.992743 12217 leader_election.cc:343] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:55.993327 12401 raft_consensus.cc:3060] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:55.970382 12523 tablet_bootstrap.cc:654] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.996191 12521 tablet_bootstrap.cc:654] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:55.970108 12522 consensus_queue.cc:260] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:55.997176 12249 raft_consensus.cc:2468] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:56.000473 12293 leader_election.cc:304] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:56.003846 12840 consensus_queue.cc:1048] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:56.003728 12886 leader_election.cc:290] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:58:56.007879 12318 raft_consensus.cc:2468] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:56.009370 12842 raft_consensus.cc:2804] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:56.011004 12842 raft_consensus.cc:493] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:56.012368 12218 leader_election.cc:304] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:56.003582 12319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b45b565aa74abfad3579abc6ed2e56" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:58:56.015393 12319 raft_consensus.cc:3060] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:56.013430 12522 ts_tablet_manager.cc:1434] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.105s	user 0.007s	sys 0.001s
I20260620 13:58:56.016829 12522 tablet_bootstrap.cc:492] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:56.020648 12584 raft_consensus.cc:2804] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:56.021176 12584 raft_consensus.cc:697] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:58:56.021901 12584 consensus_queue.cc:237] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:56.027210 12521 tablet_bootstrap.cc:492] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:56.027967 12521 ts_tablet_manager.cc:1403] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.004s
I20260620 13:58:56.032269 12521 raft_consensus.cc:359] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:56.032968 12521 raft_consensus.cc:385] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:56.033264 12521 raft_consensus.cc:740] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:56.033679 12842 raft_consensus.cc:3060] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:56.034718 12521 consensus_queue.cc:260] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:56.035084 12319 raft_consensus.cc:2468] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 1.
I20260620 13:58:56.048005 12218 leader_election.cc:304] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:56.049117 12959 raft_consensus.cc:2804] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:56.049582 12959 raft_consensus.cc:697] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:58:56.050367 12959 consensus_queue.cc:237] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:56.057889 12522 tablet_bootstrap.cc:654] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:56.062268 12146 catalog_manager.cc:5696] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:56.069013 12842 raft_consensus.cc:515] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:56.037843 12521 ts_tablet_manager.cc:1434] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260620 13:58:56.078629 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b45b565aa74abfad3579abc6ed2e56" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:56.082608 12870 raft_consensus.cc:493] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:56.089569 12521 tablet_bootstrap.cc:492] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:56.089524 12870 raft_consensus.cc:515] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:56.091861 12870 leader_election.cc:290] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:56.093032 12584 consensus_queue.cc:1048] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:56.093997 12959 consensus_queue.cc:1048] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 13:58:56.096202 12217 leader_election.cc:343] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:56.099217 12249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b27c67d5c9b4e2dbc82e90717ebbf9e" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:56.100385 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b27c67d5c9b4e2dbc82e90717ebbf9e" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:56.101037 12472 raft_consensus.cc:2468] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
W20260620 13:58:56.101732 12367 leader_election.cc:343] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:56.087298 12520 tablet_bootstrap.cc:492] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:56.103042 12520 ts_tablet_manager.cc:1403] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.139s	user 0.013s	sys 0.000s
I20260620 13:58:56.104542 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dff624788f433e88274d14f0db3c4c" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
W20260620 13:58:56.106822 12290 leader_election.cc:343] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:56.108347 12249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dff624788f433e88274d14f0db3c4c" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:56.108599 12520 raft_consensus.cc:359] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:56.109218 12249 raft_consensus.cc:3060] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:56.109447 12520 raft_consensus.cc:385] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:56.109839 12520 raft_consensus.cc:740] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:56.115697 12364 leader_election.cc:304] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:58:56.116298 12842 leader_election.cc:290] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:56.118871 12870 raft_consensus.cc:2804] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:56.119323 12870 raft_consensus.cc:493] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:56.119678 12870 raft_consensus.cc:3060] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:56.121196 12249 raft_consensus.cc:2468] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:56.132750 12146 catalog_manager.cc:5696] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 1 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:56.136543 12293 leader_election.cc:304] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:58:56.137388 12720 raft_consensus.cc:2804] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:56.138517 12720 raft_consensus.cc:697] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:56.140467 12720 consensus_queue.cc:237] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:56.110541 12520 consensus_queue.cc:260] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:56.131954 12521 tablet_bootstrap.cc:654] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:56.160568 12870 raft_consensus.cc:515] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:56.167147 12249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b27c67d5c9b4e2dbc82e90717ebbf9e" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:56.167732 12147 catalog_manager.cc:5696] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 1 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:56.168893 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b27c67d5c9b4e2dbc82e90717ebbf9e" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:56.169482 12472 raft_consensus.cc:3060] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:58:56.169486 12367 leader_election.cc:343] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:56.179298 12523 tablet_bootstrap.cc:492] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:56.179864 12523 ts_tablet_manager.cc:1403] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.232s	user 0.021s	sys 0.038s
I20260620 13:58:56.180174 12915 consensus_queue.cc:1048] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:56.161020 12520 ts_tablet_manager.cc:1434] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260620 13:58:56.246496 12523 raft_consensus.cc:359] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:56.248219 12521 tablet_bootstrap.cc:492] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:56.248819 12523 raft_consensus.cc:385] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:56.249217 12523 raft_consensus.cc:740] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:56.249343 12520 tablet_bootstrap.cc:492] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c: Bootstrap starting.
I20260620 13:58:56.248842 12521 ts_tablet_manager.cc:1403] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.160s	user 0.016s	sys 0.008s
I20260620 13:58:56.163152 12870 leader_election.cc:290] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:56.256446 12842 raft_consensus.cc:493] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:56.264609 12523 consensus_queue.cc:260] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:56.289485 12975 raft_consensus.cc:493] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:56.294631 12523 ts_tablet_manager.cc:1434] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.114s	user 0.004s	sys 0.008s
I20260620 13:58:56.278381 12842 raft_consensus.cc:515] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:56.331363 12886 consensus_queue.cc:1048] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:56.311875 12720 consensus_queue.cc:1048] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260620 13:58:56.356580 12523 tablet_bootstrap.cc:492] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:56.361622 12840 consensus_queue.cc:1048] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260620 13:58:56.308766 12975 raft_consensus.cc:515] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:56.372756 12520 tablet_bootstrap.cc:654] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:56.362144 12319 raft_consensus.cc:3060] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:58:56.377053 12292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:37673, user_credentials={real_user=slave}} blocked reactor thread for 68325.8us
I20260620 13:58:56.393375 12521 raft_consensus.cc:359] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:56.394089 12521 raft_consensus.cc:385] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:56.394368 12521 raft_consensus.cc:740] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:56.372367 12959 consensus_queue.cc:1048] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260620 13:58:56.396045 12842 leader_election.cc:290] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:56.400410 12975 leader_election.cc:290] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:56.395044 12521 consensus_queue.cc:260] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:56.409602 12523 tablet_bootstrap.cc:654] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:56.429690 12522 tablet_bootstrap.cc:492] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:56.430275 12522 ts_tablet_manager.cc:1403] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.414s	user 0.025s	sys 0.006s
I20260620 13:58:56.432232 12521 ts_tablet_manager.cc:1434] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.178s	user 0.007s	sys 0.000s
I20260620 13:58:56.435333 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad12197ae0a40fe8dff265afe9d96af" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:56.435565 12521 tablet_bootstrap.cc:492] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0: Bootstrap starting.
I20260620 13:58:56.440354 12318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c659d02f1647c7b404779d983439ca" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:56.443162 12472 raft_consensus.cc:2468] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
W20260620 13:58:56.430886 12293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 118953us
W20260620 13:58:56.449198 12197 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:58:56.449513 12521 tablet_bootstrap.cc:654] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:56.459903 12364 leader_election.cc:304] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:58:56.454797 12522 raft_consensus.cc:359] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:56.462642 12522 raft_consensus.cc:385] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:56.463073 12522 raft_consensus.cc:740] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:56.466157 12522 consensus_queue.cc:260] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:56.468422 12522 ts_tablet_manager.cc:1434] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260620 13:58:56.469730 12522 tablet_bootstrap.cc:492] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:56.471199 12973 consensus_queue.cc:1048] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 13:58:56.477216 12441 leader_election.cc:343] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:58:56.482419 12217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:37673, user_credentials={real_user=slave}} blocked reactor thread for 87372.1us
I20260620 13:58:56.476346 12871 raft_consensus.cc:493] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:56.488956 12973 raft_consensus.cc:2804] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:56.520419 12973 raft_consensus.cc:697] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:56.521768 12973 consensus_queue.cc:237] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:56.524076 12974 consensus_queue.cc:1048] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:56.538089 12522 tablet_bootstrap.cc:654] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:56.491005 12247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c659d02f1647c7b404779d983439ca" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:56.503237 12871 raft_consensus.cc:515] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:56.540912 12871 leader_election.cc:290] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:56.559250 12584 raft_consensus.cc:493] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:56.559957 12584 raft_consensus.cc:515] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
W20260620 13:58:56.572052 12441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 74987us
W20260620 13:58:56.576087 12441 leader_election.cc:343] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:56.576504 12441 leader_election.cc:304] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:56.582501 12584 leader_election.cc:290] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:56.585922 12401 raft_consensus.cc:3060] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:56.587356 12520 tablet_bootstrap.cc:492] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c: No bootstrap required, opened a new log
I20260620 13:58:56.587926 12520 ts_tablet_manager.cc:1403] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c: Time spent bootstrapping tablet: real 0.339s	user 0.018s	sys 0.005s
I20260620 13:58:56.590878 12523 tablet_bootstrap.cc:492] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:56.591416 12947 raft_consensus.cc:2749] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:56.593082 12523 ts_tablet_manager.cc:1403] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.247s	user 0.013s	sys 0.002s
I20260620 13:58:56.603735 12398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b27c67d5c9b4e2dbc82e90717ebbf9e" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:56.606580 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b27c67d5c9b4e2dbc82e90717ebbf9e" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:56.607659 12467 raft_consensus.cc:2393] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d43d0ad579244c0a3ebb71069c1ab4f in current term 1: Already voted for candidate c51ef915af09435db6046c91bb9d00e0 in this term.
I20260620 13:58:56.607793 12981 raft_consensus.cc:493] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:56.608336 12981 raft_consensus.cc:515] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:56.611550 12215 leader_election.cc:304] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:56.619861 12520 raft_consensus.cc:359] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:56.620774 12520 raft_consensus.cc:385] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:56.620990 12520 raft_consensus.cc:740] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Initialized, Role: FOLLOWER
I20260620 13:58:56.628351 12322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b83072f19644f5806c4391cbb1bce5" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:56.629501 12322 raft_consensus.cc:2393] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c51ef915af09435db6046c91bb9d00e0 in current term 1: Already voted for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in this term.
I20260620 13:58:56.636181 12521 tablet_bootstrap.cc:492] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0: No bootstrap required, opened a new log
I20260620 13:58:56.628464 12400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100d2b85fd4c4959bfbb5df7beb05915" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:58:56.644057 12521 ts_tablet_manager.cc:1403] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0: Time spent bootstrapping tablet: real 0.209s	user 0.015s	sys 0.024s
I20260620 13:58:56.639523 12520 consensus_queue.cc:260] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
W20260620 13:58:56.684283 12215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 72848.3us
I20260620 13:58:56.675339 12400 raft_consensus.cc:2468] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
W20260620 13:58:56.693387 12292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:37673, user_credentials={real_user=slave}} blocked reactor thread for 68019.4us
I20260620 13:58:56.740358 12520 ts_tablet_manager.cc:1434] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c: Time spent starting tablet: real 0.152s	user 0.006s	sys 0.008s
I20260620 13:58:56.773033 12993 raft_consensus.cc:3060] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:56.773876 12982 raft_consensus.cc:493] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:56.774546 12982 raft_consensus.cc:515] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:56.741860 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad12197ae0a40fe8dff265afe9d96af" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:56.742097 12981 leader_election.cc:290] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:56.808933 12523 raft_consensus.cc:359] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:56.810070 12523 raft_consensus.cc:385] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:56.810350 12523 raft_consensus.cc:740] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:56.812518 12993 raft_consensus.cc:2749] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:56.817852 12521 raft_consensus.cc:359] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:56.818943 12521 raft_consensus.cc:385] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:56.819269 12521 raft_consensus.cc:740] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Initialized, Role: FOLLOWER
I20260620 13:58:56.819959 12521 consensus_queue.cc:260] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:56.820755 12247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dff624788f433e88274d14f0db3c4c" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:56.820839 12523 consensus_queue.cc:260] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:56.821753 12247 raft_consensus.cc:2393] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69a98f1d9eda4cd9bdd2287823f798f6 in current term 1: Already voted for candidate fcd1bd5dfea74c378a6154f83707154c in this term.
I20260620 13:58:56.785880 12982 leader_election.cc:290] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
W20260620 13:58:56.831429 12989 log.cc:927] Time spent T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260620 13:58:56.833577 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100d2b85fd4c4959bfbb5df7beb05915" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:56.834931 12475 raft_consensus.cc:2468] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:56.843361 12325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dff624788f433e88274d14f0db3c4c" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:56.854179 12290 leader_election.cc:304] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0
I20260620 13:58:56.856633 12290 leader_election.cc:304] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
W20260620 13:58:56.864214 12367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 170346us
I20260620 13:58:56.933822 12523 ts_tablet_manager.cc:1434] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.340s	user 0.009s	sys 0.000s
I20260620 13:58:56.934696 12521 ts_tablet_manager.cc:1434] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0: Time spent starting tablet: real 0.290s	user 0.017s	sys 0.001s
I20260620 13:58:56.870505 12915 raft_consensus.cc:2749] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:56.992542 12915 raft_consensus.cc:2804] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:57.037563 12915 raft_consensus.cc:493] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:57.075613 12915 raft_consensus.cc:3060] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:57.074398 12248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b83072f19644f5806c4391cbb1bce5" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
W20260620 13:58:57.082446 12367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 95003.8us
I20260620 13:58:57.112301 12998 raft_consensus.cc:493] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:57.113006 12998 raft_consensus.cc:515] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:57.138847 12522 tablet_bootstrap.cc:492] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:57.142216 12522 ts_tablet_manager.cc:1403] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.673s	user 0.018s	sys 0.012s
I20260620 13:58:57.153599 12998 leader_election.cc:290] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
W20260620 13:58:57.171614 12218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.003s	sys 0.017s
W20260620 13:58:57.182833 12218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.003s	sys 0.017s
I20260620 13:58:57.188460 12993 consensus_queue.cc:1048] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:57.189677 12523 tablet_bootstrap.cc:492] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6: Bootstrap starting.
I20260620 13:58:57.171070 12915 raft_consensus.cc:515] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:57.191223 12959 consensus_queue.cc:1048] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:57.192353 12915 leader_election.cc:290] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:58:57.197777 12523 tablet_bootstrap.cc:654] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:57.201689 12984 consensus_queue.cc:1048] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260620 13:58:57.245333 13001 log.cc:927] Time spent T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260620 13:58:57.286283 12523 tablet_bootstrap.cc:492] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6: No bootstrap required, opened a new log
I20260620 13:58:57.286783 12523 ts_tablet_manager.cc:1403] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent bootstrapping tablet: real 0.097s	user 0.021s	sys 0.000s
I20260620 13:58:57.289251 12441 leader_election.cc:304] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:57.295819 12980 raft_consensus.cc:493] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:57.296536 12980 raft_consensus.cc:515] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:57.291616 12870 raft_consensus.cc:493] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:58:57.298426 12870 raft_consensus.cc:515] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:57.301357 12870 leader_election.cc:290] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:57.288085 12475 raft_consensus.cc:3060] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:57.304490 12523 raft_consensus.cc:359] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:57.308394 12523 raft_consensus.cc:385] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:57.308724 12523 raft_consensus.cc:740] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Initialized, Role: FOLLOWER
I20260620 13:58:57.289928 12472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100d2b85fd4c4959bfbb5df7beb05915" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:57.309420 12523 consensus_queue.cc:260] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:57.310348 12394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100d2b85fd4c4959bfbb5df7beb05915" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:58:57.311132 12394 raft_consensus.cc:3060] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:57.310053 12472 raft_consensus.cc:3060] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:57.294094 12367 leader_election.cc:304] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:57.321681 12523 ts_tablet_manager.cc:1434] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.001s
I20260620 13:58:57.305406 12980 leader_election.cc:290] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:57.324440 12249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b45b565aa74abfad3579abc6ed2e56" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:57.359972 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c659d02f1647c7b404779d983439ca" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:57.360836 12470 raft_consensus.cc:2468] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 0.
I20260620 13:58:57.361478 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c659d02f1647c7b404779d983439ca" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:57.362171 12290 leader_election.cc:304] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:57.363129 13015 raft_consensus.cc:2804] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:57.363528 13015 raft_consensus.cc:493] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:57.364032 13015 raft_consensus.cc:3060] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:57.329802 12871 raft_consensus.cc:2749] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:57.381856 12978 consensus_queue.cc:1048] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:57.385502 12522 raft_consensus.cc:359] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:57.386358 12522 raft_consensus.cc:385] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:57.386660 12522 raft_consensus.cc:740] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:57.389847 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a169ed363546d282eb265bd36bc136" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
W20260620 13:58:57.391453 12367 leader_election.cc:343] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:57.413342 12872 consensus_queue.cc:1048] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:57.422245 12522 consensus_queue.cc:260] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:57.425478 12522 ts_tablet_manager.cc:1434] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.251s	user 0.007s	sys 0.000s
I20260620 13:58:57.426610 12522 tablet_bootstrap.cc:492] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:58:57.431919 12394 raft_consensus.cc:2468] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:57.442498 12320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b45b565aa74abfad3579abc6ed2e56" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:57.443753 12320 raft_consensus.cc:2393] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c51ef915af09435db6046c91bb9d00e0 in current term 1: Already voted for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in this term.
I20260620 13:58:57.444629 12947 raft_consensus.cc:2749] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:57.450321 12395 raft_consensus.cc:3060] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:57.469394 12472 raft_consensus.cc:2468] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
W20260620 13:58:57.475338 12215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 169329us
I20260620 13:58:57.477985 12367 leader_election.cc:304] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:57.478950 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a169ed363546d282eb265bd36bc136" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:57.479799 12473 raft_consensus.cc:2468] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 0.
I20260620 13:58:57.480950 12290 leader_election.cc:304] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:57.494046 12720 raft_consensus.cc:2804] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:57.496582 13012 consensus_queue.cc:1048] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260620 13:58:57.499449 12720 raft_consensus.cc:697] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:57.504637 12720 consensus_queue.cc:237] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:58:57.515997 12364 leader_election.cc:304] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:58:57.517030 12618 raft_consensus.cc:2804] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:58:57.517463 12618 raft_consensus.cc:493] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:58:57.517840 12618 raft_consensus.cc:3060] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:58:57.483904 12293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 98231.6us
W20260620 13:58:57.553587 12197 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260620 13:58:57.571589 12293 leader_election.cc:343] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:58:57.513168 12870 consensus_queue.cc:1048] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260620 13:58:57.512548 13015 raft_consensus.cc:515] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:57.587251 13008 raft_consensus.cc:2749] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:58:57.588937 13008 raft_consensus.cc:493] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:58:57.589469 13008 raft_consensus.cc:515] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:58:57.603533 12618 raft_consensus.cc:515] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:57.600632 12470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c659d02f1647c7b404779d983439ca" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:57.578910 13015 leader_election.cc:290] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:57.620998 12959 consensus_queue.cc:1048] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260620 13:58:57.664757 12522 tablet_bootstrap.cc:654] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f: Neither blocks nor log segments found. Creating new log.
I20260620 13:58:57.681105 12252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c659d02f1647c7b404779d983439ca" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:57.682216 12252 raft_consensus.cc:3060] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:58:57.686954 12218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:37965, user_credentials={real_user=slave}} blocked reactor thread for 74111.5us
I20260620 13:58:57.668008 12470 raft_consensus.cc:3060] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:57.726183 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a169ed363546d282eb265bd36bc136" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:58:57.726836 12475 raft_consensus.cc:3060] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:58:57.807018 13021 log.cc:927] Time spent T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260620 13:58:57.752018 13008 leader_election.cc:290] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:57.824178 12618 leader_election.cc:290] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:58:57.828042 12250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1ae3d064cd49309bf086b257c3f664" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" is_pre_election: true
I20260620 13:58:57.846313 12147 catalog_manager.cc:5696] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } }
W20260620 13:58:57.737249 12293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 65953us
I20260620 13:58:57.878409 12475 raft_consensus.cc:2468] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:58:57.884425 12252 raft_consensus.cc:2468] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
W20260620 13:58:57.787038 12217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:37673, user_credentials={real_user=slave}} blocked reactor thread for 43641.7us
W20260620 13:58:57.934988 12364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 216656us
I20260620 13:58:57.946465 12470 raft_consensus.cc:2468] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:58:57.957713 12522 tablet_bootstrap.cc:492] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f: No bootstrap required, opened a new log
I20260620 13:58:57.958303 12522 ts_tablet_manager.cc:1403] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.532s	user 0.042s	sys 0.076s
I20260620 13:58:57.962602 12522 raft_consensus.cc:359] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:57.966149 12522 raft_consensus.cc:385] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:58:57.966534 12522 raft_consensus.cc:740] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:58:57.972761 12522 consensus_queue.cc:260] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:57.980259 12364 leader_election.cc:304] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:58:57.982528 12290 leader_election.cc:304] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:58:57.989744 12522 ts_tablet_manager.cc:1434] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.008s
I20260620 13:58:57.984172 12872 raft_consensus.cc:2804] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:57.995715 13014 raft_consensus.cc:2804] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:58:58.022846 12720 consensus_queue.cc:1048] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:58:58.028426 12245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a169ed363546d282eb265bd36bc136" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
I20260620 13:58:58.029072 12245 raft_consensus.cc:3060] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:58:58.013989 12872 raft_consensus.cc:697] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:58:58.036610 12883 raft_consensus.cc:493] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fcd1bd5dfea74c378a6154f83707154c)
I20260620 13:58:58.015278 12325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1ae3d064cd49309bf086b257c3f664" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:58.067349 12367 leader_election.cc:304] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:58.068210 13013 raft_consensus.cc:2749] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:58:58.068394 12872 consensus_queue.cc:237] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:58:58.039965 13014 raft_consensus.cc:697] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:58:58.073309 13014 consensus_queue.cc:237] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:58.077180 12146 catalog_manager.cc:5696] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 1 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:58.066846 12245 raft_consensus.cc:2468] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
W20260620 13:58:58.082443 13028 log.cc:927] Time spent T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260620 13:58:58.085520 12883 raft_consensus.cc:515] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:58:58.130944 12883 leader_election.cc:290] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:58:58.134588 12466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dff624788f433e88274d14f0db3c4c" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:58:58.163725 12320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dff624788f433e88274d14f0db3c4c" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:58:58.171628 12218 leader_election.cc:304] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:58:58.173297 13004 raft_consensus.cc:2749] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:58:58.205538 13014 consensus_queue.cc:1048] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:58.393364 12148 catalog_manager.cc:5696] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260620 13:58:58.417423 12146 catalog_manager.cc:5696] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 1 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260620 13:58:58.607775 13012 consensus_queue.cc:1048] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:58.623817 13000 consensus_queue.cc:1048] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:58.652427 12872 consensus_queue.cc:1048] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:58.707594 12872 consensus_queue.cc:1048] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:58:59.576646  4719 tablet_server.cc:179] TabletServer@127.4.155.193:0 shutting down...
W20260620 13:58:59.593001 12293 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 391 similar messages]
W20260620 13:58:59.599442 12293 consensus_peers.cc:597] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:59.613178 12293 consensus_peers.cc:597] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:59.615628 12367 consensus_peers.cc:597] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:59.638417 12367 consensus_peers.cc:597] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:59.643651  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:58:59.647128  4719 tablet_replica.cc:333] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.648192  4719 raft_consensus.cc:2243] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.648811  4719 raft_consensus.cc:2272] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.652585  4719 tablet_replica.cc:333] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.653529  4719 raft_consensus.cc:2243] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.654088  4719 raft_consensus.cc:2272] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.658237  4719 tablet_replica.cc:333] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.659411  4719 raft_consensus.cc:2243] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.660015  4719 raft_consensus.cc:2272] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.662689  4719 tablet_replica.cc:333] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.663923  4719 raft_consensus.cc:2243] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:59.665190  4719 raft_consensus.cc:2272] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:59.666555 12441 consensus_peers.cc:597] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:59.667797  4719 tablet_replica.cc:333] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.668792  4719 raft_consensus.cc:2243] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.669421  4719 raft_consensus.cc:2272] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.673295  4719 tablet_replica.cc:333] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.675523  4719 raft_consensus.cc:2243] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.676342  4719 raft_consensus.cc:2272] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.680197  4719 tablet_replica.cc:333] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.681316  4719 raft_consensus.cc:2243] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.682161  4719 raft_consensus.cc:2272] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.685750  4719 tablet_replica.cc:333] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.687142  4719 raft_consensus.cc:2243] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:59.688619  4719 raft_consensus.cc:2272] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.692428  4719 tablet_replica.cc:333] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.693369  4719 raft_consensus.cc:2243] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:59.694271  4719 raft_consensus.cc:2272] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.697938  4719 tablet_replica.cc:333] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.698832  4719 raft_consensus.cc:2243] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:59.700042  4719 raft_consensus.cc:2272] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.704936  4719 tablet_replica.cc:333] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.705817  4719 raft_consensus.cc:2243] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:59.706871  4719 raft_consensus.cc:2272] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.710029  4719 tablet_replica.cc:333] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.711025  4719 raft_consensus.cc:2243] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.711680  4719 raft_consensus.cc:2272] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.714784  4719 tablet_replica.cc:333] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.715622  4719 raft_consensus.cc:2243] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.716126  4719 raft_consensus.cc:2272] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:59.719316 12441 consensus_peers.cc:597] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:59.720016 12441 consensus_peers.cc:597] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:59.723820  4719 tablet_replica.cc:333] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.724882  4719 raft_consensus.cc:2243] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.725493  4719 raft_consensus.cc:2272] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:59.726665 12367 consensus_peers.cc:597] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:59.729283  4719 tablet_replica.cc:333] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.730348  4719 raft_consensus.cc:2243] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:59.731472  4719 raft_consensus.cc:2272] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.754056  4719 tablet_replica.cc:333] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.755033  4719 raft_consensus.cc:2243] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.755975  4719 raft_consensus.cc:2272] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:59.759296 12367 consensus_peers.cc:597] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:59.759357  4719 tablet_replica.cc:333] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.781067  4719 raft_consensus.cc:2243] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.781756  4719 raft_consensus.cc:2272] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.784909  4719 tablet_replica.cc:333] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.785804  4719 raft_consensus.cc:2243] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
W20260620 13:58:59.785976 12367 consensus_peers.cc:597] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:59.786667 12367 consensus_peers.cc:597] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:59.775681 12293 consensus_peers.cc:597] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:59.779446 12441 consensus_peers.cc:597] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:59.787009  4719 raft_consensus.cc:2272] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:59.793551 12293 consensus_peers.cc:597] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:59.795753  4719 tablet_replica.cc:333] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.796901  4719 raft_consensus.cc:2243] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
W20260620 13:58:59.797652 12441 consensus_peers.cc:597] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:59.798235  4719 raft_consensus.cc:2272] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.801725  4719 tablet_replica.cc:333] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.802986  4719 raft_consensus.cc:2243] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.803573  4719 raft_consensus.cc:2272] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.807137  4719 tablet_replica.cc:333] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.807986  4719 raft_consensus.cc:2243] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.808543  4719 raft_consensus.cc:2272] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.811410  4719 tablet_replica.cc:333] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
W20260620 13:58:59.822943 12293 consensus_peers.cc:597] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:59.812258  4719 raft_consensus.cc:2243] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.827399  4719 raft_consensus.cc:2272] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:59.840124 12367 consensus_peers.cc:597] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:59.829671 12293 consensus_peers.cc:597] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:59.846372 12367 consensus_peers.cc:597] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:58:59.847055 12367 consensus_peers.cc:597] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:59.852224  4719 tablet_replica.cc:333] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.853230  4719 raft_consensus.cc:2243] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.853880  4719 raft_consensus.cc:2272] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.859269  4719 tablet_replica.cc:333] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.860374  4719 raft_consensus.cc:2243] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:59.861868  4719 raft_consensus.cc:2272] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.866145  4719 tablet_replica.cc:333] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.866961  4719 raft_consensus.cc:2243] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.867609  4719 raft_consensus.cc:2272] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.870415  4719 tablet_replica.cc:333] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.871310  4719 raft_consensus.cc:2243] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.871894  4719 raft_consensus.cc:2272] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.874840  4719 tablet_replica.cc:333] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.875664  4719 raft_consensus.cc:2243] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.876307  4719 raft_consensus.cc:2272] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:59.883030 12293 consensus_peers.cc:597] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:59.885526  4719 tablet_replica.cc:333] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.886931  4719 raft_consensus.cc:2243] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:59.888154  4719 raft_consensus.cc:2272] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.893155  4719 tablet_replica.cc:333] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.894510  4719 raft_consensus.cc:2243] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.895458  4719 raft_consensus.cc:2272] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.899070  4719 tablet_replica.cc:333] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.900041  4719 raft_consensus.cc:2243] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:59.901335  4719 raft_consensus.cc:2272] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.904686  4719 tablet_replica.cc:333] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.905625  4719 raft_consensus.cc:2243] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.906242  4719 raft_consensus.cc:2272] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.909586  4719 tablet_replica.cc:333] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.910422  4719 raft_consensus.cc:2243] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:59.911504  4719 raft_consensus.cc:2272] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.914304  4719 tablet_replica.cc:333] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.915269  4719 raft_consensus.cc:2243] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.915927  4719 raft_consensus.cc:2272] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.919024  4719 tablet_replica.cc:333] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.920228  4719 raft_consensus.cc:2243] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.921051  4719 raft_consensus.cc:2272] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:59.921125 12367 consensus_peers.cc:597] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:59.924332  4719 tablet_replica.cc:333] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.925293  4719 raft_consensus.cc:2243] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:59.926378  4719 raft_consensus.cc:2272] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.929629  4719 tablet_replica.cc:333] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.930478  4719 raft_consensus.cc:2243] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.931010  4719 raft_consensus.cc:2272] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.934604  4719 tablet_replica.cc:333] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.935571  4719 raft_consensus.cc:2243] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.936249  4719 raft_consensus.cc:2272] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.940435  4719 tablet_replica.cc:333] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.941241  4719 raft_consensus.cc:2243] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.941844  4719 raft_consensus.cc:2272] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.945343  4719 tablet_replica.cc:333] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.946602  4719 raft_consensus.cc:2243] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.947517  4719 raft_consensus.cc:2272] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.951633  4719 tablet_replica.cc:333] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.952558  4719 raft_consensus.cc:2243] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:59.953745  4719 raft_consensus.cc:2272] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.957264  4719 tablet_replica.cc:333] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.958037  4719 raft_consensus.cc:2243] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:59.959141  4719 raft_consensus.cc:2272] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:59.960429 12367 consensus_peers.cc:597] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:59.962222  4719 tablet_replica.cc:333] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.963091  4719 raft_consensus.cc:2243] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:58:59.964145  4719 raft_consensus.cc:2272] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.966962  4719 tablet_replica.cc:333] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.967903  4719 raft_consensus.cc:2243] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.968561  4719 raft_consensus.cc:2272] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:58:59.969924 12441 consensus_peers.cc:597] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:58:59.972370  4719 tablet_replica.cc:333] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.973242  4719 raft_consensus.cc:2243] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.973831  4719 raft_consensus.cc:2272] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:58:59.976936  4719 tablet_replica.cc:333] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f: stopping tablet replica
I20260620 13:58:59.977645  4719 raft_consensus.cc:2243] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:58:59.978340  4719 raft_consensus.cc:2272] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:00.000260 12293 consensus_peers.cc:597] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:00.011441 12293 consensus_peers.cc:597] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:00.065061 12293 consensus_peers.cc:597] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:00.082348 12367 consensus_peers.cc:597] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:00.097112  4719 tablet_server.cc:196] TabletServer@127.4.155.193:0 shutdown complete.
W20260620 13:59:00.104434 12441 consensus_peers.cc:597] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:00.231755  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:59:00.240929 13068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:00.244984 13069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:00.251653 13071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:00.258842  4719 server_base.cc:1061] running on GCE node
I20260620 13:59:00.261976  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:59:00.262372  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:59:00.262696  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963940262661 us; error 0 us; skew 500 ppm
I20260620 13:59:00.263546  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:59:00.268230  4719 webserver.cc:533] Webserver started at http://127.4.155.193:45949/ using document root <none> and password file <none>
I20260620 13:59:00.268962  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:59:00.269261  4719 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260620 13:59:00.323553  4719 fs_manager.cc:714] Time spent opening directory manager: real 0.044s	user 0.006s	sys 0.017s
I20260620 13:59:00.353011 13079 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:00.357127  4719 fs_manager.cc:730] Time spent opening block manager: real 0.014s	user 0.001s	sys 0.004s
I20260620 13:59:00.357530  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-0-root
uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
format_stamp: "Formatted at 2026-06-20 13:58:44 on dist-test-slave-n70f"
I20260620 13:59:00.358006  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1781963654985192-4719-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:59:00.377800  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:59:00.379478  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:59:00.391742  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:59:00.397361 13086 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260620 13:59:00.599678 13064 raft_consensus.cc:493] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:00.600365 13064 raft_consensus.cc:515] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:00.603924 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369e0ab28a64476cb0e07ab5672b9337" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:59:00.610615 13064 leader_election.cc:290] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
W20260620 13:59:00.617755 12293 leader_election.cc:336] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:00.618244 12293 leader_election.cc:304] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:59:00.619403 13064 raft_consensus.cc:2749] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:00.734315 12997 raft_consensus.cc:493] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:00.735019 12997 raft_consensus.cc:515] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:00.739487 12997 leader_election.cc:290] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:00.741374 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61907296334d4a149ab81ba5337a1a27" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
W20260620 13:59:00.748873 12367 leader_election.cc:336] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:00.749392 12367 leader_election.cc:304] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:59:00.750155 12997 raft_consensus.cc:2749] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:00.768649 12997 raft_consensus.cc:493] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:00.769271 12997 raft_consensus.cc:515] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:00.773737 12324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1ae3d064cd49309bf086b257c3f664" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:59:00.774279 12997 leader_election.cc:290] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
W20260620 13:59:00.780220 12367 leader_election.cc:336] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:00.777791 13064 raft_consensus.cc:493] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:00.781550 12367 leader_election.cc:304] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:59:00.782320 13064 raft_consensus.cc:515] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:00.783859 12872 raft_consensus.cc:2749] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:00.788535 13064 leader_election.cc:290] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:00.789928 12395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1ae3d064cd49309bf086b257c3f664" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:00.790578 12395 raft_consensus.cc:2468] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:59:00.793680  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260620 13:59:00.794014  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.398s	user 0.009s	sys 0.000s
I20260620 13:59:00.794751  4719 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260620 13:59:00.799538 12292 leader_election.cc:304] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:00.800469 13064 raft_consensus.cc:2804] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:00.800976 13064 raft_consensus.cc:493] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:00.801386 13064 raft_consensus.cc:3060] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:59:00.801915 12293 leader_election.cc:336] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:00.806748 13086 tablet_bootstrap.cc:492] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:00.810614 13064 raft_consensus.cc:515] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
W20260620 13:59:00.817282 12293 leader_election.cc:336] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:00.819701 13064 leader_election.cc:290] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:00.819928 12395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1ae3d064cd49309bf086b257c3f664" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:00.820695 12395 raft_consensus.cc:3060] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:00.824309 12977 raft_consensus.cc:493] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:00.824777 12977 raft_consensus.cc:515] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:00.826792 12977 leader_election.cc:290] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:59:00.828959 12324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369e0ab28a64476cb0e07ab5672b9337" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:59:00.829130 12395 raft_consensus.cc:2468] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 2.
I20260620 13:59:00.829653 12324 raft_consensus.cc:2468] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:59:00.831225 12292 leader_election.cc:304] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:00.833518 12441 leader_election.cc:304] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:00.834971 12977 raft_consensus.cc:2804] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:00.835345 12977 raft_consensus.cc:493] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:00.835683 12977 raft_consensus.cc:3060] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:59:00.844981 12441 leader_election.cc:336] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:00.848505 13086 tablet_bootstrap.cc:492] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:00.849568 13086 tablet_bootstrap.cc:492] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:00.850239 13086 ts_tablet_manager.cc:1403] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.004s
I20260620 13:59:00.854373 13012 raft_consensus.cc:2804] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:00.854941 13012 raft_consensus.cc:697] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:59:00.855844 13012 consensus_queue.cc:237] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:00.853193 13086 raft_consensus.cc:359] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:00.869040 13086 raft_consensus.cc:740] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:00.870579 13086 consensus_queue.cc:260] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:00.885933 13073 raft_consensus.cc:493] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:00.886917 13086 ts_tablet_manager.cc:1434] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.000s
I20260620 13:59:00.886550 13073 raft_consensus.cc:515] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:00.887802 13086 tablet_bootstrap.cc:492] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:00.889230 13073 leader_election.cc:290] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:00.889860 13073 raft_consensus.cc:493] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:00.891049 13073 raft_consensus.cc:515] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:00.891486 12395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9124333b2aae40e2b813819981e990e5" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:00.896445 13073 leader_election.cc:290] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:00.896818 12395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786cabf18ace418e912751ea7c5cc45d" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:00.897364 12997 raft_consensus.cc:493] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:00.962047 12997 raft_consensus.cc:515] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:00.964216 12997 leader_election.cc:290] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:59:00.901576 13077 raft_consensus.cc:493] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:00.930208 13087 raft_consensus.cc:493] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:00.965876 13087 raft_consensus.cc:515] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:00.934763 13000 raft_consensus.cc:493] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:00.936544 13086 tablet_bootstrap.cc:492] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:00.968362 13000 raft_consensus.cc:515] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:00.969025 13086 tablet_bootstrap.cc:492] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:00.969794 13086 ts_tablet_manager.cc:1403] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.082s	user 0.021s	sys 0.000s
I20260620 13:59:00.971302 13087 leader_election.cc:290] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:00.970913 13000 leader_election.cc:290] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:00.972456 13086 raft_consensus.cc:359] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:00.972766 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75286f26552b4e788b3844d3aa342b01" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:59:00.973155 13086 raft_consensus.cc:740] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:00.953866 12148 catalog_manager.cc:5696] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 1 to 2, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 2 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:00.974086 13086 consensus_queue.cc:260] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:00.976286 13086 ts_tablet_manager.cc:1434] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260620 13:59:00.977099 13086 tablet_bootstrap.cc:492] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:00.976989 13077 raft_consensus.cc:515] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:00.979204 13077 leader_election.cc:290] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:59:00.984964 13097 raft_consensus.cc:493] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:00.985857 13097 raft_consensus.cc:515] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:00.989394 12324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b83072f19644f5806c4391cbb1bce5" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:59:00.997125 13094 raft_consensus.cc:493] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:00.997768 13094 raft_consensus.cc:515] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.002171 13094 leader_election.cc:290] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:01.004142 13097 leader_election.cc:290] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.005028 12395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61907296334d4a149ab81ba5337a1a27" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:01.005735 12395 raft_consensus.cc:2468] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:59:01.007439 12440 leader_election.cc:304] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:01.008252 13097 raft_consensus.cc:2804] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.008859 13097 raft_consensus.cc:493] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.009263 13097 raft_consensus.cc:3060] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.015209 13087 raft_consensus.cc:493] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.015848 13087 raft_consensus.cc:515] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.018339 13087 leader_election.cc:290] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.024471 13086 tablet_bootstrap.cc:492] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:01.025476 13086 tablet_bootstrap.cc:492] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:01.025381 13097 raft_consensus.cc:515] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.026371 13086 ts_tablet_manager.cc:1403] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.004s
I20260620 13:59:01.027834 13097 leader_election.cc:290] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.028626 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61907296334d4a149ab81ba5337a1a27" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:01.029209 12399 raft_consensus.cc:3060] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.029248 13086 raft_consensus.cc:359] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:01.029968 13086 raft_consensus.cc:740] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:01.030853 13086 consensus_queue.cc:260] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:01.033105 13086 ts_tablet_manager.cc:1434] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260620 13:59:01.033872 13086 tablet_bootstrap.cc:492] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:01.037177 12399 raft_consensus.cc:2468] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 2.
I20260620 13:59:01.025317 12395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe9fd2ff66d4141a2c7f7023278714d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:01.038812 12440 leader_election.cc:304] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:01.042289 13073 raft_consensus.cc:493] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.042848 13073 raft_consensus.cc:515] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.043286 13097 raft_consensus.cc:2804] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:01.043887 13097 raft_consensus.cc:697] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:59:01.044876 13097 consensus_queue.cc:237] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.046461 12395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75286f26552b4e788b3844d3aa342b01" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:01.047483 12395 raft_consensus.cc:2468] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:59:01.051043 12440 leader_election.cc:304] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:01.054944 13077 raft_consensus.cc:493] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.055781 13077 raft_consensus.cc:515] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.058863 13077 leader_election.cc:290] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.060834 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09dbf9acadba454f83e6b30932aa7806" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:01.061303 13101 raft_consensus.cc:2804] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.135190 13101 raft_consensus.cc:493] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.135634 13101 raft_consensus.cc:3060] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.143605 13101 raft_consensus.cc:515] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.146788 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75286f26552b4e788b3844d3aa342b01" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:01.147457 12399 raft_consensus.cc:3060] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.069180 13073 leader_election.cc:290] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.077559 12149 catalog_manager.cc:5696] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 1 to 2, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 2 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:01.081575 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c50f25282d94111a4d435e85e67af34" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
W20260620 13:59:01.097092 12293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 99959.2us
I20260620 13:59:01.162422 12399 raft_consensus.cc:2468] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 2.
I20260620 13:59:01.163679 12440 leader_election.cc:304] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:01.164731 12997 raft_consensus.cc:493] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.165076 13101 leader_election.cc:290] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:00.959985 12977 raft_consensus.cc:515] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:01.124526 12474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d587f93178449aa9441f0d350cc166d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:59:01.166319 12474 raft_consensus.cc:2468] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:59:01.128114 13064 raft_consensus.cc:493] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.167567 13064 raft_consensus.cc:515] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.170363 13064 leader_election.cc:290] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:01.130740 13087 raft_consensus.cc:493] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.171234 13087 raft_consensus.cc:515] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.174297 13087 leader_election.cc:290] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:59:01.177663 12977 leader_election.cc:290] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:59:01.165314 12997 raft_consensus.cc:515] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.166971 13101 raft_consensus.cc:2804] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:01.178726 13101 raft_consensus.cc:697] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:59:01.179582 13101 consensus_queue.cc:237] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.180311 12997 leader_election.cc:290] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.187974 12977 raft_consensus.cc:493] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.188628 12977 raft_consensus.cc:515] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.191601 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c50f25282d94111a4d435e85e67af34" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:01.192189 12399 raft_consensus.cc:2468] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:59:01.193432 12440 leader_election.cc:304] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:01.194330 13073 raft_consensus.cc:2804] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.194867 13073 raft_consensus.cc:493] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.195441 13073 raft_consensus.cc:3060] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.196342 12977 leader_election.cc:290] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
W20260620 13:59:01.216378 12364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 70162.4us
I20260620 13:59:01.216595 12324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d587f93178449aa9441f0d350cc166d" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:59:01.217232 12324 raft_consensus.cc:2468] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:59:01.220374 13087 raft_consensus.cc:493] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.221071 13087 raft_consensus.cc:515] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.224165 12474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786cabf18ace418e912751ea7c5cc45d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:59:01.229899 12474 raft_consensus.cc:2468] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:59:01.224519 12872 raft_consensus.cc:493] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.231196 12872 raft_consensus.cc:515] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.233819 12872 leader_election.cc:290] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.234345 13095 raft_consensus.cc:493] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.234875 13095 raft_consensus.cc:515] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.237673 13095 leader_election.cc:290] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:01.237911 13086 tablet_bootstrap.cc:492] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:01.223057 13087 leader_election.cc:290] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
W20260620 13:59:01.240445 12441 leader_election.cc:336] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.240922 12441 leader_election.cc:304] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0
I20260620 13:59:01.241971 13101 raft_consensus.cc:2749] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 13:59:01.242166 12441 leader_election.cc:336] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.242681 12441 leader_election.cc:304] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0
I20260620 13:59:01.244984 13086 tablet_bootstrap.cc:492] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:01.245793 13086 ts_tablet_manager.cc:1403] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.212s	user 0.096s	sys 0.077s
I20260620 13:59:01.248526 13101 raft_consensus.cc:2749] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 13:59:01.250363 12293 leader_election.cc:336] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.251427 13073 raft_consensus.cc:515] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.254606 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c50f25282d94111a4d435e85e67af34" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:01.255227 12399 raft_consensus.cc:3060] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:59:01.256518 12293 leader_election.cc:336] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.257009 12293 leader_election.cc:304] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0
W20260620 13:59:01.258656 12290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 54285.5us
I20260620 13:59:01.259866 12290 leader_election.cc:304] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
W20260620 13:59:01.264518 12367 leader_election.cc:336] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.264977 12399 raft_consensus.cc:2468] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 2.
I20260620 13:59:01.265098 12367 leader_election.cc:304] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c
W20260620 13:59:01.265981 12367 leader_election.cc:336] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.266224 12440 leader_election.cc:304] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:01.266423 12367 leader_election.cc:304] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:59:01.268404 13087 raft_consensus.cc:2749] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:01.268517 12395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b83072f19644f5806c4391cbb1bce5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:01.269304 12395 raft_consensus.cc:2468] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:59:01.267087 13101 raft_consensus.cc:2804] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:01.270428 13101 raft_consensus.cc:697] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:59:01.269359 13087 raft_consensus.cc:2749] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:01.271382 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b45b565aa74abfad3579abc6ed2e56" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:01.271571 12364 leader_election.cc:304] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:01.272199 12396 raft_consensus.cc:2468] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:59:01.271442 13101 consensus_queue.cc:237] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.275427 13087 raft_consensus.cc:2804] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.276038 13087 raft_consensus.cc:493] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.275933 13086 raft_consensus.cc:359] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.276867 13087 raft_consensus.cc:3060] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.276868 13086 raft_consensus.cc:740] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:01.279661 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9124333b2aae40e2b813819981e990e5" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:59:01.284066 12475 raft_consensus.cc:2468] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:59:01.284109 13086 consensus_queue.cc:260] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.286434 13086 ts_tablet_manager.cc:1434] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.000s
I20260620 13:59:01.275848 12474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:59:01.288794 12977 raft_consensus.cc:493] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.288944 12441 leader_election.cc:304] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:01.289435 12977 raft_consensus.cc:515] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.291447 12474 raft_consensus.cc:2468] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:59:01.291591 13064 raft_consensus.cc:2749] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:01.292476 12292 leader_election.cc:304] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:01.293797 12292 leader_election.cc:304] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:01.293962 13064 raft_consensus.cc:2804] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.294366 13064 raft_consensus.cc:493] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.294740 13064 raft_consensus.cc:3060] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.295464 13103 raft_consensus.cc:493] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.296075 13094 raft_consensus.cc:2804] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.295976 13103 raft_consensus.cc:515] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:01.296486 13094 raft_consensus.cc:493] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.296867 13094 raft_consensus.cc:3060] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.296794 12393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:01.297971 12393 raft_consensus.cc:2468] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:59:01.298130 13103 leader_election.cc:290] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.299281 13077 raft_consensus.cc:2804] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.299554 12440 leader_election.cc:304] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:01.299721 13077 raft_consensus.cc:493] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.300411 13097 raft_consensus.cc:2804] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.300829 13077 raft_consensus.cc:3060] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.300881 13097 raft_consensus.cc:493] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.301383 13097 raft_consensus.cc:3060] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.303453 12324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369e0ab28a64476cb0e07ab5672b9337" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:01.303762 12977 leader_election.cc:290] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.304109 12324 raft_consensus.cc:3060] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.304965 13104 raft_consensus.cc:2804] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.305406 13104 raft_consensus.cc:493] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.305765 13104 raft_consensus.cc:3060] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:59:01.304366 12290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 44604us
I20260620 13:59:01.296123 13086 tablet_bootstrap.cc:492] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:01.308280 12364 leader_election.cc:304] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
W20260620 13:59:01.308243 12293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 51754.3us
I20260620 13:59:01.315429 12872 raft_consensus.cc:493] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.317855 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2940ddb8684b88ac43aa54628de34f" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:59:01.316077 12872 raft_consensus.cc:515] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.320585 12872 leader_election.cc:290] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.324186 12364 leader_election.cc:304] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:01.329197 12872 raft_consensus.cc:2804] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.329545 12872 raft_consensus.cc:493] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.329803 12872 raft_consensus.cc:3060] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.332305 12321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdb1bbde932422ba09645787f9d2446" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:59:01.328785 12997 raft_consensus.cc:2804] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.323269 13095 raft_consensus.cc:493] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.341346 13087 raft_consensus.cc:515] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.342725 13073 leader_election.cc:290] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.363250 12872 raft_consensus.cc:515] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.342785 12977 raft_consensus.cc:493] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.347287 12997 raft_consensus.cc:493] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.349465 12321 raft_consensus.cc:2468] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:59:01.339555 13097 raft_consensus.cc:515] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.370738 12872 leader_election.cc:290] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.377444 12872 raft_consensus.cc:493] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.377960 12872 raft_consensus.cc:515] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.378206  4719 ts_tablet_manager.cc:616] Registered 45 tablets
I20260620 13:59:01.381853  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.587s	user 0.316s	sys 0.003s
I20260620 13:59:01.383226 12872 leader_election.cc:290] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:59:01.371472 12997 raft_consensus.cc:3060] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.364914 13094 raft_consensus.cc:515] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.361433 13095 raft_consensus.cc:515] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:01.371209 12977 raft_consensus.cc:515] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:01.371233 13000 raft_consensus.cc:493] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
W20260620 13:59:01.389683 12441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:37965, user_credentials={real_user=slave}} blocked reactor thread for 79422.5us
I20260620 13:59:01.393428 13087 leader_election.cc:290] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.395294 13064 raft_consensus.cc:515] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.396620 13077 raft_consensus.cc:515] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:01.409413 13077 leader_election.cc:290] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
W20260620 13:59:01.417694 12441 leader_election.cc:336] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:01.419483 12441 leader_election.cc:336] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.423234 13097 leader_election.cc:290] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.424954 13095 leader_election.cc:290] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.419931 13064 leader_election.cc:290] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
W20260620 13:59:01.430421 12441 leader_election.cc:336] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:01.429908 12293 leader_election.cc:336] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.399715 12474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09dbf9acadba454f83e6b30932aa7806" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
W20260620 13:59:01.437052 12441 leader_election.cc:336] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.440268 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17521c552cad497e9ae59a332d156c0e" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:59:01.440958 12475 raft_consensus.cc:2468] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 1.
I20260620 13:59:01.439360 12393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:01.442344 13104 raft_consensus.cc:515] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:01.412544 13000 raft_consensus.cc:515] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.443339 12393 raft_consensus.cc:2393] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 69a98f1d9eda4cd9bdd2287823f798f6 in current term 2: Already voted for candidate c51ef915af09435db6046c91bb9d00e0 in this term.
I20260620 13:59:01.440512 12441 leader_election.cc:304] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0
W20260620 13:59:01.446686 12441 leader_election.cc:336] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:01.458510 12293 leader_election.cc:336] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.462875 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b83072f19644f5806c4391cbb1bce5" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:01.463578 12399 raft_consensus.cc:3060] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.454658 12367 leader_election.cc:304] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:01.467551 12977 leader_election.cc:290] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:59:01.470211 12473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786cabf18ace418e912751ea7c5cc45d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:01.470813 12473 raft_consensus.cc:3060] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:59:01.471575 12367 leader_election.cc:336] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.472168 12367 leader_election.cc:304] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:59:01.452581 12474 raft_consensus.cc:2468] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
I20260620 13:59:01.475557 13118 raft_consensus.cc:2804] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.475979 13118 raft_consensus.cc:493] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.476328 13118 raft_consensus.cc:3060] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.478231 12324 raft_consensus.cc:2468] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 2.
I20260620 13:59:01.479612 13116 raft_consensus.cc:2749] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:01.482470 13104 leader_election.cc:290] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.484807 13094 leader_election.cc:290] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:01.485637 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:01.486356 12475 raft_consensus.cc:2393] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c51ef915af09435db6046c91bb9d00e0 in current term 2: Already voted for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in this term.
W20260620 13:59:01.486937 12367 leader_election.cc:336] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:01.487778 12367 leader_election.cc:336] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:01.488595 12367 leader_election.cc:336] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:01.489509 12367 leader_election.cc:336] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.490741 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d587f93178449aa9441f0d350cc166d" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:01.491524 12323 raft_consensus.cc:2393] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 69a98f1d9eda4cd9bdd2287823f798f6 in current term 2: Already voted for candidate fcd1bd5dfea74c378a6154f83707154c in this term.
I20260620 13:59:01.492772 12321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe9fd2ff66d4141a2c7f7023278714d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:59:01.493427 12321 raft_consensus.cc:2468] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 1.
W20260620 13:59:01.493517 12293 leader_election.cc:336] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:01.494381 12293 leader_election.cc:336] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:01.494848 12293 leader_election.cc:336] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:01.495451 12293 leader_election.cc:336] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.495820 12293 leader_election.cc:304] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:59:01.500047 13094 raft_consensus.cc:2749] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:01.502126 12290 leader_election.cc:304] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
W20260620 13:59:01.501870 12441 leader_election.cc:336] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:01.503803 12441 leader_election.cc:336] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.505016 13012 raft_consensus.cc:2804] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.505309 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d587f93178449aa9441f0d350cc166d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:01.505532 13012 raft_consensus.cc:493] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
W20260620 13:59:01.504388 12441 leader_election.cc:336] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.507455 13000 leader_election.cc:290] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:01.506125 13118 raft_consensus.cc:515] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.479538 13097 raft_consensus.cc:2749] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:01.506292 12467 raft_consensus.cc:2393] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fcd1bd5dfea74c378a6154f83707154c in current term 2: Already voted for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in this term.
I20260620 13:59:01.509948 13118 leader_election.cc:290] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:59:01.506157 13012 raft_consensus.cc:3060] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:59:01.507882 12367 leader_election.cc:336] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:01.512457 12367 leader_election.cc:336] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:01.512936 12367 leader_election.cc:336] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.513345 12399 raft_consensus.cc:2468] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 2.
W20260620 13:59:01.513542 12367 leader_election.cc:336] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.521644 12364 leader_election.cc:304] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:01.530508 12473 raft_consensus.cc:2468] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 2.
I20260620 13:59:01.530180 12367 leader_election.cc:304] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
W20260620 13:59:01.531865 12293 consensus_peers.cc:597] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:01.532555 12293 leader_election.cc:336] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.532631 12364 leader_election.cc:304] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:59:01.533032 12293 leader_election.cc:304] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:59:01.533308 12324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdb1bbde932422ba09645787f9d2446" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:01.533895 12324 raft_consensus.cc:3060] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.536362 12872 raft_consensus.cc:2804] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.536753 12872 raft_consensus.cc:493] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.537062 12872 raft_consensus.cc:3060] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.538396 13111 raft_consensus.cc:2749] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:59:01.536949 13000 raft_consensus.cc:2749] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:59:01.540719 12364 leader_election.cc:304] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:01.542241 13087 raft_consensus.cc:2804] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:01.542699 13087 raft_consensus.cc:697] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:01.543524 13087 consensus_queue.cc:237] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.537150 13118 raft_consensus.cc:2804] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.546538 13118 raft_consensus.cc:493] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.546922 13118 raft_consensus.cc:3060] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.544466 12149 catalog_manager.cc:5696] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 1 to 2, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 2 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:01.551343 12149 catalog_manager.cc:5696] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 1 to 2, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 2 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:01.549667 12323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2940ddb8684b88ac43aa54628de34f" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:59:01.555455 12323 raft_consensus.cc:2468] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 1.
I20260620 13:59:01.546916 12872 raft_consensus.cc:515] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.558432 12324 raft_consensus.cc:2468] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 2.
I20260620 13:59:01.559311 12441 leader_election.cc:304] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:01.559561 12367 leader_election.cc:304] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:01.561717 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b45b565aa74abfad3579abc6ed2e56" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:01.562410 12397 raft_consensus.cc:3060] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.569167 13111 raft_consensus.cc:2804] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:01.569911 13111 raft_consensus.cc:697] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:01.572206 12395 raft_consensus.cc:1275] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer fcd1bd5dfea74c378a6154f83707154c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:01.573156 12872 leader_election.cc:290] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:59:01.573441 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdb1bbde932422ba09645787f9d2446" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:01.574899 12395 raft_consensus.cc:1275] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 69a98f1d9eda4cd9bdd2287823f798f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:01.577603 12292 leader_election.cc:304] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
W20260620 13:59:01.579847 12293 leader_election.cc:336] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.582068 12441 leader_election.cc:304] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:01.582763 12324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe9fd2ff66d4141a2c7f7023278714d" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:01.583472 12324 raft_consensus.cc:3060] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:59:01.583855 12441 leader_election.cc:336] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:01.584486 12441 leader_election.cc:336] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:01.585001 12441 leader_election.cc:336] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.585419 12441 leader_election.cc:304] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:59:01.587689 13114 raft_consensus.cc:2804] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:01.588321 13114 raft_consensus.cc:493] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:01.588836 13114 raft_consensus.cc:3060] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.589783 12977 consensus_queue.cc:1048] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:01.595626 13094 raft_consensus.cc:2804] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:01.596572 13094 raft_consensus.cc:697] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:59:01.597839 13094 consensus_queue.cc:237] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.599197 13097 raft_consensus.cc:2804] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:01.599941 13097 raft_consensus.cc:697] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:59:01.601114 13097 consensus_queue.cc:237] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
W20260620 13:59:01.607349 12367 leader_election.cc:336] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:01.608300 12367 leader_election.cc:336] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.550179 12997 raft_consensus.cc:515] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.610754 12397 raft_consensus.cc:2468] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 2.
I20260620 13:59:01.571019 13111 consensus_queue.cc:237] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
W20260620 13:59:01.621256 12367 leader_election.cc:336] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.613010 12997 leader_election.cc:290] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.625699 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9124333b2aae40e2b813819981e990e5" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:01.626423 12467 raft_consensus.cc:3060] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.626996 13104 consensus_queue.cc:1048] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:01.629491 12292 leader_election.cc:304] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0
I20260620 13:59:01.630851 12292 leader_election.cc:304] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:01.632112 13086 tablet_bootstrap.cc:492] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:01.614764 13012 raft_consensus.cc:515] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:01.633972 13073 raft_consensus.cc:2749] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:59:01.633535 13112 raft_consensus.cc:2749] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:01.635828 13012 leader_election.cc:290] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:01.637740 13104 raft_consensus.cc:2804] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:01.637832 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17521c552cad497e9ae59a332d156c0e" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:01.638274 13104 raft_consensus.cc:697] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:59:01.638619 12469 raft_consensus.cc:3060] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:59:01.639743 12441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 54748.2us
W20260620 13:59:01.640542 12441 leader_election.cc:336] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.641013 12441 leader_election.cc:304] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0
I20260620 13:59:01.647652 12148 catalog_manager.cc:5696] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 1 to 2, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:01.653885 12467 raft_consensus.cc:2468] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 2.
I20260620 13:59:01.646937 13073 raft_consensus.cc:2749] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 13:59:01.639150 13104 consensus_queue.cc:237] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
W20260620 13:59:01.663914 12293 leader_election.cc:336] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.675552 12469 raft_consensus.cc:2468] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 2.
I20260620 13:59:01.677659 12290 leader_election.cc:304] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:01.679231 13000 raft_consensus.cc:2804] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:01.679848 13000 raft_consensus.cc:697] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:59:01.680776 13000 consensus_queue.cc:237] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:01.684969 13086 tablet_bootstrap.cc:492] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:01.685355 12364 leader_election.cc:304] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:01.685745 13086 ts_tablet_manager.cc:1403] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.390s	user 0.030s	sys 0.017s
W20260620 13:59:01.686125 12441 leader_election.cc:336] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.686378 12324 raft_consensus.cc:2468] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 2.
I20260620 13:59:01.687332 13087 raft_consensus.cc:2804] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:01.689652 13087 raft_consensus.cc:697] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:01.687821 12367 leader_election.cc:304] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:01.691670 12872 raft_consensus.cc:2804] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:01.692288 12872 raft_consensus.cc:697] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:01.693292 12872 consensus_queue.cc:237] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.706550 13086 raft_consensus.cc:359] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.708240 13086 raft_consensus.cc:740] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:01.709649 13086 consensus_queue.cc:260] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:01.714185 13086 ts_tablet_manager.cc:1434] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260620 13:59:01.746930 12397 raft_consensus.cc:1275] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 69a98f1d9eda4cd9bdd2287823f798f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260620 13:59:01.783990 12364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 63698us
I20260620 13:59:01.690521 13087 consensus_queue.cc:237] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.826730 13086 tablet_bootstrap.cc:492] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:01.814503 13118 raft_consensus.cc:515] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:01.835820 13097 consensus_queue.cc:1048] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260620 13:59:01.845037 13118 leader_election.cc:290] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
W20260620 13:59:01.905689 12441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:37965, user_credentials={real_user=slave}} blocked reactor thread for 204388us
I20260620 13:59:01.915696 12393 raft_consensus.cc:1275] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 69a98f1d9eda4cd9bdd2287823f798f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260620 13:59:01.920177 12292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.195:37673, user_credentials={real_user=slave}} blocked reactor thread for 90369.9us
I20260620 13:59:01.911841 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09dbf9acadba454f83e6b30932aa7806" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:01.928313 12467 raft_consensus.cc:3060] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:01.932911 13114 raft_consensus.cc:515] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:01.935065 13114 leader_election.cc:290] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Requested vote from peers 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
W20260620 13:59:01.949782 12441 consensus_peers.cc:597] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:01.948755 13129 log.cc:927] Time spent T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0: Append to log took a long time: real 0.239s	user 0.006s	sys 0.000s
I20260620 13:59:01.953178 12148 catalog_manager.cc:5696] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 1 to 2, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 2 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:01.973392 12149 catalog_manager.cc:5696] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 1 to 2, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 2 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:01.938364 12467 raft_consensus.cc:2468] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 2.
I20260620 13:59:01.994263 12364 leader_election.cc:304] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
W20260620 13:59:01.994417 13146 log.cc:927] Time spent T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260620 13:59:01.996086 13108 raft_consensus.cc:2804] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:01.997107 13108 raft_consensus.cc:697] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
W20260620 13:59:01.998909 12367 leader_election.cc:336] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:01.998167 13108 consensus_queue.cc:237] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:02.000773 13142 consensus_queue.cc:1048] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260620 13:59:02.008661 12441 consensus_peers.cc:597] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:02.045827 12293 consensus_peers.cc:597] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:02.089082 12441 leader_election.cc:336] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
W20260620 13:59:02.089775 12441 consensus_peers.cc:597] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:02.106959 12290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 197208us
I20260620 13:59:02.108074 12473 raft_consensus.cc:1275] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Refusing update from remote peer c51ef915af09435db6046c91bb9d00e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260620 13:59:02.112689 12367 consensus_peers.cc:597] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:02.114799 12320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2940ddb8684b88ac43aa54628de34f" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:02.115552 12320 raft_consensus.cc:3060] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:02.115922 13090 raft_consensus.cc:493] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:02.116587 13090 raft_consensus.cc:515] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
W20260620 13:59:02.120675 12367 consensus_peers.cc:597] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.121265 13111 consensus_queue.cc:1048] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:02.144028 12392 raft_consensus.cc:1275] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer fcd1bd5dfea74c378a6154f83707154c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:02.132977 13090 leader_election.cc:290] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:02.155848 13104 consensus_queue.cc:1048] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260620 13:59:02.158707 12367 consensus_peers.cc:597] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:02.149827 12148 catalog_manager.cc:5696] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 1 to 2, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:02.162158 12148 catalog_manager.cc:5696] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 1 to 2, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:02.169025 12320 raft_consensus.cc:2468] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 2.
W20260620 13:59:02.181180 12441 consensus_peers.cc:597] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:02.187083 12441 consensus_peers.cc:597] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:02.187774 12148 catalog_manager.cc:5696] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 1 to 2, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:02.199674 13086 tablet_bootstrap.cc:492] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:02.200817 13086 tablet_bootstrap.cc:492] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:02.201604 13086 ts_tablet_manager.cc:1403] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.375s	user 0.024s	sys 0.018s
W20260620 13:59:02.211417 12290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 103478us
I20260620 13:59:02.218226 12473 raft_consensus.cc:1275] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Refusing update from remote peer fcd1bd5dfea74c378a6154f83707154c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260620 13:59:02.218381 12367 consensus_peers.cc:597] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.229122 12148 catalog_manager.cc:5696] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 1 to 2, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } }
W20260620 13:59:02.234062 12367 consensus_peers.cc:597] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:02.240447 12367 consensus_peers.cc:597] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:02.240964 12367 consensus_peers.cc:597] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:02.262187 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee8de600a8646df90a272c586e08ae5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
W20260620 13:59:02.262734 12367 consensus_peers.cc:597] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.275580 12324 raft_consensus.cc:1275] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Refusing update from remote peer c51ef915af09435db6046c91bb9d00e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:02.277145 13086 raft_consensus.cc:359] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:02.278311 13086 raft_consensus.cc:740] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:02.280663 12324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee8de600a8646df90a272c586e08ae5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:59:02.282655 12441 leader_election.cc:304] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:02.282810 13083 leader_election.cc:304] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:59:02.283882 13090 raft_consensus.cc:2749] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:02.284127 13093 raft_consensus.cc:2804] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election won for term 2
W20260620 13:59:02.284699 12367 consensus_peers.cc:597] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.284814 13093 raft_consensus.cc:697] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:59:02.285944 13093 consensus_queue.cc:237] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:02.285477 13086 consensus_queue.cc:260] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:02.290409 12148 catalog_manager.cc:5696] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 1 to 2, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 2 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:02.293820 12148 catalog_manager.cc:5696] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 1 to 2, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 2 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:02.299549 12321 raft_consensus.cc:1275] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Refusing update from remote peer c51ef915af09435db6046c91bb9d00e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:02.309417 13120 consensus_queue.cc:1048] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:02.310937 13086 ts_tablet_manager.cc:1434] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.000s
I20260620 13:59:02.311830 13086 tablet_bootstrap.cc:492] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
W20260620 13:59:02.312592 12293 consensus_peers.cc:597] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:02.313239 12293 consensus_peers.cc:597] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:02.313745 12293 consensus_peers.cc:597] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:02.314579 12293 consensus_peers.cc:597] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:02.315640 12441 consensus_peers.cc:597] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:02.317128 12367 consensus_peers.cc:597] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.324606 13153 consensus_queue.cc:1048] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260620 13:59:02.324903 12441 consensus_peers.cc:597] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.328532 12320 raft_consensus.cc:1275] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Refusing update from remote peer 69a98f1d9eda4cd9bdd2287823f798f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:02.331159 13111 consensus_queue.cc:1048] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260620 13:59:02.372439 12367 consensus_peers.cc:597] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:02.382822 12293 consensus_peers.cc:597] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.385349 12148 catalog_manager.cc:5696] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 1 to 2, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 2 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } }
W20260620 13:59:02.393432 12367 consensus_peers.cc:597] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.399837 13090 raft_consensus.cc:493] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:02.395627 13093 consensus_queue.cc:1048] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260620 13:59:02.400391 13090 raft_consensus.cc:515] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:02.405613 12467 raft_consensus.cc:1275] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Refusing update from remote peer c51ef915af09435db6046c91bb9d00e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:02.409063 13090 leader_election.cc:290] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:59:02.408968 13116 consensus_queue.cc:1048] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:02.413800 12397 raft_consensus.cc:1275] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer fcd1bd5dfea74c378a6154f83707154c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:02.416385 12320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c52f04bdd14864afe89398fc3af00c" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
W20260620 13:59:02.420326 12367 consensus_peers.cc:597] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:02.420409 12441 consensus_peers.cc:597] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:02.440083 12293 consensus_peers.cc:597] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:02.479676 12293 consensus_peers.cc:597] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.462013 13153 consensus_queue.cc:1048] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260620 13:59:02.490681 13086 tablet_bootstrap.cc:492] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260620 13:59:02.495085 12293 consensus_peers.cc:597] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:02.498092 12441 consensus_peers.cc:597] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.513643 13086 tablet_bootstrap.cc:492] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:02.514464 13086 ts_tablet_manager.cc:1403] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.203s	user 0.021s	sys 0.001s
I20260620 13:59:02.538646 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c52f04bdd14864afe89398fc3af00c" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
W20260620 13:59:02.540412 12367 consensus_peers.cc:597] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.540938 13080 leader_election.cc:304] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:59:02.543150 13090 raft_consensus.cc:2749] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 13:59:02.541169 12367 consensus_peers.cc:597] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.544744 13086 raft_consensus.cc:359] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:02.560146 13086 raft_consensus.cc:740] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
W20260620 13:59:02.546448 12293 consensus_peers.cc:597] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.561535 13086 consensus_queue.cc:260] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:02.563714 13086 ts_tablet_manager.cc:1434] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260620 13:59:02.567180 13086 tablet_bootstrap.cc:492] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:02.569840 12469 raft_consensus.cc:1275] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Refusing update from remote peer c51ef915af09435db6046c91bb9d00e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:02.571844 13108 consensus_queue.cc:1048] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:02.617304 13086 tablet_bootstrap.cc:492] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:02.618405 13086 tablet_bootstrap.cc:492] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:02.619218 13086 ts_tablet_manager.cc:1403] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.004s
W20260620 13:59:02.619663 12441 consensus_peers.cc:597] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.622469 13086 raft_consensus.cc:359] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:02.623373 13086 raft_consensus.cc:740] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:02.624164 13086 consensus_queue.cc:260] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:02.626688 13086 ts_tablet_manager.cc:1434] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260620 13:59:02.627615 13086 tablet_bootstrap.cc:492] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:02.653575 13086 tablet_bootstrap.cc:492] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260620 13:59:02.655563 12367 consensus_peers.cc:597] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:02.657827 13086 tablet_bootstrap.cc:492] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:02.658674 13086 ts_tablet_manager.cc:1403] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.008s
I20260620 13:59:02.670645 13090 raft_consensus.cc:493] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:02.671272 13090 raft_consensus.cc:515] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:02.677129 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e933cf7b644e4b893d2e7e85425be" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:02.678287 13090 leader_election.cc:290] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:02.682041 13086 raft_consensus.cc:359] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:02.682910 13086 raft_consensus.cc:740] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:02.685475 12321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2e933cf7b644e4b893d2e7e85425be" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:59:02.688436 13083 leader_election.cc:304] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:59:02.690402 13090 raft_consensus.cc:2749] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 13:59:02.677753 12293 consensus_peers.cc:597] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.683792 13086 consensus_queue.cc:260] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:02.705156 13086 ts_tablet_manager.cc:1434] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260620 13:59:02.706187 13086 tablet_bootstrap.cc:492] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:02.716042 13090 raft_consensus.cc:493] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:02.716866 13090 raft_consensus.cc:515] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:02.721288 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d2754643614cdcb0928c841c0fa0bb" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:59:02.726121 13090 leader_election.cc:290] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:59:02.726450 12321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d2754643614cdcb0928c841c0fa0bb" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:59:02.728713 13083 leader_election.cc:304] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:59:02.730291 13090 raft_consensus.cc:2749] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 13:59:02.734869 12441 consensus_peers.cc:597] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:02.820142 13086 tablet_bootstrap.cc:492] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:02.823230 13086 tablet_bootstrap.cc:492] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:02.824019 13086 ts_tablet_manager.cc:1403] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.005s
I20260620 13:59:02.826884 13086 raft_consensus.cc:359] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:02.827764 13086 raft_consensus.cc:740] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:02.828572 13086 consensus_queue.cc:260] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:02.831059 13086 ts_tablet_manager.cc:1434] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260620 13:59:02.831990 13086 tablet_bootstrap.cc:492] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:02.887965 12326 raft_consensus.cc:1275] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Refusing update from remote peer 69a98f1d9eda4cd9bdd2287823f798f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:02.890137 13093 consensus_queue.cc:1048] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260620 13:59:02.902886 12441 consensus_peers.cc:597] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:02.923795 12293 consensus_peers.cc:597] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:03.098945 12293 consensus_peers.cc:597] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:03.107946 13086 tablet_bootstrap.cc:492] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:03.110978 13086 tablet_bootstrap.cc:492] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:03.114728 13086 ts_tablet_manager.cc:1403] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.283s	user 0.064s	sys 0.079s
I20260620 13:59:03.133950 13086 raft_consensus.cc:359] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:03.134684 13086 raft_consensus.cc:740] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:03.135536 13086 consensus_queue.cc:260] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:03.137660 13086 ts_tablet_manager.cc:1434] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260620 13:59:03.144860 13086 tablet_bootstrap.cc:492] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
W20260620 13:59:03.159169 12364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 54358.9us
W20260620 13:59:03.170159 12367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:37965, user_credentials={real_user=slave}} blocked reactor thread for 76534.1us
W20260620 13:59:03.175431 12441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:37965, user_credentials={real_user=slave}} blocked reactor thread for 61361.2us
I20260620 13:59:03.247457 13086 tablet_bootstrap.cc:492] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:03.248502 13086 tablet_bootstrap.cc:492] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:03.249217 13086 ts_tablet_manager.cc:1403] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.111s	user 0.015s	sys 0.005s
I20260620 13:59:03.251871 13086 raft_consensus.cc:359] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
W20260620 13:59:03.253278 12367 consensus_peers.cc:597] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:03.256672 13086 raft_consensus.cc:740] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:03.258776 13086 consensus_queue.cc:260] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:03.262060 13086 ts_tablet_manager.cc:1434] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260620 13:59:03.264400 13086 tablet_bootstrap.cc:492] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:03.286557 13086 tablet_bootstrap.cc:492] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:03.287637 13086 tablet_bootstrap.cc:492] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:03.288511 13086 ts_tablet_manager.cc:1403] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260620 13:59:03.291021 13086 raft_consensus.cc:359] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:03.292106 13086 raft_consensus.cc:740] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:03.294117 13086 consensus_queue.cc:260] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:03.298131 13086 ts_tablet_manager.cc:1434] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260620 13:59:03.299885 13086 tablet_bootstrap.cc:492] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:03.339794 13141 raft_consensus.cc:493] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:03.340448 13141 raft_consensus.cc:515] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:03.343838 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d587f93178449aa9441f0d350cc166d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:59:03.344570 12467 raft_consensus.cc:2468] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 2.
I20260620 13:59:03.345880 12290 leader_election.cc:304] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:03.346750 13148 raft_consensus.cc:2804] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:59:03.347260 13148 raft_consensus.cc:493] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:03.347579 13148 raft_consensus.cc:3060] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:03.347957 13141 leader_election.cc:290] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
W20260620 13:59:03.354195 12293 leader_election.cc:336] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:03.356273 13148 raft_consensus.cc:515] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:03.359345 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d587f93178449aa9441f0d350cc166d" candidate_uuid: "fcd1bd5dfea74c378a6154f83707154c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:03.360157 12467 raft_consensus.cc:3060] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:03.346742 13086 tablet_bootstrap.cc:492] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:03.363050 13086 tablet_bootstrap.cc:492] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:03.363855 13086 ts_tablet_manager.cc:1403] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.008s
I20260620 13:59:03.367985 12467 raft_consensus.cc:2468] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd1bd5dfea74c378a6154f83707154c in term 3.
I20260620 13:59:03.369298 12290 leader_election.cc:304] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:03.370196 13141 raft_consensus.cc:2804] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:59:03.370723 13141 raft_consensus.cc:697] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 3 LEADER]: Becoming Leader. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:59:03.371611 13141 consensus_queue.cc:237] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:03.369724 13086 raft_consensus.cc:359] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:03.378471 13086 raft_consensus.cc:740] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:03.378563 13148 leader_election.cc:290] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 3 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:03.379379 13086 consensus_queue.cc:260] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
W20260620 13:59:03.384367 12293 leader_election.cc:336] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:03.387362 13086 ts_tablet_manager.cc:1434] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260620 13:59:03.388916 13086 tablet_bootstrap.cc:492] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:03.396914 12146 catalog_manager.cc:5696] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c reported cstate change: term changed from 1 to 3, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to fcd1bd5dfea74c378a6154f83707154c (127.4.155.194). New cstate: current_term: 3 leader_uuid: "fcd1bd5dfea74c378a6154f83707154c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:03.434878 13086 tablet_bootstrap.cc:492] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:03.435945 13086 tablet_bootstrap.cc:492] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:03.436602 13086 ts_tablet_manager.cc:1403] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.015s
I20260620 13:59:03.439611 13086 raft_consensus.cc:359] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:03.447089 13086 raft_consensus.cc:740] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:03.447952 13086 consensus_queue.cc:260] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:03.450441 13086 ts_tablet_manager.cc:1434] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260620 13:59:03.451277 13086 tablet_bootstrap.cc:492] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:03.455860 13207 raft_consensus.cc:493] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:03.456589 13207 raft_consensus.cc:515] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:03.461572 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:59:03.462481 12467 raft_consensus.cc:2468] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 2.
I20260620 13:59:03.463899 12364 leader_election.cc:304] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:03.464596 13207 leader_election.cc:290] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
I20260620 13:59:03.465468 13203 raft_consensus.cc:2804] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:59:03.465912 13203 raft_consensus.cc:493] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:03.466748 13203 raft_consensus.cc:3060] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:59:03.470738 12367 leader_election.cc:336] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:03.483764 13203 raft_consensus.cc:515] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:03.486792 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:03.487416 12467 raft_consensus.cc:3060] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:03.487550 13203 leader_election.cc:290] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 3 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
W20260620 13:59:03.502792 12367 leader_election.cc:336] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:03.520123 13086 tablet_bootstrap.cc:492] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:03.522001 13086 tablet_bootstrap.cc:492] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:03.522786 13086 ts_tablet_manager.cc:1403] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.072s	user 0.026s	sys 0.010s
I20260620 13:59:03.526412 13086 raft_consensus.cc:359] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:03.527081 13086 raft_consensus.cc:740] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:03.527784 13086 consensus_queue.cc:260] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:03.529852 13086 ts_tablet_manager.cc:1434] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 13:59:03.530699 13086 tablet_bootstrap.cc:492] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:03.548763 13090 raft_consensus.cc:493] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:03.549463 13090 raft_consensus.cc:515] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:03.559404 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ae493b3ffc48e19f911962029c41e5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:03.562846 12326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ae493b3ffc48e19f911962029c41e5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:59:03.552989 13090 leader_election.cc:290] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:03.566910 13082 leader_election.cc:304] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:59:03.570313 13090 raft_consensus.cc:2749] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:03.568776 12467 raft_consensus.cc:2468] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 3.
I20260620 13:59:03.571854 12364 leader_election.cc:304] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:03.572878 13203 raft_consensus.cc:2804] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:59:03.573443 13203 raft_consensus.cc:697] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 3 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:03.574851 13203 consensus_queue.cc:237] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:03.576342 13086 tablet_bootstrap.cc:492] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:03.577376 13086 tablet_bootstrap.cc:492] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:03.578169 13086 ts_tablet_manager.cc:1403] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.009s
I20260620 13:59:03.582630 13086 raft_consensus.cc:359] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:03.583354 13086 raft_consensus.cc:740] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:03.584002 13086 consensus_queue.cc:260] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:03.587630 13086 ts_tablet_manager.cc:1434] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260620 13:59:03.588490 13086 tablet_bootstrap.cc:492] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:03.614338 12146 catalog_manager.cc:5696] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 1 to 3, leader changed from 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193) to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:03.629431 13086 tablet_bootstrap.cc:492] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:03.630774 13086 tablet_bootstrap.cc:492] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:03.631657 13086 ts_tablet_manager.cc:1403] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.010s
I20260620 13:59:03.635259 13086 raft_consensus.cc:359] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:03.636060 13086 raft_consensus.cc:740] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:03.637414 13086 consensus_queue.cc:260] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:03.640664 13086 ts_tablet_manager.cc:1434] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260620 13:59:03.641887 13086 tablet_bootstrap.cc:492] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:03.680989 13086 tablet_bootstrap.cc:492] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:03.682502 13086 tablet_bootstrap.cc:492] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:03.683261 13086 ts_tablet_manager.cc:1403] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.003s
I20260620 13:59:03.686514 13086 raft_consensus.cc:359] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:03.691318 13086 raft_consensus.cc:740] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:03.692209 13086 consensus_queue.cc:260] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:03.697714 13086 ts_tablet_manager.cc:1434] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.004s
I20260620 13:59:03.698885 13086 tablet_bootstrap.cc:492] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:03.738030 13086 tablet_bootstrap.cc:492] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:03.739420 13086 tablet_bootstrap.cc:492] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:03.740201 13086 ts_tablet_manager.cc:1403] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.010s
I20260620 13:59:03.744827 13086 raft_consensus.cc:359] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:03.745664 13086 raft_consensus.cc:740] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:03.746523 13086 consensus_queue.cc:260] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:03.749436 13086 ts_tablet_manager.cc:1434] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260620 13:59:03.750367 13086 tablet_bootstrap.cc:492] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:03.845096 13251 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.193:35839 every 8 connection(s)
I20260620 13:59:03.847887 13086 tablet_bootstrap.cc:492] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:03.850565 13086 tablet_bootstrap.cc:492] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:03.851326 13086 ts_tablet_manager.cc:1403] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.101s	user 0.036s	sys 0.045s
I20260620 13:59:03.851866  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.193:35839
I20260620 13:59:03.854874 13086 raft_consensus.cc:359] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:03.855738 13086 raft_consensus.cc:740] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:03.856463 13086 consensus_queue.cc:260] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:03.859479 13086 ts_tablet_manager.cc:1434] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260620 13:59:03.860349 13086 tablet_bootstrap.cc:492] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:03.912521 13086 tablet_bootstrap.cc:492] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:03.913785 13086 tablet_bootstrap.cc:492] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:03.914393 13086 ts_tablet_manager.cc:1403] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.010s
I20260620 13:59:03.920302 13086 raft_consensus.cc:359] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:03.921444 13086 raft_consensus.cc:740] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:03.922340 13086 consensus_queue.cc:260] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:03.925472 13086 ts_tablet_manager.cc:1434] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260620 13:59:03.926393 13086 tablet_bootstrap.cc:492] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:03.941172 12467 raft_consensus.cc:1275] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Refusing update from remote peer fcd1bd5dfea74c378a6154f83707154c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260620 13:59:03.944988 13219 consensus_queue.cc:1048] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:03.952890 13208 raft_consensus.cc:3060] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:03.954011 13090 raft_consensus.cc:493] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:03.954550 13090 raft_consensus.cc:515] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:03.956859 13090 leader_election.cc:290] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:59:03.959017 13209 raft_consensus.cc:3060] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:03.973270 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2596bf072bda4ad188dcc3f1438a4d7d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:04.014366 12475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2596bf072bda4ad188dcc3f1438a4d7d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:59:04.027752 13086 tablet_bootstrap.cc:492] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:04.030190 13086 tablet_bootstrap.cc:492] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:04.030926 13086 ts_tablet_manager.cc:1403] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.010s
I20260620 13:59:04.033322 13211 raft_consensus.cc:3060] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 3
I20260620 13:59:04.046077 13086 raft_consensus.cc:359] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:04.051275 13086 raft_consensus.cc:740] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:04.053845 13086 consensus_queue.cc:260] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:04.054697 13211 raft_consensus.cc:1275] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Refusing update from remote peer fcd1bd5dfea74c378a6154f83707154c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260620 13:59:04.056751 13261 raft_consensus.cc:493] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:04.059919 13086 ts_tablet_manager.cc:1434] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260620 13:59:04.060061 13261 raft_consensus.cc:515] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:04.070958 13261 leader_election.cc:290] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:59:04.071833 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c51ef915af09435db6046c91bb9d00e0" is_pre_election: true
I20260620 13:59:04.073467 13086 tablet_bootstrap.cc:492] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:04.078214 13261 raft_consensus.cc:493] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:04.078882 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
I20260620 13:59:04.079988 12469 raft_consensus.cc:2368] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d43d0ad579244c0a3ebb71069c1ab4f for earlier term 2. Current term is 3.
I20260620 13:59:04.080755 13261 raft_consensus.cc:515] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:04.090051 13261 leader_election.cc:290] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:59:04.099434 12320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c52f04bdd14864afe89398fc3af00c" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fcd1bd5dfea74c378a6154f83707154c" is_pre_election: true
I20260620 13:59:04.114777 13080 leader_election.cc:304] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0
I20260620 13:59:04.116870 13090 raft_consensus.cc:2749] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:04.118274 13080 leader_election.cc:400] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Vote denied by peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785) with higher term. Message: Invalid argument: T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d43d0ad579244c0a3ebb71069c1ab4f for earlier term 2. Current term is 3.
I20260620 13:59:04.118607 13080 leader_election.cc:403] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260620 13:59:04.119149 13090 raft_consensus.cc:3060] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 3
I20260620 13:59:04.126731 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c52f04bdd14864afe89398fc3af00c" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" is_pre_election: true
W20260620 13:59:04.128551 12441 consensus_peers.cc:597] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:04.128842 13219 consensus_queue.cc:1048] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:04.154206 13090 raft_consensus.cc:2749] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785) with higher term. Message: Invalid argument: T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d43d0ad579244c0a3ebb71069c1ab4f for earlier term 2. Current term is 3.
I20260620 13:59:04.156816 13211 raft_consensus.cc:3060] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:04.161167 13201 raft_consensus.cc:1275] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Refusing update from remote peer c51ef915af09435db6046c91bb9d00e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260620 13:59:04.163298 13086 tablet_bootstrap.cc:492] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:04.164448 13086 tablet_bootstrap.cc:492] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:04.165215 13086 ts_tablet_manager.cc:1403] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.013s
I20260620 13:59:04.168598 13202 consensus_queue.cc:1048] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:04.176476 13086 raft_consensus.cc:359] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:04.177546 13086 raft_consensus.cc:740] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:04.177680 13080 leader_election.cc:304] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f; no voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c
I20260620 13:59:04.180892 13269 raft_consensus.cc:2749] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:04.185855 13253 heartbeater.cc:344] Connected to a master server at 127.4.155.254:43785
I20260620 13:59:04.186367 13253 heartbeater.cc:461] Registering TS with master...
I20260620 13:59:04.187318 13253 heartbeater.cc:507] Master 127.4.155.254:43785 requested a full tablet report, sending...
I20260620 13:59:04.181649 13086 consensus_queue.cc:260] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:04.196524 13086 ts_tablet_manager.cc:1434] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260620 13:59:04.197449 13086 tablet_bootstrap.cc:492] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:04.205621 12469 raft_consensus.cc:1275] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Refusing update from remote peer c51ef915af09435db6046c91bb9d00e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260620 13:59:04.207949 13108 consensus_queue.cc:1048] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:04.219175 13209 raft_consensus.cc:3060] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:04.222572 13086 tablet_bootstrap.cc:492] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:04.223762 13086 tablet_bootstrap.cc:492] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:04.224735 13086 ts_tablet_manager.cc:1403] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.008s
I20260620 13:59:04.227658 13086 raft_consensus.cc:359] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:04.228394 13086 raft_consensus.cc:740] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:04.229378 13086 consensus_queue.cc:260] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:04.231467 13086 ts_tablet_manager.cc:1434] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260620 13:59:04.232263 13086 tablet_bootstrap.cc:492] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:04.276806 13086 tablet_bootstrap.cc:492] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:04.277917 13086 tablet_bootstrap.cc:492] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:04.278597 13086 ts_tablet_manager.cc:1403] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.004s
I20260620 13:59:04.281221 13086 raft_consensus.cc:359] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:04.282115 13086 raft_consensus.cc:740] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:04.282893 13086 consensus_queue.cc:260] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:04.285266 13086 ts_tablet_manager.cc:1434] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260620 13:59:04.286013 13086 tablet_bootstrap.cc:492] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:04.324100 13208 raft_consensus.cc:3060] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:04.328464 13086 tablet_bootstrap.cc:492] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:04.329603 13086 tablet_bootstrap.cc:492] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:04.330528 13086 ts_tablet_manager.cc:1403] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.009s
I20260620 13:59:04.333267 13086 raft_consensus.cc:359] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:04.334137 13086 raft_consensus.cc:740] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:04.335276 13086 consensus_queue.cc:260] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:04.337498 13086 ts_tablet_manager.cc:1434] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 13:59:04.338373 13086 tablet_bootstrap.cc:492] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
W20260620 13:59:04.333881 12367 consensus_peers.cc:597] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:04.348985 12149 ts_manager.cc:194] Re-registered known tserver with Master: 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
W20260620 13:59:04.356148 12293 consensus_peers.cc:597] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:59:04.357796 13086 tablet_bootstrap.cc:492] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:04.359042 13086 tablet_bootstrap.cc:492] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:04.361114 13086 ts_tablet_manager.cc:1403] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.000s
I20260620 13:59:04.364346 13086 raft_consensus.cc:359] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:04.365305 13086 raft_consensus.cc:740] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:04.366039 13086 consensus_queue.cc:260] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:04.368603 13086 ts_tablet_manager.cc:1434] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260620 13:59:04.369486 13086 tablet_bootstrap.cc:492] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:04.391258 13086 tablet_bootstrap.cc:492] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:04.392416 13086 tablet_bootstrap.cc:492] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:04.393110 13086 ts_tablet_manager.cc:1403] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260620 13:59:04.397608 13086 raft_consensus.cc:359] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:04.398623 13086 raft_consensus.cc:740] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:04.399636 13086 consensus_queue.cc:260] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:04.402267 13086 ts_tablet_manager.cc:1434] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260620 13:59:04.403221 13086 tablet_bootstrap.cc:492] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:04.405786 12149 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39614
I20260620 13:59:04.411913 13253 heartbeater.cc:499] Master 127.4.155.254:43785 was elected leader, sending a full tablet report...
I20260620 13:59:04.438887 13086 tablet_bootstrap.cc:492] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:04.439944 13086 tablet_bootstrap.cc:492] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:04.440769 13086 ts_tablet_manager.cc:1403] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.003s
I20260620 13:59:04.443449 13086 raft_consensus.cc:359] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:04.444154 13086 raft_consensus.cc:740] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:04.445044 13086 consensus_queue.cc:260] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:04.447583 13086 ts_tablet_manager.cc:1434] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260620 13:59:04.448442 13086 tablet_bootstrap.cc:492] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:04.476686 13086 tablet_bootstrap.cc:492] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260620 13:59:04.477406 12441 consensus_peers.cc:597] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:04.477845 13086 tablet_bootstrap.cc:492] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:04.480386 13086 ts_tablet_manager.cc:1403] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.008s
I20260620 13:59:04.483492 13086 raft_consensus.cc:359] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:04.484329 13086 raft_consensus.cc:740] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:04.485113 13086 consensus_queue.cc:260] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:04.487162 13086 ts_tablet_manager.cc:1434] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260620 13:59:04.488057 13086 tablet_bootstrap.cc:492] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
W20260620 13:59:04.497696 12441 consensus_peers.cc:597] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:04.564767 13086 tablet_bootstrap.cc:492] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:04.565766 13086 tablet_bootstrap.cc:492] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:04.566803 13086 ts_tablet_manager.cc:1403] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.079s	user 0.022s	sys 0.026s
I20260620 13:59:04.570201 13086 raft_consensus.cc:359] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:04.570940 13086 raft_consensus.cc:740] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:04.571727 13086 consensus_queue.cc:260] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:04.621268 13086 ts_tablet_manager.cc:1434] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260620 13:59:04.687153 13086 tablet_bootstrap.cc:492] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:04.774176 13209 raft_consensus.cc:3060] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:59:04.893406 12441 consensus_peers.cc:597] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:04.998811 12293 consensus_peers.cc:597] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:59:05.017315 13086 tablet_bootstrap.cc:492] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:05.018603 13086 tablet_bootstrap.cc:492] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:05.036513 13086 ts_tablet_manager.cc:1403] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.390s	user 0.024s	sys 0.010s
W20260620 13:59:05.048436 12441 consensus_peers.cc:597] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:59:05.037523 12367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:37965, user_credentials={real_user=slave}} blocked reactor thread for 48936.9us
I20260620 13:59:05.070936 13086 raft_consensus.cc:359] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:05.072292 13086 raft_consensus.cc:740] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
W20260620 13:59:05.088039 12293 consensus_peers.cc:597] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:05.088987 12367 consensus_peers.cc:597] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:59:05.091387 13086 consensus_queue.cc:260] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:05.094354 13086 ts_tablet_manager.cc:1434] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260620 13:59:05.096393 13086 tablet_bootstrap.cc:492] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:05.110651 13208 raft_consensus.cc:3060] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:59:05.125924 12293 consensus_peers.cc:597] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260620 13:59:05.128216 13199 raft_consensus.cc:3060] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:59:05.167200 12367 consensus_peers.cc:597] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260620 13:59:05.184836 12441 consensus_peers.cc:597] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260620 13:59:05.192950 13086 tablet_bootstrap.cc:492] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:05.193784 13086 tablet_bootstrap.cc:492] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:05.194343 13086 ts_tablet_manager.cc:1403] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.098s	user 0.009s	sys 0.019s
I20260620 13:59:05.197991 13086 raft_consensus.cc:359] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:05.198820 13086 raft_consensus.cc:740] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:05.199831 13086 consensus_queue.cc:260] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:05.202648 13086 ts_tablet_manager.cc:1434] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260620 13:59:05.203708 13086 tablet_bootstrap.cc:492] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:05.229995 13086 tablet_bootstrap.cc:492] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:05.230954 13086 tablet_bootstrap.cc:492] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:05.231624 13086 ts_tablet_manager.cc:1403] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.009s
I20260620 13:59:05.236876 13086 raft_consensus.cc:359] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:05.237578 13086 raft_consensus.cc:740] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:05.238390 13086 consensus_queue.cc:260] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:05.240762 13086 ts_tablet_manager.cc:1434] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260620 13:59:05.241755 13086 tablet_bootstrap.cc:492] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:05.269459 13086 tablet_bootstrap.cc:492] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:05.270568 13086 tablet_bootstrap.cc:492] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:05.271275 13086 ts_tablet_manager.cc:1403] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.014s
I20260620 13:59:05.274330 13086 raft_consensus.cc:359] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:05.275249 13086 raft_consensus.cc:740] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:05.276958 13086 consensus_queue.cc:260] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:05.292860 13086 ts_tablet_manager.cc:1434] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260620 13:59:05.293771 13086 tablet_bootstrap.cc:492] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:05.329507 13086 tablet_bootstrap.cc:492] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:05.330566 13086 tablet_bootstrap.cc:492] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:05.331259 13086 ts_tablet_manager.cc:1403] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.008s
I20260620 13:59:05.334153 13086 raft_consensus.cc:359] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:05.334812 13086 raft_consensus.cc:740] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:05.335496 13086 consensus_queue.cc:260] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:05.337993 13086 ts_tablet_manager.cc:1434] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260620 13:59:05.338862 13086 tablet_bootstrap.cc:492] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:05.373322 13086 tablet_bootstrap.cc:492] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:05.374361 13086 tablet_bootstrap.cc:492] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:05.375025 13086 ts_tablet_manager.cc:1403] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.013s
I20260620 13:59:05.385016 13086 raft_consensus.cc:359] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:05.385586 13086 raft_consensus.cc:740] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:05.386252 13086 consensus_queue.cc:260] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:05.389024 13086 ts_tablet_manager.cc:1434] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260620 13:59:05.391947 13086 tablet_bootstrap.cc:492] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:05.417438 13086 tablet_bootstrap.cc:492] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:05.418463 13086 tablet_bootstrap.cc:492] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:05.419203 13086 ts_tablet_manager.cc:1403] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.012s
I20260620 13:59:05.421824 13086 raft_consensus.cc:359] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:05.422897 13086 raft_consensus.cc:740] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:05.423719 13086 consensus_queue.cc:260] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:05.426666 13086 ts_tablet_manager.cc:1434] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260620 13:59:05.427707 13086 tablet_bootstrap.cc:492] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:05.459095 13086 tablet_bootstrap.cc:492] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:05.460145 13086 tablet_bootstrap.cc:492] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:05.460783 13086 ts_tablet_manager.cc:1403] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.008s
I20260620 13:59:05.462725 13206 raft_consensus.cc:3060] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:05.463476 13086 raft_consensus.cc:359] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:05.464232 13086 raft_consensus.cc:740] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:05.464977 13086 consensus_queue.cc:260] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:05.467360 13086 ts_tablet_manager.cc:1434] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260620 13:59:05.469038 13086 tablet_bootstrap.cc:492] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:05.469146 13199 raft_consensus.cc:3060] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:05.487403 13086 tablet_bootstrap.cc:492] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:05.488373 13086 tablet_bootstrap.cc:492] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:05.489018 13086 ts_tablet_manager.cc:1403] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260620 13:59:05.491613 13086 raft_consensus.cc:359] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:05.492272 13086 raft_consensus.cc:740] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:05.492941 13086 consensus_queue.cc:260] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:05.495923 13086 ts_tablet_manager.cc:1434] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260620 13:59:05.496847 13086 tablet_bootstrap.cc:492] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:05.528477 13086 tablet_bootstrap.cc:492] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:05.530222 13086 tablet_bootstrap.cc:492] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:05.530927 13086 ts_tablet_manager.cc:1403] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.008s
I20260620 13:59:05.537170 13086 raft_consensus.cc:359] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:05.538134 13086 raft_consensus.cc:740] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:05.538808 13086 consensus_queue.cc:260] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:05.541225 13086 ts_tablet_manager.cc:1434] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.003s
I20260620 13:59:05.542058 13086 tablet_bootstrap.cc:492] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:05.559844 13199 raft_consensus.cc:3060] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:05.588791 13086 tablet_bootstrap.cc:492] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:05.589653 13086 tablet_bootstrap.cc:492] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:05.590346 13086 ts_tablet_manager.cc:1403] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.048s	user 0.030s	sys 0.009s
I20260620 13:59:05.593181 13086 raft_consensus.cc:359] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:05.593873 13086 raft_consensus.cc:740] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:05.594588 13086 consensus_queue.cc:260] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:05.604040 13086 ts_tablet_manager.cc:1434] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260620 13:59:05.604952 13086 tablet_bootstrap.cc:492] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:05.616111 13201 raft_consensus.cc:3060] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:05.730104 13086 tablet_bootstrap.cc:492] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:05.731081 13086 tablet_bootstrap.cc:492] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:05.731750 13086 ts_tablet_manager.cc:1403] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.127s	user 0.039s	sys 0.062s
I20260620 13:59:05.734654 13086 raft_consensus.cc:359] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:05.735368 13086 raft_consensus.cc:740] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:05.736477 13086 consensus_queue.cc:260] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:05.738446 13086 ts_tablet_manager.cc:1434] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260620 13:59:05.739701 13086 tablet_bootstrap.cc:492] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap starting.
I20260620 13:59:05.768217 13086 tablet_bootstrap.cc:492] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 13:59:05.769266 13086 tablet_bootstrap.cc:492] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f: Bootstrap complete.
I20260620 13:59:05.769876 13086 ts_tablet_manager.cc:1403] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.011s
I20260620 13:59:05.774937 13086 raft_consensus.cc:359] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:05.777156 13086 raft_consensus.cc:740] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Initialized, Role: FOLLOWER
I20260620 13:59:05.777900 13086 consensus_queue.cc:260] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:05.780593 13086 ts_tablet_manager.cc:1434] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260620 13:59:05.947059 13211 raft_consensus.cc:3060] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:06.261768 13211 raft_consensus.cc:3060] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:13.883991  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:13.943189 12321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17521c552cad497e9ae59a332d156c0e"
dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
mode: GRACEFUL
new_leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:48118
I20260620 13:59:13.943771 12321 raft_consensus.cc:606] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Received request to transfer leadership to TS 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:13.958197 12392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2596bf072bda4ad188dcc3f1438a4d7d"
dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
mode: GRACEFUL
new_leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:35994
I20260620 13:59:13.958818 12392 raft_consensus.cc:606] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Received request to transfer leadership to TS 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:13.963311 12392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "462ac845f28a431eb612b5e09327f55a"
dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
mode: GRACEFUL
new_leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
 from {username='slave'} at 127.0.0.1:35994
I20260620 13:59:13.964210 12392 raft_consensus.cc:606] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Received request to transfer leadership to TS 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:59:13.967331 12392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "786cabf18ace418e912751ea7c5cc45d"
dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
mode: GRACEFUL
new_leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:35994
I20260620 13:59:13.968022 12392 raft_consensus.cc:606] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Received request to transfer leadership to TS 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:13.970532 12392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5a169ed363546d282eb265bd36bc136"
dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
mode: GRACEFUL
new_leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:35994
I20260620 13:59:13.971055 12392 raft_consensus.cc:606] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Received request to transfer leadership to TS 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:13.973678 12392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fad12197ae0a40fe8dff265afe9d96af"
dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
mode: GRACEFUL
new_leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
 from {username='slave'} at 127.0.0.1:35994
I20260620 13:59:13.974215 12392 raft_consensus.cc:606] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Received request to transfer leadership to TS 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:59:13.975351  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260620 13:59:13.977123  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:13.978180  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:14.012560 13328 raft_consensus.cc:993] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0: : Instructing follower 69a98f1d9eda4cd9bdd2287823f798f6 to start an election
I20260620 13:59:14.013779 13328 raft_consensus.cc:1081] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Signalling peer 69a98f1d9eda4cd9bdd2287823f798f6 to start an election
I20260620 13:59:14.016115 12474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fad12197ae0a40fe8dff265afe9d96af"
dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
 from {username='slave'} at 127.0.0.1:39840
I20260620 13:59:14.016721 12474 raft_consensus.cc:493] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:14.017098 12474 raft_consensus.cc:3060] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:14.024853 12474 raft_consensus.cc:515] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:14.028632 13333 raft_consensus.cc:993] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c: : Instructing follower 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:14.029232 13333 raft_consensus.cc:1081] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Signalling peer 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:14.031149 12474 leader_election.cc:290] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:14.032234 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad12197ae0a40fe8dff265afe9d96af" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:14.032825 13211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17521c552cad497e9ae59a332d156c0e"
dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:58744
I20260620 13:59:14.033090 12392 raft_consensus.cc:3055] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:14.033386 13211 raft_consensus.cc:493] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:14.033564 12392 raft_consensus.cc:740] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:14.033773 13211 raft_consensus.cc:3060] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:14.034744 12392 consensus_queue.cc:260] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:14.035192 12326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad12197ae0a40fe8dff265afe9d96af" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:14.035892 12326 raft_consensus.cc:3060] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:14.038663 12392 raft_consensus.cc:3060] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:14.045837 13328 raft_consensus.cc:993] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0: : Instructing follower 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:14.046494 13328 raft_consensus.cc:1081] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Signalling peer 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:14.044693 12326 raft_consensus.cc:2468] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 2.
I20260620 13:59:14.048020 12392 raft_consensus.cc:2468] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 2.
I20260620 13:59:14.048635 12321 raft_consensus.cc:1240] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Rejecting Update request from peer c51ef915af09435db6046c91bb9d00e0 for earlier term 1. Current term is 2. Ops: []
I20260620 13:59:14.049314 13208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2596bf072bda4ad188dcc3f1438a4d7d"
dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:58756
I20260620 13:59:14.049690 12440 leader_election.cc:304] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:14.049995 13208 raft_consensus.cc:493] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:14.050387 13208 raft_consensus.cc:3060] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:14.050772 13322 raft_consensus.cc:2804] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:14.051311 13322 raft_consensus.cc:697] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:59:14.052163 13322 consensus_queue.cc:237] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:14.053901 13211 raft_consensus.cc:515] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:14.057698 13211 leader_election.cc:290] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 3 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:59:14.058851 12326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17521c552cad497e9ae59a332d156c0e" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:14.059882 12326 raft_consensus.cc:3055] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:59:14.060564 12326 raft_consensus.cc:740] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:59:14.061331 12326 consensus_queue.cc:260] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:14.062027 12474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17521c552cad497e9ae59a332d156c0e" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:14.062484 12326 raft_consensus.cc:3060] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:14.062636 12474 raft_consensus.cc:3060] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:14.069911 12326 raft_consensus.cc:2468] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 3.
I20260620 13:59:14.086150 12474 raft_consensus.cc:2468] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 3.
I20260620 13:59:14.087656 13083 leader_election.cc:304] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:14.068500 13208 raft_consensus.cc:515] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:14.104441 13208 leader_election.cc:290] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:59:14.105356 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2596bf072bda4ad188dcc3f1438a4d7d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:14.106011 12392 raft_consensus.cc:3055] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:14.106081 12474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2596bf072bda4ad188dcc3f1438a4d7d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:14.106352 12392 raft_consensus.cc:740] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:14.107578 13344 raft_consensus.cc:2804] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:59:14.107681 12392 consensus_queue.cc:260] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:14.108908 12474 raft_consensus.cc:3060] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:14.116454 13344 raft_consensus.cc:697] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:59:14.116753 12392 raft_consensus.cc:3060] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:14.120488 12474 raft_consensus.cc:2468] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:14.117574 13344 consensus_queue.cc:237] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:14.123940 13080 leader_election.cc:304] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:59:14.125638 13345 raft_consensus.cc:2804] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:14.127383 12148 catalog_manager.cc:5696] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 1 to 2, leader changed from c51ef915af09435db6046c91bb9d00e0 (127.4.155.195) to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 2 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:14.129369 12392 raft_consensus.cc:2468] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:14.130525 13345 raft_consensus.cc:697] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:59:14.131744 13345 consensus_queue.cc:237] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:14.141202 12146 catalog_manager.cc:5696] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 2 to 3, leader changed from fcd1bd5dfea74c378a6154f83707154c (127.4.155.194) to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 3 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:14.165983 12146 catalog_manager.cc:5696] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 1 to 2, leader changed from c51ef915af09435db6046c91bb9d00e0 (127.4.155.195) to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 2 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:14.353850 13323 raft_consensus.cc:993] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0: : Instructing follower 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:14.354406 13329 raft_consensus.cc:1081] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Signalling peer 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:14.355940 13211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "786cabf18ace418e912751ea7c5cc45d"
dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:58756
I20260620 13:59:14.356479 13211 raft_consensus.cc:493] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:14.356812 13211 raft_consensus.cc:3060] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:14.362630 13211 raft_consensus.cc:515] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:14.364277 13211 leader_election.cc:290] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 3 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:59:14.365078 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786cabf18ace418e912751ea7c5cc45d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:14.365283 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786cabf18ace418e912751ea7c5cc45d" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:14.365643 12392 raft_consensus.cc:3055] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:59:14.365932 12467 raft_consensus.cc:3060] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:14.366029 12392 raft_consensus.cc:740] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:14.366860 12392 consensus_queue.cc:260] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:14.368153 12392 raft_consensus.cc:3060] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:14.372339 12467 raft_consensus.cc:2468] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 3.
I20260620 13:59:14.373046 12392 raft_consensus.cc:2468] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 3.
I20260620 13:59:14.373739 13080 leader_election.cc:304] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:59:14.375028 13345 raft_consensus.cc:2804] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:59:14.375638 13345 raft_consensus.cc:697] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:59:14.376446 13345 consensus_queue.cc:237] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:14.389896 12146 catalog_manager.cc:5696] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 2 to 3, leader changed from c51ef915af09435db6046c91bb9d00e0 (127.4.155.195) to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 3 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:14.402021 13323 raft_consensus.cc:993] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0: : Instructing follower 69a98f1d9eda4cd9bdd2287823f798f6 to start an election
I20260620 13:59:14.402846 13329 raft_consensus.cc:1081] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Signalling peer 69a98f1d9eda4cd9bdd2287823f798f6 to start an election
I20260620 13:59:14.404904 12467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "462ac845f28a431eb612b5e09327f55a"
dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
 from {username='slave'} at 127.0.0.1:39840
I20260620 13:59:14.405582 12467 raft_consensus.cc:493] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:14.405928 12467 raft_consensus.cc:3060] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:14.410936 12467 raft_consensus.cc:515] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:14.412629 12467 leader_election.cc:290] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:14.413627 12326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac845f28a431eb612b5e09327f55a" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:14.413650 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac845f28a431eb612b5e09327f55a" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:14.414212 12326 raft_consensus.cc:3060] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:14.414314 12392 raft_consensus.cc:3055] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:14.414806 12392 raft_consensus.cc:740] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:14.415558 12392 consensus_queue.cc:260] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:14.416478 12392 raft_consensus.cc:3060] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:14.419255 12326 raft_consensus.cc:2468] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 2.
I20260620 13:59:14.420573 12441 leader_election.cc:304] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:14.421425 13341 raft_consensus.cc:2804] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:14.422016 13341 raft_consensus.cc:697] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:59:14.421932 12392 raft_consensus.cc:2468] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 2.
I20260620 13:59:14.423444 13341 consensus_queue.cc:237] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:14.438328 12146 catalog_manager.cc:5696] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 1 to 2, leader changed from c51ef915af09435db6046c91bb9d00e0 (127.4.155.195) to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 2 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:14.464248 12396 raft_consensus.cc:1275] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 69a98f1d9eda4cd9bdd2287823f798f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:14.467141 13329 raft_consensus.cc:993] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0: : Instructing follower 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:14.467020 13342 consensus_queue.cc:1048] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:14.467669 13329 raft_consensus.cc:1081] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Signalling peer 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:14.469597 13199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5a169ed363546d282eb265bd36bc136"
dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:58756
I20260620 13:59:14.470299 13199 raft_consensus.cc:493] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:14.470664 13199 raft_consensus.cc:3060] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:14.477814 13199 raft_consensus.cc:515] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:14.480443 13199 leader_election.cc:290] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:59:14.481037 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a169ed363546d282eb265bd36bc136" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:14.481769 12396 raft_consensus.cc:3055] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:14.482087 12396 raft_consensus.cc:740] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:14.482805 12467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a169ed363546d282eb265bd36bc136" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:14.483184 12396 consensus_queue.cc:260] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:14.485168 12396 raft_consensus.cc:3060] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:14.483615 12467 raft_consensus.cc:3060] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:14.496158 12467 raft_consensus.cc:2468] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:14.498040 13080 leader_election.cc:304] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:59:14.500600 13345 raft_consensus.cc:2804] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:14.501488 13345 raft_consensus.cc:697] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:59:14.502281 13345 consensus_queue.cc:237] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:14.503747 12326 raft_consensus.cc:1275] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Refusing update from remote peer 69a98f1d9eda4cd9bdd2287823f798f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:14.508862 13359 consensus_queue.cc:1048] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:14.539068 12148 catalog_manager.cc:5696] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 1 to 2, leader changed from c51ef915af09435db6046c91bb9d00e0 (127.4.155.195) to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 2 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:14.551645 12396 raft_consensus.cc:2468] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:14.577378 12467 raft_consensus.cc:1275] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:59:14.578792 13345 consensus_queue.cc:1048] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:59:14.589612 12326 raft_consensus.cc:1275] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:59:14.590876 13345 consensus_queue.cc:1048] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:59:14.771483 12474 raft_consensus.cc:1275] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:14.784003 13345 consensus_queue.cc:1048] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:14.794965 12396 raft_consensus.cc:1275] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:14.803187 13345 consensus_queue.cc:1048] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:14.819381 12471 raft_consensus.cc:1275] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260620 13:59:14.826936 12441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 101440us
I20260620 13:59:14.833228 13345 consensus_queue.cc:1048] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:59:14.905036 12395 raft_consensus.cc:1275] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:59:14.907076 13345 consensus_queue.cc:1048] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260620 13:59:14.915011 12364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 55914.9us
I20260620 13:59:14.954028 12326 raft_consensus.cc:1275] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Refusing update from remote peer 69a98f1d9eda4cd9bdd2287823f798f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:14.968209 13322 consensus_queue.cc:1048] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:14.989706 12469 raft_consensus.cc:1275] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:15.022393 12395 raft_consensus.cc:1275] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 69a98f1d9eda4cd9bdd2287823f798f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:15.028759  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260620 13:59:15.032333 12364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 62128.5us
W20260620 13:59:15.033469 12367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 67678.1us
I20260620 13:59:15.063073 13341 consensus_queue.cc:1048] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260620 13:59:15.087224 13080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.196:41785, user_credentials={real_user=slave}} blocked reactor thread for 76194us
I20260620 13:59:15.053671 13378 consensus_queue.cc:1048] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260620 13:59:15.133210 13383 log.cc:927] Time spent T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260620 13:59:15.188542 12399 raft_consensus.cc:1275] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:15.214689 13386 consensus_queue.cc:1048] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260620 13:59:15.235838 12441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:35839, user_credentials={real_user=slave}} blocked reactor thread for 61443.2us
I20260620 13:59:15.451768 12396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d12122a1bf1410bb150a27f3bf46fdf"
dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
mode: GRACEFUL
new_leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:35994
I20260620 13:59:15.452664 12396 raft_consensus.cc:606] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Received request to transfer leadership to TS 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:15.456785 12326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30a0ef32a33f4a609e678abbfa038080"
dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
mode: GRACEFUL
new_leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:48118
I20260620 13:59:15.457381 12326 raft_consensus.cc:606] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Received request to transfer leadership to TS 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:15.460337 12396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fdb1bbde932422ba09645787f9d2446"
dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
mode: GRACEFUL
new_leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:35994
I20260620 13:59:15.460902 12396 raft_consensus.cc:606] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Received request to transfer leadership to TS 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:15.464874 12396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51af9cbc1bcc4e1cbd3c5c37e44f865b"
dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
mode: GRACEFUL
new_leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
 from {username='slave'} at 127.0.0.1:35994
I20260620 13:59:15.465507 12396 raft_consensus.cc:606] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Received request to transfer leadership to TS 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:59:15.468293 12396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8"
dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
mode: GRACEFUL
new_leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:35994
I20260620 13:59:15.468726 12396 raft_consensus.cc:606] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 3 LEADER]: Received request to transfer leadership to TS 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:15.470988 12396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efeb9f3004de439280900847880929c6"
dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
mode: GRACEFUL
new_leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:35994
I20260620 13:59:15.471549 12396 raft_consensus.cc:606] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Received request to transfer leadership to TS 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:15.472836  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260620 13:59:15.474187  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:15.474957  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:15.543468 13369 raft_consensus.cc:993] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c: : Instructing follower 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:15.544016 13369 raft_consensus.cc:1081] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Signalling peer 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:15.546000 13201 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30a0ef32a33f4a609e678abbfa038080"
dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:58744
I20260620 13:59:15.546564 13201 raft_consensus.cc:493] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:15.546888 13201 raft_consensus.cc:3060] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:15.554642 13201 raft_consensus.cc:515] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:15.556363 13201 leader_election.cc:290] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:15.557478 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a0ef32a33f4a609e678abbfa038080" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:15.557523 12326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a0ef32a33f4a609e678abbfa038080" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:15.558776 12326 raft_consensus.cc:3055] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:15.559140 12326 raft_consensus.cc:740] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:59:15.558442 12396 raft_consensus.cc:3060] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:15.562520 12326 consensus_queue.cc:260] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:15.563642 12326 raft_consensus.cc:3060] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:15.573271 12396 raft_consensus.cc:2468] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:15.574697 12326 raft_consensus.cc:2468] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:15.575748 13082 leader_election.cc:304] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:15.576907 13382 raft_consensus.cc:2804] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:15.577553 13382 raft_consensus.cc:697] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:59:15.578589 13382 consensus_queue.cc:237] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:15.580174 13370 raft_consensus.cc:993] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0: : Instructing follower 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:15.580847 13380 raft_consensus.cc:1081] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 3 LEADER]: Signalling peer 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:15.583251 13198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8"
dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:58756
I20260620 13:59:15.583830 13198 raft_consensus.cc:493] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:15.584345 13198 raft_consensus.cc:3060] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:59:15.593313 13198 raft_consensus.cc:515] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:15.593050 12148 catalog_manager.cc:5696] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 1 to 2, leader changed from fcd1bd5dfea74c378a6154f83707154c (127.4.155.194) to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 2 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:15.596127 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:15.596762 12396 raft_consensus.cc:3055] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 13:59:15.597617 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b5f917a39d4ff0bbbc205b4aa941d8" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:15.597661 12396 raft_consensus.cc:740] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:15.598686 12469 raft_consensus.cc:3060] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:59:15.599615 12396 consensus_queue.cc:260] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:15.600890 12396 raft_consensus.cc:3060] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Advancing to term 4
I20260620 13:59:15.597093 13198 leader_election.cc:290] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 4 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:59:15.607535 12469 raft_consensus.cc:2468] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 4.
I20260620 13:59:15.608153 12396 raft_consensus.cc:2468] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 4.
I20260620 13:59:15.610369 13082 leader_election.cc:304] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:15.611450 13382 raft_consensus.cc:2804] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 4 FOLLOWER]: Leader election won for term 4
I20260620 13:59:15.611976 13382 raft_consensus.cc:697] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 4 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:59:15.613013 13382 consensus_queue.cc:237] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:15.628666 12148 catalog_manager.cc:5696] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 3 to 4, leader changed from c51ef915af09435db6046c91bb9d00e0 (127.4.155.195) to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 4 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:15.722841 13375 raft_consensus.cc:993] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0: : Instructing follower 69a98f1d9eda4cd9bdd2287823f798f6 to start an election
I20260620 13:59:15.723583 13370 raft_consensus.cc:1081] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Signalling peer 69a98f1d9eda4cd9bdd2287823f798f6 to start an election
I20260620 13:59:15.725296 12469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51af9cbc1bcc4e1cbd3c5c37e44f865b"
dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
 from {username='slave'} at 127.0.0.1:39840
I20260620 13:59:15.726409 12469 raft_consensus.cc:493] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:15.726758 12469 raft_consensus.cc:3060] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:15.734035 12469 raft_consensus.cc:515] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:15.736227 12469 leader_election.cc:290] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:15.737243 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51af9cbc1bcc4e1cbd3c5c37e44f865b" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:15.737499 12326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51af9cbc1bcc4e1cbd3c5c37e44f865b" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:15.738018 12396 raft_consensus.cc:3055] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:15.738895 12396 raft_consensus.cc:740] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:15.738117 12326 raft_consensus.cc:3060] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:15.743206 12396 consensus_queue.cc:260] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:15.744621 12396 raft_consensus.cc:3060] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:15.747730 13370 raft_consensus.cc:993] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0: : Instructing follower 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:15.748383 12326 raft_consensus.cc:2468] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 2.
I20260620 13:59:15.748765 13375 raft_consensus.cc:1081] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Signalling peer 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:15.749476 12441 leader_election.cc:304] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:15.750484 13393 raft_consensus.cc:2804] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:15.750989 13393 raft_consensus.cc:697] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:59:15.751893 13393 consensus_queue.cc:237] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:15.753331 13198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d12122a1bf1410bb150a27f3bf46fdf"
dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:58756
I20260620 13:59:15.753955 13198 raft_consensus.cc:493] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:15.754315 13198 raft_consensus.cc:3060] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:15.755033 12396 raft_consensus.cc:2468] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 2.
I20260620 13:59:15.765723 12148 catalog_manager.cc:5696] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 1 to 2, leader changed from c51ef915af09435db6046c91bb9d00e0 (127.4.155.195) to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 2 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:15.782181 13198 raft_consensus.cc:515] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:15.784528 13198 leader_election.cc:290] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:59:15.785516 13375 raft_consensus.cc:993] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0: : Instructing follower 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:15.785379 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d12122a1bf1410bb150a27f3bf46fdf" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:15.786044 13375 raft_consensus.cc:1081] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Signalling peer 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:15.786055 12396 raft_consensus.cc:3055] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:15.787487 13375 raft_consensus.cc:993] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0: : Instructing follower 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:15.787446 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d12122a1bf1410bb150a27f3bf46fdf" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:15.788324 12469 raft_consensus.cc:3060] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:15.788439 13370 raft_consensus.cc:1081] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Signalling peer 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:15.787516 12396 raft_consensus.cc:740] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:15.792299 12396 consensus_queue.cc:260] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:15.793562 12396 raft_consensus.cc:3060] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:15.796518 12469 raft_consensus.cc:2468] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:15.798566 13080 leader_election.cc:304] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 
I20260620 13:59:15.799870 13382 raft_consensus.cc:2804] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:15.800220 13209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efeb9f3004de439280900847880929c6"
dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:58756
I20260620 13:59:15.800396 13382 raft_consensus.cc:697] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:59:15.800843 13209 raft_consensus.cc:493] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:15.801283 13209 raft_consensus.cc:3060] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:15.801358 13382 consensus_queue.cc:237] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:15.803751 13198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fdb1bbde932422ba09645787f9d2446"
dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:58756
I20260620 13:59:15.804435 13198 raft_consensus.cc:493] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:15.804837 13198 raft_consensus.cc:3060] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:15.809795 12396 raft_consensus.cc:2468] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:15.812844 13209 raft_consensus.cc:515] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:15.813755 13198 raft_consensus.cc:515] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:15.816256 13198 leader_election.cc:290] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 3 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:15.818398 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdb1bbde932422ba09645787f9d2446" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:15.819281 12397 raft_consensus.cc:3055] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:59:15.819824 12397 raft_consensus.cc:740] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:15.818403 12326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fdb1bbde932422ba09645787f9d2446" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:15.821796 12326 raft_consensus.cc:3060] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:15.818799 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efeb9f3004de439280900847880929c6" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:15.824601 12396 raft_consensus.cc:3055] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:15.824954 12396 raft_consensus.cc:740] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:15.822216 12397 consensus_queue.cc:260] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:15.826071 12396 consensus_queue.cc:260] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:15.827418 12396 raft_consensus.cc:3060] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:15.830205 12326 raft_consensus.cc:2468] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 3.
I20260620 13:59:15.831295 13083 leader_election.cc:304] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:15.832736 12397 raft_consensus.cc:3060] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:15.836247 12396 raft_consensus.cc:2468] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:15.837234 13382 raft_consensus.cc:2804] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:59:15.837836 13382 raft_consensus.cc:697] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:59:15.838163 13082 leader_election.cc:304] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:15.839124 13386 raft_consensus.cc:2804] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:15.838940 13382 consensus_queue.cc:237] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:15.836814 12148 catalog_manager.cc:5696] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 1 to 2, leader changed from c51ef915af09435db6046c91bb9d00e0 (127.4.155.195) to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 2 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:15.842408 13209 leader_election.cc:290] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Requested vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:59:15.850456 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efeb9f3004de439280900847880929c6" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:15.851512 12469 raft_consensus.cc:3060] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:15.860476 12397 raft_consensus.cc:2468] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 3.
I20260620 13:59:15.861054 12469 raft_consensus.cc:2468] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:15.860195 13386 raft_consensus.cc:697] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:59:15.862495 13386 consensus_queue.cc:237] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:15.875231 12148 catalog_manager.cc:5696] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 2 to 3, leader changed from c51ef915af09435db6046c91bb9d00e0 (127.4.155.195) to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 3 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:15.876391 12148 catalog_manager.cc:5696] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 1 to 2, leader changed from c51ef915af09435db6046c91bb9d00e0 (127.4.155.195) to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 2 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:16.051594 12474 raft_consensus.cc:1275] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 4 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260620 13:59:16.052989 13386 consensus_queue.cc:1048] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:59:16.060231 12397 raft_consensus.cc:1275] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:16.061808 13386 consensus_queue.cc:1048] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:16.068567 12396 raft_consensus.cc:1275] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 4 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260620 13:59:16.073522 13406 consensus_queue.cc:1048] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260620 13:59:16.093014 12326 raft_consensus.cc:1275] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:16.104504 13382 consensus_queue.cc:1048] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:16.212926 12396 raft_consensus.cc:1275] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 69a98f1d9eda4cd9bdd2287823f798f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:16.214393 13392 consensus_queue.cc:1048] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:16.223516 12326 raft_consensus.cc:1275] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Refusing update from remote peer 69a98f1d9eda4cd9bdd2287823f798f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:16.225463 13420 consensus_queue.cc:1048] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:16.253404 12396 raft_consensus.cc:1275] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:59:16.255254 13406 consensus_queue.cc:1048] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:59:16.265514 12326 raft_consensus.cc:1275] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:59:16.269721 13382 consensus_queue.cc:1048] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:59:16.279445 12396 raft_consensus.cc:1275] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:16.281221 13382 consensus_queue.cc:1048] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:16.293702 12469 raft_consensus.cc:1275] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:16.297945 13406 consensus_queue.cc:1048] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:16.300963 12469 raft_consensus.cc:1275] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:16.303157 13382 consensus_queue.cc:1048] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:16.334158 12396 raft_consensus.cc:1275] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:16.336324 13382 consensus_queue.cc:1048] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:16.512166  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:16.551258 12326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ee8de600a8646df90a272c586e08ae5"
dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
mode: GRACEFUL
new_leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:48118
I20260620 13:59:16.551878 12326 raft_consensus.cc:606] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Received request to transfer leadership to TS 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:16.555006 12326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "100d2b85fd4c4959bfbb5df7beb05915"
dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
mode: GRACEFUL
new_leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
 from {username='slave'} at 127.0.0.1:48118
I20260620 13:59:16.556087 12326 raft_consensus.cc:606] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Received request to transfer leadership to TS 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:59:16.584649 12474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7aa301d02030498583d201921146bb89"
dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
mode: GRACEFUL
new_leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:46522
I20260620 13:59:16.585515 12474 raft_consensus.cc:606] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Received request to transfer leadership to TS 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:16.589047 12326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85ae493b3ffc48e19f911962029c41e5"
dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
mode: GRACEFUL
new_leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:48118
I20260620 13:59:16.589578 12326 raft_consensus.cc:606] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Received request to transfer leadership to TS 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:16.592114 12321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3b45b565aa74abfad3579abc6ed2e56"
dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
mode: GRACEFUL
new_leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:48118
I20260620 13:59:16.592679 12321 raft_consensus.cc:606] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Received request to transfer leadership to TS 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:16.593664  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260620 13:59:16.594820  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:16.595511  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:16.710811 13339 raft_consensus.cc:993] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c: : Instructing follower 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:16.711355 13369 raft_consensus.cc:1081] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Signalling peer 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:16.712898 13198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ee8de600a8646df90a272c586e08ae5"
dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:58744
I20260620 13:59:16.713587 13198 raft_consensus.cc:493] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:16.713981 13198 raft_consensus.cc:3060] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:16.720721 13198 raft_consensus.cc:515] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:16.722481 13198 leader_election.cc:290] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:16.723475 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee8de600a8646df90a272c586e08ae5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:16.723541 12326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee8de600a8646df90a272c586e08ae5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:16.724076 12396 raft_consensus.cc:3060] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:16.724355 12326 raft_consensus.cc:3055] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:16.724642 12326 raft_consensus.cc:740] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:59:16.725291 12326 consensus_queue.cc:260] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:16.726526 12326 raft_consensus.cc:3060] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:16.732214 12396 raft_consensus.cc:2468] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:16.734555 13082 leader_election.cc:304] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:16.735594 13382 raft_consensus.cc:2804] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:16.736083 13382 raft_consensus.cc:697] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:59:16.737633 12326 raft_consensus.cc:2468] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:16.737248 13382 consensus_queue.cc:237] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:16.752104 13431 raft_consensus.cc:993] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c: : Instructing follower 69a98f1d9eda4cd9bdd2287823f798f6 to start an election
I20260620 13:59:16.750953 12149 catalog_manager.cc:5696] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 1 to 2, leader changed from fcd1bd5dfea74c378a6154f83707154c (127.4.155.194) to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 2 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:16.752681 13339 raft_consensus.cc:1081] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Signalling peer 69a98f1d9eda4cd9bdd2287823f798f6 to start an election
I20260620 13:59:16.754323 12469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "100d2b85fd4c4959bfbb5df7beb05915"
dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
 from {username='slave'} at 127.0.0.1:39838
I20260620 13:59:16.755064 12469 raft_consensus.cc:493] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:16.755482 12469 raft_consensus.cc:3060] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:16.762329 12469 raft_consensus.cc:515] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:16.766655 12326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100d2b85fd4c4959bfbb5df7beb05915" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:16.766911 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100d2b85fd4c4959bfbb5df7beb05915" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:16.767450 12326 raft_consensus.cc:3055] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:16.767768 12396 raft_consensus.cc:3060] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:16.767832 12326 raft_consensus.cc:740] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:59:16.766310 12469 leader_election.cc:290] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:16.768707 12326 consensus_queue.cc:260] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:16.770087 12326 raft_consensus.cc:3060] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:16.775894 12396 raft_consensus.cc:2468] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 2.
I20260620 13:59:16.777328 12326 raft_consensus.cc:2468] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 2.
I20260620 13:59:16.777294 12440 leader_election.cc:304] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:16.778360 13393 raft_consensus.cc:2804] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:16.778862 13393 raft_consensus.cc:697] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:59:16.780030 13393 consensus_queue.cc:237] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:16.794919 12149 catalog_manager.cc:5696] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 1 to 2, leader changed from fcd1bd5dfea74c378a6154f83707154c (127.4.155.194) to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 2 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:16.814244 13420 raft_consensus.cc:993] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6: : Instructing follower 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:16.814738 13393 raft_consensus.cc:1081] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Signalling peer 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:16.816563 13198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7aa301d02030498583d201921146bb89"
dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:58758
I20260620 13:59:16.817605 13198 raft_consensus.cc:493] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:16.818089 13198 raft_consensus.cc:3060] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:16.825206 13198 raft_consensus.cc:515] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:16.827304 13198 leader_election.cc:290] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Requested vote from peers 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785), fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965)
I20260620 13:59:16.828421 12326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa301d02030498583d201921146bb89" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:16.829037 12326 raft_consensus.cc:3060] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:16.829077 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa301d02030498583d201921146bb89" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:16.829715 12469 raft_consensus.cc:3055] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:16.830015 12469 raft_consensus.cc:740] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:59:16.830848 12469 consensus_queue.cc:260] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:16.832166 12469 raft_consensus.cc:3060] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:16.835657 12326 raft_consensus.cc:2468] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:16.836855 13083 leader_election.cc:304] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:16.837766 12469 raft_consensus.cc:2468] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:16.838075 13427 raft_consensus.cc:2804] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:16.838652 13427 raft_consensus.cc:697] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:59:16.839646 13427 consensus_queue.cc:237] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } }
I20260620 13:59:16.856895 13369 raft_consensus.cc:993] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c: : Instructing follower 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:16.857409 13431 raft_consensus.cc:1081] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Signalling peer 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:16.857970 12149 catalog_manager.cc:5696] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 1 to 2, leader changed from 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196) to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 2 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:16.859179 13209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85ae493b3ffc48e19f911962029c41e5"
dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:58744
I20260620 13:59:16.859805 13209 raft_consensus.cc:493] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:16.860149 13209 raft_consensus.cc:3060] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:16.869810 13209 raft_consensus.cc:515] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:16.873984 13209 leader_election.cc:290] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:16.875038 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ae493b3ffc48e19f911962029c41e5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:16.875979 12396 raft_consensus.cc:3060] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:16.882526 12396 raft_consensus.cc:2468] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:16.883574 12326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ae493b3ffc48e19f911962029c41e5" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:16.883818 13082 leader_election.cc:304] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:16.884589 12326 raft_consensus.cc:3055] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:16.884927 12326 raft_consensus.cc:740] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:59:16.885200 13427 raft_consensus.cc:2804] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:16.885732 13427 raft_consensus.cc:697] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:59:16.886024 12326 consensus_queue.cc:260] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:16.886619 13427 consensus_queue.cc:237] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:16.887869 12326 raft_consensus.cc:3060] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:16.894750 12326 raft_consensus.cc:2468] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:16.897912 12149 catalog_manager.cc:5696] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 1 to 2, leader changed from fcd1bd5dfea74c378a6154f83707154c (127.4.155.194) to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 2 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:16.981021 13431 raft_consensus.cc:993] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c: : Instructing follower 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:16.982949 13339 raft_consensus.cc:1081] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Signalling peer 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:16.984747 13198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3b45b565aa74abfad3579abc6ed2e56"
dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:58744
I20260620 13:59:16.985482 13198 raft_consensus.cc:493] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:16.985924 13198 raft_consensus.cc:3060] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:16.992600 13198 raft_consensus.cc:515] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:16.994375 13198 leader_election.cc:290] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 3 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:16.995318 12321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b45b565aa74abfad3579abc6ed2e56" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:16.995431 12397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b45b565aa74abfad3579abc6ed2e56" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:16.995899 12321 raft_consensus.cc:3055] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:59:16.996244 12321 raft_consensus.cc:740] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fcd1bd5dfea74c378a6154f83707154c, State: Running, Role: LEADER
I20260620 13:59:16.996091 12397 raft_consensus.cc:3060] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:16.996956 12321 consensus_queue.cc:260] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:16.998086 12321 raft_consensus.cc:3060] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:17.002948 12397 raft_consensus.cc:2468] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 3.
I20260620 13:59:17.004341 13082 leader_election.cc:304] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0; no voters: 
I20260620 13:59:17.004549 12321 raft_consensus.cc:2468] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 3.
I20260620 13:59:17.005093 13427 raft_consensus.cc:2804] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:59:17.005558 13427 raft_consensus.cc:697] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:59:17.006305 13427 consensus_queue.cc:237] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:17.015314 12149 catalog_manager.cc:5696] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 2 to 3, leader changed from fcd1bd5dfea74c378a6154f83707154c (127.4.155.194) to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 3 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:17.165185 12397 raft_consensus.cc:1275] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 69a98f1d9eda4cd9bdd2287823f798f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:17.166882 13442 consensus_queue.cc:1048] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:17.193565 12399 raft_consensus.cc:1275] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:17.196264 13386 consensus_queue.cc:1048] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:17.200229 12321 raft_consensus.cc:1275] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Refusing update from remote peer 69a98f1d9eda4cd9bdd2287823f798f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:17.201828 13392 consensus_queue.cc:1048] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:17.231550 12326 raft_consensus.cc:1275] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:17.235395 13382 consensus_queue.cc:1048] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:17.251680 12321 raft_consensus.cc:1275] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:17.253525 13386 consensus_queue.cc:1048] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:17.276301 12469 raft_consensus.cc:1275] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:17.277603 13386 consensus_queue.cc:1048] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:17.416769 12321 raft_consensus.cc:1275] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:59:17.417053 12326 raft_consensus.cc:1275] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:17.418335 13427 consensus_queue.cc:1048] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:59:17.418675 13386 consensus_queue.cc:1048] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:17.430439 12399 raft_consensus.cc:1275] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:59:17.433800 12399 raft_consensus.cc:1275] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:17.433544 13386 consensus_queue.cc:1048] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:59:17.439122 13386 consensus_queue.cc:1048] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:17.637319  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:17.672793 12469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b6c6d2474cc47d09439ce00490af552"
dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
mode: GRACEFUL
new_leader_uuid: "c51ef915af09435db6046c91bb9d00e0"
 from {username='slave'} at 127.0.0.1:46522
I20260620 13:59:17.673790 12469 raft_consensus.cc:606] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Received request to transfer leadership to TS c51ef915af09435db6046c91bb9d00e0
I20260620 13:59:17.676414  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260620 13:59:17.678130  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:17.678828  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:17.685621 13393 raft_consensus.cc:993] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6: : Instructing follower c51ef915af09435db6046c91bb9d00e0 to start an election
I20260620 13:59:17.686190 13442 raft_consensus.cc:1081] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Signalling peer c51ef915af09435db6046c91bb9d00e0 to start an election
I20260620 13:59:17.687826 12397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b6c6d2474cc47d09439ce00490af552"
dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
 from {username='slave'} at 127.0.0.1:39894
I20260620 13:59:17.688309 12397 raft_consensus.cc:493] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:17.688633 12397 raft_consensus.cc:3060] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:17.696712 12397 raft_consensus.cc:515] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:17.699994 12326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6c6d2474cc47d09439ce00490af552" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:17.700098 12397 leader_election.cc:290] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:59:17.700649 12326 raft_consensus.cc:3060] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:17.702668 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6c6d2474cc47d09439ce00490af552" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:17.703390 12469 raft_consensus.cc:3055] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:17.703734 12469 raft_consensus.cc:740] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:59:17.704797 12469 consensus_queue.cc:260] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:17.706037 12469 raft_consensus.cc:3060] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:17.710520 12326 raft_consensus.cc:2468] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 2.
I20260620 13:59:17.711936 12367 leader_election.cc:304] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:17.713121 13329 raft_consensus.cc:2804] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:17.713558 13329 raft_consensus.cc:697] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:17.714337 13329 consensus_queue.cc:237] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:17.717116 12469 raft_consensus.cc:2468] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 2.
I20260620 13:59:17.730537 12149 catalog_manager.cc:5696] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 1 to 2, leader changed from 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196) to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 2 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:18.119797 12469 raft_consensus.cc:1275] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Refusing update from remote peer c51ef915af09435db6046c91bb9d00e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:18.120995 13329 consensus_queue.cc:1048] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:18.133944 12321 raft_consensus.cc:1275] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Refusing update from remote peer c51ef915af09435db6046c91bb9d00e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:18.136336 13329 consensus_queue.cc:1048] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:18.730664  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:18.782770 12397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b65eb66c55e74ee78340946d691c4e72"
dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
mode: GRACEFUL
new_leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
 from {username='slave'} at 127.0.0.1:35994
I20260620 13:59:18.783490 12397 raft_consensus.cc:606] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Received request to transfer leadership to TS 69a98f1d9eda4cd9bdd2287823f798f6
I20260620 13:59:18.785472  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260620 13:59:18.787395  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:18.788193  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:19.202327 13469 raft_consensus.cc:993] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0: : Instructing follower 69a98f1d9eda4cd9bdd2287823f798f6 to start an election
I20260620 13:59:19.202812 13469 raft_consensus.cc:1081] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Signalling peer 69a98f1d9eda4cd9bdd2287823f798f6 to start an election
I20260620 13:59:19.204362 12469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b65eb66c55e74ee78340946d691c4e72"
dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
 from {username='slave'} at 127.0.0.1:39840
I20260620 13:59:19.204859 12469 raft_consensus.cc:493] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:19.205097 12469 raft_consensus.cc:3060] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:19.210707 12469 raft_consensus.cc:515] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:19.212285 12469 leader_election.cc:290] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:19.213001 12321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65eb66c55e74ee78340946d691c4e72" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:19.213351 12399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65eb66c55e74ee78340946d691c4e72" candidate_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:19.213703 12321 raft_consensus.cc:3060] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:19.213882 12399 raft_consensus.cc:3055] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:19.214203 12399 raft_consensus.cc:740] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:19.214901 12399 consensus_queue.cc:260] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:19.216070 12399 raft_consensus.cc:3060] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:19.220242 12321 raft_consensus.cc:2468] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 2.
I20260620 13:59:19.221401 12441 leader_election.cc:304] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:19.222210 13442 raft_consensus.cc:2804] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:19.222666 13442 raft_consensus.cc:697] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Becoming Leader. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:59:19.223321 12399 raft_consensus.cc:2468] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69a98f1d9eda4cd9bdd2287823f798f6 in term 2.
I20260620 13:59:19.223582 13442 consensus_queue.cc:237] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:19.234396 12148 catalog_manager.cc:5696] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 reported cstate change: term changed from 1 to 2, leader changed from c51ef915af09435db6046c91bb9d00e0 (127.4.155.195) to 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196). New cstate: current_term: 2 leader_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:19.612493 12399 raft_consensus.cc:1275] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 69a98f1d9eda4cd9bdd2287823f798f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:19.613555 13393 consensus_queue.cc:1048] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:19.626151 12321 raft_consensus.cc:1275] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Refusing update from remote peer 69a98f1d9eda4cd9bdd2287823f798f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:19.627555 13479 consensus_queue.cc:1048] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:19.834736  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:19.872113 12469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "462ac845f28a431eb612b5e09327f55a"
dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
mode: GRACEFUL
new_leader_uuid: "c51ef915af09435db6046c91bb9d00e0"
 from {username='slave'} at 127.0.0.1:46522
I20260620 13:59:19.872699 12469 raft_consensus.cc:606] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Received request to transfer leadership to TS c51ef915af09435db6046c91bb9d00e0
I20260620 13:59:19.873916  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260620 13:59:19.875365  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:19.876022  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:20.206161 13479 raft_consensus.cc:993] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6: : Instructing follower c51ef915af09435db6046c91bb9d00e0 to start an election
I20260620 13:59:20.206713 13442 raft_consensus.cc:1081] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Signalling peer c51ef915af09435db6046c91bb9d00e0 to start an election
I20260620 13:59:20.208257 12399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "462ac845f28a431eb612b5e09327f55a"
dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
 from {username='slave'} at 127.0.0.1:39894
I20260620 13:59:20.208801 12399 raft_consensus.cc:493] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:20.209143 12399 raft_consensus.cc:3060] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:20.215288 12399 raft_consensus.cc:515] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:20.218072 12399 leader_election.cc:290] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 3 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196:41785)
I20260620 13:59:20.219295 12469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac845f28a431eb612b5e09327f55a" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "69a98f1d9eda4cd9bdd2287823f798f6"
I20260620 13:59:20.219754 12320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "462ac845f28a431eb612b5e09327f55a" candidate_uuid: "c51ef915af09435db6046c91bb9d00e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:20.220455 12469 raft_consensus.cc:3055] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:59:20.220585 12320 raft_consensus.cc:3060] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:20.220912 12469 raft_consensus.cc:740] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 69a98f1d9eda4cd9bdd2287823f798f6, State: Running, Role: LEADER
I20260620 13:59:20.222076 12469 consensus_queue.cc:260] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:20.223181 12469 raft_consensus.cc:3060] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:20.229117 12320 raft_consensus.cc:2468] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 3.
I20260620 13:59:20.231379 12469 raft_consensus.cc:2468] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c51ef915af09435db6046c91bb9d00e0 in term 3.
I20260620 13:59:20.232576 12367 leader_election.cc:304] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c51ef915af09435db6046c91bb9d00e0, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:20.233381 13469 raft_consensus.cc:2804] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:59:20.233932 13469 raft_consensus.cc:697] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 3 LEADER]: Becoming Leader. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:20.235311 13469 consensus_queue.cc:237] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } }
I20260620 13:59:20.246558 12149 catalog_manager.cc:5696] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 reported cstate change: term changed from 2 to 3, leader changed from 69a98f1d9eda4cd9bdd2287823f798f6 (127.4.155.196) to c51ef915af09435db6046c91bb9d00e0 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "c51ef915af09435db6046c91bb9d00e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:20.772643 12320 raft_consensus.cc:1275] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Refusing update from remote peer c51ef915af09435db6046c91bb9d00e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:59:20.774065 13469 consensus_queue.cc:1048] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:59:20.785246 12469 raft_consensus.cc:1275] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Refusing update from remote peer c51ef915af09435db6046c91bb9d00e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:59:20.793201 13484 consensus_queue.cc:1048] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:59:20.919971  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:20.963892 12396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7edd30f224ff4b17bc0d671c619c821b"
dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
mode: GRACEFUL
new_leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:35994
I20260620 13:59:20.964493 12396 raft_consensus.cc:606] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Received request to transfer leadership to TS 4d43d0ad579244c0a3ebb71069c1ab4f
I20260620 13:59:20.965663  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260620 13:59:20.967262  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:20.967893  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:21.194577 13469 raft_consensus.cc:993] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0: : Instructing follower 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:21.195143 13469 raft_consensus.cc:1081] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Signalling peer 4d43d0ad579244c0a3ebb71069c1ab4f to start an election
I20260620 13:59:21.196513 13198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7edd30f224ff4b17bc0d671c619c821b"
dest_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f"
 from {username='slave'} at 127.0.0.1:58756
I20260620 13:59:21.196902 13198 raft_consensus.cc:493] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:21.197221 13198 raft_consensus.cc:3060] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:21.203322 13198 raft_consensus.cc:515] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:21.206424 13198 leader_election.cc:290] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Requested vote from peers fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965), c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673)
I20260620 13:59:21.206552 12320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edd30f224ff4b17bc0d671c619c821b" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd1bd5dfea74c378a6154f83707154c"
I20260620 13:59:21.207291 12320 raft_consensus.cc:3060] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:21.207144 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edd30f224ff4b17bc0d671c619c821b" candidate_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c51ef915af09435db6046c91bb9d00e0"
I20260620 13:59:21.208088 12396 raft_consensus.cc:3055] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:21.208427 12396 raft_consensus.cc:740] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c51ef915af09435db6046c91bb9d00e0, State: Running, Role: LEADER
I20260620 13:59:21.209285 12396 consensus_queue.cc:260] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:21.210472 12396 raft_consensus.cc:3060] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:21.214401 12320 raft_consensus.cc:2468] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:21.215531 13083 leader_election.cc:304] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d43d0ad579244c0a3ebb71069c1ab4f, fcd1bd5dfea74c378a6154f83707154c; no voters: 
I20260620 13:59:21.216259 13497 raft_consensus.cc:2804] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:21.216704 13497 raft_consensus.cc:697] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Becoming Leader. State: Replica: 4d43d0ad579244c0a3ebb71069c1ab4f, State: Running, Role: LEADER
I20260620 13:59:21.217494 13497 consensus_queue.cc:237] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } }
I20260620 13:59:21.223670 12396 raft_consensus.cc:2468] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d43d0ad579244c0a3ebb71069c1ab4f in term 2.
I20260620 13:59:21.230634 12149 catalog_manager.cc:5696] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f reported cstate change: term changed from 1 to 2, leader changed from c51ef915af09435db6046c91bb9d00e0 (127.4.155.195) to 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193). New cstate: current_term: 2 leader_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:21.752194 12399 raft_consensus.cc:1275] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:21.753665 13382 consensus_queue.cc:1048] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:21.775895 12321 raft_consensus.cc:1275] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Refusing update from remote peer 4d43d0ad579244c0a3ebb71069c1ab4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:21.777753 13507 consensus_queue.cc:1048] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd1bd5dfea74c378a6154f83707154c" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:22.010411  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:22.064807  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:59:22.066357  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:22.067029  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:22.104650  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:22.144544  4719 tablet_server.cc:179] TabletServer@127.4.155.193:35839 shutting down...
W20260620 13:59:22.153296 12367 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 345 similar messages]
W20260620 13:59:22.157189 12367 consensus_peers.cc:597] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.185544  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:59:22.186681  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.187875  4719 raft_consensus.cc:2243] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.188555  4719 raft_consensus.cc:2272] T 369e0ab28a64476cb0e07ab5672b9337 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.191689  4719 tablet_replica.cc:333] stopping tablet replica
W20260620 13:59:22.191546 12293 consensus_peers.cc:597] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.192721  4719 raft_consensus.cc:2243] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus shutting down.
W20260620 13:59:22.192906 12293 consensus_peers.cc:597] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.193328  4719 raft_consensus.cc:2272] T 1c50f25282d94111a4d435e85e67af34 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.194326 12367 consensus_peers.cc:597] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.196075  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.197247  4719 raft_consensus.cc:2243] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.197844  4719 raft_consensus.cc:2272] T 11868dc915f6412eaed3c2ba56738bfc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.200879  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.201887  4719 raft_consensus.cc:2243] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.202442  4719 raft_consensus.cc:2272] T 61907296334d4a149ab81ba5337a1a27 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.205696  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.206312  4719 raft_consensus.cc:2243] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.207077  4719 raft_consensus.cc:2272] T 928bd8a07cbe4d58b19f3669419f928d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.209980  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.210914  4719 raft_consensus.cc:2243] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.211810  4719 raft_consensus.cc:2272] T 17521c552cad497e9ae59a332d156c0e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.214679  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.215624  4719 raft_consensus.cc:2243] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.216207  4719 raft_consensus.cc:2272] T 93da747507134e1699f01078033ae503 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.218740 12367 consensus_peers.cc:597] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.219274  4719 tablet_replica.cc:333] stopping tablet replica
W20260620 13:59:22.219686 12293 consensus_peers.cc:597] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.220191  4719 raft_consensus.cc:2243] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.221299  4719 raft_consensus.cc:2272] T 7edd30f224ff4b17bc0d671c619c821b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.223776 12441 consensus_peers.cc:597] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.224195  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.225234  4719 raft_consensus.cc:2243] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.225826  4719 raft_consensus.cc:2272] T d4a422539280460c895f371ef9eb8f4d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.228770  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.229632  4719 raft_consensus.cc:2243] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.230113  4719 raft_consensus.cc:2272] T 918029829d594bafac9e17a30edcacee P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.230532 12441 consensus_peers.cc:597] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.232976  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.233929  4719 raft_consensus.cc:2243] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.234459  4719 raft_consensus.cc:2272] T 9c1f1202d4ad46b49a994c23c7f566c1 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.237710  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.238595  4719 raft_consensus.cc:2243] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.239759  4719 raft_consensus.cc:2272] T 1d12122a1bf1410bb150a27f3bf46fdf P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.242280  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.242951  4719 raft_consensus.cc:2243] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.243566  4719 raft_consensus.cc:2272] T 98b83072f19644f5806c4391cbb1bce5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.246694  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.247656  4719 raft_consensus.cc:2243] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.248281  4719 raft_consensus.cc:2272] T a0dff624788f433e88274d14f0db3c4c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.250389 12367 consensus_peers.cc:597] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.251195  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.251858  4719 raft_consensus.cc:2243] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.252272  4719 raft_consensus.cc:2272] T e34e64f189e740e1bbebd03257e5af90 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.254665  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.255388  4719 raft_consensus.cc:2243] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.256155  4719 raft_consensus.cc:2272] T 4fdb1bbde932422ba09645787f9d2446 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.258601  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.259390  4719 raft_consensus.cc:2243] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.260131  4719 raft_consensus.cc:2272] T efeb9f3004de439280900847880929c6 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.262197  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.262934  4719 raft_consensus.cc:2243] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.263422  4719 raft_consensus.cc:2272] T a6e8c601ed2e4253b8c7f5dceb77f518 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.265398  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.266219  4719 raft_consensus.cc:2243] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.266808  4719 raft_consensus.cc:2272] T 7c1ae3d064cd49309bf086b257c3f664 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.269259  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.269964  4719 raft_consensus.cc:2243] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.270660  4719 raft_consensus.cc:2272] T 75286f26552b4e788b3844d3aa342b01 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.271600 12441 consensus_peers.cc:597] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.273239  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.274020  4719 raft_consensus.cc:2243] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.274636  4719 raft_consensus.cc:2272] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.276479 12293 consensus_peers.cc:597] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.277416  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.278155  4719 raft_consensus.cc:2243] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.278565  4719 raft_consensus.cc:2272] T d70f84c10ad144b2b4d6bd50567b54ed P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.280821  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.281574  4719 raft_consensus.cc:2243] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.282032  4719 raft_consensus.cc:2272] T 1565041017e04674b72abd4fdbab6b1b P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.283982 12441 consensus_peers.cc:597] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.284927  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.285593  4719 raft_consensus.cc:2243] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.286454  4719 raft_consensus.cc:2272] T 30a0ef32a33f4a609e678abbfa038080 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.289083  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.289966  4719 raft_consensus.cc:2243] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.290819  4719 raft_consensus.cc:2272] T c5a169ed363546d282eb265bd36bc136 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.293677  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.294411  4719 raft_consensus.cc:2243] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.295011  4719 raft_consensus.cc:2272] T c8c659d02f1647c7b404779d983439ca P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.298574  4719 tablet_replica.cc:333] stopping tablet replica
W20260620 13:59:22.298424 12367 consensus_peers.cc:597] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.299608  4719 raft_consensus.cc:2243] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.300199  4719 raft_consensus.cc:2272] T 840318536322435dac01a843c641b718 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.303212  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.304141  4719 raft_consensus.cc:2243] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.304780  4719 raft_consensus.cc:2272] T 09dbf9acadba454f83e6b30932aa7806 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.306705 12293 consensus_peers.cc:597] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.308049  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.308900  4719 raft_consensus.cc:2243] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.309439  4719 raft_consensus.cc:2272] T 97d2754643614cdcb0928c841c0fa0bb P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.312224  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.312798  4719 raft_consensus.cc:2243] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.313236  4719 raft_consensus.cc:2272] T 9124333b2aae40e2b813819981e990e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.315398  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.315979  4719 raft_consensus.cc:2243] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.316332  4719 raft_consensus.cc:2272] T bc2940ddb8684b88ac43aa54628de34f P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.318789  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.319584  4719 raft_consensus.cc:2243] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.319967  4719 raft_consensus.cc:2272] T 99e449058fb942ddb74eb93a98cb4336 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.322007  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.322542  4719 raft_consensus.cc:2243] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.322992  4719 raft_consensus.cc:2272] T 7d587f93178449aa9441f0d350cc166d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.325335  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.325954  4719 raft_consensus.cc:2243] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.326750  4719 raft_consensus.cc:2272] T 0ee8de600a8646df90a272c586e08ae5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.329200  4719 tablet_replica.cc:333] stopping tablet replica
W20260620 13:59:22.329555 12367 consensus_peers.cc:597] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.329752  4719 raft_consensus.cc:2243] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.330307  4719 raft_consensus.cc:2272] T ff2e933cf7b644e4b893d2e7e85425be P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.332538  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.333051  4719 raft_consensus.cc:2243] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.333755  4719 raft_consensus.cc:2272] T 85ae493b3ffc48e19f911962029c41e5 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.335765  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.336262  4719 raft_consensus.cc:2243] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.337023  4719 raft_consensus.cc:2272] T d3b45b565aa74abfad3579abc6ed2e56 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.339048  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.339619  4719 raft_consensus.cc:2243] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.340092  4719 raft_consensus.cc:2272] T 1fe9fd2ff66d4141a2c7f7023278714d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.342624  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.343252  4719 raft_consensus.cc:2243] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 4 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.344110  4719 raft_consensus.cc:2272] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.346037  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.346575  4719 raft_consensus.cc:2243] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.347014  4719 raft_consensus.cc:2272] T 62a796c8979c4c2bb4de0ee5e4cd35dc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.349432  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.350039  4719 raft_consensus.cc:2243] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.350893  4719 raft_consensus.cc:2272] T 2596bf072bda4ad188dcc3f1438a4d7d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.353504  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.354003  4719 raft_consensus.cc:2243] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.354663  4719 raft_consensus.cc:2272] T 7aa301d02030498583d201921146bb89 P 4d43d0ad579244c0a3ebb71069c1ab4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.357018  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.357708  4719 raft_consensus.cc:2243] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.358227  4719 raft_consensus.cc:2272] T a6c52f04bdd14864afe89398fc3af00c P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.359613 12367 consensus_peers.cc:597] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.360977  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.361567  4719 raft_consensus.cc:2243] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.362299  4719 raft_consensus.cc:2272] T 786cabf18ace418e912751ea7c5cc45d P 4d43d0ad579244c0a3ebb71069c1ab4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.364365  4719 tablet_replica.cc:333] stopping tablet replica
I20260620 13:59:22.364854  4719 raft_consensus.cc:2243] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.365245  4719 raft_consensus.cc:2272] T 40cf2f63a9574e2098c933116f1700cc P 4d43d0ad579244c0a3ebb71069c1ab4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.385856 12293 consensus_peers.cc:597] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.395727 12293 consensus_peers.cc:597] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.403841 12441 consensus_peers.cc:597] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.411908 12441 consensus_peers.cc:597] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.419826 12293 consensus_peers.cc:597] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.438159  4719 tablet_server.cc:196] TabletServer@127.4.155.193:35839 shutdown complete.
W20260620 13:59:22.441545 12441 consensus_peers.cc:597] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.448206 12441 consensus_peers.cc:597] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.463474 12441 consensus_peers.cc:597] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.482631 12367 consensus_peers.cc:597] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.501959 12367 consensus_peers.cc:597] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.520824 12441 consensus_peers.cc:597] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.523334  4719 tablet_server.cc:179] TabletServer@127.4.155.194:0 shutting down...
W20260620 13:59:22.550544 12293 consensus_peers.cc:597] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.551981 12441 consensus_peers.cc:597] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.557053 12441 consensus_peers.cc:597] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.568068 12367 consensus_peers.cc:597] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.570375 12293 consensus_peers.cc:597] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.583247  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:59:22.584187  4719 tablet_replica.cc:333] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.585017  4719 raft_consensus.cc:2243] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.586334  4719 raft_consensus.cc:2272] T c8c659d02f1647c7b404779d983439ca P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.588830  4719 tablet_replica.cc:333] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.589360  4719 raft_consensus.cc:2243] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.589709  4719 raft_consensus.cc:2272] T 100d2b85fd4c4959bfbb5df7beb05915 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.592180  4719 tablet_replica.cc:333] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.593129  4719 raft_consensus.cc:2243] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.593600  4719 raft_consensus.cc:2272] T fad12197ae0a40fe8dff265afe9d96af P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.596055  4719 tablet_replica.cc:333] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.596910  4719 raft_consensus.cc:2243] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.597461  4719 raft_consensus.cc:2272] T 7aa301d02030498583d201921146bb89 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.600306  4719 tablet_replica.cc:333] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.601166  4719 raft_consensus.cc:2243] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.602243  4719 raft_consensus.cc:2272] T 7d587f93178449aa9441f0d350cc166d P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.605468  4719 tablet_replica.cc:333] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.606153  4719 raft_consensus.cc:2243] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.606657  4719 raft_consensus.cc:2272] T 1fe9fd2ff66d4141a2c7f7023278714d P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.609265  4719 tablet_replica.cc:333] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.609838  4719 raft_consensus.cc:2243] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.610262  4719 raft_consensus.cc:2272] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.612234  4719 tablet_replica.cc:333] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.612864  4719 raft_consensus.cc:2243] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.613308  4719 raft_consensus.cc:2272] T 369e0ab28a64476cb0e07ab5672b9337 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.615190  4719 tablet_replica.cc:333] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.615752  4719 raft_consensus.cc:2243] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.616155  4719 raft_consensus.cc:2272] T 0ee8de600a8646df90a272c586e08ae5 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.617945  4719 tablet_replica.cc:333] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.618506  4719 raft_consensus.cc:2243] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.619330  4719 raft_consensus.cc:2272] T a0dff624788f433e88274d14f0db3c4c P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.621325  4719 tablet_replica.cc:333] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.621925  4719 raft_consensus.cc:2243] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.622867  4719 raft_consensus.cc:2272] T 98b83072f19644f5806c4391cbb1bce5 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.625123  4719 tablet_replica.cc:333] T ff3958c528894be19bfada85bc17a4ee P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.625713  4719 raft_consensus.cc:2243] T ff3958c528894be19bfada85bc17a4ee P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.626214  4719 raft_consensus.cc:2272] T ff3958c528894be19bfada85bc17a4ee P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.630074  4719 tablet_replica.cc:333] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.631240  4719 raft_consensus.cc:2243] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.631913  4719 raft_consensus.cc:2272] T 15db1e0a1aa646e281b8e1a998d8f6d4 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.634804  4719 tablet_replica.cc:333] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.635573  4719 raft_consensus.cc:2243] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.636198  4719 raft_consensus.cc:2272] T 7edd30f224ff4b17bc0d671c619c821b P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.636278 12367 consensus_peers.cc:597] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.638839  4719 tablet_replica.cc:333] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.639631  4719 raft_consensus.cc:2243] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.640621  4719 raft_consensus.cc:2272] T d4a422539280460c895f371ef9eb8f4d P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.643682  4719 tablet_replica.cc:333] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.644433  4719 raft_consensus.cc:2243] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.644958  4719 raft_consensus.cc:2272] T 7b6c6d2474cc47d09439ce00490af552 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.644953 12367 consensus_peers.cc:597] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.647256  4719 tablet_replica.cc:333] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.648131  4719 raft_consensus.cc:2243] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.648695  4719 raft_consensus.cc:2272] T 62a796c8979c4c2bb4de0ee5e4cd35dc P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.651652  4719 tablet_replica.cc:333] T 840318536322435dac01a843c641b718 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.652508  4719 raft_consensus.cc:2243] T 840318536322435dac01a843c641b718 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.653113  4719 raft_consensus.cc:2272] T 840318536322435dac01a843c641b718 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.656864  4719 tablet_replica.cc:333] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
W20260620 13:59:22.657760 12441 consensus_peers.cc:597] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.658221  4719 raft_consensus.cc:2243] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.658888  4719 raft_consensus.cc:2272] T 462ac845f28a431eb612b5e09327f55a P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.661626  4719 tablet_replica.cc:333] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.662585  4719 raft_consensus.cc:2243] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.663179  4719 raft_consensus.cc:2272] T b65eb66c55e74ee78340946d691c4e72 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.666405  4719 tablet_replica.cc:333] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.667284  4719 raft_consensus.cc:2243] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 2 LEADER]: Raft consensus shutting down.
W20260620 13:59:22.668295 12441 consensus_peers.cc:597] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.668322  4719 raft_consensus.cc:2272] T 7c1ae3d064cd49309bf086b257c3f664 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.672271  4719 tablet_replica.cc:333] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.673099  4719 raft_consensus.cc:2243] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.674110  4719 raft_consensus.cc:2272] T 9c1f1202d4ad46b49a994c23c7f566c1 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.676736  4719 tablet_replica.cc:333] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.677471  4719 raft_consensus.cc:2243] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.678488  4719 raft_consensus.cc:2272] T 56e0ab75d2c84468b813c054386f4b27 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.679807 12367 consensus_peers.cc:597] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 -> Peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Couldn't send request to peer 4d43d0ad579244c0a3ebb71069c1ab4f. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.681154  4719 tablet_replica.cc:333] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.682160  4719 raft_consensus.cc:2243] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.683282  4719 raft_consensus.cc:2272] T 97d2754643614cdcb0928c841c0fa0bb P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.686416  4719 tablet_replica.cc:333] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.687243  4719 raft_consensus.cc:2243] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Raft consensus shutting down.
W20260620 13:59:22.687652 12367 consensus_peers.cc:597] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.687817  4719 raft_consensus.cc:2272] T 17521c552cad497e9ae59a332d156c0e P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.690886  4719 tablet_replica.cc:333] T 93da747507134e1699f01078033ae503 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.691859  4719 raft_consensus.cc:2243] T 93da747507134e1699f01078033ae503 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.692456  4719 raft_consensus.cc:2272] T 93da747507134e1699f01078033ae503 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.695333  4719 tablet_replica.cc:333] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.696060  4719 raft_consensus.cc:2243] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.696509  4719 raft_consensus.cc:2272] T a6c52f04bdd14864afe89398fc3af00c P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.698500  4719 tablet_replica.cc:333] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.699010  4719 raft_consensus.cc:2243] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.699864  4719 raft_consensus.cc:2272] T 1565041017e04674b72abd4fdbab6b1b P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.702041  4719 tablet_replica.cc:333] T d70f84c10ad144b2b4d6bd50567b54ed P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.702952  4719 raft_consensus.cc:2243] T d70f84c10ad144b2b4d6bd50567b54ed P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.703511  4719 raft_consensus.cc:2272] T d70f84c10ad144b2b4d6bd50567b54ed P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.706094  4719 tablet_replica.cc:333] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.706647  4719 raft_consensus.cc:2243] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Raft consensus shutting down.
W20260620 13:59:22.706828 12441 consensus_peers.cc:597] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.707486  4719 raft_consensus.cc:2272] T 00f805a171a24872a79e07cc3a788290 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.710074  4719 tablet_replica.cc:333] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.710880  4719 raft_consensus.cc:2243] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.711509  4719 raft_consensus.cc:2272] T 928bd8a07cbe4d58b19f3669419f928d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.714344  4719 tablet_replica.cc:333] T 99e449058fb942ddb74eb93a98cb4336 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.715093  4719 raft_consensus.cc:2243] T 99e449058fb942ddb74eb93a98cb4336 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.715695  4719 raft_consensus.cc:2272] T 99e449058fb942ddb74eb93a98cb4336 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.717644  4719 tablet_replica.cc:333] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.718158  4719 raft_consensus.cc:2243] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.718585  4719 raft_consensus.cc:2272] T bc2940ddb8684b88ac43aa54628de34f P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.720530  4719 tablet_replica.cc:333] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.721822  4719 raft_consensus.cc:2243] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.723388  4719 raft_consensus.cc:2272] T e34e64f189e740e1bbebd03257e5af90 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.726768  4719 tablet_replica.cc:333] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.727622  4719 raft_consensus.cc:2243] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.728196  4719 raft_consensus.cc:2272] T 4fdb1bbde932422ba09645787f9d2446 P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.731024  4719 tablet_replica.cc:333] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.731825  4719 raft_consensus.cc:2243] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.732326  4719 raft_consensus.cc:2272] T 30a0ef32a33f4a609e678abbfa038080 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.734411  4719 tablet_replica.cc:333] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.734972  4719 raft_consensus.cc:2243] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.735780  4719 raft_consensus.cc:2272] T 8e74afa4f8b64bf691a223a9eff804d7 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.739711  4719 tablet_replica.cc:333] T 11868dc915f6412eaed3c2ba56738bfc P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.740541  4719 raft_consensus.cc:2243] T 11868dc915f6412eaed3c2ba56738bfc P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.741134  4719 raft_consensus.cc:2272] T 11868dc915f6412eaed3c2ba56738bfc P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.742231 12441 consensus_peers.cc:597] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.744580  4719 tablet_replica.cc:333] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.745503  4719 raft_consensus.cc:2243] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.746503  4719 raft_consensus.cc:2272] T 517e043628a84907974c6a2fbf432d08 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.748983  4719 tablet_replica.cc:333] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.749521  4719 raft_consensus.cc:2243] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.749933  4719 raft_consensus.cc:2272] T d3b45b565aa74abfad3579abc6ed2e56 P fcd1bd5dfea74c378a6154f83707154c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.752029  4719 tablet_replica.cc:333] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.752599  4719 raft_consensus.cc:2243] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.753002  4719 raft_consensus.cc:2272] T 85ae493b3ffc48e19f911962029c41e5 P fcd1bd5dfea74c378a6154f83707154c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.754810  4719 tablet_replica.cc:333] T ff2e933cf7b644e4b893d2e7e85425be P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.755357  4719 raft_consensus.cc:2243] T ff2e933cf7b644e4b893d2e7e85425be P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.755741  4719 raft_consensus.cc:2272] T ff2e933cf7b644e4b893d2e7e85425be P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.757890  4719 tablet_replica.cc:333] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.758740  4719 raft_consensus.cc:2243] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.759462  4719 raft_consensus.cc:2272] T 1a9724c70f584a9c8aced9cc416e027d P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:22.761914  4719 tablet_replica.cc:333] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c: stopping tablet replica
I20260620 13:59:22.762534  4719 raft_consensus.cc:2243] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:22.764047  4719 raft_consensus.cc:2272] T 065fb7373cff4c42b0917abd9199dac5 P fcd1bd5dfea74c378a6154f83707154c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:22.782498 12441 consensus_peers.cc:597] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.796021 12441 consensus_peers.cc:597] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.802627 12441 consensus_peers.cc:597] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.813571 12367 consensus_peers.cc:597] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.837628 12367 consensus_peers.cc:597] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:37965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.849968 12441 consensus_peers.cc:597] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:37965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.854225  4719 tablet_server.cc:196] TabletServer@127.4.155.194:0 shutdown complete.
W20260620 13:59:22.906653 12367 consensus_peers.cc:597] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:37965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.932593 12367 consensus_peers.cc:597] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:37965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.950608  4719 tablet_server.cc:179] TabletServer@127.4.155.195:0 shutting down...
W20260620 13:59:22.962667 12367 consensus_peers.cc:597] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:37965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:22.966022 12440 consensus_peers.cc:597] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Couldn't send request to peer c51ef915af09435db6046c91bb9d00e0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:22.996536  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:59:22.997617  4719 tablet_replica.cc:333] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:22.998790  4719 raft_consensus.cc:2243] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:22.999487  4719 raft_consensus.cc:2272] T c5a169ed363546d282eb265bd36bc136 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.001598  4719 tablet_replica.cc:333] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.002178  4719 raft_consensus.cc:2243] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.002750  4719 raft_consensus.cc:2272] T 100d2b85fd4c4959bfbb5df7beb05915 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.005916  4719 tablet_replica.cc:333] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.006695  4719 raft_consensus.cc:2243] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.007346  4719 raft_consensus.cc:2272] T fad12197ae0a40fe8dff265afe9d96af P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:23.008498 12441 consensus_peers.cc:597] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:37965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:23.009021 12441 consensus_peers.cc:597] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:37965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:23.010143  4719 tablet_replica.cc:333] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.010823  4719 raft_consensus.cc:2243] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.011334  4719 raft_consensus.cc:2272] T 8e74afa4f8b64bf691a223a9eff804d7 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.013338  4719 tablet_replica.cc:333] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.014355  4719 raft_consensus.cc:2243] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.015512  4719 raft_consensus.cc:2272] T 918029829d594bafac9e17a30edcacee P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.018419  4719 tablet_replica.cc:333] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.019243  4719 raft_consensus.cc:2243] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.019735  4719 raft_consensus.cc:2272] T 1c50f25282d94111a4d435e85e67af34 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.022430  4719 tablet_replica.cc:333] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.023244  4719 raft_consensus.cc:2243] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.023854  4719 raft_consensus.cc:2272] T 0ee8de600a8646df90a272c586e08ae5 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.026552  4719 tablet_replica.cc:333] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.027349  4719 raft_consensus.cc:2243] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.027860  4719 raft_consensus.cc:2272] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.030141  4719 tablet_replica.cc:333] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.030663  4719 raft_consensus.cc:2243] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.031049  4719 raft_consensus.cc:2272] T 98b83072f19644f5806c4391cbb1bce5 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.033026  4719 tablet_replica.cc:333] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.033648  4719 raft_consensus.cc:2243] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.034335  4719 raft_consensus.cc:2272] T ff3958c528894be19bfada85bc17a4ee P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.036736  4719 tablet_replica.cc:333] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.037489  4719 raft_consensus.cc:2243] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.038041  4719 raft_consensus.cc:2272] T 61907296334d4a149ab81ba5337a1a27 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.041186  4719 tablet_replica.cc:333] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.041988  4719 raft_consensus.cc:2243] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.046677  4719 raft_consensus.cc:2272] T 15db1e0a1aa646e281b8e1a998d8f6d4 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:23.047863 12441 consensus_peers.cc:597] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer fcd1bd5dfea74c378a6154f83707154c (127.4.155.194:37965): Couldn't send request to peer fcd1bd5dfea74c378a6154f83707154c. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:37965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:23.049117  4719 tablet_replica.cc:333] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.049989  4719 raft_consensus.cc:2243] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.050802  4719 raft_consensus.cc:2272] T 7edd30f224ff4b17bc0d671c619c821b P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.053838  4719 tablet_replica.cc:333] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.054489  4719 raft_consensus.cc:2243] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260620 13:59:23.054983 12440 consensus_peers.cc:597] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Couldn't send request to peer c51ef915af09435db6046c91bb9d00e0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:23.055022  4719 raft_consensus.cc:2272] T d4a422539280460c895f371ef9eb8f4d P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.057832  4719 tablet_replica.cc:333] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.058458  4719 raft_consensus.cc:2243] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.058944  4719 raft_consensus.cc:2272] T 00f805a171a24872a79e07cc3a788290 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.061517  4719 tablet_replica.cc:333] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.062346  4719 raft_consensus.cc:2243] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.062820  4719 raft_consensus.cc:2272] T b65eb66c55e74ee78340946d691c4e72 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:23.062985 12440 consensus_peers.cc:597] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Couldn't send request to peer c51ef915af09435db6046c91bb9d00e0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:23.064862  4719 tablet_replica.cc:333] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.065495  4719 raft_consensus.cc:2243] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.066187  4719 raft_consensus.cc:2272] T 462ac845f28a431eb612b5e09327f55a P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.069047  4719 tablet_replica.cc:333] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.069824  4719 raft_consensus.cc:2243] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.070410  4719 raft_consensus.cc:2272] T 2596bf072bda4ad188dcc3f1438a4d7d P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.073068  4719 tablet_replica.cc:333] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.073899  4719 raft_consensus.cc:2243] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.074472  4719 raft_consensus.cc:2272] T 9c1f1202d4ad46b49a994c23c7f566c1 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.077399  4719 tablet_replica.cc:333] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.078157  4719 raft_consensus.cc:2243] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.078732  4719 raft_consensus.cc:2272] T 56e0ab75d2c84468b813c054386f4b27 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.081552  4719 tablet_replica.cc:333] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.082456  4719 raft_consensus.cc:2243] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Raft consensus shutting down.
W20260620 13:59:23.085206 12440 consensus_peers.cc:597] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Couldn't send request to peer c51ef915af09435db6046c91bb9d00e0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:23.088862  4719 raft_consensus.cc:2272] T 62a796c8979c4c2bb4de0ee5e4cd35dc P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.091307  4719 tablet_replica.cc:333] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.091962  4719 raft_consensus.cc:2243] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.092691  4719 raft_consensus.cc:2272] T 7b6c6d2474cc47d09439ce00490af552 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.094928  4719 tablet_replica.cc:333] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.095726  4719 raft_consensus.cc:2243] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.096221  4719 raft_consensus.cc:2272] T 7c1ae3d064cd49309bf086b257c3f664 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.098770  4719 tablet_replica.cc:333] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.099463  4719 raft_consensus.cc:2243] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.099893  4719 raft_consensus.cc:2272] T 1d12122a1bf1410bb150a27f3bf46fdf P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.102229  4719 tablet_replica.cc:333] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.103046  4719 raft_consensus.cc:2243] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.104190  4719 raft_consensus.cc:2272] T a6e8c601ed2e4253b8c7f5dceb77f518 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.106693  4719 tablet_replica.cc:333] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.107565  4719 raft_consensus.cc:2243] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.108539  4719 raft_consensus.cc:2272] T 09dbf9acadba454f83e6b30932aa7806 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.111626  4719 tablet_replica.cc:333] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.112468  4719 raft_consensus.cc:2243] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.113266  4719 raft_consensus.cc:2272] T 1fe9fd2ff66d4141a2c7f7023278714d P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.115765  4719 tablet_replica.cc:333] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.116341  4719 raft_consensus.cc:2243] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.116799  4719 raft_consensus.cc:2272] T 86b5f917a39d4ff0bbbc205b4aa941d8 P c51ef915af09435db6046c91bb9d00e0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.118829  4719 tablet_replica.cc:333] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.119504  4719 raft_consensus.cc:2243] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.119956  4719 raft_consensus.cc:2272] T efeb9f3004de439280900847880929c6 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.122080  4719 tablet_replica.cc:333] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.122818  4719 raft_consensus.cc:2243] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.123936  4719 raft_consensus.cc:2272] T 93da747507134e1699f01078033ae503 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.126492  4719 tablet_replica.cc:333] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.127226  4719 raft_consensus.cc:2243] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.128180  4719 raft_consensus.cc:2272] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.130088  4719 tablet_replica.cc:333] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.130645  4719 raft_consensus.cc:2243] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.131057  4719 raft_consensus.cc:2272] T 75286f26552b4e788b3844d3aa342b01 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.133013  4719 tablet_replica.cc:333] T 1565041017e04674b72abd4fdbab6b1b P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.133549  4719 raft_consensus.cc:2243] T 1565041017e04674b72abd4fdbab6b1b P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.133952  4719 raft_consensus.cc:2272] T 1565041017e04674b72abd4fdbab6b1b P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.136096  4719 tablet_replica.cc:333] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.136766  4719 raft_consensus.cc:2243] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.137266  4719 raft_consensus.cc:2272] T 4fdb1bbde932422ba09645787f9d2446 P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.139765  4719 tablet_replica.cc:333] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.140532  4719 raft_consensus.cc:2243] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.141001  4719 raft_consensus.cc:2272] T 30a0ef32a33f4a609e678abbfa038080 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.143463  4719 tablet_replica.cc:333] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.144182  4719 raft_consensus.cc:2243] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.145164  4719 raft_consensus.cc:2272] T 9124333b2aae40e2b813819981e990e5 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.147226  4719 tablet_replica.cc:333] T 517e043628a84907974c6a2fbf432d08 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.147827  4719 raft_consensus.cc:2243] T 517e043628a84907974c6a2fbf432d08 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.148267  4719 raft_consensus.cc:2272] T 517e043628a84907974c6a2fbf432d08 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.150303  4719 tablet_replica.cc:333] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.150820  4719 raft_consensus.cc:2243] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.151278  4719 raft_consensus.cc:2272] T d3b45b565aa74abfad3579abc6ed2e56 P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.153079  4719 tablet_replica.cc:333] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.153610  4719 raft_consensus.cc:2243] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.153998  4719 raft_consensus.cc:2272] T 85ae493b3ffc48e19f911962029c41e5 P c51ef915af09435db6046c91bb9d00e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.156412  4719 tablet_replica.cc:333] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.156983  4719 raft_consensus.cc:2243] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.157760  4719 raft_consensus.cc:2272] T ff2e933cf7b644e4b893d2e7e85425be P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.160003  4719 tablet_replica.cc:333] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.160560  4719 raft_consensus.cc:2243] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.161031  4719 raft_consensus.cc:2272] T 786cabf18ace418e912751ea7c5cc45d P c51ef915af09435db6046c91bb9d00e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.162955  4719 tablet_replica.cc:333] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.163512  4719 raft_consensus.cc:2243] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.164335  4719 raft_consensus.cc:2272] T 1a9724c70f584a9c8aced9cc416e027d P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.166333  4719 tablet_replica.cc:333] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.166831  4719 raft_consensus.cc:2243] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.167717  4719 raft_consensus.cc:2272] T 40cf2f63a9574e2098c933116f1700cc P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.169697  4719 tablet_replica.cc:333] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0: stopping tablet replica
I20260620 13:59:23.170181  4719 raft_consensus.cc:2243] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.170585  4719 raft_consensus.cc:2272] T 065fb7373cff4c42b0917abd9199dac5 P c51ef915af09435db6046c91bb9d00e0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:23.222100 12440 consensus_peers.cc:597] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Couldn't send request to peer c51ef915af09435db6046c91bb9d00e0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:23.235792  4719 tablet_server.cc:196] TabletServer@127.4.155.195:0 shutdown complete.
W20260620 13:59:23.300709 12440 consensus_peers.cc:597] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Couldn't send request to peer c51ef915af09435db6046c91bb9d00e0. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.195:37673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:23.314579 12440 consensus_peers.cc:597] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 -> Peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Couldn't send request to peer c51ef915af09435db6046c91bb9d00e0. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.195:37673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:23.317855  4719 tablet_server.cc:179] TabletServer@127.4.155.196:0 shutting down...
I20260620 13:59:23.338922 13442 raft_consensus.cc:493] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4d43d0ad579244c0a3ebb71069c1ab4f)
I20260620 13:59:23.339730 13442 raft_consensus.cc:515] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51ef915af09435db6046c91bb9d00e0" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 37673 } } peers { permanent_uuid: "69a98f1d9eda4cd9bdd2287823f798f6" member_type: VOTER last_known_addr { host: "127.4.155.196" port: 41785 } } peers { permanent_uuid: "4d43d0ad579244c0a3ebb71069c1ab4f" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35839 } }
I20260620 13:59:23.344233 13442 leader_election.cc:290] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673), 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839)
W20260620 13:59:23.349318 12440 leader_election.cc:336] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c51ef915af09435db6046c91bb9d00e0 (127.4.155.195:37673): Network error: Client connection negotiation failed: client connection to 127.4.155.195:37673: connect: Connection refused (error 111)
W20260620 13:59:23.350528 12441 leader_election.cc:336] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4d43d0ad579244c0a3ebb71069c1ab4f (127.4.155.193:35839): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35839: connect: Connection refused (error 111)
I20260620 13:59:23.351135 12441 leader_election.cc:304] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69a98f1d9eda4cd9bdd2287823f798f6; no voters: 4d43d0ad579244c0a3ebb71069c1ab4f, c51ef915af09435db6046c91bb9d00e0
I20260620 13:59:23.351981 13442 raft_consensus.cc:2749] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 13:59:23.372300  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:59:23.373087  4719 tablet_replica.cc:333] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.373838  4719 raft_consensus.cc:2243] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.374635  4719 raft_consensus.cc:2272] T 100d2b85fd4c4959bfbb5df7beb05915 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.376659  4719 tablet_replica.cc:333] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.377310  4719 raft_consensus.cc:2243] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.377795  4719 raft_consensus.cc:2272] T c5a169ed363546d282eb265bd36bc136 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.379684  4719 tablet_replica.cc:333] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.380160  4719 raft_consensus.cc:2243] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.380537  4719 raft_consensus.cc:2272] T c8c659d02f1647c7b404779d983439ca P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.382436  4719 tablet_replica.cc:333] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.382917  4719 raft_consensus.cc:2243] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.383368  4719 raft_consensus.cc:2272] T 17521c552cad497e9ae59a332d156c0e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.385121  4719 tablet_replica.cc:333] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.385604  4719 raft_consensus.cc:2243] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.386269  4719 raft_consensus.cc:2272] T fad12197ae0a40fe8dff265afe9d96af P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.388139  4719 tablet_replica.cc:333] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.388636  4719 raft_consensus.cc:2243] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.389006  4719 raft_consensus.cc:2272] T 7aa301d02030498583d201921146bb89 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.391206  4719 tablet_replica.cc:333] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.392009  4719 raft_consensus.cc:2243] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.392915  4719 raft_consensus.cc:2272] T 61907296334d4a149ab81ba5337a1a27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.396005  4719 tablet_replica.cc:333] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.396637  4719 raft_consensus.cc:2243] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.397157  4719 raft_consensus.cc:2272] T 7d587f93178449aa9441f0d350cc166d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.400068  4719 tablet_replica.cc:333] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.400858  4719 raft_consensus.cc:2243] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.401835  4719 raft_consensus.cc:2272] T 51af9cbc1bcc4e1cbd3c5c37e44f865b P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.404186  4719 tablet_replica.cc:333] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.404800  4719 raft_consensus.cc:2243] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.405644  4719 raft_consensus.cc:2272] T 1c50f25282d94111a4d435e85e67af34 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.407680  4719 tablet_replica.cc:333] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.408229  4719 raft_consensus.cc:2243] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.408638  4719 raft_consensus.cc:2272] T 918029829d594bafac9e17a30edcacee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.410543  4719 tablet_replica.cc:333] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.411209  4719 raft_consensus.cc:2243] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.412096  4719 raft_consensus.cc:2272] T 369e0ab28a64476cb0e07ab5672b9337 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.414055  4719 tablet_replica.cc:333] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.414573  4719 raft_consensus.cc:2243] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.414958  4719 raft_consensus.cc:2272] T a0dff624788f433e88274d14f0db3c4c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.416879  4719 tablet_replica.cc:333] T ff3958c528894be19bfada85bc17a4ee P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.417375  4719 raft_consensus.cc:2243] T ff3958c528894be19bfada85bc17a4ee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.417727  4719 raft_consensus.cc:2272] T ff3958c528894be19bfada85bc17a4ee P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.419615  4719 tablet_replica.cc:333] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.420099  4719 raft_consensus.cc:2243] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.420480  4719 raft_consensus.cc:2272] T 15db1e0a1aa646e281b8e1a998d8f6d4 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.422189  4719 tablet_replica.cc:333] T e34e64f189e740e1bbebd03257e5af90 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.422675  4719 raft_consensus.cc:2243] T e34e64f189e740e1bbebd03257e5af90 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.423015  4719 raft_consensus.cc:2272] T e34e64f189e740e1bbebd03257e5af90 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.424867  4719 tablet_replica.cc:333] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.425419  4719 raft_consensus.cc:2243] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.425828  4719 raft_consensus.cc:2272] T 462ac845f28a431eb612b5e09327f55a P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.427750  4719 tablet_replica.cc:333] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.428486  4719 raft_consensus.cc:2243] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.429173  4719 raft_consensus.cc:2272] T b65eb66c55e74ee78340946d691c4e72 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.430953  4719 tablet_replica.cc:333] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.431531  4719 raft_consensus.cc:2243] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.431885  4719 raft_consensus.cc:2272] T 2596bf072bda4ad188dcc3f1438a4d7d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.433485  4719 tablet_replica.cc:333] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.433959  4719 raft_consensus.cc:2243] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.434315  4719 raft_consensus.cc:2272] T 786cabf18ace418e912751ea7c5cc45d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.436154  4719 tablet_replica.cc:333] T 1a9724c70f584a9c8aced9cc416e027d P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.436748  4719 raft_consensus.cc:2243] T 1a9724c70f584a9c8aced9cc416e027d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.437160  4719 raft_consensus.cc:2272] T 1a9724c70f584a9c8aced9cc416e027d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.438915  4719 tablet_replica.cc:333] T 40cf2f63a9574e2098c933116f1700cc P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.439529  4719 raft_consensus.cc:2243] T 40cf2f63a9574e2098c933116f1700cc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.439935  4719 raft_consensus.cc:2272] T 40cf2f63a9574e2098c933116f1700cc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.441804  4719 tablet_replica.cc:333] T 065fb7373cff4c42b0917abd9199dac5 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.442344  4719 raft_consensus.cc:2243] T 065fb7373cff4c42b0917abd9199dac5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.442763  4719 raft_consensus.cc:2272] T 065fb7373cff4c42b0917abd9199dac5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.444593  4719 tablet_replica.cc:333] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.445214  4719 raft_consensus.cc:2243] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.445953  4719 raft_consensus.cc:2272] T bc2940ddb8684b88ac43aa54628de34f P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.447969  4719 tablet_replica.cc:333] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.448501  4719 raft_consensus.cc:2243] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.449256  4719 raft_consensus.cc:2272] T 99e449058fb942ddb74eb93a98cb4336 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.451243  4719 tablet_replica.cc:333] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.451766  4719 raft_consensus.cc:2243] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.452188  4719 raft_consensus.cc:2272] T 97d2754643614cdcb0928c841c0fa0bb P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.453998  4719 tablet_replica.cc:333] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.454547  4719 raft_consensus.cc:2243] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.454983  4719 raft_consensus.cc:2272] T 9124333b2aae40e2b813819981e990e5 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.456919  4719 tablet_replica.cc:333] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.457489  4719 raft_consensus.cc:2243] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.457875  4719 raft_consensus.cc:2272] T 56e0ab75d2c84468b813c054386f4b27 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.459707  4719 tablet_replica.cc:333] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.460242  4719 raft_consensus.cc:2243] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.460644  4719 raft_consensus.cc:2272] T 7b6c6d2474cc47d09439ce00490af552 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.462427  4719 tablet_replica.cc:333] T 00f805a171a24872a79e07cc3a788290 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.462939  4719 raft_consensus.cc:2243] T 00f805a171a24872a79e07cc3a788290 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.463372  4719 raft_consensus.cc:2272] T 00f805a171a24872a79e07cc3a788290 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.465093  4719 tablet_replica.cc:333] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.465615  4719 raft_consensus.cc:2243] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.466027  4719 raft_consensus.cc:2272] T 4b27c67d5c9b4e2dbc82e90717ebbf9e P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.467909  4719 tablet_replica.cc:333] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.468427  4719 raft_consensus.cc:2243] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.469161  4719 raft_consensus.cc:2272] T 75286f26552b4e788b3844d3aa342b01 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.471494  4719 tablet_replica.cc:333] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.472122  4719 raft_consensus.cc:2243] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.473027  4719 raft_consensus.cc:2272] T d70f84c10ad144b2b4d6bd50567b54ed P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.475394  4719 tablet_replica.cc:333] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.475929  4719 raft_consensus.cc:2243] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.476619  4719 raft_consensus.cc:2272] T 928bd8a07cbe4d58b19f3669419f928d P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.478349  4719 tablet_replica.cc:333] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.478807  4719 raft_consensus.cc:2243] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.479282  4719 raft_consensus.cc:2272] T 86b5f917a39d4ff0bbbc205b4aa941d8 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.480978  4719 tablet_replica.cc:333] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.481539  4719 raft_consensus.cc:2243] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.481900  4719 raft_consensus.cc:2272] T efeb9f3004de439280900847880929c6 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.483671  4719 tablet_replica.cc:333] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.484128  4719 raft_consensus.cc:2243] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.484810  4719 raft_consensus.cc:2272] T a6c52f04bdd14864afe89398fc3af00c P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.486470  4719 tablet_replica.cc:333] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.486902  4719 raft_consensus.cc:2243] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.487336  4719 raft_consensus.cc:2272] T 1d12122a1bf1410bb150a27f3bf46fdf P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.488867  4719 tablet_replica.cc:333] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.489300  4719 raft_consensus.cc:2243] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.489979  4719 raft_consensus.cc:2272] T 840318536322435dac01a843c641b718 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.491792  4719 tablet_replica.cc:333] T a6e8c601ed2e4253b8c7f5dceb77f518 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.492261  4719 raft_consensus.cc:2243] T a6e8c601ed2e4253b8c7f5dceb77f518 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.492622  4719 raft_consensus.cc:2272] T a6e8c601ed2e4253b8c7f5dceb77f518 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.494390  4719 tablet_replica.cc:333] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.494985  4719 raft_consensus.cc:2243] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.495409  4719 raft_consensus.cc:2272] T 09dbf9acadba454f83e6b30932aa7806 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.497128  4719 tablet_replica.cc:333] T 8e74afa4f8b64bf691a223a9eff804d7 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.497571  4719 raft_consensus.cc:2243] T 8e74afa4f8b64bf691a223a9eff804d7 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.497923  4719 raft_consensus.cc:2272] T 8e74afa4f8b64bf691a223a9eff804d7 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.499682  4719 tablet_replica.cc:333] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.500151  4719 raft_consensus.cc:2243] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.500885  4719 raft_consensus.cc:2272] T 11868dc915f6412eaed3c2ba56738bfc P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.502653  4719 tablet_replica.cc:333] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6: stopping tablet replica
I20260620 13:59:23.503124  4719 raft_consensus.cc:2243] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:23.503535  4719 raft_consensus.cc:2272] T 517e043628a84907974c6a2fbf432d08 P 69a98f1d9eda4cd9bdd2287823f798f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.569665  4719 tablet_server.cc:196] TabletServer@127.4.155.196:0 shutdown complete.
I20260620 13:59:23.632573  4719 master.cc:562] Master@127.4.155.254:43785 shutting down...
I20260620 13:59:23.664037  4719 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:23.664603  4719 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:23.664949  4719 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8fc3216e21144116aedea0a90c5fd4ea: stopping tablet replica
I20260620 13:59:23.726789  4719 master.cc:584] Master@127.4.155.254:43785 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (39875 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:497: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
[  SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode (9 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260620 13:59:23.835826  4719 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.155.254:38209
I20260620 13:59:23.837070  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:59:23.844139 13522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:23.844323 13523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:23.845330 13525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:23.846194  4719 server_base.cc:1061] running on GCE node
I20260620 13:59:23.849248  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:59:23.849532  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:59:23.849655  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963963849644 us; error 0 us; skew 500 ppm
I20260620 13:59:23.850159  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:59:23.853577  4719 webserver.cc:533] Webserver started at http://127.4.155.254:43595/ using document root <none> and password file <none>
I20260620 13:59:23.854041  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:59:23.854204  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:59:23.854439  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:59:23.855661  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/master-0-root/instance:
uuid: "47b12350c34e4e12af0dff07d394f6a9"
format_stamp: "Formatted at 2026-06-20 13:59:23 on dist-test-slave-n70f"
I20260620 13:59:23.860096  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260620 13:59:23.863749 13530 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:23.864790  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260620 13:59:23.865054  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/master-0-root
uuid: "47b12350c34e4e12af0dff07d394f6a9"
format_stamp: "Formatted at 2026-06-20 13:59:23 on dist-test-slave-n70f"
I20260620 13:59:23.865301  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:59:23.875689  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:59:23.876921  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:59:23.917193  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.254:38209
I20260620 13:59:23.917315 13581 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.254:38209 every 8 connection(s)
I20260620 13:59:23.922276 13582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:23.933770 13582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9: Bootstrap starting.
I20260620 13:59:23.938705 13582 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:23.943303 13582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9: No bootstrap required, opened a new log
I20260620 13:59:23.945490 13582 raft_consensus.cc:359] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b12350c34e4e12af0dff07d394f6a9" member_type: VOTER }
I20260620 13:59:23.945881 13582 raft_consensus.cc:385] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:23.946059 13582 raft_consensus.cc:740] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b12350c34e4e12af0dff07d394f6a9, State: Initialized, Role: FOLLOWER
I20260620 13:59:23.946674 13582 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b12350c34e4e12af0dff07d394f6a9" member_type: VOTER }
I20260620 13:59:23.947094 13582 raft_consensus.cc:399] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 13:59:23.947381 13582 raft_consensus.cc:493] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 13:59:23.947592 13582 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:23.952556 13582 raft_consensus.cc:515] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b12350c34e4e12af0dff07d394f6a9" member_type: VOTER }
I20260620 13:59:23.953087 13582 leader_election.cc:304] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47b12350c34e4e12af0dff07d394f6a9; no voters: 
I20260620 13:59:23.954357 13582 leader_election.cc:290] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 13:59:23.954959 13585 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:23.956444 13585 raft_consensus.cc:697] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [term 1 LEADER]: Becoming Leader. State: Replica: 47b12350c34e4e12af0dff07d394f6a9, State: Running, Role: LEADER
I20260620 13:59:23.957151 13585 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b12350c34e4e12af0dff07d394f6a9" member_type: VOTER }
I20260620 13:59:23.957724 13582 sys_catalog.cc:565] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 13:59:23.962829 13586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47b12350c34e4e12af0dff07d394f6a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b12350c34e4e12af0dff07d394f6a9" member_type: VOTER } }
I20260620 13:59:23.963703 13586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [sys.catalog]: This master's current role is: LEADER
I20260620 13:59:23.963413 13587 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47b12350c34e4e12af0dff07d394f6a9. Latest consensus state: current_term: 1 leader_uuid: "47b12350c34e4e12af0dff07d394f6a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b12350c34e4e12af0dff07d394f6a9" member_type: VOTER } }
I20260620 13:59:23.964676 13587 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [sys.catalog]: This master's current role is: LEADER
I20260620 13:59:23.972188 13592 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260620 13:59:23.977831 13592 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260620 13:59:23.983675  4719 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 13:59:23.988322 13592 catalog_manager.cc:1382] Generated new cluster ID: 2de9f676364f4ea49832eaf3142041df
I20260620 13:59:23.988662 13592 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260620 13:59:24.012346 13592 catalog_manager.cc:1405] Generated new certificate authority record
I20260620 13:59:24.013849 13592 catalog_manager.cc:1539] Loading token signing keys...
I20260620 13:59:24.027746 13592 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9: Generated new TSK 0
I20260620 13:59:24.028395 13592 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260620 13:59:24.052570  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:59:24.058992 13603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:24.060412 13604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:24.064015 13606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:24.064080  4719 server_base.cc:1061] running on GCE node
I20260620 13:59:24.065552  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:59:24.065807  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:59:24.066008  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963964065990 us; error 0 us; skew 500 ppm
I20260620 13:59:24.066772  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:59:24.069643  4719 webserver.cc:533] Webserver started at http://127.4.155.193:45383/ using document root <none> and password file <none>
I20260620 13:59:24.070202  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:59:24.070453  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:59:24.070751  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:59:24.072045  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/ts-0-root/instance:
uuid: "1eb6e81993a04da7a6beeb06a5d65b74"
format_stamp: "Formatted at 2026-06-20 13:59:24 on dist-test-slave-n70f"
I20260620 13:59:24.077508  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260620 13:59:24.081390 13611 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:24.082388  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260620 13:59:24.082767  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/ts-0-root
uuid: "1eb6e81993a04da7a6beeb06a5d65b74"
format_stamp: "Formatted at 2026-06-20 13:59:24 on dist-test-slave-n70f"
I20260620 13:59:24.083290  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:59:24.103760  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:59:24.105114  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:59:24.106614  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:59:24.108986  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:59:24.109216  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:24.109485  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:59:24.109691  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:24.157080  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.193:42227
I20260620 13:59:24.157186 13673 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.193:42227 every 8 connection(s)
I20260620 13:59:24.162238  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:59:24.169605 13678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:24.171996 13679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:24.173454 13681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:24.173527  4719 server_base.cc:1061] running on GCE node
I20260620 13:59:24.174736  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:59:24.174966  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:59:24.175225  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963964175204 us; error 0 us; skew 500 ppm
I20260620 13:59:24.175885  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:59:24.178960  4719 webserver.cc:533] Webserver started at http://127.4.155.194:33217/ using document root <none> and password file <none>
I20260620 13:59:24.179549 13674 heartbeater.cc:344] Connected to a master server at 127.4.155.254:38209
I20260620 13:59:24.179762  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:59:24.180416 13674 heartbeater.cc:461] Registering TS with master...
I20260620 13:59:24.180423  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:59:24.181087  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:59:24.181898 13674 heartbeater.cc:507] Master 127.4.155.254:38209 requested a full tablet report, sending...
I20260620 13:59:24.182984  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/ts-1-root/instance:
uuid: "13d5077c7ce34043b48cc3e4e99834ab"
format_stamp: "Formatted at 2026-06-20 13:59:24 on dist-test-slave-n70f"
I20260620 13:59:24.185250 13547 ts_manager.cc:194] Registered new tserver with Master: 1eb6e81993a04da7a6beeb06a5d65b74 (127.4.155.193:42227)
I20260620 13:59:24.187768 13547 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40502
I20260620 13:59:24.189126  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260620 13:59:24.193161 13686 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:24.193974  4719 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260620 13:59:24.194231  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/ts-1-root
uuid: "13d5077c7ce34043b48cc3e4e99834ab"
format_stamp: "Formatted at 2026-06-20 13:59:24 on dist-test-slave-n70f"
I20260620 13:59:24.194509  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:59:24.216205  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:59:24.217514  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:59:24.219043  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:59:24.221591  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:59:24.221800  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:24.222008  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:59:24.222179  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:24.266870  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.194:36621
I20260620 13:59:24.266993 13748 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.194:36621 every 8 connection(s)
I20260620 13:59:24.271840  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:59:24.279302 13752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:24.281811 13753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:24.285769  4719 server_base.cc:1061] running on GCE node
I20260620 13:59:24.286252 13749 heartbeater.cc:344] Connected to a master server at 127.4.155.254:38209
I20260620 13:59:24.286772 13749 heartbeater.cc:461] Registering TS with master...
W20260620 13:59:24.287546 13755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:24.287792 13749 heartbeater.cc:507] Master 127.4.155.254:38209 requested a full tablet report, sending...
I20260620 13:59:24.288677  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:59:24.288972  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:59:24.289192  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963964289159 us; error 0 us; skew 500 ppm
I20260620 13:59:24.289948  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:59:24.290534 13547 ts_manager.cc:194] Registered new tserver with Master: 13d5077c7ce34043b48cc3e4e99834ab (127.4.155.194:36621)
I20260620 13:59:24.292280 13547 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40516
I20260620 13:59:24.292750  4719 webserver.cc:533] Webserver started at http://127.4.155.195:41043/ using document root <none> and password file <none>
I20260620 13:59:24.293404  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:59:24.293660  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:59:24.293936  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:59:24.295213  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/ts-2-root/instance:
uuid: "15163245557b4d03bdeaf1ce5d79dee9"
format_stamp: "Formatted at 2026-06-20 13:59:24 on dist-test-slave-n70f"
I20260620 13:59:24.300925  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.005s
I20260620 13:59:24.304601 13760 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:24.305976  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260620 13:59:24.306615  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/ts-2-root
uuid: "15163245557b4d03bdeaf1ce5d79dee9"
format_stamp: "Formatted at 2026-06-20 13:59:24 on dist-test-slave-n70f"
I20260620 13:59:24.307085  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1781963654985192-4719-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:59:24.338358  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:59:24.339656  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:59:24.341406  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:59:24.343904  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:59:24.344192  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:24.344506  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:59:24.344686  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:24.387902  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.195:43939
I20260620 13:59:24.388024 13822 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.195:43939 every 8 connection(s)
I20260620 13:59:24.402019 13823 heartbeater.cc:344] Connected to a master server at 127.4.155.254:38209
I20260620 13:59:24.402491 13823 heartbeater.cc:461] Registering TS with master...
I20260620 13:59:24.403254 13823 heartbeater.cc:507] Master 127.4.155.254:38209 requested a full tablet report, sending...
I20260620 13:59:24.405373 13547 ts_manager.cc:194] Registered new tserver with Master: 15163245557b4d03bdeaf1ce5d79dee9 (127.4.155.195:43939)
I20260620 13:59:24.406119  4719 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015004165s
I20260620 13:59:24.406787 13547 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40524
I20260620 13:59:24.432683 13547 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40532:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260620 13:59:24.434928 13547 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 13:59:24.484604 13714 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba837840f7f4db48f722cd9e0febd08 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=6f3c202983064324b42160ac56d5911e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260620 13:59:24.486227 13714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba837840f7f4db48f722cd9e0febd08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:24.489305 13713 tablet_service.cc:1511] Processing CreateTablet for tablet ff97b0658f314f75a847f713506df23b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=6f3c202983064324b42160ac56d5911e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260620 13:59:24.490746 13713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff97b0658f314f75a847f713506df23b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:24.494966 13639 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba837840f7f4db48f722cd9e0febd08 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=6f3c202983064324b42160ac56d5911e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260620 13:59:24.496476 13639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba837840f7f4db48f722cd9e0febd08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:24.507371 13638 tablet_service.cc:1511] Processing CreateTablet for tablet ff97b0658f314f75a847f713506df23b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=6f3c202983064324b42160ac56d5911e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260620 13:59:24.507483 13788 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba837840f7f4db48f722cd9e0febd08 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=6f3c202983064324b42160ac56d5911e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260620 13:59:24.508881 13638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff97b0658f314f75a847f713506df23b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:24.509279 13788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba837840f7f4db48f722cd9e0febd08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:24.511924 13787 tablet_service.cc:1511] Processing CreateTablet for tablet ff97b0658f314f75a847f713506df23b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=6f3c202983064324b42160ac56d5911e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260620 13:59:24.513257 13787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff97b0658f314f75a847f713506df23b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:24.527827 13838 tablet_bootstrap.cc:492] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab: Bootstrap starting.
I20260620 13:59:24.539606 13840 tablet_bootstrap.cc:492] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9: Bootstrap starting.
I20260620 13:59:24.542097 13839 tablet_bootstrap.cc:492] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74: Bootstrap starting.
I20260620 13:59:24.545579 13840 tablet_bootstrap.cc:654] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:24.546358 13838 tablet_bootstrap.cc:654] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:24.550069 13839 tablet_bootstrap.cc:654] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:24.551041 13840 tablet_bootstrap.cc:492] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9: No bootstrap required, opened a new log
I20260620 13:59:24.551563 13840 ts_tablet_manager.cc:1403] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.004s
I20260620 13:59:24.552317 13838 tablet_bootstrap.cc:492] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab: No bootstrap required, opened a new log
I20260620 13:59:24.552834 13838 ts_tablet_manager.cc:1403] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.007s
I20260620 13:59:24.554553 13840 raft_consensus.cc:359] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.555197 13840 raft_consensus.cc:385] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:24.555511 13840 raft_consensus.cc:740] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15163245557b4d03bdeaf1ce5d79dee9, State: Initialized, Role: FOLLOWER
I20260620 13:59:24.556118 13839 tablet_bootstrap.cc:492] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74: No bootstrap required, opened a new log
I20260620 13:59:24.556202 13840 consensus_queue.cc:260] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.556353 13838 raft_consensus.cc:359] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } } peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } }
I20260620 13:59:24.557353 13838 raft_consensus.cc:385] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:24.557662 13838 raft_consensus.cc:740] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d5077c7ce34043b48cc3e4e99834ab, State: Initialized, Role: FOLLOWER
I20260620 13:59:24.558383 13838 consensus_queue.cc:260] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } } peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } }
I20260620 13:59:24.556741 13839 ts_tablet_manager.cc:1403] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.009s
I20260620 13:59:24.561267 13749 heartbeater.cc:499] Master 127.4.155.254:38209 was elected leader, sending a full tablet report...
I20260620 13:59:24.561601 13838 ts_tablet_manager.cc:1434] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260620 13:59:24.562652 13838 tablet_bootstrap.cc:492] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab: Bootstrap starting.
I20260620 13:59:24.562635 13839 raft_consensus.cc:359] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } } peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } }
I20260620 13:59:24.563735 13839 raft_consensus.cc:385] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:24.564051 13839 raft_consensus.cc:740] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eb6e81993a04da7a6beeb06a5d65b74, State: Initialized, Role: FOLLOWER
I20260620 13:59:24.567557 13839 consensus_queue.cc:260] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } } peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } }
I20260620 13:59:24.570152 13838 tablet_bootstrap.cc:654] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:24.574376 13674 heartbeater.cc:499] Master 127.4.155.254:38209 was elected leader, sending a full tablet report...
I20260620 13:59:24.575493 13839 ts_tablet_manager.cc:1434] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.000s
I20260620 13:59:24.576933 13839 tablet_bootstrap.cc:492] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74: Bootstrap starting.
I20260620 13:59:24.577857 13823 heartbeater.cc:499] Master 127.4.155.254:38209 was elected leader, sending a full tablet report...
I20260620 13:59:24.580590 13840 ts_tablet_manager.cc:1434] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9: Time spent starting tablet: real 0.029s	user 0.014s	sys 0.012s
I20260620 13:59:24.581265 13838 tablet_bootstrap.cc:492] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab: No bootstrap required, opened a new log
I20260620 13:59:24.581699 13840 tablet_bootstrap.cc:492] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9: Bootstrap starting.
I20260620 13:59:24.581800 13838 ts_tablet_manager.cc:1403] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.000s
I20260620 13:59:24.584141 13839 tablet_bootstrap.cc:654] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:24.585038 13838 raft_consensus.cc:359] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.585911 13838 raft_consensus.cc:385] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:24.586244 13838 raft_consensus.cc:740] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d5077c7ce34043b48cc3e4e99834ab, State: Initialized, Role: FOLLOWER
I20260620 13:59:24.587674 13838 consensus_queue.cc:260] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.590497 13840 tablet_bootstrap.cc:654] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:24.591442 13838 ts_tablet_manager.cc:1434] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260620 13:59:24.596884 13839 tablet_bootstrap.cc:492] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74: No bootstrap required, opened a new log
I20260620 13:59:24.597755 13839 ts_tablet_manager.cc:1403] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260620 13:59:24.601931 13839 raft_consensus.cc:359] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.603140 13839 raft_consensus.cc:385] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:24.603608 13839 raft_consensus.cc:740] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eb6e81993a04da7a6beeb06a5d65b74, State: Initialized, Role: FOLLOWER
I20260620 13:59:24.604552 13839 consensus_queue.cc:260] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.606478 13840 tablet_bootstrap.cc:492] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9: No bootstrap required, opened a new log
I20260620 13:59:24.606932 13839 ts_tablet_manager.cc:1434] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260620 13:59:24.607064 13840 ts_tablet_manager.cc:1403] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.008s
I20260620 13:59:24.609803 13840 raft_consensus.cc:359] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } } peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } }
I20260620 13:59:24.610448 13840 raft_consensus.cc:385] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:24.610711 13840 raft_consensus.cc:740] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15163245557b4d03bdeaf1ce5d79dee9, State: Initialized, Role: FOLLOWER
I20260620 13:59:24.611459 13840 consensus_queue.cc:260] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } } peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } }
I20260620 13:59:24.613365 13840 ts_tablet_manager.cc:1434] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260620 13:59:24.633999 13845 raft_consensus.cc:493] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:24.634514 13845 raft_consensus.cc:515] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } } peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } }
I20260620 13:59:24.636844 13845 leader_election.cc:290] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15163245557b4d03bdeaf1ce5d79dee9 (127.4.155.195:43939), 1eb6e81993a04da7a6beeb06a5d65b74 (127.4.155.193:42227)
I20260620 13:59:24.639055 13844 raft_consensus.cc:493] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:24.640480 13844 raft_consensus.cc:515] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
W20260620 13:59:24.641815 13824 tablet.cc:2406] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 13:59:24.648224 13844 leader_election.cc:290] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eb6e81993a04da7a6beeb06a5d65b74 (127.4.155.193:42227), 13d5077c7ce34043b48cc3e4e99834ab (127.4.155.194:36621)
I20260620 13:59:24.650585 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba837840f7f4db48f722cd9e0febd08" candidate_uuid: "13d5077c7ce34043b48cc3e4e99834ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15163245557b4d03bdeaf1ce5d79dee9" is_pre_election: true
I20260620 13:59:24.651473 13798 raft_consensus.cc:2468] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d5077c7ce34043b48cc3e4e99834ab in term 0.
I20260620 13:59:24.653087 13690 leader_election.cc:304] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d5077c7ce34043b48cc3e4e99834ab, 15163245557b4d03bdeaf1ce5d79dee9; no voters: 
I20260620 13:59:24.653966 13845 raft_consensus.cc:2804] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:24.654354 13845 raft_consensus.cc:493] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:24.654713 13845 raft_consensus.cc:3060] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:24.658547 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba837840f7f4db48f722cd9e0febd08" candidate_uuid: "13d5077c7ce34043b48cc3e4e99834ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" is_pre_election: true
I20260620 13:59:24.659565 13649 raft_consensus.cc:2468] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d5077c7ce34043b48cc3e4e99834ab in term 0.
I20260620 13:59:24.664202 13845 raft_consensus.cc:515] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } } peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } }
I20260620 13:59:24.665937 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff97b0658f314f75a847f713506df23b" candidate_uuid: "15163245557b4d03bdeaf1ce5d79dee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" is_pre_election: true
I20260620 13:59:24.666706 13649 raft_consensus.cc:2468] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15163245557b4d03bdeaf1ce5d79dee9 in term 0.
I20260620 13:59:24.667157 13845 leader_election.cc:290] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [CANDIDATE]: Term 1 election: Requested vote from peers 15163245557b4d03bdeaf1ce5d79dee9 (127.4.155.195:43939), 1eb6e81993a04da7a6beeb06a5d65b74 (127.4.155.193:42227)
I20260620 13:59:24.667862 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba837840f7f4db48f722cd9e0febd08" candidate_uuid: "13d5077c7ce34043b48cc3e4e99834ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15163245557b4d03bdeaf1ce5d79dee9"
I20260620 13:59:24.668503 13798 raft_consensus.cc:3060] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:24.668506 13764 leader_election.cc:304] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15163245557b4d03bdeaf1ce5d79dee9, 1eb6e81993a04da7a6beeb06a5d65b74; no voters: 
I20260620 13:59:24.668921 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba837840f7f4db48f722cd9e0febd08" candidate_uuid: "13d5077c7ce34043b48cc3e4e99834ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eb6e81993a04da7a6beeb06a5d65b74"
I20260620 13:59:24.669636 13649 raft_consensus.cc:3060] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:24.670002 13844 raft_consensus.cc:2804] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:24.670434 13844 raft_consensus.cc:493] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:24.670787 13844 raft_consensus.cc:3060] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:24.673017 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff97b0658f314f75a847f713506df23b" candidate_uuid: "15163245557b4d03bdeaf1ce5d79dee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d5077c7ce34043b48cc3e4e99834ab" is_pre_election: true
I20260620 13:59:24.673847 13724 raft_consensus.cc:2468] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15163245557b4d03bdeaf1ce5d79dee9 in term 0.
I20260620 13:59:24.677156 13798 raft_consensus.cc:2468] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d5077c7ce34043b48cc3e4e99834ab in term 1.
I20260620 13:59:24.678622 13690 leader_election.cc:304] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d5077c7ce34043b48cc3e4e99834ab, 15163245557b4d03bdeaf1ce5d79dee9; no voters: 
I20260620 13:59:24.678733 13844 raft_consensus.cc:515] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.680557 13845 raft_consensus.cc:2804] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:24.682026 13649 raft_consensus.cc:2468] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d5077c7ce34043b48cc3e4e99834ab in term 1.
I20260620 13:59:24.682335 13844 leader_election.cc:290] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [CANDIDATE]: Term 1 election: Requested vote from peers 1eb6e81993a04da7a6beeb06a5d65b74 (127.4.155.193:42227), 13d5077c7ce34043b48cc3e4e99834ab (127.4.155.194:36621)
I20260620 13:59:24.683457 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff97b0658f314f75a847f713506df23b" candidate_uuid: "15163245557b4d03bdeaf1ce5d79dee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eb6e81993a04da7a6beeb06a5d65b74"
I20260620 13:59:24.684011 13845 raft_consensus.cc:697] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 1 LEADER]: Becoming Leader. State: Replica: 13d5077c7ce34043b48cc3e4e99834ab, State: Running, Role: LEADER
I20260620 13:59:24.684128 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff97b0658f314f75a847f713506df23b" candidate_uuid: "15163245557b4d03bdeaf1ce5d79dee9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d5077c7ce34043b48cc3e4e99834ab"
I20260620 13:59:24.684444 13648 raft_consensus.cc:3060] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:24.684976 13724 raft_consensus.cc:3060] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:24.685591 13845 consensus_queue.cc:237] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } } peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } }
I20260620 13:59:24.693557 13648 raft_consensus.cc:2468] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15163245557b4d03bdeaf1ce5d79dee9 in term 1.
I20260620 13:59:24.694296 13724 raft_consensus.cc:2468] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15163245557b4d03bdeaf1ce5d79dee9 in term 1.
I20260620 13:59:24.694761 13764 leader_election.cc:304] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15163245557b4d03bdeaf1ce5d79dee9, 1eb6e81993a04da7a6beeb06a5d65b74; no voters: 
I20260620 13:59:24.695708 13844 raft_consensus.cc:2804] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:24.696873 13844 raft_consensus.cc:697] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 1 LEADER]: Becoming Leader. State: Replica: 15163245557b4d03bdeaf1ce5d79dee9, State: Running, Role: LEADER
I20260620 13:59:24.697757 13844 consensus_queue.cc:237] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.697492 13546 catalog_manager.cc:5696] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 13d5077c7ce34043b48cc3e4e99834ab (127.4.155.194). New cstate: current_term: 1 leader_uuid: "13d5077c7ce34043b48cc3e4e99834ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:24.708166 13544 catalog_manager.cc:5696] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15163245557b4d03bdeaf1ce5d79dee9 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "15163245557b4d03bdeaf1ce5d79dee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:24.757015 13544 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40546:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260620 13:59:24.759431 13544 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 13:59:24.786671 13639 tablet_service.cc:1511] Processing CreateTablet for tablet 1ef8f897b5f84b2e90385bb3f9982a60 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=86d151b36b724bb2862ef9be8e355acb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260620 13:59:24.788033 13639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef8f897b5f84b2e90385bb3f9982a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:24.788129 13714 tablet_service.cc:1511] Processing CreateTablet for tablet 1ef8f897b5f84b2e90385bb3f9982a60 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=86d151b36b724bb2862ef9be8e355acb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260620 13:59:24.789458 13714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef8f897b5f84b2e90385bb3f9982a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:24.790473 13638 tablet_service.cc:1511] Processing CreateTablet for tablet c343a36c0d2344d5800a1a6c9540874a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=86d151b36b724bb2862ef9be8e355acb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260620 13:59:24.791762 13638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c343a36c0d2344d5800a1a6c9540874a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:24.792110 13787 tablet_service.cc:1511] Processing CreateTablet for tablet 1ef8f897b5f84b2e90385bb3f9982a60 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=86d151b36b724bb2862ef9be8e355acb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260620 13:59:24.793371 13787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef8f897b5f84b2e90385bb3f9982a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:24.796149 13713 tablet_service.cc:1511] Processing CreateTablet for tablet c343a36c0d2344d5800a1a6c9540874a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=86d151b36b724bb2862ef9be8e355acb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260620 13:59:24.797940 13713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c343a36c0d2344d5800a1a6c9540874a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:24.805125 13788 tablet_service.cc:1511] Processing CreateTablet for tablet c343a36c0d2344d5800a1a6c9540874a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=86d151b36b724bb2862ef9be8e355acb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260620 13:59:24.807220 13788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c343a36c0d2344d5800a1a6c9540874a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:24.817304 13838 tablet_bootstrap.cc:492] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab: Bootstrap starting.
I20260620 13:59:24.818887 13839 tablet_bootstrap.cc:492] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74: Bootstrap starting.
I20260620 13:59:24.824286 13838 tablet_bootstrap.cc:654] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:24.826882 13840 tablet_bootstrap.cc:492] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9: Bootstrap starting.
I20260620 13:59:24.826344 13839 tablet_bootstrap.cc:654] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:24.835247 13840 tablet_bootstrap.cc:654] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:24.844570 13838 tablet_bootstrap.cc:492] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab: No bootstrap required, opened a new log
I20260620 13:59:24.845510 13838 ts_tablet_manager.cc:1403] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.004s
I20260620 13:59:24.849596 13838 raft_consensus.cc:359] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.850629 13838 raft_consensus.cc:385] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:24.850925 13840 tablet_bootstrap.cc:492] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9: No bootstrap required, opened a new log
I20260620 13:59:24.851015 13838 raft_consensus.cc:740] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d5077c7ce34043b48cc3e4e99834ab, State: Initialized, Role: FOLLOWER
I20260620 13:59:24.851625 13840 ts_tablet_manager.cc:1403] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.002s
I20260620 13:59:24.852761 13838 consensus_queue.cc:260] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.855144 13840 raft_consensus.cc:359] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.855921 13840 raft_consensus.cc:385] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:24.856231 13840 raft_consensus.cc:740] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15163245557b4d03bdeaf1ce5d79dee9, State: Initialized, Role: FOLLOWER
I20260620 13:59:24.857100 13840 consensus_queue.cc:260] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.861159 13838 ts_tablet_manager.cc:1434] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.001s
I20260620 13:59:24.862264 13839 tablet_bootstrap.cc:492] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74: No bootstrap required, opened a new log
I20260620 13:59:24.862504 13840 ts_tablet_manager.cc:1434] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260620 13:59:24.862918 13839 ts_tablet_manager.cc:1403] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74: Time spent bootstrapping tablet: real 0.044s	user 0.030s	sys 0.004s
I20260620 13:59:24.867136 13838 tablet_bootstrap.cc:492] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab: Bootstrap starting.
I20260620 13:59:24.867566 13840 tablet_bootstrap.cc:492] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9: Bootstrap starting.
I20260620 13:59:24.867080 13839 raft_consensus.cc:359] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.868252 13839 raft_consensus.cc:385] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:24.868606 13839 raft_consensus.cc:740] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eb6e81993a04da7a6beeb06a5d65b74, State: Initialized, Role: FOLLOWER
I20260620 13:59:24.869414 13839 consensus_queue.cc:260] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.872035 13839 ts_tablet_manager.cc:1434] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260620 13:59:24.873286 13839 tablet_bootstrap.cc:492] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74: Bootstrap starting.
I20260620 13:59:24.919593 13840 tablet_bootstrap.cc:654] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:24.921782 13838 tablet_bootstrap.cc:654] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:24.937007 13839 tablet_bootstrap.cc:654] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:24.944424 13840 tablet_bootstrap.cc:492] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9: No bootstrap required, opened a new log
I20260620 13:59:24.944871 13838 tablet_bootstrap.cc:492] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab: No bootstrap required, opened a new log
I20260620 13:59:24.945163 13840 ts_tablet_manager.cc:1403] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9: Time spent bootstrapping tablet: real 0.078s	user 0.007s	sys 0.011s
I20260620 13:59:24.946044 13838 ts_tablet_manager.cc:1403] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab: Time spent bootstrapping tablet: real 0.079s	user 0.007s	sys 0.010s
I20260620 13:59:24.949651 13840 raft_consensus.cc:359] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.951364 13840 raft_consensus.cc:385] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:24.951761 13840 raft_consensus.cc:740] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15163245557b4d03bdeaf1ce5d79dee9, State: Initialized, Role: FOLLOWER
I20260620 13:59:24.952852 13840 consensus_queue.cc:260] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.952404 13838 raft_consensus.cc:359] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.953842 13838 raft_consensus.cc:385] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:24.954322 13838 raft_consensus.cc:740] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d5077c7ce34043b48cc3e4e99834ab, State: Initialized, Role: FOLLOWER
I20260620 13:59:24.955857 13840 ts_tablet_manager.cc:1434] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260620 13:59:24.955868 13838 consensus_queue.cc:260] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.961184 13838 ts_tablet_manager.cc:1434] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.011s
I20260620 13:59:24.965556 13839 tablet_bootstrap.cc:492] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74: No bootstrap required, opened a new log
I20260620 13:59:24.966883 13839 ts_tablet_manager.cc:1403] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74: Time spent bootstrapping tablet: real 0.094s	user 0.018s	sys 0.023s
I20260620 13:59:24.970913 13839 raft_consensus.cc:359] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.972026 13839 raft_consensus.cc:385] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:24.972573 13839 raft_consensus.cc:740] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eb6e81993a04da7a6beeb06a5d65b74, State: Initialized, Role: FOLLOWER
I20260620 13:59:24.973980 13839 consensus_queue.cc:260] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:24.976573 13839 ts_tablet_manager.cc:1434] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
W20260620 13:59:24.976456 13595 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:59:24.998152 13846 raft_consensus.cc:493] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:24.998829 13846 raft_consensus.cc:515] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:25.001839 13846 leader_election.cc:290] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d5077c7ce34043b48cc3e4e99834ab (127.4.155.194:36621), 15163245557b4d03bdeaf1ce5d79dee9 (127.4.155.195:43939)
I20260620 13:59:25.020143 13845 raft_consensus.cc:493] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:25.020159 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef8f897b5f84b2e90385bb3f9982a60" candidate_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15163245557b4d03bdeaf1ce5d79dee9" is_pre_election: true
I20260620 13:59:25.021522 13798 raft_consensus.cc:2468] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1eb6e81993a04da7a6beeb06a5d65b74 in term 0.
I20260620 13:59:25.022426 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef8f897b5f84b2e90385bb3f9982a60" candidate_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d5077c7ce34043b48cc3e4e99834ab" is_pre_election: true
I20260620 13:59:25.021008 13845 raft_consensus.cc:515] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:25.024350 13724 raft_consensus.cc:2468] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1eb6e81993a04da7a6beeb06a5d65b74 in term 0.
I20260620 13:59:25.028133 13615 leader_election.cc:304] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15163245557b4d03bdeaf1ce5d79dee9, 1eb6e81993a04da7a6beeb06a5d65b74; no voters: 
I20260620 13:59:25.029165 13846 raft_consensus.cc:2804] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:25.029587 13846 raft_consensus.cc:493] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:25.029997 13846 raft_consensus.cc:3060] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:25.030403 13845 leader_election.cc:290] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eb6e81993a04da7a6beeb06a5d65b74 (127.4.155.193:42227), 15163245557b4d03bdeaf1ce5d79dee9 (127.4.155.195:43939)
I20260620 13:59:25.031778 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef8f897b5f84b2e90385bb3f9982a60" candidate_uuid: "13d5077c7ce34043b48cc3e4e99834ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15163245557b4d03bdeaf1ce5d79dee9" is_pre_election: true
I20260620 13:59:25.032573 13798 raft_consensus.cc:2468] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d5077c7ce34043b48cc3e4e99834ab in term 0.
I20260620 13:59:25.032897 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef8f897b5f84b2e90385bb3f9982a60" candidate_uuid: "13d5077c7ce34043b48cc3e4e99834ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" is_pre_election: true
I20260620 13:59:25.033933 13690 leader_election.cc:304] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d5077c7ce34043b48cc3e4e99834ab, 15163245557b4d03bdeaf1ce5d79dee9; no voters: 
I20260620 13:59:25.034711 13845 raft_consensus.cc:2804] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:25.035171 13845 raft_consensus.cc:493] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:25.035552 13845 raft_consensus.cc:3060] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:25.042292 13846 raft_consensus.cc:515] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:25.043678 13648 raft_consensus.cc:2393] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13d5077c7ce34043b48cc3e4e99834ab in current term 1: Already voted for candidate 1eb6e81993a04da7a6beeb06a5d65b74 in this term.
I20260620 13:59:25.045351 13853 raft_consensus.cc:493] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:25.045966 13853 raft_consensus.cc:515] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:25.046259 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef8f897b5f84b2e90385bb3f9982a60" candidate_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d5077c7ce34043b48cc3e4e99834ab"
I20260620 13:59:25.046274 13845 raft_consensus.cc:515] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:25.047271 13846 leader_election.cc:290] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [CANDIDATE]: Term 1 election: Requested vote from peers 13d5077c7ce34043b48cc3e4e99834ab (127.4.155.194:36621), 15163245557b4d03bdeaf1ce5d79dee9 (127.4.155.195:43939)
I20260620 13:59:25.047837 13724 raft_consensus.cc:2393] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1eb6e81993a04da7a6beeb06a5d65b74 in current term 1: Already voted for candidate 13d5077c7ce34043b48cc3e4e99834ab in this term.
I20260620 13:59:25.048810 13853 leader_election.cc:290] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eb6e81993a04da7a6beeb06a5d65b74 (127.4.155.193:42227), 15163245557b4d03bdeaf1ce5d79dee9 (127.4.155.195:43939)
I20260620 13:59:25.049239 13648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef8f897b5f84b2e90385bb3f9982a60" candidate_uuid: "13d5077c7ce34043b48cc3e4e99834ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eb6e81993a04da7a6beeb06a5d65b74"
I20260620 13:59:25.048854 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef8f897b5f84b2e90385bb3f9982a60" candidate_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15163245557b4d03bdeaf1ce5d79dee9"
I20260620 13:59:25.049831 13845 leader_election.cc:290] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [CANDIDATE]: Term 1 election: Requested vote from peers 1eb6e81993a04da7a6beeb06a5d65b74 (127.4.155.193:42227), 15163245557b4d03bdeaf1ce5d79dee9 (127.4.155.195:43939)
I20260620 13:59:25.050091 13648 raft_consensus.cc:2393] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 13d5077c7ce34043b48cc3e4e99834ab in current term 1: Already voted for candidate 1eb6e81993a04da7a6beeb06a5d65b74 in this term.
I20260620 13:59:25.049959 13798 raft_consensus.cc:3060] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:25.050673 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c343a36c0d2344d5800a1a6c9540874a" candidate_uuid: "13d5077c7ce34043b48cc3e4e99834ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" is_pre_election: true
I20260620 13:59:25.051430 13649 raft_consensus.cc:2468] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d5077c7ce34043b48cc3e4e99834ab in term 0.
I20260620 13:59:25.053107 13797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c343a36c0d2344d5800a1a6c9540874a" candidate_uuid: "13d5077c7ce34043b48cc3e4e99834ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15163245557b4d03bdeaf1ce5d79dee9" is_pre_election: true
I20260620 13:59:25.053542 13796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef8f897b5f84b2e90385bb3f9982a60" candidate_uuid: "13d5077c7ce34043b48cc3e4e99834ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15163245557b4d03bdeaf1ce5d79dee9"
I20260620 13:59:25.054091 13797 raft_consensus.cc:2468] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d5077c7ce34043b48cc3e4e99834ab in term 0.
I20260620 13:59:25.055804 13690 leader_election.cc:304] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d5077c7ce34043b48cc3e4e99834ab, 1eb6e81993a04da7a6beeb06a5d65b74; no voters: 
I20260620 13:59:25.056494 13845 raft_consensus.cc:2804] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:25.056885 13845 raft_consensus.cc:493] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:25.056685 13690 leader_election.cc:304] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13d5077c7ce34043b48cc3e4e99834ab; no voters: 15163245557b4d03bdeaf1ce5d79dee9, 1eb6e81993a04da7a6beeb06a5d65b74
I20260620 13:59:25.057271 13845 raft_consensus.cc:3060] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:25.057639 13853 raft_consensus.cc:2749] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260620 13:59:25.059819 13798 raft_consensus.cc:2468] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eb6e81993a04da7a6beeb06a5d65b74 in term 1.
I20260620 13:59:25.061030 13615 leader_election.cc:304] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15163245557b4d03bdeaf1ce5d79dee9, 1eb6e81993a04da7a6beeb06a5d65b74; no voters: 13d5077c7ce34043b48cc3e4e99834ab
I20260620 13:59:25.061899 13846 raft_consensus.cc:2804] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:25.063024 13846 raft_consensus.cc:697] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 1 LEADER]: Becoming Leader. State: Replica: 1eb6e81993a04da7a6beeb06a5d65b74, State: Running, Role: LEADER
I20260620 13:59:25.063961 13846 consensus_queue.cc:237] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:25.064604 13845 raft_consensus.cc:515] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:25.066471 13845 leader_election.cc:290] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [CANDIDATE]: Term 1 election: Requested vote from peers 1eb6e81993a04da7a6beeb06a5d65b74 (127.4.155.193:42227), 15163245557b4d03bdeaf1ce5d79dee9 (127.4.155.195:43939)
I20260620 13:59:25.067435 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c343a36c0d2344d5800a1a6c9540874a" candidate_uuid: "13d5077c7ce34043b48cc3e4e99834ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eb6e81993a04da7a6beeb06a5d65b74"
I20260620 13:59:25.068244 13649 raft_consensus.cc:3060] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:25.067649 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c343a36c0d2344d5800a1a6c9540874a" candidate_uuid: "13d5077c7ce34043b48cc3e4e99834ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15163245557b4d03bdeaf1ce5d79dee9"
I20260620 13:59:25.071043 13798 raft_consensus.cc:3060] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:25.074798 13546 catalog_manager.cc:5696] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1eb6e81993a04da7a6beeb06a5d65b74 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:25.081264 13798 raft_consensus.cc:2468] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d5077c7ce34043b48cc3e4e99834ab in term 1.
I20260620 13:59:25.081450 13845 consensus_queue.cc:1048] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:25.082809 13690 leader_election.cc:304] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d5077c7ce34043b48cc3e4e99834ab, 15163245557b4d03bdeaf1ce5d79dee9; no voters: 
I20260620 13:59:25.084370 13649 raft_consensus.cc:2468] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d5077c7ce34043b48cc3e4e99834ab in term 1.
I20260620 13:59:25.081545 13844 consensus_queue.cc:1048] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260620 13:59:25.089618 13845 raft_consensus.cc:2804] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:25.090269 13845 raft_consensus.cc:697] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 1 LEADER]: Becoming Leader. State: Replica: 13d5077c7ce34043b48cc3e4e99834ab, State: Running, Role: LEADER
I20260620 13:59:25.091178 13845 consensus_queue.cc:237] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:25.101394 13546 catalog_manager.cc:5696] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 13d5077c7ce34043b48cc3e4e99834ab (127.4.155.194). New cstate: current_term: 1 leader_uuid: "13d5077c7ce34043b48cc3e4e99834ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:25.122637 13855 consensus_queue.cc:1048] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:25.145187 13845 consensus_queue.cc:1048] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:25.173928 13724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ba837840f7f4db48f722cd9e0febd08"
dest_uuid: "13d5077c7ce34043b48cc3e4e99834ab"
mode: GRACEFUL
new_leader_uuid: "1eb6e81993a04da7a6beeb06a5d65b74"
 from {username='slave'} at 127.0.0.1:39816
I20260620 13:59:25.174659 13724 raft_consensus.cc:606] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 1 LEADER]: Received request to transfer leadership to TS 1eb6e81993a04da7a6beeb06a5d65b74
I20260620 13:59:25.188673 13798 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff97b0658f314f75a847f713506df23b"
dest_uuid: "15163245557b4d03bdeaf1ce5d79dee9"
mode: GRACEFUL
new_leader_uuid: "13d5077c7ce34043b48cc3e4e99834ab"
 from {username='slave'} at 127.0.0.1:48792
I20260620 13:59:25.189227 13798 raft_consensus.cc:606] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 1 LEADER]: Received request to transfer leadership to TS 13d5077c7ce34043b48cc3e4e99834ab
I20260620 13:59:25.198019 13724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c343a36c0d2344d5800a1a6c9540874a"
dest_uuid: "13d5077c7ce34043b48cc3e4e99834ab"
mode: GRACEFUL
new_leader_uuid: "1eb6e81993a04da7a6beeb06a5d65b74"
 from {username='slave'} at 127.0.0.1:39816
I20260620 13:59:25.198549 13724 raft_consensus.cc:606] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 1 LEADER]: Received request to transfer leadership to TS 1eb6e81993a04da7a6beeb06a5d65b74
I20260620 13:59:25.446895 13846 consensus_queue.cc:1048] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:25.458665 13886 consensus_queue.cc:1048] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:25.588207 13882 consensus_queue.cc:1048] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:25.600349 13882 consensus_queue.cc:1048] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:25.608618 13845 raft_consensus.cc:993] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab: : Instructing follower 1eb6e81993a04da7a6beeb06a5d65b74 to start an election
I20260620 13:59:25.609153 13845 raft_consensus.cc:1081] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 1 LEADER]: Signalling peer 1eb6e81993a04da7a6beeb06a5d65b74 to start an election
I20260620 13:59:25.610867 13649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c343a36c0d2344d5800a1a6c9540874a"
dest_uuid: "1eb6e81993a04da7a6beeb06a5d65b74"
 from {username='slave'} at 127.0.0.1:49014
I20260620 13:59:25.611474 13649 raft_consensus.cc:493] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:25.611784 13649 raft_consensus.cc:3060] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:25.618031 13649 raft_consensus.cc:515] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:25.620132 13649 leader_election.cc:290] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [CANDIDATE]: Term 2 election: Requested vote from peers 13d5077c7ce34043b48cc3e4e99834ab (127.4.155.194:36621), 15163245557b4d03bdeaf1ce5d79dee9 (127.4.155.195:43939)
I20260620 13:59:25.621215 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c343a36c0d2344d5800a1a6c9540874a" candidate_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13d5077c7ce34043b48cc3e4e99834ab"
I20260620 13:59:25.621941 13724 raft_consensus.cc:3055] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:25.621775 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c343a36c0d2344d5800a1a6c9540874a" candidate_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15163245557b4d03bdeaf1ce5d79dee9"
I20260620 13:59:25.622361 13724 raft_consensus.cc:740] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13d5077c7ce34043b48cc3e4e99834ab, State: Running, Role: LEADER
I20260620 13:59:25.622605 13798 raft_consensus.cc:3060] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:25.623353 13724 consensus_queue.cc:260] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:25.624715 13724 raft_consensus.cc:3060] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:25.629139 13798 raft_consensus.cc:2468] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eb6e81993a04da7a6beeb06a5d65b74 in term 2.
I20260620 13:59:25.630586 13615 leader_election.cc:304] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15163245557b4d03bdeaf1ce5d79dee9, 1eb6e81993a04da7a6beeb06a5d65b74; no voters: 
I20260620 13:59:25.631500 13886 raft_consensus.cc:2804] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:25.631960 13886 raft_consensus.cc:697] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 LEADER]: Becoming Leader. State: Replica: 1eb6e81993a04da7a6beeb06a5d65b74, State: Running, Role: LEADER
I20260620 13:59:25.632062 13844 raft_consensus.cc:993] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9: : Instructing follower 13d5077c7ce34043b48cc3e4e99834ab to start an election
I20260620 13:59:25.632105 13724 raft_consensus.cc:2468] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eb6e81993a04da7a6beeb06a5d65b74 in term 2.
I20260620 13:59:25.632879 13844 raft_consensus.cc:1081] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 1 LEADER]: Signalling peer 13d5077c7ce34043b48cc3e4e99834ab to start an election
I20260620 13:59:25.633045 13886 consensus_queue.cc:237] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:25.634824 13724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff97b0658f314f75a847f713506df23b"
dest_uuid: "13d5077c7ce34043b48cc3e4e99834ab"
 from {username='slave'} at 127.0.0.1:39804
I20260620 13:59:25.635514 13724 raft_consensus.cc:493] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:25.635870 13724 raft_consensus.cc:3060] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:25.640626 13544 catalog_manager.cc:5696] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 reported cstate change: term changed from 1 to 2, leader changed from 13d5077c7ce34043b48cc3e4e99834ab (127.4.155.194) to 1eb6e81993a04da7a6beeb06a5d65b74 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:25.642951 13724 raft_consensus.cc:515] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:25.645267 13724 leader_election.cc:290] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [CANDIDATE]: Term 2 election: Requested vote from peers 1eb6e81993a04da7a6beeb06a5d65b74 (127.4.155.193:42227), 15163245557b4d03bdeaf1ce5d79dee9 (127.4.155.195:43939)
I20260620 13:59:25.646360 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff97b0658f314f75a847f713506df23b" candidate_uuid: "13d5077c7ce34043b48cc3e4e99834ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15163245557b4d03bdeaf1ce5d79dee9"
I20260620 13:59:25.647008 13798 raft_consensus.cc:3055] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:25.647387 13798 raft_consensus.cc:740] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15163245557b4d03bdeaf1ce5d79dee9, State: Running, Role: LEADER
I20260620 13:59:25.648335 13798 consensus_queue.cc:260] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:25.649701 13798 raft_consensus.cc:3060] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:25.657418 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff97b0658f314f75a847f713506df23b" candidate_uuid: "13d5077c7ce34043b48cc3e4e99834ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1eb6e81993a04da7a6beeb06a5d65b74"
I20260620 13:59:25.658034 13649 raft_consensus.cc:3060] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:25.658725 13798 raft_consensus.cc:2468] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d5077c7ce34043b48cc3e4e99834ab in term 2.
I20260620 13:59:25.660089 13690 leader_election.cc:304] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d5077c7ce34043b48cc3e4e99834ab, 15163245557b4d03bdeaf1ce5d79dee9; no voters: 
I20260620 13:59:25.660919 13882 raft_consensus.cc:2804] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:25.661360 13882 raft_consensus.cc:697] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [term 2 LEADER]: Becoming Leader. State: Replica: 13d5077c7ce34043b48cc3e4e99834ab, State: Running, Role: LEADER
I20260620 13:59:25.662292 13882 consensus_queue.cc:237] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:25.666091 13649 raft_consensus.cc:2468] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d5077c7ce34043b48cc3e4e99834ab in term 2.
I20260620 13:59:25.669637 13544 catalog_manager.cc:5696] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab reported cstate change: term changed from 1 to 2, leader changed from 15163245557b4d03bdeaf1ce5d79dee9 (127.4.155.195) to 13d5077c7ce34043b48cc3e4e99834ab (127.4.155.194). New cstate: current_term: 2 leader_uuid: "13d5077c7ce34043b48cc3e4e99834ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:25.691942 13845 raft_consensus.cc:993] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab: : Instructing follower 1eb6e81993a04da7a6beeb06a5d65b74 to start an election
I20260620 13:59:25.692440 13882 raft_consensus.cc:1081] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 1 LEADER]: Signalling peer 1eb6e81993a04da7a6beeb06a5d65b74 to start an election
I20260620 13:59:25.693976 13649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ba837840f7f4db48f722cd9e0febd08"
dest_uuid: "1eb6e81993a04da7a6beeb06a5d65b74"
 from {username='slave'} at 127.0.0.1:49014
I20260620 13:59:25.694502 13649 raft_consensus.cc:493] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:25.694826 13649 raft_consensus.cc:3060] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:25.700076 13649 raft_consensus.cc:515] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } } peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } }
I20260620 13:59:25.702278 13649 leader_election.cc:290] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [CANDIDATE]: Term 2 election: Requested vote from peers 13d5077c7ce34043b48cc3e4e99834ab (127.4.155.194:36621), 15163245557b4d03bdeaf1ce5d79dee9 (127.4.155.195:43939)
I20260620 13:59:25.702836 13798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba837840f7f4db48f722cd9e0febd08" candidate_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15163245557b4d03bdeaf1ce5d79dee9"
I20260620 13:59:25.702739 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba837840f7f4db48f722cd9e0febd08" candidate_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13d5077c7ce34043b48cc3e4e99834ab"
I20260620 13:59:25.703650 13798 raft_consensus.cc:3060] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:25.703708 13724 raft_consensus.cc:3055] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:25.704187 13724 raft_consensus.cc:740] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13d5077c7ce34043b48cc3e4e99834ab, State: Running, Role: LEADER
I20260620 13:59:25.705391 13724 consensus_queue.cc:260] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } } peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } }
I20260620 13:59:25.706686 13724 raft_consensus.cc:3060] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:25.712021 13798 raft_consensus.cc:2468] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eb6e81993a04da7a6beeb06a5d65b74 in term 2.
I20260620 13:59:25.713500 13615 leader_election.cc:304] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15163245557b4d03bdeaf1ce5d79dee9, 1eb6e81993a04da7a6beeb06a5d65b74; no voters: 
I20260620 13:59:25.714254 13886 raft_consensus.cc:2804] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:25.714439 13724 raft_consensus.cc:2468] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eb6e81993a04da7a6beeb06a5d65b74 in term 2.
I20260620 13:59:25.714780 13886 raft_consensus.cc:697] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 LEADER]: Becoming Leader. State: Replica: 1eb6e81993a04da7a6beeb06a5d65b74, State: Running, Role: LEADER
I20260620 13:59:25.715795 13886 consensus_queue.cc:237] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } } peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } }
I20260620 13:59:25.722114 13544 catalog_manager.cc:5696] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 reported cstate change: term changed from 1 to 2, leader changed from 13d5077c7ce34043b48cc3e4e99834ab (127.4.155.194) to 1eb6e81993a04da7a6beeb06a5d65b74 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:25.943061  4719 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260620 13:59:25.944712  4719 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260620 13:59:25.945135  4719 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260620 13:59:25.958485 13649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c343a36c0d2344d5800a1a6c9540874a"
dest_uuid: "1eb6e81993a04da7a6beeb06a5d65b74"
mode: GRACEFUL
new_leader_uuid: "15163245557b4d03bdeaf1ce5d79dee9"
 from {username='slave'} at 127.0.0.1:49024
I20260620 13:59:25.959007 13649 raft_consensus.cc:606] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 LEADER]: Received request to transfer leadership to TS 15163245557b4d03bdeaf1ce5d79dee9
I20260620 13:59:25.960444  4719 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260620 13:59:26.060995 13724 raft_consensus.cc:1275] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 2 FOLLOWER]: Refusing update from remote peer 1eb6e81993a04da7a6beeb06a5d65b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:26.063119 13871 consensus_queue.cc:1048] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:26.063659 13649 raft_consensus.cc:1275] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 FOLLOWER]: Refusing update from remote peer 13d5077c7ce34043b48cc3e4e99834ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:26.065281 13882 consensus_queue.cc:1048] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:26.072854 13798 raft_consensus.cc:1275] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 2 FOLLOWER]: Refusing update from remote peer 1eb6e81993a04da7a6beeb06a5d65b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:26.079562 13886 consensus_queue.cc:1048] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:26.083981 13798 raft_consensus.cc:1275] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 2 FOLLOWER]: Refusing update from remote peer 13d5077c7ce34043b48cc3e4e99834ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:26.085620 13845 consensus_queue.cc:1048] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:26.089001 13871 raft_consensus.cc:993] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74: : Instructing follower 15163245557b4d03bdeaf1ce5d79dee9 to start an election
I20260620 13:59:26.089481 13886 raft_consensus.cc:1081] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 LEADER]: Signalling peer 15163245557b4d03bdeaf1ce5d79dee9 to start an election
I20260620 13:59:26.094434 13798 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c343a36c0d2344d5800a1a6c9540874a"
dest_uuid: "15163245557b4d03bdeaf1ce5d79dee9"
 from {username='slave'} at 127.0.0.1:48784
I20260620 13:59:26.094985 13798 raft_consensus.cc:493] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:26.095343 13798 raft_consensus.cc:3060] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:26.105566 13798 raft_consensus.cc:515] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:26.108350 13798 leader_election.cc:290] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [CANDIDATE]: Term 3 election: Requested vote from peers 1eb6e81993a04da7a6beeb06a5d65b74 (127.4.155.193:42227), 13d5077c7ce34043b48cc3e4e99834ab (127.4.155.194:36621)
I20260620 13:59:26.108935 13649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c343a36c0d2344d5800a1a6c9540874a" candidate_uuid: "15163245557b4d03bdeaf1ce5d79dee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1eb6e81993a04da7a6beeb06a5d65b74"
I20260620 13:59:26.109939 13649 raft_consensus.cc:3055] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:59:26.110294 13649 raft_consensus.cc:740] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1eb6e81993a04da7a6beeb06a5d65b74, State: Running, Role: LEADER
I20260620 13:59:26.111912 13649 consensus_queue.cc:260] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:26.112914 13649 raft_consensus.cc:3060] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:26.115550 13724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c343a36c0d2344d5800a1a6c9540874a" candidate_uuid: "15163245557b4d03bdeaf1ce5d79dee9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13d5077c7ce34043b48cc3e4e99834ab"
I20260620 13:59:26.116137 13724 raft_consensus.cc:3060] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:26.119889 13649 raft_consensus.cc:2468] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15163245557b4d03bdeaf1ce5d79dee9 in term 3.
I20260620 13:59:26.121459 13764 leader_election.cc:304] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15163245557b4d03bdeaf1ce5d79dee9, 1eb6e81993a04da7a6beeb06a5d65b74; no voters: 
I20260620 13:59:26.121925 13724 raft_consensus.cc:2468] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15163245557b4d03bdeaf1ce5d79dee9 in term 3.
I20260620 13:59:26.122227 13844 raft_consensus.cc:2804] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:59:26.122787 13844 raft_consensus.cc:697] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 3 LEADER]: Becoming Leader. State: Replica: 15163245557b4d03bdeaf1ce5d79dee9, State: Running, Role: LEADER
I20260620 13:59:26.123661 13844 consensus_queue.cc:237] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } }
I20260620 13:59:26.129628 13544 catalog_manager.cc:5696] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 reported cstate change: term changed from 2 to 3, leader changed from 1eb6e81993a04da7a6beeb06a5d65b74 (127.4.155.193) to 15163245557b4d03bdeaf1ce5d79dee9 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "15163245557b4d03bdeaf1ce5d79dee9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eb6e81993a04da7a6beeb06a5d65b74" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:26.159198 13798 raft_consensus.cc:1275] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9 [term 2 FOLLOWER]: Refusing update from remote peer 1eb6e81993a04da7a6beeb06a5d65b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:26.160742 13886 consensus_queue.cc:1048] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15163245557b4d03bdeaf1ce5d79dee9" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 43939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:26.170367 13724 raft_consensus.cc:1275] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 2 FOLLOWER]: Refusing update from remote peer 1eb6e81993a04da7a6beeb06a5d65b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:26.172694 13896 consensus_queue.cc:1048] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d5077c7ce34043b48cc3e4e99834ab" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 36621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:26.191268  4719 tablet_server.cc:179] TabletServer@127.4.155.193:0 shutting down...
I20260620 13:59:26.223941  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:59:26.224699  4719 tablet_replica.cc:333] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74: stopping tablet replica
I20260620 13:59:26.225309  4719 raft_consensus.cc:2243] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:26.226140  4719 raft_consensus.cc:2272] T 1ef8f897b5f84b2e90385bb3f9982a60 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:26.229218  4719 tablet_replica.cc:333] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74: stopping tablet replica
I20260620 13:59:26.229936  4719 raft_consensus.cc:2243] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:26.230436  4719 raft_consensus.cc:2272] T c343a36c0d2344d5800a1a6c9540874a P 1eb6e81993a04da7a6beeb06a5d65b74 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:26.233381  4719 tablet_replica.cc:333] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74: stopping tablet replica
I20260620 13:59:26.234032  4719 raft_consensus.cc:2243] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:26.234521  4719 raft_consensus.cc:2272] T ff97b0658f314f75a847f713506df23b P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:26.238085  4719 tablet_replica.cc:333] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74: stopping tablet replica
I20260620 13:59:26.238670  4719 raft_consensus.cc:2243] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:26.239629  4719 raft_consensus.cc:2272] T 2ba837840f7f4db48f722cd9e0febd08 P 1eb6e81993a04da7a6beeb06a5d65b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:26.266651  4719 tablet_server.cc:196] TabletServer@127.4.155.193:0 shutdown complete.
I20260620 13:59:26.282675  4719 tablet_server.cc:179] TabletServer@127.4.155.194:0 shutting down...
I20260620 13:59:26.312558  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:59:26.313510  4719 tablet_replica.cc:333] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab: stopping tablet replica
I20260620 13:59:26.314082  4719 raft_consensus.cc:2243] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:26.314561  4719 raft_consensus.cc:2272] T c343a36c0d2344d5800a1a6c9540874a P 13d5077c7ce34043b48cc3e4e99834ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:26.316892  4719 tablet_replica.cc:333] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab: stopping tablet replica
I20260620 13:59:26.317498  4719 raft_consensus.cc:2243] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:26.317940  4719 raft_consensus.cc:2272] T 1ef8f897b5f84b2e90385bb3f9982a60 P 13d5077c7ce34043b48cc3e4e99834ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:26.320794  4719 tablet_replica.cc:333] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab: stopping tablet replica
I20260620 13:59:26.321360  4719 raft_consensus.cc:2243] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:26.322263  4719 raft_consensus.cc:2272] T ff97b0658f314f75a847f713506df23b P 13d5077c7ce34043b48cc3e4e99834ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:26.325232  4719 tablet_replica.cc:333] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab: stopping tablet replica
I20260620 13:59:26.325775  4719 raft_consensus.cc:2243] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:26.326212  4719 raft_consensus.cc:2272] T 2ba837840f7f4db48f722cd9e0febd08 P 13d5077c7ce34043b48cc3e4e99834ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:26.351594  4719 tablet_server.cc:196] TabletServer@127.4.155.194:0 shutdown complete.
I20260620 13:59:26.368450  4719 tablet_server.cc:179] TabletServer@127.4.155.195:0 shutting down...
I20260620 13:59:26.393543  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:59:26.394354  4719 tablet_replica.cc:333] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9: stopping tablet replica
I20260620 13:59:26.394956  4719 raft_consensus.cc:2243] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:26.395450  4719 raft_consensus.cc:2272] T 1ef8f897b5f84b2e90385bb3f9982a60 P 15163245557b4d03bdeaf1ce5d79dee9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:26.397969  4719 tablet_replica.cc:333] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9: stopping tablet replica
I20260620 13:59:26.398492  4719 raft_consensus.cc:2243] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:59:26.399063  4719 pending_rounds.cc:70] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9: Trying to abort 1 pending ops.
I20260620 13:59:26.399322  4719 pending_rounds.cc:77] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7298924405249826816 op_type: NO_OP noop_request { }
I20260620 13:59:26.399570  4719 raft_consensus.cc:2889] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 13:59:26.399796  4719 raft_consensus.cc:2272] T c343a36c0d2344d5800a1a6c9540874a P 15163245557b4d03bdeaf1ce5d79dee9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:26.402637  4719 tablet_replica.cc:333] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9: stopping tablet replica
I20260620 13:59:26.403218  4719 raft_consensus.cc:2243] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:26.403735  4719 raft_consensus.cc:2272] T 2ba837840f7f4db48f722cd9e0febd08 P 15163245557b4d03bdeaf1ce5d79dee9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:26.406165  4719 tablet_replica.cc:333] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9: stopping tablet replica
I20260620 13:59:26.406774  4719 raft_consensus.cc:2243] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:26.407310  4719 raft_consensus.cc:2272] T ff97b0658f314f75a847f713506df23b P 15163245557b4d03bdeaf1ce5d79dee9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:26.422709  4719 tablet_server.cc:196] TabletServer@127.4.155.195:0 shutdown complete.
I20260620 13:59:26.438611  4719 master.cc:562] Master@127.4.155.254:38209 shutting down...
I20260620 13:59:26.459776  4719 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:26.460358  4719 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:26.460712  4719 tablet_replica.cc:333] T 00000000000000000000000000000000 P 47b12350c34e4e12af0dff07d394f6a9: stopping tablet replica
I20260620 13:59:26.481506  4719 master.cc:584] Master@127.4.155.254:38209 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2685 ms)
[----------] 6 tests from LeaderRebalancerTest (311357 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260620 13:59:26.520215  4719 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.155.254:42757
I20260620 13:59:26.521386  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:59:26.528061 13898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:26.528170 13899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:26.529347 13901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:26.531038  4719 server_base.cc:1061] running on GCE node
I20260620 13:59:26.531989  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:59:26.532176  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:59:26.532361  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963966532347 us; error 0 us; skew 500 ppm
I20260620 13:59:26.533214  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:59:26.536397  4719 webserver.cc:533] Webserver started at http://127.4.155.254:44557/ using document root <none> and password file <none>
I20260620 13:59:26.536947  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:59:26.537133  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:59:26.537429  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:59:26.538617  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/master-0-root/instance:
uuid: "1a1cef163b904e4084cab21cc3904bb7"
format_stamp: "Formatted at 2026-06-20 13:59:26 on dist-test-slave-n70f"
I20260620 13:59:26.543442  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260620 13:59:26.547225 13906 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:26.548235  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260620 13:59:26.548604  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/master-0-root
uuid: "1a1cef163b904e4084cab21cc3904bb7"
format_stamp: "Formatted at 2026-06-20 13:59:26 on dist-test-slave-n70f"
I20260620 13:59:26.548924  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:59:26.578053  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:59:26.579416  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:59:26.621692  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.254:42757
I20260620 13:59:26.621824 13957 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.254:42757 every 8 connection(s)
I20260620 13:59:26.625831 13958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:26.639743 13958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7: Bootstrap starting.
I20260620 13:59:26.646100 13958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:26.651520 13958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7: No bootstrap required, opened a new log
I20260620 13:59:26.654296 13958 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1cef163b904e4084cab21cc3904bb7" member_type: VOTER }
I20260620 13:59:26.654805 13958 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:26.655467 13958 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a1cef163b904e4084cab21cc3904bb7, State: Initialized, Role: FOLLOWER
I20260620 13:59:26.656220 13958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1cef163b904e4084cab21cc3904bb7" member_type: VOTER }
I20260620 13:59:26.656729 13958 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 13:59:26.656972 13958 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 13:59:26.657265 13958 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:26.662480 13958 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1cef163b904e4084cab21cc3904bb7" member_type: VOTER }
I20260620 13:59:26.663066 13958 leader_election.cc:304] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a1cef163b904e4084cab21cc3904bb7; no voters: 
I20260620 13:59:26.664314 13958 leader_election.cc:290] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 13:59:26.664819 13961 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:26.666306 13961 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [term 1 LEADER]: Becoming Leader. State: Replica: 1a1cef163b904e4084cab21cc3904bb7, State: Running, Role: LEADER
I20260620 13:59:26.666985 13961 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1cef163b904e4084cab21cc3904bb7" member_type: VOTER }
I20260620 13:59:26.667538 13958 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 13:59:26.670547 13963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a1cef163b904e4084cab21cc3904bb7. Latest consensus state: current_term: 1 leader_uuid: "1a1cef163b904e4084cab21cc3904bb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1cef163b904e4084cab21cc3904bb7" member_type: VOTER } }
I20260620 13:59:26.670514 13962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a1cef163b904e4084cab21cc3904bb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1cef163b904e4084cab21cc3904bb7" member_type: VOTER } }
I20260620 13:59:26.671689 13963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [sys.catalog]: This master's current role is: LEADER
I20260620 13:59:26.671895 13962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [sys.catalog]: This master's current role is: LEADER
I20260620 13:59:26.676920 13966 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260620 13:59:26.683568 13966 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260620 13:59:26.684779  4719 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 13:59:26.693364 13966 catalog_manager.cc:1382] Generated new cluster ID: 82cc31406907463dba44640ffa54892a
I20260620 13:59:26.693696 13966 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260620 13:59:26.718549 13966 catalog_manager.cc:1405] Generated new certificate authority record
I20260620 13:59:26.719942 13966 catalog_manager.cc:1539] Loading token signing keys...
I20260620 13:59:26.733866 13966 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7: Generated new TSK 0
I20260620 13:59:26.734504 13966 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260620 13:59:26.752189  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:59:26.761072 13980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:26.761209 13979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:26.764451 13982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:26.765327  4719 server_base.cc:1061] running on GCE node
I20260620 13:59:26.766269  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:59:26.766470  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:59:26.766673  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963966766658 us; error 0 us; skew 500 ppm
I20260620 13:59:26.767745  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:59:26.770946  4719 webserver.cc:533] Webserver started at http://127.4.155.193:44657/ using document root <none> and password file <none>
I20260620 13:59:26.771559  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:59:26.771723  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:59:26.772040  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:59:26.773238  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/ts-0-root/instance:
uuid: "f33b223a2a51440683343b1044c26647"
format_stamp: "Formatted at 2026-06-20 13:59:26 on dist-test-slave-n70f"
I20260620 13:59:26.778095  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260620 13:59:26.781880 13987 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:26.782882  4719 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260620 13:59:26.783262  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/ts-0-root
uuid: "f33b223a2a51440683343b1044c26647"
format_stamp: "Formatted at 2026-06-20 13:59:26 on dist-test-slave-n70f"
I20260620 13:59:26.783628  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:59:26.806730  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:59:26.808393  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:59:26.809957  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:59:26.813316  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:59:26.813805  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260620 13:59:26.814356  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:59:26.814564  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:26.876729  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.193:35951
I20260620 13:59:26.876827 14049 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.193:35951 every 8 connection(s)
I20260620 13:59:26.881961  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:59:26.896116 14054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:26.896452 14055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:26.898419 14057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:26.901221  4719 server_base.cc:1061] running on GCE node
I20260620 13:59:26.901952 14050 heartbeater.cc:344] Connected to a master server at 127.4.155.254:42757
I20260620 13:59:26.902626 14050 heartbeater.cc:461] Registering TS with master...
I20260620 13:59:26.904141 14050 heartbeater.cc:507] Master 127.4.155.254:42757 requested a full tablet report, sending...
I20260620 13:59:26.904663  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:59:26.905009  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:59:26.905232  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963966905212 us; error 0 us; skew 500 ppm
I20260620 13:59:26.906042  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:59:26.907008 13923 ts_manager.cc:194] Registered new tserver with Master: f33b223a2a51440683343b1044c26647 (127.4.155.193:35951)
I20260620 13:59:26.910030  4719 webserver.cc:533] Webserver started at http://127.4.155.194:35545/ using document root <none> and password file <none>
I20260620 13:59:26.910915 13923 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43006
I20260620 13:59:26.911247  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:59:26.911607  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:59:26.911893  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:59:26.913280  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/ts-1-root/instance:
uuid: "ddd2d9da052f4f21838c60a4f143fdba"
format_stamp: "Formatted at 2026-06-20 13:59:26 on dist-test-slave-n70f"
I20260620 13:59:26.918313  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260620 13:59:26.922806 14062 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:26.924216  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260620 13:59:26.924739  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/ts-1-root
uuid: "ddd2d9da052f4f21838c60a4f143fdba"
format_stamp: "Formatted at 2026-06-20 13:59:26 on dist-test-slave-n70f"
I20260620 13:59:26.925063  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:59:26.939611  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:59:26.940814  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:59:26.942490  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:59:26.945540  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:59:26.945890  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:26.946139  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:59:26.946309  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:27.004614  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.194:39675
I20260620 13:59:27.004717 14124 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.194:39675 every 8 connection(s)
I20260620 13:59:27.010102  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:59:27.022850 14128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:27.026787 14125 heartbeater.cc:344] Connected to a master server at 127.4.155.254:42757
W20260620 13:59:27.026741 14129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:27.027464 14125 heartbeater.cc:461] Registering TS with master...
I20260620 13:59:27.028448 14125 heartbeater.cc:507] Master 127.4.155.254:42757 requested a full tablet report, sending...
W20260620 13:59:27.028988 14131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:27.030982 13923 ts_manager.cc:194] Registered new tserver with Master: ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:27.032346  4719 server_base.cc:1061] running on GCE node
I20260620 13:59:27.032814 13923 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43012
I20260620 13:59:27.033627  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:59:27.033957  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:59:27.034176  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963967034157 us; error 0 us; skew 500 ppm
I20260620 13:59:27.034997  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:59:27.038472  4719 webserver.cc:533] Webserver started at http://127.4.155.195:33803/ using document root <none> and password file <none>
I20260620 13:59:27.038949  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:59:27.039229  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:59:27.039577  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:59:27.041085  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/ts-2-root/instance:
uuid: "3072dd282fc542529a7558aafe37a46e"
format_stamp: "Formatted at 2026-06-20 13:59:27 on dist-test-slave-n70f"
I20260620 13:59:27.047066  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260620 13:59:27.051024 14136 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:27.052377  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260620 13:59:27.052879  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/ts-2-root
uuid: "3072dd282fc542529a7558aafe37a46e"
format_stamp: "Formatted at 2026-06-20 13:59:27 on dist-test-slave-n70f"
I20260620 13:59:27.053314  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1781963654985192-4719-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:59:27.087894  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:59:27.089123  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:59:27.090694  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:59:27.093061  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:59:27.093326  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:27.093580  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:59:27.093755  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:27.139755  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.195:36327
I20260620 13:59:27.140065 14198 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.195:36327 every 8 connection(s)
I20260620 13:59:27.155158 14199 heartbeater.cc:344] Connected to a master server at 127.4.155.254:42757
I20260620 13:59:27.155733 14199 heartbeater.cc:461] Registering TS with master...
I20260620 13:59:27.156598 14199 heartbeater.cc:507] Master 127.4.155.254:42757 requested a full tablet report, sending...
I20260620 13:59:27.159077 13923 ts_manager.cc:194] Registered new tserver with Master: 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:27.159312  4719 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016372022s
I20260620 13:59:27.161304 13923 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43018
I20260620 13:59:27.189688 13923 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43022:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260620 13:59:27.192781 13923 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 13:59:27.278415 14162 tablet_service.cc:1511] Processing CreateTablet for tablet 95ff38af22f04e42bf57fb40b90dff72 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260620 13:59:27.279983 14163 tablet_service.cc:1511] Processing CreateTablet for tablet 4714f60c31e649ddba4445c6022d9dc3 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260620 13:59:27.281038 14161 tablet_service.cc:1511] Processing CreateTablet for tablet c29e05ada4be4b84903c875dce890372 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260620 13:59:27.282351 14159 tablet_service.cc:1511] Processing CreateTablet for tablet 73e50c85167b4a6c83892dd58be19c79 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260620 13:59:27.283350 14160 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc8f78c35054fb680acf6668bfa8f57 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260620 13:59:27.284729 14158 tablet_service.cc:1511] Processing CreateTablet for tablet 80e1393235534f46bd9ee5f875cdd944 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260620 13:59:27.287022 14090 tablet_service.cc:1511] Processing CreateTablet for tablet 07529c987ba84d0faf98639d7465d0c2 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260620 13:59:27.287668 14164 tablet_service.cc:1511] Processing CreateTablet for tablet 07529c987ba84d0faf98639d7465d0c2 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260620 13:59:27.288468 14090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07529c987ba84d0faf98639d7465d0c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.288569 14086 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc8f78c35054fb680acf6668bfa8f57 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260620 13:59:27.279973 14162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ff38af22f04e42bf57fb40b90dff72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.289996 14086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc8f78c35054fb680acf6668bfa8f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.289707 14087 tablet_service.cc:1511] Processing CreateTablet for tablet c29e05ada4be4b84903c875dce890372 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260620 13:59:27.291839 14087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29e05ada4be4b84903c875dce890372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.292594 14089 tablet_service.cc:1511] Processing CreateTablet for tablet 4714f60c31e649ddba4445c6022d9dc3 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260620 13:59:27.293972 14089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4714f60c31e649ddba4445c6022d9dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.295454 14159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e50c85167b4a6c83892dd58be19c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.296308 14088 tablet_service.cc:1511] Processing CreateTablet for tablet 95ff38af22f04e42bf57fb40b90dff72 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260620 13:59:27.297896 14088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ff38af22f04e42bf57fb40b90dff72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.299491 14163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4714f60c31e649ddba4445c6022d9dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.300311 14085 tablet_service.cc:1511] Processing CreateTablet for tablet 73e50c85167b4a6c83892dd58be19c79 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260620 13:59:27.301182 14015 tablet_service.cc:1511] Processing CreateTablet for tablet 07529c987ba84d0faf98639d7465d0c2 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260620 13:59:27.301777 14085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e50c85167b4a6c83892dd58be19c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.302727 14015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07529c987ba84d0faf98639d7465d0c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.304119 14008 tablet_service.cc:1511] Processing CreateTablet for tablet 62846366d99d41cd88aa9d766bbf6e9b (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260620 13:59:27.305315 14083 tablet_service.cc:1511] Processing CreateTablet for tablet 62846366d99d41cd88aa9d766bbf6e9b (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260620 13:59:27.306080 14008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62846366d99d41cd88aa9d766bbf6e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.307528 14084 tablet_service.cc:1511] Processing CreateTablet for tablet 80e1393235534f46bd9ee5f875cdd944 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260620 13:59:27.308162 14010 tablet_service.cc:1511] Processing CreateTablet for tablet 73e50c85167b4a6c83892dd58be19c79 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260620 13:59:27.309608 14010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e50c85167b4a6c83892dd58be19c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.306890 14083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62846366d99d41cd88aa9d766bbf6e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.312330 14009 tablet_service.cc:1511] Processing CreateTablet for tablet 80e1393235534f46bd9ee5f875cdd944 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260620 13:59:27.313755 14009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e1393235534f46bd9ee5f875cdd944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.316076 14084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e1393235534f46bd9ee5f875cdd944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.316797 14013 tablet_service.cc:1511] Processing CreateTablet for tablet 95ff38af22f04e42bf57fb40b90dff72 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260620 13:59:27.318748 14013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ff38af22f04e42bf57fb40b90dff72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.320099 14011 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc8f78c35054fb680acf6668bfa8f57 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260620 13:59:27.322149 14014 tablet_service.cc:1511] Processing CreateTablet for tablet 4714f60c31e649ddba4445c6022d9dc3 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260620 13:59:27.305672 14012 tablet_service.cc:1511] Processing CreateTablet for tablet c29e05ada4be4b84903c875dce890372 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260620 13:59:27.327062 14158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e1393235534f46bd9ee5f875cdd944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.329012 14164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07529c987ba84d0faf98639d7465d0c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.332587 14014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4714f60c31e649ddba4445c6022d9dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.334316 14011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc8f78c35054fb680acf6668bfa8f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.335978 14012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29e05ada4be4b84903c875dce890372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.338361 14161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29e05ada4be4b84903c875dce890372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.340344 14160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc8f78c35054fb680acf6668bfa8f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.352062 14214 tablet_bootstrap.cc:492] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:27.368736 14214 tablet_bootstrap.cc:654] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.372489 14157 tablet_service.cc:1511] Processing CreateTablet for tablet 62846366d99d41cd88aa9d766bbf6e9b (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260620 13:59:27.374420 14157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62846366d99d41cd88aa9d766bbf6e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.373907 14007 tablet_service.cc:1511] Processing CreateTablet for tablet aae371b2d718455abbbfafb14691c3e1 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260620 13:59:27.376144 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aae371b2d718455abbbfafb14691c3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.383863 14156 tablet_service.cc:1511] Processing CreateTablet for tablet aae371b2d718455abbbfafb14691c3e1 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260620 13:59:27.385957 14156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aae371b2d718455abbbfafb14691c3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.395862 14086 tablet_service.cc:1511] Processing CreateTablet for tablet aae371b2d718455abbbfafb14691c3e1 (DEFAULT_TABLE table=test-workload [id=c047b752db3d41e19e54fded5b93c746]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260620 13:59:27.397382 14086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aae371b2d718455abbbfafb14691c3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:27.452488 14217 tablet_bootstrap.cc:492] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:27.464781 14214 tablet_bootstrap.cc:492] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:27.461488 14215 tablet_bootstrap.cc:492] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:27.465417 14214 ts_tablet_manager.cc:1403] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.114s	user 0.010s	sys 0.015s
I20260620 13:59:27.468547 14214 raft_consensus.cc:359] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.469338 14214 raft_consensus.cc:385] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.469640 14214 raft_consensus.cc:740] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.472952 14214 consensus_queue.cc:260] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.481495 14125 heartbeater.cc:499] Master 127.4.155.254:42757 was elected leader, sending a full tablet report...
I20260620 13:59:27.484174 14214 ts_tablet_manager.cc:1434] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.010s
I20260620 13:59:27.485370 14214 tablet_bootstrap.cc:492] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:27.492296 14214 tablet_bootstrap.cc:654] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.498183 14215 tablet_bootstrap.cc:654] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.499871 14217 tablet_bootstrap.cc:654] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.509855 14215 tablet_bootstrap.cc:492] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
I20260620 13:59:27.510157 14217 tablet_bootstrap.cc:492] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:27.510430 14215 ts_tablet_manager.cc:1403] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.004s
I20260620 13:59:27.510749 14217 ts_tablet_manager.cc:1403] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.000s
I20260620 13:59:27.512373 14214 tablet_bootstrap.cc:492] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:27.512972 14214 ts_tablet_manager.cc:1403] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.002s
I20260620 13:59:27.513684 14215 raft_consensus.cc:359] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.513954 14217 raft_consensus.cc:359] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.514514 14215 raft_consensus.cc:385] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.514595 14217 raft_consensus.cc:385] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.514955 14215 raft_consensus.cc:740] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.515085 14217 raft_consensus.cc:740] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.515823 14215 consensus_queue.cc:260] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.515995 14214 raft_consensus.cc:359] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.516019 14217 consensus_queue.cc:260] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.516793 14214 raft_consensus.cc:385] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.517201 14214 raft_consensus.cc:740] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.518116 14214 consensus_queue.cc:260] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.519189 14215 ts_tablet_manager.cc:1434] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260620 13:59:27.519302 14050 heartbeater.cc:499] Master 127.4.155.254:42757 was elected leader, sending a full tablet report...
I20260620 13:59:27.520313 14215 tablet_bootstrap.cc:492] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:27.520460 14214 ts_tablet_manager.cc:1434] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260620 13:59:27.521461 14214 tablet_bootstrap.cc:492] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:27.529412 14215 tablet_bootstrap.cc:654] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.533712 14214 tablet_bootstrap.cc:654] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.529145 14217 ts_tablet_manager.cc:1434] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260620 13:59:27.535733 14199 heartbeater.cc:499] Master 127.4.155.254:42757 was elected leader, sending a full tablet report...
I20260620 13:59:27.536209 14217 tablet_bootstrap.cc:492] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:27.541548 14218 raft_consensus.cc:493] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:27.542174 14218 raft_consensus.cc:515] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.544229 14217 tablet_bootstrap.cc:654] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.544878 14218 leader_election.cc:290] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:27.550858 14215 tablet_bootstrap.cc:492] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
I20260620 13:59:27.551575 14215 ts_tablet_manager.cc:1403] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.009s
I20260620 13:59:27.556442 14215 raft_consensus.cc:359] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.558288 14215 raft_consensus.cc:385] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.558689 14215 raft_consensus.cc:740] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.559839 14215 consensus_queue.cc:260] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.562676 14215 ts_tablet_manager.cc:1434] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260620 13:59:27.564013 14215 tablet_bootstrap.cc:492] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:27.573699 14214 tablet_bootstrap.cc:492] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:27.574278 14214 ts_tablet_manager.cc:1403] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.018s
I20260620 13:59:27.577589 14214 raft_consensus.cc:359] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.582087 14214 raft_consensus.cc:385] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.582022 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29e05ada4be4b84903c875dce890372" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647" is_pre_election: true
I20260620 13:59:27.582763 14214 raft_consensus.cc:740] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.584055 14214 consensus_queue.cc:260] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.584936 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29e05ada4be4b84903c875dce890372" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:27.587213 14214 ts_tablet_manager.cc:1434] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.005s
W20260620 13:59:27.587213 14064 leader_election.cc:343] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:59:27.588572 14064 leader_election.cc:343] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:27.588819 14214 tablet_bootstrap.cc:492] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:27.589001 14064 leader_election.cc:304] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba; no voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647
I20260620 13:59:27.589241 14218 raft_consensus.cc:493] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:27.590075 14218 raft_consensus.cc:515] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.592240 14218 leader_election.cc:290] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:27.592723 14218 raft_consensus.cc:2749] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:27.593799 14217 tablet_bootstrap.cc:492] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:27.594360 14217 ts_tablet_manager.cc:1403] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.013s
I20260620 13:59:27.594907 14215 tablet_bootstrap.cc:654] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.597363 14214 tablet_bootstrap.cc:654] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.597528 14217 raft_consensus.cc:359] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.598346 14217 raft_consensus.cc:385] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.598634 14217 raft_consensus.cc:740] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.599433 14217 consensus_queue.cc:260] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.601900 14217 ts_tablet_manager.cc:1434] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260620 13:59:27.602864 14217 tablet_bootstrap.cc:492] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:27.610746 14217 tablet_bootstrap.cc:654] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.612090 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e50c85167b4a6c83892dd58be19c79" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647" is_pre_election: true
W20260620 13:59:27.613682 14064 leader_election.cc:343] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:27.614276 14214 tablet_bootstrap.cc:492] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:27.614276 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e50c85167b4a6c83892dd58be19c79" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:27.615223 14214 ts_tablet_manager.cc:1403] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.010s
I20260620 13:59:27.616171 14215 tablet_bootstrap.cc:492] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
W20260620 13:59:27.616039 14064 leader_election.cc:343] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:27.616707 14215 ts_tablet_manager.cc:1403] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.004s
I20260620 13:59:27.616605 14064 leader_election.cc:304] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba; no voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647
I20260620 13:59:27.617980 14217 tablet_bootstrap.cc:492] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:27.618499 14217 ts_tablet_manager.cc:1403] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260620 13:59:27.619045 14214 raft_consensus.cc:359] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.619410 14215 raft_consensus.cc:359] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.619875 14214 raft_consensus.cc:385] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.620074 14215 raft_consensus.cc:385] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.620244 14214 raft_consensus.cc:740] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.620505 14215 raft_consensus.cc:740] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.620783 14229 raft_consensus.cc:2749] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:27.621170 14214 consensus_queue.cc:260] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.621340 14215 consensus_queue.cc:260] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.622825 14217 raft_consensus.cc:359] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.623641 14215 ts_tablet_manager.cc:1434] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260620 13:59:27.623674 14217 raft_consensus.cc:385] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.625221 14217 raft_consensus.cc:740] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.625548 14214 ts_tablet_manager.cc:1434] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260620 13:59:27.626539 14214 tablet_bootstrap.cc:492] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:27.627012 14215 tablet_bootstrap.cc:492] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:27.626051 14217 consensus_queue.cc:260] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.631558 14222 raft_consensus.cc:493] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:27.632169 14222 raft_consensus.cc:515] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.633092 14217 ts_tablet_manager.cc:1434] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260620 13:59:27.633711 14214 tablet_bootstrap.cc:654] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.636489 14215 tablet_bootstrap.cc:654] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.645928 14222 leader_election.cc:290] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:27.652976 14217 tablet_bootstrap.cc:492] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:27.670789 14217 tablet_bootstrap.cc:654] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.677559 14214 tablet_bootstrap.cc:492] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:27.678112 14214 ts_tablet_manager.cc:1403] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.009s
W20260620 13:59:27.679242 13971 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:59:27.679589 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62846366d99d41cd88aa9d766bbf6e9b" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:27.680008 14215 tablet_bootstrap.cc:492] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
I20260620 13:59:27.680356 14174 raft_consensus.cc:2468] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 0.
I20260620 13:59:27.680531 14215 ts_tablet_manager.cc:1403] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.028s
I20260620 13:59:27.681690 14214 raft_consensus.cc:359] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } }
I20260620 13:59:27.682322 13989 leader_election.cc:304] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:27.682598 14214 raft_consensus.cc:385] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.683267 14222 raft_consensus.cc:2804] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:27.683656 14222 raft_consensus.cc:493] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:27.684090 14222 raft_consensus.cc:3060] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:27.683738 14215 raft_consensus.cc:359] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } }
I20260620 13:59:27.684594 14215 raft_consensus.cc:385] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.684948 14215 raft_consensus.cc:740] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.683000 14214 raft_consensus.cc:740] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.685918 14215 consensus_queue.cc:260] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } }
I20260620 13:59:27.687618 14217 tablet_bootstrap.cc:492] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:27.688156 14217 ts_tablet_manager.cc:1403] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.005s
I20260620 13:59:27.688724 14215 ts_tablet_manager.cc:1434] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260620 13:59:27.689760 14215 tablet_bootstrap.cc:492] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:27.690234 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62846366d99d41cd88aa9d766bbf6e9b" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:27.691177 14217 raft_consensus.cc:359] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.691954 14217 raft_consensus.cc:385] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260620 13:59:27.692013 13991 leader_election.cc:343] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:27.692363 14217 raft_consensus.cc:740] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.693229 14214 consensus_queue.cc:260] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } }
I20260620 13:59:27.695971 14214 ts_tablet_manager.cc:1434] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260620 13:59:27.697046 14215 tablet_bootstrap.cc:654] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.697122 14214 tablet_bootstrap.cc:492] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:27.704859 14217 consensus_queue.cc:260] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.705665 14215 tablet_bootstrap.cc:492] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
I20260620 13:59:27.706329 14215 ts_tablet_manager.cc:1403] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260620 13:59:27.707656 14217 ts_tablet_manager.cc:1434] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.003s
I20260620 13:59:27.708761 14217 tablet_bootstrap.cc:492] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:27.709379 14215 raft_consensus.cc:359] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.710170 14215 raft_consensus.cc:385] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.710466 14215 raft_consensus.cc:740] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.711398 14215 consensus_queue.cc:260] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.712169 14222 raft_consensus.cc:515] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.713774 14215 ts_tablet_manager.cc:1434] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260620 13:59:27.715288 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62846366d99d41cd88aa9d766bbf6e9b" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:27.716120 14217 tablet_bootstrap.cc:654] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
W20260620 13:59:27.716859 13991 leader_election.cc:343] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:27.717628 14238 raft_consensus.cc:493] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:27.718112 14238 raft_consensus.cc:515] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.719609 14222 leader_election.cc:290] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Requested vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:27.718559 14214 tablet_bootstrap.cc:654] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.721524 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e50c85167b4a6c83892dd58be19c79" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:27.722378 14100 raft_consensus.cc:2468] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 0.
I20260620 13:59:27.722994 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62846366d99d41cd88aa9d766bbf6e9b" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:27.723590 14174 raft_consensus.cc:3060] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:27.723672 13991 leader_election.cc:304] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:27.724611 14222 raft_consensus.cc:2804] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:27.725042 14238 leader_election.cc:290] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:27.725068 14222 raft_consensus.cc:493] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:27.717154 14215 tablet_bootstrap.cc:492] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:27.725739 14222 raft_consensus.cc:3060] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:27.728047 14217 tablet_bootstrap.cc:492] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:27.728597 14217 ts_tablet_manager.cc:1403] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260620 13:59:27.728682 14173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e50c85167b4a6c83892dd58be19c79" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:27.729489 14173 raft_consensus.cc:2468] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 0.
I20260620 13:59:27.731886 14217 raft_consensus.cc:359] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.732661 14217 raft_consensus.cc:385] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.732959 14217 raft_consensus.cc:740] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.733317 14215 tablet_bootstrap.cc:654] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.733825 14222 raft_consensus.cc:515] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.733930 14217 consensus_queue.cc:260] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.736734 14217 ts_tablet_manager.cc:1434] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260620 13:59:27.737299 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e50c85167b4a6c83892dd58be19c79" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:27.738031 14100 raft_consensus.cc:3060] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:27.738839 14238 raft_consensus.cc:493] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:27.739428 14238 raft_consensus.cc:515] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } }
I20260620 13:59:27.741454 14217 tablet_bootstrap.cc:492] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:27.741885 14238 leader_election.cc:290] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:27.743059 14099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07529c987ba84d0faf98639d7465d0c2" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:27.743538 14173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07529c987ba84d0faf98639d7465d0c2" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:27.743842 14099 raft_consensus.cc:2468] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 0.
W20260620 13:59:27.745371 13989 leader_election.cc:343] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:27.745993 13989 leader_election.cc:304] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 3072dd282fc542529a7558aafe37a46e
I20260620 13:59:27.747161 14238 raft_consensus.cc:2804] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:27.747545 14238 raft_consensus.cc:493] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:27.747879 14238 raft_consensus.cc:3060] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:27.752169 14100 raft_consensus.cc:2468] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 1.
I20260620 13:59:27.753405 14217 tablet_bootstrap.cc:654] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.753576 13991 leader_election.cc:304] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:27.756073 14222 leader_election.cc:290] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Requested vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:27.757225 14173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e50c85167b4a6c83892dd58be19c79" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:27.757402 14222 raft_consensus.cc:2804] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:27.757910 14173 raft_consensus.cc:3060] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:27.758411 14222 raft_consensus.cc:697] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Becoming Leader. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:27.759279 14174 raft_consensus.cc:2468] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 1.
I20260620 13:59:27.764783 13989 leader_election.cc:304] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: ddd2d9da052f4f21838c60a4f143fdba
I20260620 13:59:27.764746 14238 raft_consensus.cc:515] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } }
I20260620 13:59:27.772876 14243 raft_consensus.cc:2804] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:27.773480 14243 raft_consensus.cc:697] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Becoming Leader. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:27.773712 14238 leader_election.cc:290] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Requested vote from peers 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:27.765866 14222 consensus_queue.cc:237] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.774389 14243 consensus_queue.cc:237] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.775611 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07529c987ba84d0faf98639d7465d0c2" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:27.776258 14100 raft_consensus.cc:3060] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:27.776423 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07529c987ba84d0faf98639d7465d0c2" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:27.777491 14215 tablet_bootstrap.cc:492] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
W20260620 13:59:27.779480 13989 leader_election.cc:343] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:27.779647 14238 raft_consensus.cc:493] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:27.782596 14215 ts_tablet_manager.cc:1403] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.002s
I20260620 13:59:27.786677 14215 raft_consensus.cc:359] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.787374 14215 raft_consensus.cc:385] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.787675 14215 raft_consensus.cc:740] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.788360 14215 consensus_queue.cc:260] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.789098 14173 raft_consensus.cc:2468] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 1.
I20260620 13:59:27.789825 14100 raft_consensus.cc:2468] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 1.
I20260620 13:59:27.790114 14215 ts_tablet_manager.cc:1434] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.002s
I20260620 13:59:27.786962 14214 tablet_bootstrap.cc:492] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:27.791131 13991 leader_election.cc:304] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 3072dd282fc542529a7558aafe37a46e
I20260620 13:59:27.791899 14214 ts_tablet_manager.cc:1403] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.021s
I20260620 13:59:27.793319 14215 tablet_bootstrap.cc:492] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:27.794555 14229 raft_consensus.cc:493] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:27.795073 14229 raft_consensus.cc:515] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.796862 14214 raft_consensus.cc:359] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.797533 14229 leader_election.cc:290] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:27.797904 14214 raft_consensus.cc:385] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.798337 14214 raft_consensus.cc:740] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.800135 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8f78c35054fb680acf6668bfa8f57" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647" is_pre_election: true
I20260620 13:59:27.801183 14215 tablet_bootstrap.cc:654] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.800558 14214 consensus_queue.cc:260] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
W20260620 13:59:27.802018 14064 leader_election.cc:343] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:27.792315 14238 raft_consensus.cc:515] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.802183 14173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8f78c35054fb680acf6668bfa8f57" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:27.803618 14214 ts_tablet_manager.cc:1434] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260620 13:59:27.804280 14217 tablet_bootstrap.cc:492] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:27.804700 14214 tablet_bootstrap.cc:492] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:27.804806 14217 ts_tablet_manager.cc:1403] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.004s
I20260620 13:59:27.808475 14244 raft_consensus.cc:2804] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election won for term 1
W20260620 13:59:27.803565 14064 leader_election.cc:343] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:27.810251 14064 leader_election.cc:304] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba; no voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647
I20260620 13:59:27.812443 14229 raft_consensus.cc:2749] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:27.812620 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae371b2d718455abbbfafb14691c3e1" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:27.813076 14214 tablet_bootstrap.cc:654] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.813828 14238 leader_election.cc:290] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
W20260620 13:59:27.814077 13991 leader_election.cc:343] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:27.815824 14173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae371b2d718455abbbfafb14691c3e1" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:27.815413 14217 raft_consensus.cc:359] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.817652 14217 raft_consensus.cc:385] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.818221 14217 raft_consensus.cc:740] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.819418 14217 consensus_queue.cc:260] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.817198 14173 raft_consensus.cc:2468] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 0.
I20260620 13:59:27.824939 13989 leader_election.cc:304] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: ddd2d9da052f4f21838c60a4f143fdba
I20260620 13:59:27.827945 14244 raft_consensus.cc:697] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Becoming Leader. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:27.829021 14244 consensus_queue.cc:237] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } }
I20260620 13:59:27.829710 14217 ts_tablet_manager.cc:1434] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260620 13:59:27.830799 14217 tablet_bootstrap.cc:492] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:27.830847 13921 catalog_manager.cc:5696] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 reported cstate change: term changed from 0 to 1, leader changed from <none> to f33b223a2a51440683343b1044c26647 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "f33b223a2a51440683343b1044c26647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:27.836742 14222 raft_consensus.cc:2804] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:27.839468 14222 raft_consensus.cc:493] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:27.840037 14222 raft_consensus.cc:3060] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:27.843969 14215 tablet_bootstrap.cc:492] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
I20260620 13:59:27.844645 14215 ts_tablet_manager.cc:1403] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.007s
I20260620 13:59:27.844684 14217 tablet_bootstrap.cc:654] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.851416 14222 raft_consensus.cc:515] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.852708 14215 raft_consensus.cc:359] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.853756 14215 raft_consensus.cc:385] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.855360 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae371b2d718455abbbfafb14691c3e1" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:27.859938 14248 raft_consensus.cc:493] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:27.860529 14248 raft_consensus.cc:515] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.861515 14222 leader_election.cc:290] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Requested vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:27.854144 14215 raft_consensus.cc:740] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.863425 14173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae371b2d718455abbbfafb14691c3e1" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e"
W20260620 13:59:27.863545 13991 leader_election.cc:343] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:27.864126 14173 raft_consensus.cc:3060] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:27.866588 14248 leader_election.cc:290] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:27.868247 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ff38af22f04e42bf57fb40b90dff72" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:27.869081 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ff38af22f04e42bf57fb40b90dff72" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:27.869968 14100 raft_consensus.cc:2468] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 0.
I20260620 13:59:27.871879 13991 leader_election.cc:304] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:27.874187 14248 raft_consensus.cc:2804] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:27.874881 14248 raft_consensus.cc:493] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:27.869136 14174 raft_consensus.cc:2468] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 0.
I20260620 13:59:27.875520 14248 raft_consensus.cc:3060] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:27.863139 14215 consensus_queue.cc:260] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.883664 14217 tablet_bootstrap.cc:492] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:27.884246 14217 ts_tablet_manager.cc:1403] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.054s	user 0.031s	sys 0.013s
I20260620 13:59:27.887430 14173 raft_consensus.cc:2468] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 1.
I20260620 13:59:27.887677 14215 ts_tablet_manager.cc:1434] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.002s
I20260620 13:59:27.887811 14217 raft_consensus.cc:359] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.888854 14217 raft_consensus.cc:385] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.888988 13989 leader_election.cc:304] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: ddd2d9da052f4f21838c60a4f143fdba
I20260620 13:59:27.889231 14217 raft_consensus.cc:740] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.889943 14222 raft_consensus.cc:2804] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:27.890486 14222 raft_consensus.cc:697] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Becoming Leader. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:27.890161 14217 consensus_queue.cc:260] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.891502 14215 tablet_bootstrap.cc:492] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:27.894681 14217 ts_tablet_manager.cc:1434] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260620 13:59:27.895944 14217 tablet_bootstrap.cc:492] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:27.891494 14222 consensus_queue.cc:237] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.902019 14214 tablet_bootstrap.cc:492] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:27.902628 14214 ts_tablet_manager.cc:1403] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.098s	user 0.023s	sys 0.021s
I20260620 13:59:27.903127 14217 tablet_bootstrap.cc:654] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.907001 14215 tablet_bootstrap.cc:654] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.907976 14229 raft_consensus.cc:493] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:27.908470 14229 raft_consensus.cc:515] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.908704 14248 raft_consensus.cc:515] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.910601 14229 leader_election.cc:290] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:27.910787 14248 leader_election.cc:290] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Requested vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:27.912024 14214 raft_consensus.cc:359] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.912791 14214 raft_consensus.cc:385] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.913069 14214 raft_consensus.cc:740] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.913638 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ff38af22f04e42bf57fb40b90dff72" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:27.913826 14214 consensus_queue.cc:260] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.914223 14100 raft_consensus.cc:3060] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:27.914093 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4714f60c31e649ddba4445c6022d9dc3" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647" is_pre_election: true
I20260620 13:59:27.915086 14025 raft_consensus.cc:2468] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 0.
I20260620 13:59:27.916649 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4714f60c31e649ddba4445c6022d9dc3" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:27.917536 14174 raft_consensus.cc:2468] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 0.
I20260620 13:59:27.918766 14214 ts_tablet_manager.cc:1434] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260620 13:59:27.919621 14173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ff38af22f04e42bf57fb40b90dff72" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:27.920113 14214 tablet_bootstrap.cc:492] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:27.920282 14173 raft_consensus.cc:3060] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:27.920315 14064 leader_election.cc:304] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:27.924070 14229 raft_consensus.cc:2804] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:27.924435 14229 raft_consensus.cc:493] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:27.924775 14229 raft_consensus.cc:3060] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:27.932358 14100 raft_consensus.cc:2468] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 1.
I20260620 13:59:27.933840 13991 leader_election.cc:304] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:27.934427 14217 tablet_bootstrap.cc:492] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:27.934978 14217 ts_tablet_manager.cc:1403] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.024s
I20260620 13:59:27.935035 14248 raft_consensus.cc:2804] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:27.935772 14248 raft_consensus.cc:697] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Becoming Leader. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:27.936666 14248 consensus_queue.cc:237] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.937873 14173 raft_consensus.cc:2468] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 1.
I20260620 13:59:27.938712 14217 raft_consensus.cc:359] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } }
I20260620 13:59:27.939586 14217 raft_consensus.cc:385] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.939857 14217 raft_consensus.cc:740] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.941933 14217 consensus_queue.cc:260] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } }
I20260620 13:59:27.944150 14217 ts_tablet_manager.cc:1434] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260620 13:59:27.945179 14215 tablet_bootstrap.cc:492] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
I20260620 13:59:27.945459 14217 tablet_bootstrap.cc:492] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:27.945710 14215 ts_tablet_manager.cc:1403] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.002s
I20260620 13:59:27.948727 14215 raft_consensus.cc:359] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.949213 14214 tablet_bootstrap.cc:654] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.945217 14229 raft_consensus.cc:515] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.952442 14217 tablet_bootstrap.cc:654] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.953626 14215 raft_consensus.cc:385] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.953984 14215 raft_consensus.cc:740] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.954206 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4714f60c31e649ddba4445c6022d9dc3" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:27.954515 14229 leader_election.cc:290] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:27.954882 14025 raft_consensus.cc:3060] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:27.955857 14173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4714f60c31e649ddba4445c6022d9dc3" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:27.956473 14173 raft_consensus.cc:3060] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:27.955582 14215 consensus_queue.cc:260] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.968452 14215 ts_tablet_manager.cc:1434] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260620 13:59:27.970489 14025 raft_consensus.cc:2468] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 1.
I20260620 13:59:27.971725 14214 tablet_bootstrap.cc:492] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:27.971923 14064 leader_election.cc:304] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:27.972048 14173 raft_consensus.cc:2468] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 1.
I20260620 13:59:27.972328 14214 ts_tablet_manager.cc:1403] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.008s
I20260620 13:59:27.972908 14229 raft_consensus.cc:2804] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:27.974287 14229 raft_consensus.cc:697] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 1 LEADER]: Becoming Leader. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:27.975199 14229 consensus_queue.cc:237] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.975742 14214 raft_consensus.cc:359] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.975251 13921 catalog_manager.cc:5696] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 reported cstate change: term changed from 0 to 1, leader changed from <none> to f33b223a2a51440683343b1044c26647 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "f33b223a2a51440683343b1044c26647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:27.972167 14215 tablet_bootstrap.cc:492] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:27.978075 13921 catalog_manager.cc:5696] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 reported cstate change: term changed from 0 to 1, leader changed from <none> to f33b223a2a51440683343b1044c26647 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "f33b223a2a51440683343b1044c26647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:27.980553 13921 catalog_manager.cc:5696] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 reported cstate change: term changed from 0 to 1, leader changed from <none> to f33b223a2a51440683343b1044c26647 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "f33b223a2a51440683343b1044c26647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:27.976584 14214 raft_consensus.cc:385] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.984393 14214 raft_consensus.cc:740] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.985714 14217 tablet_bootstrap.cc:492] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:27.985266 14214 consensus_queue.cc:260] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.986219 14217 ts_tablet_manager.cc:1403] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.013s
I20260620 13:59:27.987197 14223 raft_consensus.cc:493] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:27.987809 14214 ts_tablet_manager.cc:1434] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260620 13:59:27.987715 14223 raft_consensus.cc:515] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.988759 14214 tablet_bootstrap.cc:492] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:27.988996 14217 raft_consensus.cc:359] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.989645 14217 raft_consensus.cc:385] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:27.989903 14217 raft_consensus.cc:740] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:27.989279 13922 catalog_manager.cc:5696] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba reported cstate change: term changed from 0 to 1, leader changed from <none> to ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194). New cstate: current_term: 1 leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:27.990573 14217 consensus_queue.cc:260] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:27.994598 14215 tablet_bootstrap.cc:654] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.996477 14214 tablet_bootstrap.cc:654] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:27.999225 13921 catalog_manager.cc:5696] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 reported cstate change: term changed from 0 to 1, leader changed from <none> to f33b223a2a51440683343b1044c26647 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "f33b223a2a51440683343b1044c26647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:28.013722 14223 leader_election.cc:290] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:28.021633 14215 tablet_bootstrap.cc:492] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
I20260620 13:59:28.022310 14215 ts_tablet_manager.cc:1403] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.001s
I20260620 13:59:28.033980 14215 raft_consensus.cc:359] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.034734 14215 raft_consensus.cc:385] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:28.034997 14215 raft_consensus.cc:740] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:28.035838 14215 consensus_queue.cc:260] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.037951 14215 ts_tablet_manager.cc:1434] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260620 13:59:28.053828 14223 raft_consensus.cc:493] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:28.054437 14223 raft_consensus.cc:515] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.058817 14223 leader_election.cc:290] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:28.068773 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29e05ada4be4b84903c875dce890372" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647" is_pre_election: true
I20260620 13:59:28.069619 14025 raft_consensus.cc:2468] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 0.
I20260620 13:59:28.071310 14138 leader_election.cc:304] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:28.071544 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29e05ada4be4b84903c875dce890372" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:28.071826 14099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e1393235534f46bd9ee5f875cdd944" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:28.072180 14223 raft_consensus.cc:2804] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:28.072665 14223 raft_consensus.cc:493] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:28.073060 14223 raft_consensus.cc:3060] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:28.072873 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e1393235534f46bd9ee5f875cdd944" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647" is_pre_election: true
I20260620 13:59:28.072402 14099 raft_consensus.cc:2468] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 0.
I20260620 13:59:28.072364 14100 raft_consensus.cc:2468] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 0.
I20260620 13:59:28.075268 14140 leader_election.cc:304] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:28.076144 14217 ts_tablet_manager.cc:1434] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.090s	user 0.036s	sys 0.039s
I20260620 13:59:28.073678 14025 raft_consensus.cc:2468] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 0.
I20260620 13:59:28.081132 14214 tablet_bootstrap.cc:492] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:28.081743 14214 ts_tablet_manager.cc:1403] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.093s	user 0.032s	sys 0.047s
I20260620 13:59:28.081911 14223 raft_consensus.cc:515] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.084811 14223 leader_election.cc:290] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:28.085152 14264 raft_consensus.cc:2804] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:28.085636 14264 raft_consensus.cc:493] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:28.085489 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29e05ada4be4b84903c875dce890372" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:28.085659 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29e05ada4be4b84903c875dce890372" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:28.086282 14100 raft_consensus.cc:3060] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:28.086735 14025 raft_consensus.cc:3060] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:28.087149 14214 raft_consensus.cc:359] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.087848 14214 raft_consensus.cc:385] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:28.088115 14214 raft_consensus.cc:740] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:28.088856 14214 consensus_queue.cc:260] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.086074 14264 raft_consensus.cc:3060] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:28.092593 14214 ts_tablet_manager.cc:1434] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260620 13:59:28.094070 14025 raft_consensus.cc:2468] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 1.
I20260620 13:59:28.095356 14100 raft_consensus.cc:2468] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 1.
I20260620 13:59:28.095920 14138 leader_election.cc:304] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:28.097164 14223 raft_consensus.cc:2804] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:28.097581 14229 raft_consensus.cc:493] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:28.098110 14229 raft_consensus.cc:515] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.100250 14229 leader_election.cc:290] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:28.101087 14264 raft_consensus.cc:515] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.102167 14173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62846366d99d41cd88aa9d766bbf6e9b" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:28.103044 14173 raft_consensus.cc:2393] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddd2d9da052f4f21838c60a4f143fdba in current term 1: Already voted for candidate f33b223a2a51440683343b1044c26647 in this term.
I20260620 13:59:28.103602 14229 raft_consensus.cc:493] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:28.104982 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e1393235534f46bd9ee5f875cdd944" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:28.105098 14229 raft_consensus.cc:515] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.105872 14024 raft_consensus.cc:3060] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:28.107549 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e1393235534f46bd9ee5f875cdd944" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:28.103633 14264 leader_election.cc:290] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:28.108820 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae371b2d718455abbbfafb14691c3e1" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647" is_pre_election: true
I20260620 13:59:28.109171 14100 raft_consensus.cc:3060] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:28.110812 14223 raft_consensus.cc:697] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:28.111857 14223 consensus_queue.cc:237] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.113086 14173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae371b2d718455abbbfafb14691c3e1" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:28.113448 14229 leader_election.cc:290] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:28.113920 14173 raft_consensus.cc:2393] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddd2d9da052f4f21838c60a4f143fdba in current term 1: Already voted for candidate f33b223a2a51440683343b1044c26647 in this term.
I20260620 13:59:28.115418 14064 leader_election.cc:304] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba; no voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647
I20260620 13:59:28.116541 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62846366d99d41cd88aa9d766bbf6e9b" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647" is_pre_election: true
I20260620 13:59:28.118482 14064 leader_election.cc:304] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba; no voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647
I20260620 13:59:28.119510 14218 raft_consensus.cc:3060] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:28.120541 14100 raft_consensus.cc:2468] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 1.
I20260620 13:59:28.120507 14024 raft_consensus.cc:2468] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 1.
I20260620 13:59:28.122148 14229 raft_consensus.cc:3060] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:28.122799 14138 leader_election.cc:304] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:28.124007 14268 raft_consensus.cc:2804] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:28.124572 14268 raft_consensus.cc:697] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:28.125418 14268 consensus_queue.cc:237] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.129345 14218 raft_consensus.cc:2749] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:28.131471 14229 raft_consensus.cc:2749] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:28.136462 14222 raft_consensus.cc:493] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:28.137022 14222 raft_consensus.cc:515] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.137478 13921 catalog_manager.cc:5696] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 1 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:28.139194 14222 leader_election.cc:290] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:28.140268 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8f78c35054fb680acf6668bfa8f57" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:28.140674 14173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8f78c35054fb680acf6668bfa8f57" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:28.140988 14100 raft_consensus.cc:2468] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 0.
I20260620 13:59:28.141305 14173 raft_consensus.cc:2468] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 0.
I20260620 13:59:28.142369 13989 leader_election.cc:304] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:28.143386 14222 raft_consensus.cc:2804] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:28.143711 14222 raft_consensus.cc:493] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:28.144011 14222 raft_consensus.cc:3060] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:28.149782 14222 raft_consensus.cc:515] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.152661 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8f78c35054fb680acf6668bfa8f57" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:28.152066 13921 catalog_manager.cc:5696] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 1 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:28.153247 14100 raft_consensus.cc:3060] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:28.153261 14222 leader_election.cc:290] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Requested vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:28.153492 14173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8f78c35054fb680acf6668bfa8f57" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:28.154215 14173 raft_consensus.cc:3060] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:28.161441 14100 raft_consensus.cc:2468] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 1.
I20260620 13:59:28.161798 14173 raft_consensus.cc:2468] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 1.
I20260620 13:59:28.162724 13991 leader_election.cc:304] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:28.163529 14222 raft_consensus.cc:2804] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:28.164054 14222 raft_consensus.cc:697] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Becoming Leader. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:28.164825 14222 consensus_queue.cc:237] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.172441 13921 catalog_manager.cc:5696] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 reported cstate change: term changed from 0 to 1, leader changed from <none> to f33b223a2a51440683343b1044c26647 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "f33b223a2a51440683343b1044c26647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:28.217855 14173 raft_consensus.cc:3060] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:28.224366 14222 consensus_queue.cc:1048] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:28.226881 14222 consensus_queue.cc:1048] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:28.241478 14248 consensus_queue.cc:1048] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:28.243064 14244 consensus_queue.cc:1048] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:28.286546 14099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4714f60c31e649ddba4445c6022d9dc3"
dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
mode: GRACEFUL
new_leader_uuid: "f33b223a2a51440683343b1044c26647"
 from {username='slave'} at 127.0.0.1:50582
I20260620 13:59:28.287285 14099 raft_consensus.cc:606] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 1 LEADER]: Received request to transfer leadership to TS f33b223a2a51440683343b1044c26647
I20260620 13:59:28.313923 14174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c29e05ada4be4b84903c875dce890372"
dest_uuid: "3072dd282fc542529a7558aafe37a46e"
mode: GRACEFUL
new_leader_uuid: "f33b223a2a51440683343b1044c26647"
 from {username='slave'} at 127.0.0.1:33242
I20260620 13:59:28.314662 14174 raft_consensus.cc:606] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Received request to transfer leadership to TS f33b223a2a51440683343b1044c26647
I20260620 13:59:28.328261 14025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cc8f78c35054fb680acf6668bfa8f57"
dest_uuid: "f33b223a2a51440683343b1044c26647"
mode: GRACEFUL
new_leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
 from {username='slave'} at 127.0.0.1:51344
I20260620 13:59:28.328809 14025 raft_consensus.cc:606] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Received request to transfer leadership to TS ddd2d9da052f4f21838c60a4f143fdba
I20260620 13:59:28.334493 14025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73e50c85167b4a6c83892dd58be19c79"
dest_uuid: "f33b223a2a51440683343b1044c26647"
mode: GRACEFUL
new_leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
 from {username='slave'} at 127.0.0.1:51344
I20260620 13:59:28.335372 14025 raft_consensus.cc:606] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Received request to transfer leadership to TS ddd2d9da052f4f21838c60a4f143fdba
I20260620 13:59:28.340715 14174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80e1393235534f46bd9ee5f875cdd944"
dest_uuid: "3072dd282fc542529a7558aafe37a46e"
mode: GRACEFUL
new_leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
 from {username='slave'} at 127.0.0.1:33242
I20260620 13:59:28.341404 14174 raft_consensus.cc:606] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Received request to transfer leadership to TS ddd2d9da052f4f21838c60a4f143fdba
I20260620 13:59:28.346566 14025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62846366d99d41cd88aa9d766bbf6e9b"
dest_uuid: "f33b223a2a51440683343b1044c26647"
mode: GRACEFUL
new_leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
 from {username='slave'} at 127.0.0.1:51344
I20260620 13:59:28.347029 14025 raft_consensus.cc:606] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Received request to transfer leadership to TS ddd2d9da052f4f21838c60a4f143fdba
I20260620 13:59:28.352144 14025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aae371b2d718455abbbfafb14691c3e1"
dest_uuid: "f33b223a2a51440683343b1044c26647"
mode: GRACEFUL
new_leader_uuid: "3072dd282fc542529a7558aafe37a46e"
 from {username='slave'} at 127.0.0.1:51344
I20260620 13:59:28.352654 14025 raft_consensus.cc:606] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Received request to transfer leadership to TS 3072dd282fc542529a7558aafe37a46e
I20260620 13:59:28.363133 14222 consensus_queue.cc:1048] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:28.370429 14244 raft_consensus.cc:993] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647: : Instructing follower 3072dd282fc542529a7558aafe37a46e to start an election
I20260620 13:59:28.370985 14244 raft_consensus.cc:1081] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Signalling peer 3072dd282fc542529a7558aafe37a46e to start an election
I20260620 13:59:28.372393 14243 consensus_queue.cc:1048] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:28.372782 14172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aae371b2d718455abbbfafb14691c3e1"
dest_uuid: "3072dd282fc542529a7558aafe37a46e"
 from {username='slave'} at 127.0.0.1:33232
I20260620 13:59:28.373529 14172 raft_consensus.cc:493] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:28.374214 14172 raft_consensus.cc:3060] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.377528 14244 consensus_queue.cc:1048] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:28.389407 14243 raft_consensus.cc:993] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647: : Instructing follower ddd2d9da052f4f21838c60a4f143fdba to start an election
I20260620 13:59:28.389855 14243 raft_consensus.cc:1081] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Signalling peer ddd2d9da052f4f21838c60a4f143fdba to start an election
I20260620 13:59:28.394161 14099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73e50c85167b4a6c83892dd58be19c79"
dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
 from {username='slave'} at 127.0.0.1:50558
I20260620 13:59:28.394901 14099 raft_consensus.cc:493] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:28.395334 14099 raft_consensus.cc:3060] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.395974 14172 raft_consensus.cc:515] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.398630 14172 leader_election.cc:290] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:28.400236 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae371b2d718455abbbfafb14691c3e1" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:28.400976 14025 raft_consensus.cc:3055] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:28.401391 14025 raft_consensus.cc:740] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:28.402021 14174 raft_consensus.cc:1240] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Rejecting Update request from peer f33b223a2a51440683343b1044c26647 for earlier term 1. Current term is 2. Ops: []
I20260620 13:59:28.402240 14025 consensus_queue.cc:260] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.400257 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae371b2d718455abbbfafb14691c3e1" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:28.403533 14025 raft_consensus.cc:3060] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.403832 14098 raft_consensus.cc:3060] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.401081 14248 consensus_queue.cc:1048] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:28.407500 14099 raft_consensus.cc:515] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.410140 14100 raft_consensus.cc:1240] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Rejecting Update request from peer f33b223a2a51440683343b1044c26647 for earlier term 1. Current term is 2. Ops: []
I20260620 13:59:28.411140 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e50c85167b4a6c83892dd58be19c79" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:28.411324 14025 raft_consensus.cc:2468] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 2.
I20260620 13:59:28.411926 14024 raft_consensus.cc:3055] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:28.412315 14024 raft_consensus.cc:740] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:28.413276 14138 leader_election.cc:304] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:28.414103 14243 consensus_queue.cc:1048] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:28.414439 14268 raft_consensus.cc:2804] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:28.414918 14268 raft_consensus.cc:697] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [term 2 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:28.415787 14268 consensus_queue.cc:237] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.416496 14098 raft_consensus.cc:2468] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 2.
I20260620 13:59:28.416723 14099 leader_election.cc:290] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:28.418716 14173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e50c85167b4a6c83892dd58be19c79" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:28.413412 14024 consensus_queue.cc:260] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.421073 14024 raft_consensus.cc:3060] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:59:28.424685 14244 consensus_queue.cc:1175] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ddd2d9da052f4f21838c60a4f143fdba" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f33b223a2a51440683343b1044c26647 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260620 13:59:28.429090 14024 raft_consensus.cc:2468] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 2.
I20260620 13:59:28.430675 14064 leader_election.cc:304] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 3072dd282fc542529a7558aafe37a46e
I20260620 13:59:28.431594 14229 raft_consensus.cc:2804] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:28.432150 14229 raft_consensus.cc:697] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Becoming Leader. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:28.433050 14222 consensus_queue.cc:1048] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:28.433048 14229 consensus_queue.cc:237] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.434226 13921 catalog_manager.cc:5696] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 1 to 2, leader changed from f33b223a2a51440683343b1044c26647 (127.4.155.193) to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 2 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:28.447217 13923 catalog_manager.cc:5696] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba reported cstate change: term changed from 1 to 2, leader changed from f33b223a2a51440683343b1044c26647 (127.4.155.193) to ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194). New cstate: current_term: 2 leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:28.454079 14229 consensus_queue.cc:1048] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:28.468559 14229 consensus_queue.cc:1048] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:28.478858 14218 raft_consensus.cc:993] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba: : Instructing follower f33b223a2a51440683343b1044c26647 to start an election
I20260620 13:59:28.479367 14218 raft_consensus.cc:1081] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 1 LEADER]: Signalling peer f33b223a2a51440683343b1044c26647 to start an election
I20260620 13:59:28.481103 14024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4714f60c31e649ddba4445c6022d9dc3"
dest_uuid: "f33b223a2a51440683343b1044c26647"
 from {username='slave'} at 127.0.0.1:51320
I20260620 13:59:28.481689 14024 raft_consensus.cc:493] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:28.482069 14024 raft_consensus.cc:3060] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.488204 14024 raft_consensus.cc:515] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.490021 14024 leader_election.cc:290] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 2 election: Requested vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:28.491163 14172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4714f60c31e649ddba4445c6022d9dc3" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:28.491035 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4714f60c31e649ddba4445c6022d9dc3" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:28.491899 14172 raft_consensus.cc:3060] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.491981 14098 raft_consensus.cc:3055] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:28.492388 14098 raft_consensus.cc:740] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:28.493260 14098 consensus_queue.cc:260] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.494663 14098 raft_consensus.cc:3060] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.500084 14172 raft_consensus.cc:2468] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 2.
I20260620 13:59:28.501714 13989 leader_election.cc:304] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:28.502192 14098 raft_consensus.cc:2468] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 2.
I20260620 13:59:28.502437 14222 raft_consensus.cc:2804] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:28.502965 14222 raft_consensus.cc:697] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 2 LEADER]: Becoming Leader. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:28.503841 14222 consensus_queue.cc:237] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.510375 13923 catalog_manager.cc:5696] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 reported cstate change: term changed from 1 to 2, leader changed from ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194) to f33b223a2a51440683343b1044c26647 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "f33b223a2a51440683343b1044c26647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:28.548509 14222 consensus_queue.cc:1048] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:28.554908 14248 raft_consensus.cc:993] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647: : Instructing follower ddd2d9da052f4f21838c60a4f143fdba to start an election
I20260620 13:59:28.555629 14244 raft_consensus.cc:1081] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Signalling peer ddd2d9da052f4f21838c60a4f143fdba to start an election
I20260620 13:59:28.557687 14099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cc8f78c35054fb680acf6668bfa8f57"
dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
 from {username='slave'} at 127.0.0.1:50558
I20260620 13:59:28.558430 14099 raft_consensus.cc:493] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:28.558806 14099 raft_consensus.cc:3060] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.560437 14222 consensus_queue.cc:1048] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:28.564200 14268 consensus_queue.cc:1048] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:28.568157 14099 raft_consensus.cc:515] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.572729 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8f78c35054fb680acf6668bfa8f57" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:28.573536 14024 raft_consensus.cc:3055] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:28.573894 14024 raft_consensus.cc:740] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:28.574106 14098 raft_consensus.cc:1240] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Rejecting Update request from peer f33b223a2a51440683343b1044c26647 for earlier term 1. Current term is 2. Ops: []
I20260620 13:59:28.576051 14099 leader_election.cc:290] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:28.574846 14024 consensus_queue.cc:260] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.579350 14024 raft_consensus.cc:3060] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:59:28.581069 14244 consensus_queue.cc:1175] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ddd2d9da052f4f21838c60a4f143fdba" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f33b223a2a51440683343b1044c26647 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260620 13:59:28.582685 14222 consensus_queue.cc:1175] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3072dd282fc542529a7558aafe37a46e" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260620 13:59:28.583670 14264 consensus_queue.cc:1048] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:28.585216 14172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8f78c35054fb680acf6668bfa8f57" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:28.585870 14172 raft_consensus.cc:3060] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.589113 14024 raft_consensus.cc:2468] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 2.
I20260620 13:59:28.592244 14223 consensus_queue.cc:1048] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:28.594506 14064 leader_election.cc:304] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:28.595429 14288 raft_consensus.cc:2804] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:28.595876 14172 raft_consensus.cc:2468] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 2.
I20260620 13:59:28.596007 14288 raft_consensus.cc:697] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Becoming Leader. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:28.597348 14288 consensus_queue.cc:237] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.601254 14223 raft_consensus.cc:993] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e: : Instructing follower f33b223a2a51440683343b1044c26647 to start an election
I20260620 13:59:28.601804 14223 raft_consensus.cc:1081] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Signalling peer f33b223a2a51440683343b1044c26647 to start an election
I20260620 13:59:28.605719 14025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c29e05ada4be4b84903c875dce890372"
dest_uuid: "f33b223a2a51440683343b1044c26647"
 from {username='slave'} at 127.0.0.1:51328
I20260620 13:59:28.606451 14025 raft_consensus.cc:493] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:28.606835 14025 raft_consensus.cc:3060] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.608830 14268 raft_consensus.cc:993] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e: : Instructing follower ddd2d9da052f4f21838c60a4f143fdba to start an election
I20260620 13:59:28.609326 14223 raft_consensus.cc:1081] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Signalling peer ddd2d9da052f4f21838c60a4f143fdba to start an election
I20260620 13:59:28.608742 13923 catalog_manager.cc:5696] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba reported cstate change: term changed from 1 to 2, leader changed from f33b223a2a51440683343b1044c26647 (127.4.155.193) to ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194). New cstate: current_term: 2 leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:28.614591 14025 raft_consensus.cc:515] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.616638 14099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80e1393235534f46bd9ee5f875cdd944"
dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
 from {username='slave'} at 127.0.0.1:50572
I20260620 13:59:28.617566 14099 raft_consensus.cc:493] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:28.617942 14099 raft_consensus.cc:3060] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.618261 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29e05ada4be4b84903c875dce890372" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:28.619150 14098 raft_consensus.cc:3060] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.624487 14264 consensus_queue.cc:1048] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:28.626426 14099 raft_consensus.cc:515] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.627990 14025 leader_election.cc:290] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 2 election: Requested vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:28.628871 14099 leader_election.cc:290] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:28.630340 14098 raft_consensus.cc:2468] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 2.
I20260620 13:59:28.630581 14172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e1393235534f46bd9ee5f875cdd944" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:28.631074 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29e05ada4be4b84903c875dce890372" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:28.631203 14172 raft_consensus.cc:3055] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:28.631722 14172 raft_consensus.cc:740] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:28.631780 14174 raft_consensus.cc:3055] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:28.632267 13991 leader_election.cc:304] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:28.632386 14174 raft_consensus.cc:740] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:28.633107 14222 raft_consensus.cc:2804] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:28.633510 14174 consensus_queue.cc:260] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.633653 14222 raft_consensus.cc:697] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [term 2 LEADER]: Becoming Leader. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:28.635178 14174 raft_consensus.cc:3060] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.635752 14222 consensus_queue.cc:237] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.632896 14172 consensus_queue.cc:260] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.637776 14172 raft_consensus.cc:3060] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.642946 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e1393235534f46bd9ee5f875cdd944" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:28.647151 14172 raft_consensus.cc:2468] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 2.
I20260620 13:59:28.649369 14064 leader_election.cc:304] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:28.650202 14288 raft_consensus.cc:2804] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:28.650734 14288 raft_consensus.cc:697] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Becoming Leader. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:28.651638 14288 consensus_queue.cc:237] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.652669 13923 catalog_manager.cc:5696] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 reported cstate change: term changed from 1 to 2, leader changed from 3072dd282fc542529a7558aafe37a46e (127.4.155.195) to f33b223a2a51440683343b1044c26647 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "f33b223a2a51440683343b1044c26647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:28.655275 14174 raft_consensus.cc:2468] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 2.
I20260620 13:59:28.664978 13922 catalog_manager.cc:5696] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba reported cstate change: term changed from 1 to 2, leader changed from 3072dd282fc542529a7558aafe37a46e (127.4.155.195) to ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194). New cstate: current_term: 2 leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:28.670624 14244 raft_consensus.cc:993] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647: : Instructing follower ddd2d9da052f4f21838c60a4f143fdba to start an election
I20260620 13:59:28.671212 14244 raft_consensus.cc:1081] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Signalling peer ddd2d9da052f4f21838c60a4f143fdba to start an election
I20260620 13:59:28.672788 14098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62846366d99d41cd88aa9d766bbf6e9b"
dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
 from {username='slave'} at 127.0.0.1:50558
I20260620 13:59:28.673427 14098 raft_consensus.cc:493] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:28.673804 14098 raft_consensus.cc:3060] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.682623 14098 raft_consensus.cc:515] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.685827 14098 leader_election.cc:290] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:28.686816 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62846366d99d41cd88aa9d766bbf6e9b" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:28.687567 14024 raft_consensus.cc:3055] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:28.688038 14024 raft_consensus.cc:740] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:28.688977 14024 consensus_queue.cc:260] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.690056 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62846366d99d41cd88aa9d766bbf6e9b" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:28.690351 14024 raft_consensus.cc:3060] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.690682 14174 raft_consensus.cc:3060] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.698427 14024 raft_consensus.cc:2468] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 2.
I20260620 13:59:28.701066 14174 raft_consensus.cc:2468] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 2.
I20260620 13:59:28.703336 14064 leader_election.cc:304] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:28.704145 14288 raft_consensus.cc:2804] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:28.704640 14288 raft_consensus.cc:697] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Becoming Leader. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:28.705447 14288 consensus_queue.cc:237] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:28.714666 13923 catalog_manager.cc:5696] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba reported cstate change: term changed from 1 to 2, leader changed from f33b223a2a51440683343b1044c26647 (127.4.155.193) to ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194). New cstate: current_term: 2 leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:28.865197 14098 raft_consensus.cc:1275] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:28.866545 14264 consensus_queue.cc:1048] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:28.876334 14024 raft_consensus.cc:1275] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:28.878343 14264 consensus_queue.cc:1048] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:28.910562 14174 raft_consensus.cc:3060] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:28.916117 14174 raft_consensus.cc:1275] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:28.917614 14288 consensus_queue.cc:1048] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:28.927570 14024 raft_consensus.cc:1275] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:28.929030 14288 consensus_queue.cc:1048] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:29.035598 14174 raft_consensus.cc:1275] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:29.036952 14288 consensus_queue.cc:1048] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:29.045471 14024 raft_consensus.cc:3060] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:29.052908 14024 raft_consensus.cc:1275] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:29.053969 14288 consensus_queue.cc:1048] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:29.057235 14098 raft_consensus.cc:1275] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Refusing update from remote peer f33b223a2a51440683343b1044c26647: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:29.059239 14248 consensus_queue.cc:1048] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:29.071645 14174 raft_consensus.cc:1275] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Refusing update from remote peer f33b223a2a51440683343b1044c26647: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:29.071697 14172 raft_consensus.cc:1275] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Refusing update from remote peer f33b223a2a51440683343b1044c26647: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:29.074024 14244 consensus_queue.cc:1048] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:29.074014 14298 consensus_queue.cc:1048] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:29.087670 14098 raft_consensus.cc:1275] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Refusing update from remote peer f33b223a2a51440683343b1044c26647: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:29.089249 14244 consensus_queue.cc:1048] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:29.185169 14174 raft_consensus.cc:1275] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:29.186561 14288 consensus_queue.cc:1048] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:29.188185 14174 raft_consensus.cc:1275] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:29.189633 14288 consensus_queue.cc:1048] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:29.196554 14024 raft_consensus.cc:1275] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:29.201493 14229 consensus_queue.cc:1048] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:29.202003 14024 raft_consensus.cc:1275] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:29.206871 14229 consensus_queue.cc:1048] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:31.384914 13921 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43032:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260620 13:59:31.388279 13921 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 13:59:31.436844 14011 tablet_service.cc:1511] Processing CreateTablet for tablet 59f03a1afd8f48dc8e6e392ffc42d79a (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260620 13:59:31.438163 14011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f03a1afd8f48dc8e6e392ffc42d79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.439548 14160 tablet_service.cc:1511] Processing CreateTablet for tablet 59f03a1afd8f48dc8e6e392ffc42d79a (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260620 13:59:31.440802 14160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f03a1afd8f48dc8e6e392ffc42d79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.440500 14009 tablet_service.cc:1511] Processing CreateTablet for tablet 4b31b6740d1843e4b84795a8f90e8597 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260620 13:59:31.441857 14009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b31b6740d1843e4b84795a8f90e8597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.437831 14086 tablet_service.cc:1511] Processing CreateTablet for tablet 59f03a1afd8f48dc8e6e392ffc42d79a (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260620 13:59:31.443949 14086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f03a1afd8f48dc8e6e392ffc42d79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.452117 14084 tablet_service.cc:1511] Processing CreateTablet for tablet 4b31b6740d1843e4b84795a8f90e8597 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260620 13:59:31.453464 14084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b31b6740d1843e4b84795a8f90e8597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.457082 14090 tablet_service.cc:1511] Processing CreateTablet for tablet 2cc6a0775dcd4ff2aeba8d1ac782fcc8 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260620 13:59:31.458607 14090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cc6a0775dcd4ff2aeba8d1ac782fcc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.465786 14012 tablet_service.cc:1511] Processing CreateTablet for tablet 2cc6a0775dcd4ff2aeba8d1ac782fcc8 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260620 13:59:31.467156 14012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cc6a0775dcd4ff2aeba8d1ac782fcc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.465523 14164 tablet_service.cc:1511] Processing CreateTablet for tablet 4b31b6740d1843e4b84795a8f90e8597 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260620 13:59:31.469614 14164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b31b6740d1843e4b84795a8f90e8597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.483505 14312 tablet_bootstrap.cc:492] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:31.492219 14312 tablet_bootstrap.cc:654] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.493908 14311 tablet_bootstrap.cc:492] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:31.501166 14311 tablet_bootstrap.cc:654] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.501194 14159 tablet_service.cc:1511] Processing CreateTablet for tablet 2cc6a0775dcd4ff2aeba8d1ac782fcc8 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260620 13:59:31.503507 14159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cc6a0775dcd4ff2aeba8d1ac782fcc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.503813 14084 tablet_service.cc:1511] Processing CreateTablet for tablet 0f4ac4bcd198440290b0bc35a20ab7d0 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260620 13:59:31.505191 14084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f4ac4bcd198440290b0bc35a20ab7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.504755 14158 tablet_service.cc:1511] Processing CreateTablet for tablet 0f4ac4bcd198440290b0bc35a20ab7d0 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260620 13:59:31.508777 14158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f4ac4bcd198440290b0bc35a20ab7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.510604 14314 tablet_bootstrap.cc:492] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:31.510289 14011 tablet_service.cc:1511] Processing CreateTablet for tablet 0f4ac4bcd198440290b0bc35a20ab7d0 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260620 13:59:31.515159 14011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f4ac4bcd198440290b0bc35a20ab7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.517835 14314 tablet_bootstrap.cc:654] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.531334 14013 tablet_service.cc:1511] Processing CreateTablet for tablet ea63887d03ad488097661550c7efb41f (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260620 13:59:31.532891 14013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea63887d03ad488097661550c7efb41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.538756 14311 tablet_bootstrap.cc:492] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
I20260620 13:59:31.539552 14311 ts_tablet_manager.cc:1403] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.005s
I20260620 13:59:31.542670 14086 tablet_service.cc:1511] Processing CreateTablet for tablet ea63887d03ad488097661550c7efb41f (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260620 13:59:31.545707 14160 tablet_service.cc:1511] Processing CreateTablet for tablet ea63887d03ad488097661550c7efb41f (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260620 13:59:31.547024 14086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea63887d03ad488097661550c7efb41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.547024 14160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea63887d03ad488097661550c7efb41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.547575 14014 tablet_service.cc:1511] Processing CreateTablet for tablet 77511ca3f725427699c041aeb81e6905 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260620 13:59:31.549064 14014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77511ca3f725427699c041aeb81e6905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.551964 14083 tablet_service.cc:1511] Processing CreateTablet for tablet 77511ca3f725427699c041aeb81e6905 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260620 13:59:31.553320 14083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77511ca3f725427699c041aeb81e6905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.542929 14311 raft_consensus.cc:359] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.560614 14311 raft_consensus.cc:385] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.561048 14311 raft_consensus.cc:740] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.550828 14312 tablet_bootstrap.cc:492] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:31.562423 14312 ts_tablet_manager.cc:1403] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.006s
I20260620 13:59:31.562037 14311 consensus_queue.cc:260] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.566021 14312 raft_consensus.cc:359] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.566859 14312 raft_consensus.cc:385] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.567246 14312 raft_consensus.cc:740] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.568557 14311 ts_tablet_manager.cc:1434] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260620 13:59:31.577147 14244 raft_consensus.cc:493] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:31.577729 14244 raft_consensus.cc:515] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.578740 14312 consensus_queue.cc:260] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.579849 14244 leader_election.cc:290] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:31.582798 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03a1afd8f48dc8e6e392ffc42d79a" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:31.584369 14172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03a1afd8f48dc8e6e392ffc42d79a" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
W20260620 13:59:31.586205 13989 leader_election.cc:343] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:59:31.587770 13991 leader_election.cc:343] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:31.588450 13991 leader_election.cc:304] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f33b223a2a51440683343b1044c26647; no voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba
I20260620 13:59:31.590057 14244 raft_consensus.cc:2749] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:31.598369 14311 tablet_bootstrap.cc:492] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:31.605965 14312 ts_tablet_manager.cc:1434] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.014s
I20260620 13:59:31.606464 14311 tablet_bootstrap.cc:654] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.609337 14314 tablet_bootstrap.cc:492] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:31.610005 14314 ts_tablet_manager.cc:1403] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.100s	user 0.008s	sys 0.020s
I20260620 13:59:31.607234 14312 tablet_bootstrap.cc:492] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:31.612879 14086 tablet_service.cc:1511] Processing CreateTablet for tablet 6d68cc99fffb46cbb317cf1f588857d2 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260620 13:59:31.613312 14314 raft_consensus.cc:359] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.613729 14160 tablet_service.cc:1511] Processing CreateTablet for tablet 77511ca3f725427699c041aeb81e6905 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260620 13:59:31.614300 14086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d68cc99fffb46cbb317cf1f588857d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.614964 14160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77511ca3f725427699c041aeb81e6905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.614292 14314 raft_consensus.cc:385] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.623705 14314 raft_consensus.cc:740] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.624567 14314 consensus_queue.cc:260] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.619742 14312 tablet_bootstrap.cc:654] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.625216 14011 tablet_service.cc:1511] Processing CreateTablet for tablet e9a8bd236b6340ffae12764b4599066b (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260620 13:59:31.626019 14311 tablet_bootstrap.cc:492] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
I20260620 13:59:31.620549 14013 tablet_service.cc:1511] Processing CreateTablet for tablet 6d68cc99fffb46cbb317cf1f588857d2 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260620 13:59:31.621418 14083 tablet_service.cc:1511] Processing CreateTablet for tablet e9a8bd236b6340ffae12764b4599066b (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260620 13:59:31.622848 14158 tablet_service.cc:1511] Processing CreateTablet for tablet 6d68cc99fffb46cbb317cf1f588857d2 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260620 13:59:31.626533 14311 ts_tablet_manager.cc:1403] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.028s	user 0.004s	sys 0.009s
I20260620 13:59:31.632712 14083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a8bd236b6340ffae12764b4599066b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.626603 14011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a8bd236b6340ffae12764b4599066b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.637298 14311 raft_consensus.cc:359] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.638278 14311 raft_consensus.cc:385] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.638656 14311 raft_consensus.cc:740] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.639899 14158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d68cc99fffb46cbb317cf1f588857d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.639670 14311 consensus_queue.cc:260] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.630340 14084 tablet_service.cc:1511] Processing CreateTablet for tablet a94b124bc8d6430ba3a7d70fc5d4fec2 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260620 13:59:31.644668 14084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a94b124bc8d6430ba3a7d70fc5d4fec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.645706 14314 ts_tablet_manager.cc:1434] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.035s	user 0.000s	sys 0.006s
I20260620 13:59:31.646132 14311 ts_tablet_manager.cc:1434] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260620 13:59:31.647349 14311 tablet_bootstrap.cc:492] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:31.652029 14013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d68cc99fffb46cbb317cf1f588857d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.654647 14311 tablet_bootstrap.cc:654] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.659394 14314 tablet_bootstrap.cc:492] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:31.669945 14159 tablet_service.cc:1511] Processing CreateTablet for tablet e9a8bd236b6340ffae12764b4599066b (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260620 13:59:31.670603 14014 tablet_service.cc:1511] Processing CreateTablet for tablet a94b124bc8d6430ba3a7d70fc5d4fec2 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260620 13:59:31.671535 14159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a8bd236b6340ffae12764b4599066b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.672060 14014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a94b124bc8d6430ba3a7d70fc5d4fec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.670749 14164 tablet_service.cc:1511] Processing CreateTablet for tablet a94b124bc8d6430ba3a7d70fc5d4fec2 (DEFAULT_TABLE table=soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260620 13:59:31.676508 14164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a94b124bc8d6430ba3a7d70fc5d4fec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:31.678201 14314 tablet_bootstrap.cc:654] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.693394 14312 tablet_bootstrap.cc:492] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:31.694005 14312 ts_tablet_manager.cc:1403] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.087s	user 0.035s	sys 0.017s
I20260620 13:59:31.697721 14312 raft_consensus.cc:359] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.702085 14312 raft_consensus.cc:385] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.702934 14312 raft_consensus.cc:740] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.704207 14312 consensus_queue.cc:260] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.708470 14312 ts_tablet_manager.cc:1434] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260620 13:59:31.711575 14311 tablet_bootstrap.cc:492] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
I20260620 13:59:31.711862 14312 tablet_bootstrap.cc:492] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:31.712301 14311 ts_tablet_manager.cc:1403] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.001s
I20260620 13:59:31.715978 14311 raft_consensus.cc:359] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.718727 14312 tablet_bootstrap.cc:654] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.718868 14311 raft_consensus.cc:385] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.719408 14311 raft_consensus.cc:740] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.723541 14311 consensus_queue.cc:260] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.725970 14314 tablet_bootstrap.cc:492] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:31.726897 14314 ts_tablet_manager.cc:1403] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.068s	user 0.030s	sys 0.001s
W20260620 13:59:31.730580 13971 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:59:31.730362 14314 raft_consensus.cc:359] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.731254 14314 raft_consensus.cc:385] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.731562 14314 raft_consensus.cc:740] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.732270 14314 consensus_queue.cc:260] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.735697 14314 ts_tablet_manager.cc:1434] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260620 13:59:31.736752 14314 tablet_bootstrap.cc:492] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:31.741269 14311 ts_tablet_manager.cc:1434] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.002s
I20260620 13:59:31.742273 14311 tablet_bootstrap.cc:492] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:31.750291 14314 tablet_bootstrap.cc:654] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.761524 14311 tablet_bootstrap.cc:654] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.765013 14312 tablet_bootstrap.cc:492] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:31.765643 14312 ts_tablet_manager.cc:1403] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.015s
I20260620 13:59:31.769038 14312 raft_consensus.cc:359] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.770032 14312 raft_consensus.cc:385] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.770529 14312 raft_consensus.cc:740] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.771059 14314 tablet_bootstrap.cc:492] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:31.772099 14314 ts_tablet_manager.cc:1403] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.004s
I20260620 13:59:31.771598 14312 consensus_queue.cc:260] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.772573 14311 tablet_bootstrap.cc:492] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
I20260620 13:59:31.773226 14311 ts_tablet_manager.cc:1403] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.010s
I20260620 13:59:31.774555 14312 ts_tablet_manager.cc:1434] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260620 13:59:31.775362 14314 raft_consensus.cc:359] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.776154 14314 raft_consensus.cc:385] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.776564 14314 raft_consensus.cc:740] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.776208 14311 raft_consensus.cc:359] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.777343 14311 raft_consensus.cc:385] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.777812 14311 raft_consensus.cc:740] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.777415 14314 consensus_queue.cc:260] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.779043 14311 consensus_queue.cc:260] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.780124 14314 ts_tablet_manager.cc:1434] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260620 13:59:31.781188 14314 tablet_bootstrap.cc:492] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:31.781795 14311 ts_tablet_manager.cc:1434] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260620 13:59:31.782928 14311 tablet_bootstrap.cc:492] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:31.789252 14314 tablet_bootstrap.cc:654] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.789750 14311 tablet_bootstrap.cc:654] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.788975 14312 tablet_bootstrap.cc:492] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:31.809306 14312 tablet_bootstrap.cc:654] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.816061 14314 tablet_bootstrap.cc:492] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:31.816680 14311 tablet_bootstrap.cc:492] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
I20260620 13:59:31.816763 14314 ts_tablet_manager.cc:1403] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.028s
I20260620 13:59:31.817418 14311 ts_tablet_manager.cc:1403] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.010s
I20260620 13:59:31.820412 14314 raft_consensus.cc:359] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.820762 14311 raft_consensus.cc:359] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.821408 14314 raft_consensus.cc:385] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.821689 14311 raft_consensus.cc:385] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.821770 14312 tablet_bootstrap.cc:492] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:31.821827 14314 raft_consensus.cc:740] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.822549 14312 ts_tablet_manager.cc:1403] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.005s
I20260620 13:59:31.822065 14311 raft_consensus.cc:740] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.823158 14314 consensus_queue.cc:260] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.825670 14314 ts_tablet_manager.cc:1434] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260620 13:59:31.825735 14312 raft_consensus.cc:359] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.826462 14312 raft_consensus.cc:385] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.826804 14312 raft_consensus.cc:740] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.826876 14314 tablet_bootstrap.cc:492] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:31.823515 14311 consensus_queue.cc:260] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.832614 14311 ts_tablet_manager.cc:1434] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260620 13:59:31.833810 14311 tablet_bootstrap.cc:492] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:31.834499 14314 tablet_bootstrap.cc:654] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.832190 14312 consensus_queue.cc:260] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.840719 14311 tablet_bootstrap.cc:654] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.841693 14314 tablet_bootstrap.cc:492] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:31.842237 14312 ts_tablet_manager.cc:1434] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260620 13:59:31.842352 14314 ts_tablet_manager.cc:1403] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260620 13:59:31.845679 14312 tablet_bootstrap.cc:492] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:31.846212 14314 raft_consensus.cc:359] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.847427 14314 raft_consensus.cc:385] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.847698 14325 raft_consensus.cc:493] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:31.847888 14314 raft_consensus.cc:740] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.848268 14325 raft_consensus.cc:515] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.849265 14314 consensus_queue.cc:260] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.852080 14314 ts_tablet_manager.cc:1434] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260620 13:59:31.853144 14314 tablet_bootstrap.cc:492] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:31.854295 14172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77511ca3f725427699c041aeb81e6905" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:31.854609 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77511ca3f725427699c041aeb81e6905" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
W20260620 13:59:31.856091 13989 leader_election.cc:343] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:31.858723 14311 tablet_bootstrap.cc:492] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
W20260620 13:59:31.858925 13991 leader_election.cc:343] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:31.859351 14311 ts_tablet_manager.cc:1403] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.008s
I20260620 13:59:31.859503 13991 leader_election.cc:304] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f33b223a2a51440683343b1044c26647; no voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba
I20260620 13:59:31.860460 14244 raft_consensus.cc:2749] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:31.860692 14314 tablet_bootstrap.cc:654] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.862874 14311 raft_consensus.cc:359] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.863685 14311 raft_consensus.cc:385] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.863781 14325 leader_election.cc:290] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:31.864121 14311 raft_consensus.cc:740] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.865085 14311 consensus_queue.cc:260] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.868978 14311 ts_tablet_manager.cc:1434] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260620 13:59:31.871076 14311 tablet_bootstrap.cc:492] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:31.873734 14314 tablet_bootstrap.cc:492] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:31.874369 14314 ts_tablet_manager.cc:1403] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.006s
I20260620 13:59:31.874797 14312 tablet_bootstrap.cc:654] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.879155 14314 raft_consensus.cc:359] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.880138 14314 raft_consensus.cc:385] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.880511 14314 raft_consensus.cc:740] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.881408 14314 consensus_queue.cc:260] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.883913 14314 ts_tablet_manager.cc:1434] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260620 13:59:31.885094 14314 tablet_bootstrap.cc:492] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:31.888213 14311 tablet_bootstrap.cc:654] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.892889 14314 tablet_bootstrap.cc:654] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.896790 14312 tablet_bootstrap.cc:492] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:31.897331 14312 ts_tablet_manager.cc:1403] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.004s
I20260620 13:59:31.900317 14312 raft_consensus.cc:359] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.900895 14312 raft_consensus.cc:385] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.901157 14312 raft_consensus.cc:740] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.901326 14311 tablet_bootstrap.cc:492] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
I20260620 13:59:31.902024 14311 ts_tablet_manager.cc:1403] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.003s
I20260620 13:59:31.901858 14312 consensus_queue.cc:260] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.904275 14312 ts_tablet_manager.cc:1434] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260620 13:59:31.904538 14314 tablet_bootstrap.cc:492] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:31.905057 14314 ts_tablet_manager.cc:1403] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260620 13:59:31.905265 14312 tablet_bootstrap.cc:492] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:31.905622 14311 raft_consensus.cc:359] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.906392 14311 raft_consensus.cc:385] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.906692 14311 raft_consensus.cc:740] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.907456 14311 consensus_queue.cc:260] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.908239 14314 raft_consensus.cc:359] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.909019 14314 raft_consensus.cc:385] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.909327 14314 raft_consensus.cc:740] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.910244 14311 ts_tablet_manager.cc:1434] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260620 13:59:31.910473 14314 consensus_queue.cc:260] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.912958 14314 ts_tablet_manager.cc:1434] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260620 13:59:31.911383 14311 tablet_bootstrap.cc:492] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:31.914009 14314 tablet_bootstrap.cc:492] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:31.921337 14314 tablet_bootstrap.cc:654] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.923465 14311 tablet_bootstrap.cc:654] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.923914 14312 tablet_bootstrap.cc:654] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.936743 14314 tablet_bootstrap.cc:492] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:31.937232 14314 ts_tablet_manager.cc:1403] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260620 13:59:31.939163 14311 tablet_bootstrap.cc:492] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
I20260620 13:59:31.939688 14311 ts_tablet_manager.cc:1403] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.006s
I20260620 13:59:31.939935 14314 raft_consensus.cc:359] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.940647 14314 raft_consensus.cc:385] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.940930 14314 raft_consensus.cc:740] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.941654 14314 consensus_queue.cc:260] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.943735 14314 ts_tablet_manager.cc:1434] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260620 13:59:31.944895 14314 tablet_bootstrap.cc:492] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e: Bootstrap starting.
I20260620 13:59:31.945916 14299 raft_consensus.cc:493] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:31.946487 14299 raft_consensus.cc:515] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.948679 14299 leader_election.cc:290] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:31.951234 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03a1afd8f48dc8e6e392ffc42d79a" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647" is_pre_election: true
I20260620 13:59:31.951810 14311 raft_consensus.cc:359] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.951958 14025 raft_consensus.cc:2468] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 0.
I20260620 13:59:31.952530 14311 raft_consensus.cc:385] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.952841 14311 raft_consensus.cc:740] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.954089 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03a1afd8f48dc8e6e392ffc42d79a" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:31.954761 14098 raft_consensus.cc:2468] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 0.
I20260620 13:59:31.954283 14311 consensus_queue.cc:260] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.955473 14325 raft_consensus.cc:493] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:31.955797 14138 leader_election.cc:304] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:31.956030 14325 raft_consensus.cc:515] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.956631 14311 ts_tablet_manager.cc:1434] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.001s
I20260620 13:59:31.957015 14299 raft_consensus.cc:2804] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:31.957406 14299 raft_consensus.cc:493] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:31.957667 14311 tablet_bootstrap.cc:492] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647: Bootstrap starting.
I20260620 13:59:31.957733 14299 raft_consensus.cc:3060] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:31.960000 14172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b31b6740d1843e4b84795a8f90e8597" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:31.960764 14314 tablet_bootstrap.cc:654] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.960698 14172 raft_consensus.cc:2468] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 0.
I20260620 13:59:31.962071 13989 leader_election.cc:304] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:31.962101 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b31b6740d1843e4b84795a8f90e8597" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:31.962831 14098 raft_consensus.cc:2468] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 0.
I20260620 13:59:31.962996 14244 raft_consensus.cc:2804] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:31.963418 14244 raft_consensus.cc:493] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:31.963766 14244 raft_consensus.cc:3060] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:31.964747 14311 tablet_bootstrap.cc:654] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:31.969787 14299 raft_consensus.cc:515] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.969436 14325 leader_election.cc:290] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:31.973268 14314 tablet_bootstrap.cc:492] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e: No bootstrap required, opened a new log
I20260620 13:59:31.973692 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03a1afd8f48dc8e6e392ffc42d79a" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:31.974220 14314 ts_tablet_manager.cc:1403] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.000s
I20260620 13:59:31.978145 14314 raft_consensus.cc:359] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.974556 14025 raft_consensus.cc:3060] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:31.979143 14314 raft_consensus.cc:385] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.979586 14314 raft_consensus.cc:740] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.980437 14314 consensus_queue.cc:260] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.984884 14311 tablet_bootstrap.cc:492] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647: No bootstrap required, opened a new log
I20260620 13:59:31.985404 14311 ts_tablet_manager.cc:1403] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.004s
I20260620 13:59:31.986168 14314 ts_tablet_manager.cc:1434] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260620 13:59:31.988595 14311 raft_consensus.cc:359] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.988893 14025 raft_consensus.cc:2468] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 1.
I20260620 13:59:31.989221 14311 raft_consensus.cc:385] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:31.988821 14244 raft_consensus.cc:515] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.989573 14311 raft_consensus.cc:740] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Initialized, Role: FOLLOWER
I20260620 13:59:31.990398 14138 leader_election.cc:304] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:31.990298 14311 consensus_queue.cc:260] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.992154 14311 ts_tablet_manager.cc:1434] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260620 13:59:31.992350 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03a1afd8f48dc8e6e392ffc42d79a" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:31.993178 14098 raft_consensus.cc:3060] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:31.994122 14342 raft_consensus.cc:493] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:31.994673 14342 raft_consensus.cc:515] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:31.998149 14342 leader_election.cc:290] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:31.998656 14342 raft_consensus.cc:2804] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:31.999012 14342 raft_consensus.cc:697] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:31.999437 14099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea63887d03ad488097661550c7efb41f" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:31.999897 14342 consensus_queue.cc:237] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
W20260620 13:59:32.001073 14140 leader_election.cc:343] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:32.005761 14312 tablet_bootstrap.cc:492] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:32.006435 14312 ts_tablet_manager.cc:1403] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.101s	user 0.018s	sys 0.011s
I20260620 13:59:32.009514 14317 raft_consensus.cc:493] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:32.010349 14312 raft_consensus.cc:359] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.010128 14317 raft_consensus.cc:515] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.015972 14317 leader_election.cc:290] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:32.011386 14299 leader_election.cc:290] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:32.002745 14098 raft_consensus.cc:2468] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 1.
I20260620 13:59:32.017627 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc6a0775dcd4ff2aeba8d1ac782fcc8" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647" is_pre_election: true
I20260620 13:59:32.018326 14025 raft_consensus.cc:2468] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 0.
I20260620 13:59:32.019064 14312 raft_consensus.cc:385] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:32.019418 14312 raft_consensus.cc:740] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:32.019950 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b31b6740d1843e4b84795a8f90e8597" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:32.020174 14312 consensus_queue.cc:260] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.020680 14174 raft_consensus.cc:3060] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.022572 14312 ts_tablet_manager.cc:1434] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260620 13:59:32.019788 14064 leader_election.cc:304] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:32.023627 14312 tablet_bootstrap.cc:492] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:32.028088 14317 raft_consensus.cc:2804] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:32.028563 14317 raft_consensus.cc:493] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:32.028908 14317 raft_consensus.cc:3060] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.032557 14174 raft_consensus.cc:2468] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 1.
I20260620 13:59:32.033598 14312 tablet_bootstrap.cc:654] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:32.034025 13989 leader_election.cc:304] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:32.039381 14325 raft_consensus.cc:2804] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:32.040066 14325 raft_consensus.cc:697] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Becoming Leader. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:32.041538 14325 consensus_queue.cc:237] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.049522 14244 leader_election.cc:290] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Requested vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:32.061602 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b31b6740d1843e4b84795a8f90e8597" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:32.062260 14098 raft_consensus.cc:3060] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.069556 14317 raft_consensus.cc:515] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.071691 14312 tablet_bootstrap.cc:492] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:32.072561 14312 ts_tablet_manager.cc:1403] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.008s
I20260620 13:59:32.072880 14098 raft_consensus.cc:2468] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 1.
I20260620 13:59:32.074484 14317 leader_election.cc:290] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
W20260620 13:59:32.060333 14138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.155.193:35951, user_credentials={real_user=slave}} blocked reactor thread for 70059.1us
I20260620 13:59:32.077411 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc6a0775dcd4ff2aeba8d1ac782fcc8" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:32.078130 14174 raft_consensus.cc:2468] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 0.
I20260620 13:59:32.079041 14172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc6a0775dcd4ff2aeba8d1ac782fcc8" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:32.079667 14172 raft_consensus.cc:3060] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.080067 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea63887d03ad488097661550c7efb41f" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647" is_pre_election: true
I20260620 13:59:32.080716 14024 raft_consensus.cc:2468] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 0.
I20260620 13:59:32.079620 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc6a0775dcd4ff2aeba8d1ac782fcc8" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:32.081892 14025 raft_consensus.cc:3060] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.080096 14312 raft_consensus.cc:359] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.082401 14312 raft_consensus.cc:385] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:32.082693 14312 raft_consensus.cc:740] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:32.083479 14312 consensus_queue.cc:260] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.087330 14325 raft_consensus.cc:493] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:32.088119 14312 ts_tablet_manager.cc:1434] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260620 13:59:32.087392 13922 catalog_manager.cc:5696] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 1 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:32.089115 14312 tablet_bootstrap.cc:492] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:32.090570 14025 raft_consensus.cc:2468] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 1.
I20260620 13:59:32.091387 14138 leader_election.cc:304] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: ddd2d9da052f4f21838c60a4f143fdba
I20260620 13:59:32.092741 14343 raft_consensus.cc:2804] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:32.093252 14343 raft_consensus.cc:493] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:32.093669 14343 raft_consensus.cc:3060] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.087865 14325 raft_consensus.cc:515] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.096429 14064 leader_election.cc:304] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:32.099050 14317 raft_consensus.cc:2804] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:32.099375 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f4ac4bcd198440290b0bc35a20ab7d0" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:32.099778 14317 raft_consensus.cc:697] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 1 LEADER]: Becoming Leader. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:32.100139 14174 raft_consensus.cc:2468] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 0.
I20260620 13:59:32.101536 13989 leader_election.cc:304] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:32.102469 14341 raft_consensus.cc:2804] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:32.102864 14341 raft_consensus.cc:493] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:32.103217 14341 raft_consensus.cc:3060] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.103624 14343 raft_consensus.cc:515] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.103355 13919 catalog_manager.cc:5696] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 reported cstate change: term changed from 0 to 1, leader changed from <none> to f33b223a2a51440683343b1044c26647 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "f33b223a2a51440683343b1044c26647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:32.106664 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f4ac4bcd198440290b0bc35a20ab7d0" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:32.109368 14098 raft_consensus.cc:2468] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 0.
I20260620 13:59:32.107935 14325 leader_election.cc:290] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:32.107720 14317 consensus_queue.cc:237] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.111905 14341 raft_consensus.cc:515] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.113826 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea63887d03ad488097661550c7efb41f" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:32.114491 14025 raft_consensus.cc:3060] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.114902 14343 leader_election.cc:290] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:32.114387 14172 raft_consensus.cc:2468] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 1.
I20260620 13:59:32.118352 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f4ac4bcd198440290b0bc35a20ab7d0" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:32.119036 14174 raft_consensus.cc:3060] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.114812 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f4ac4bcd198440290b0bc35a20ab7d0" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:32.116140 14099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea63887d03ad488097661550c7efb41f" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:32.123445 14098 raft_consensus.cc:3060] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.123488 14099 raft_consensus.cc:3060] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.131283 14348 raft_consensus.cc:493] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:32.131959 14348 raft_consensus.cc:515] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.133273 14174 raft_consensus.cc:2468] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 1.
I20260620 13:59:32.133775 14341 leader_election.cc:290] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Requested vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:32.134488 13989 leader_election.cc:304] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:32.135568 14099 raft_consensus.cc:2468] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 1.
I20260620 13:59:32.136392 14341 raft_consensus.cc:2804] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:32.134903 14348 leader_election.cc:290] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:32.137066 14341 raft_consensus.cc:697] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Becoming Leader. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:32.137913 14341 consensus_queue.cc:237] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.139635 14312 tablet_bootstrap.cc:654] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:32.139983 14098 raft_consensus.cc:2468] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 1.
I20260620 13:59:32.145578 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77511ca3f725427699c041aeb81e6905" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647" is_pre_election: true
I20260620 13:59:32.146515 14024 raft_consensus.cc:2468] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 0.
I20260620 13:59:32.148959 14140 leader_election.cc:304] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:32.149489 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77511ca3f725427699c041aeb81e6905" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:32.149886 14343 raft_consensus.cc:2804] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:32.150221 14174 raft_consensus.cc:2468] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 0.
I20260620 13:59:32.150375 14343 raft_consensus.cc:697] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:32.151273 14343 consensus_queue.cc:237] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.152292 14064 leader_election.cc:304] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:32.153280 14348 raft_consensus.cc:2804] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:32.153612 14348 raft_consensus.cc:493] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:32.153961 14348 raft_consensus.cc:3060] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.154503 14025 raft_consensus.cc:2468] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 1.
I20260620 13:59:32.161068 14343 raft_consensus.cc:493] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:32.161792 14343 raft_consensus.cc:515] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.164078 14348 raft_consensus.cc:515] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.165164 14343 leader_election.cc:290] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:32.165864 14348 leader_election.cc:290] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:32.166241 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a8bd236b6340ffae12764b4599066b" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647" is_pre_election: true
I20260620 13:59:32.167152 14025 raft_consensus.cc:2468] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 0.
I20260620 13:59:32.167495 14312 tablet_bootstrap.cc:492] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:32.168025 14312 ts_tablet_manager.cc:1403] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.006s
I20260620 13:59:32.168200 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77511ca3f725427699c041aeb81e6905" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:32.168780 14024 raft_consensus.cc:3060] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.168617 14138 leader_election.cc:304] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:32.169926 14343 raft_consensus.cc:2804] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:32.170393 14343 raft_consensus.cc:493] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:32.170789 14343 raft_consensus.cc:3060] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.170974 14312 raft_consensus.cc:359] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.171722 14312 raft_consensus.cc:385] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:32.171980 14312 raft_consensus.cc:740] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:32.172676 14312 consensus_queue.cc:260] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.174892 14312 ts_tablet_manager.cc:1434] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 13:59:32.175828 14312 tablet_bootstrap.cc:492] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba: Bootstrap starting.
I20260620 13:59:32.177243 14024 raft_consensus.cc:2468] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 1.
I20260620 13:59:32.179250 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77511ca3f725427699c041aeb81e6905" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:32.182300 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a8bd236b6340ffae12764b4599066b" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:32.183059 14343 raft_consensus.cc:515] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.182312 14174 raft_consensus.cc:3060] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.183615 14064 leader_election.cc:304] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:32.185246 14317 raft_consensus.cc:2804] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader election won for term 1
W20260620 13:59:32.185619 14140 leader_election.cc:343] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:32.186265 14317 raft_consensus.cc:697] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [term 1 LEADER]: Becoming Leader. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:32.187172 14343 leader_election.cc:290] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:32.187206 14317 consensus_queue.cc:237] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.187897 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a8bd236b6340ffae12764b4599066b" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:32.188781 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a8bd236b6340ffae12764b4599066b" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:32.189363 14024 raft_consensus.cc:3060] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.193163 14174 raft_consensus.cc:2468] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 1.
W20260620 13:59:32.195703 14140 leader_election.cc:343] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:32.196882 14024 raft_consensus.cc:2468] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 1.
I20260620 13:59:32.197743 14312 tablet_bootstrap.cc:654] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:32.198163 14138 leader_election.cc:304] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: ddd2d9da052f4f21838c60a4f143fdba
I20260620 13:59:32.199496 14343 raft_consensus.cc:2804] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:32.199986 14343 raft_consensus.cc:697] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:32.200845 14343 consensus_queue.cc:237] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.206357 14341 raft_consensus.cc:493] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:32.205642 13920 catalog_manager.cc:5696] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba reported cstate change: term changed from 0 to 1, leader changed from <none> to ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194). New cstate: current_term: 1 leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:32.206951 14341 raft_consensus.cc:515] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.209102 14341 leader_election.cc:290] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:32.210805 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94b124bc8d6430ba3a7d70fc5d4fec2" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:32.211576 14174 raft_consensus.cc:2468] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 0.
I20260620 13:59:32.212549 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94b124bc8d6430ba3a7d70fc5d4fec2" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:32.212798 13989 leader_election.cc:304] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:32.213425 14098 raft_consensus.cc:2468] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 0.
I20260620 13:59:32.213780 14341 raft_consensus.cc:2804] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:32.214268 14341 raft_consensus.cc:493] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:32.214634 14341 raft_consensus.cc:3060] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.222023 14341 raft_consensus.cc:515] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.224915 14341 leader_election.cc:290] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Requested vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:32.224882 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94b124bc8d6430ba3a7d70fc5d4fec2" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:32.225749 14098 raft_consensus.cc:3060] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.226936 13919 catalog_manager.cc:5696] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 reported cstate change: term changed from 0 to 1, leader changed from <none> to f33b223a2a51440683343b1044c26647 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "f33b223a2a51440683343b1044c26647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:32.229637 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94b124bc8d6430ba3a7d70fc5d4fec2" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:32.230288 14174 raft_consensus.cc:3060] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.238941 14098 raft_consensus.cc:2468] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 1.
I20260620 13:59:32.240618 13991 leader_election.cc:304] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:32.241766 14341 raft_consensus.cc:2804] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:32.242595 14341 raft_consensus.cc:697] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Becoming Leader. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:32.243561 14341 consensus_queue.cc:237] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.253146 14174 raft_consensus.cc:2468] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 1.
I20260620 13:59:32.253877 14312 tablet_bootstrap.cc:492] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba: No bootstrap required, opened a new log
I20260620 13:59:32.256589 14312 ts_tablet_manager.cc:1403] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.000s
I20260620 13:59:32.259347 14312 raft_consensus.cc:359] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.258914 13920 catalog_manager.cc:5696] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba reported cstate change: term changed from 0 to 1, leader changed from <none> to ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194). New cstate: current_term: 1 leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:32.260020 14312 raft_consensus.cc:385] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:32.260361 14312 raft_consensus.cc:740] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Initialized, Role: FOLLOWER
I20260620 13:59:32.261006 14312 consensus_queue.cc:260] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.263365 14312 ts_tablet_manager.cc:1434] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260620 13:59:32.267234 13922 catalog_manager.cc:5696] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 1 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:32.268910 13919 catalog_manager.cc:5696] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 reported cstate change: term changed from 0 to 1, leader changed from <none> to f33b223a2a51440683343b1044c26647 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "f33b223a2a51440683343b1044c26647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:32.270099 13922 catalog_manager.cc:5696] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 1 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:32.298931 14341 raft_consensus.cc:493] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:32.299615 14343 raft_consensus.cc:493] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:32.299682 14341 raft_consensus.cc:515] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.300132 14343 raft_consensus.cc:515] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.302619 14343 leader_election.cc:290] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:32.303292 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d68cc99fffb46cbb317cf1f588857d2" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:32.303654 14099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d68cc99fffb46cbb317cf1f588857d2" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:32.303292 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d68cc99fffb46cbb317cf1f588857d2" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647" is_pre_election: true
I20260620 13:59:32.303995 14098 raft_consensus.cc:2468] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 0.
I20260620 13:59:32.304579 14024 raft_consensus.cc:2468] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 0.
I20260620 13:59:32.305552 14140 leader_election.cc:304] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:32.306239 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d68cc99fffb46cbb317cf1f588857d2" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:32.306610 14343 raft_consensus.cc:2804] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:32.306790 14341 leader_election.cc:290] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:32.306980 14343 raft_consensus.cc:493] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:32.307333 14343 raft_consensus.cc:3060] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.312175 14343 raft_consensus.cc:515] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.313055 14174 raft_consensus.cc:2393] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f33b223a2a51440683343b1044c26647 in current term 1: Already voted for candidate 3072dd282fc542529a7558aafe37a46e in this term.
I20260620 13:59:32.314025 14343 leader_election.cc:290] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:32.314718 13989 leader_election.cc:304] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f33b223a2a51440683343b1044c26647; no voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba
I20260620 13:59:32.315301 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d68cc99fffb46cbb317cf1f588857d2" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:32.315721 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d68cc99fffb46cbb317cf1f588857d2" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:32.315761 14341 raft_consensus.cc:3060] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.316473 14098 raft_consensus.cc:3060] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.323503 14098 raft_consensus.cc:2468] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 1.
I20260620 13:59:32.323504 14341 raft_consensus.cc:2749] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:32.324854 14140 leader_election.cc:304] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:32.325738 14343 raft_consensus.cc:2804] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:32.326175 14343 raft_consensus.cc:697] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:32.326983 14343 consensus_queue.cc:237] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.330710 14024 raft_consensus.cc:2468] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 1.
I20260620 13:59:32.336228 13920 catalog_manager.cc:5696] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 1 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:32.350721 14348 raft_consensus.cc:493] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:32.351378 14348 raft_consensus.cc:515] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.353003 14348 leader_election.cc:290] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:32.354053 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a8bd236b6340ffae12764b4599066b" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33b223a2a51440683343b1044c26647" is_pre_election: true
I20260620 13:59:32.354210 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a8bd236b6340ffae12764b4599066b" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:32.354809 14024 raft_consensus.cc:2393] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddd2d9da052f4f21838c60a4f143fdba in current term 1: Already voted for candidate 3072dd282fc542529a7558aafe37a46e in this term.
I20260620 13:59:32.355993 14064 leader_election.cc:304] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba; no voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647
I20260620 13:59:32.356695 14348 raft_consensus.cc:3060] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:32.361709 14348 raft_consensus.cc:2749] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:32.457826 14174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59f03a1afd8f48dc8e6e392ffc42d79a"
dest_uuid: "3072dd282fc542529a7558aafe37a46e"
mode: GRACEFUL
new_leader_uuid: "f33b223a2a51440683343b1044c26647"
 from {username='slave'} at 127.0.0.1:33242
I20260620 13:59:32.458587 14174 raft_consensus.cc:606] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Received request to transfer leadership to TS f33b223a2a51440683343b1044c26647
I20260620 13:59:32.466866 14098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cc6a0775dcd4ff2aeba8d1ac782fcc8"
dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
mode: GRACEFUL
new_leader_uuid: "f33b223a2a51440683343b1044c26647"
 from {username='slave'} at 127.0.0.1:50582
I20260620 13:59:32.467392 14098 raft_consensus.cc:606] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 1 LEADER]: Received request to transfer leadership to TS f33b223a2a51440683343b1044c26647
I20260620 13:59:32.476258 14174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea63887d03ad488097661550c7efb41f"
dest_uuid: "3072dd282fc542529a7558aafe37a46e"
mode: GRACEFUL
new_leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
 from {username='slave'} at 127.0.0.1:33242
I20260620 13:59:32.476765 14174 raft_consensus.cc:606] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Received request to transfer leadership to TS ddd2d9da052f4f21838c60a4f143fdba
I20260620 13:59:32.484740 14174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d68cc99fffb46cbb317cf1f588857d2"
dest_uuid: "3072dd282fc542529a7558aafe37a46e"
mode: GRACEFUL
new_leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
 from {username='slave'} at 127.0.0.1:33242
I20260620 13:59:32.485347 14174 raft_consensus.cc:606] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Received request to transfer leadership to TS ddd2d9da052f4f21838c60a4f143fdba
I20260620 13:59:32.491145 14174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9a8bd236b6340ffae12764b4599066b"
dest_uuid: "3072dd282fc542529a7558aafe37a46e"
mode: GRACEFUL
new_leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
 from {username='slave'} at 127.0.0.1:33242
I20260620 13:59:32.491717 14174 raft_consensus.cc:606] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Received request to transfer leadership to TS ddd2d9da052f4f21838c60a4f143fdba
I20260620 13:59:32.497300 14024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a94b124bc8d6430ba3a7d70fc5d4fec2"
dest_uuid: "f33b223a2a51440683343b1044c26647"
mode: GRACEFUL
new_leader_uuid: "3072dd282fc542529a7558aafe37a46e"
 from {username='slave'} at 127.0.0.1:51344
I20260620 13:59:32.497785 14024 raft_consensus.cc:606] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Received request to transfer leadership to TS 3072dd282fc542529a7558aafe37a46e
I20260620 13:59:32.522501 14341 consensus_queue.cc:1048] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:32.522547 14343 consensus_queue.cc:1048] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:32.528757 14325 consensus_queue.cc:1048] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:32.531615 14343 raft_consensus.cc:993] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e: : Instructing follower f33b223a2a51440683343b1044c26647 to start an election
I20260620 13:59:32.532116 14343 raft_consensus.cc:1081] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Signalling peer f33b223a2a51440683343b1044c26647 to start an election
I20260620 13:59:32.535902 14025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59f03a1afd8f48dc8e6e392ffc42d79a"
dest_uuid: "f33b223a2a51440683343b1044c26647"
 from {username='slave'} at 127.0.0.1:51328
I20260620 13:59:32.558259 14025 raft_consensus.cc:493] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:32.558813 14025 raft_consensus.cc:3060] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.569442 14025 raft_consensus.cc:515] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.575448 14025 leader_election.cc:290] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 2 election: Requested vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:32.575809 14099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03a1afd8f48dc8e6e392ffc42d79a" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:32.576759 14099 raft_consensus.cc:3060] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.576776 14174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03a1afd8f48dc8e6e392ffc42d79a" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:32.577136 14299 consensus_queue.cc:1048] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:32.580266 14174 raft_consensus.cc:3055] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:32.580601 14174 raft_consensus.cc:740] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:32.581230 14174 consensus_queue.cc:260] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.582592 14174 raft_consensus.cc:3060] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.585343 14348 consensus_queue.cc:1048] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:32.588088 14099 raft_consensus.cc:2468] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 2.
I20260620 13:59:32.588946 14098 raft_consensus.cc:1240] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Rejecting Update request from peer 3072dd282fc542529a7558aafe37a46e for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260620 13:59:32.589197 14174 raft_consensus.cc:2468] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 2.
I20260620 13:59:32.590806 13991 leader_election.cc:304] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:32.591797 14325 raft_consensus.cc:2804] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:32.592259 14325 raft_consensus.cc:697] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 2 LEADER]: Becoming Leader. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:32.592986 14325 consensus_queue.cc:237] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.599902 14317 consensus_queue.cc:1048] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:32.607990 13922 catalog_manager.cc:5696] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 reported cstate change: term changed from 1 to 2, leader changed from 3072dd282fc542529a7558aafe37a46e (127.4.155.195) to f33b223a2a51440683343b1044c26647 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "f33b223a2a51440683343b1044c26647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:32.642897 14325 consensus_queue.cc:1048] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:32.650816 14341 raft_consensus.cc:993] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647: : Instructing follower 3072dd282fc542529a7558aafe37a46e to start an election
I20260620 13:59:32.651355 14339 raft_consensus.cc:1081] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Signalling peer 3072dd282fc542529a7558aafe37a46e to start an election
I20260620 13:59:32.655678 14174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a94b124bc8d6430ba3a7d70fc5d4fec2"
dest_uuid: "3072dd282fc542529a7558aafe37a46e"
 from {username='slave'} at 127.0.0.1:33232
I20260620 13:59:32.656838 14317 consensus_queue.cc:1048] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:32.658768 14174 raft_consensus.cc:493] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:32.659297 14174 raft_consensus.cc:3060] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.659231 14339 consensus_queue.cc:1048] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:32.668671 14174 raft_consensus.cc:515] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.669380 14339 consensus_queue.cc:1048] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:32.676129 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94b124bc8d6430ba3a7d70fc5d4fec2" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:32.676791 14024 raft_consensus.cc:3055] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:32.677102 14024 raft_consensus.cc:740] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:32.677325 14174 leader_election.cc:290] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:32.677881 14024 consensus_queue.cc:260] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.679510 14024 raft_consensus.cc:3060] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.682533 14099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a94b124bc8d6430ba3a7d70fc5d4fec2" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:32.683215 14099 raft_consensus.cc:3060] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.691597 14339 consensus_queue.cc:1048] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:32.697986 14317 consensus_queue.cc:1048] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:32.699461 14099 raft_consensus.cc:2468] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 2.
I20260620 13:59:32.701336 14024 raft_consensus.cc:2468] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 2.
I20260620 13:59:32.710436 14140 leader_election.cc:304] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:32.711366 14299 raft_consensus.cc:2804] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:32.711854 14299 raft_consensus.cc:697] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [term 2 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:32.712663 14299 consensus_queue.cc:237] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.714568 14351 raft_consensus.cc:993] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba: : Instructing follower f33b223a2a51440683343b1044c26647 to start an election
I20260620 13:59:32.715078 14351 raft_consensus.cc:1081] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 1 LEADER]: Signalling peer f33b223a2a51440683343b1044c26647 to start an election
I20260620 13:59:32.719980 14023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2cc6a0775dcd4ff2aeba8d1ac782fcc8"
dest_uuid: "f33b223a2a51440683343b1044c26647"
 from {username='slave'} at 127.0.0.1:51320
I20260620 13:59:32.720611 14023 raft_consensus.cc:493] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:32.721043 14023 raft_consensus.cc:3060] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.726763 14378 consensus_queue.cc:1048] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260620 13:59:32.733004 14299 consensus_queue.cc:1048] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:32.739466 14023 raft_consensus.cc:515] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.751420 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc6a0775dcd4ff2aeba8d1ac782fcc8" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:32.751756 14024 raft_consensus.cc:1240] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Rejecting Update request from peer ddd2d9da052f4f21838c60a4f143fdba for earlier term 1. Current term is 2. Ops: []
I20260620 13:59:32.752952 14378 consensus_queue.cc:1048] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:32.754269 14023 leader_election.cc:290] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 2 election: Requested vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:32.754554 14348 consensus_queue.cc:1059] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:32.757143 13923 catalog_manager.cc:5696] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 1 to 2, leader changed from f33b223a2a51440683343b1044c26647 (127.4.155.193) to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 2 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:32.752064 14100 raft_consensus.cc:3055] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:32.759641 14100 raft_consensus.cc:740] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:32.760005 14173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc6a0775dcd4ff2aeba8d1ac782fcc8" candidate_uuid: "f33b223a2a51440683343b1044c26647" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:32.760612 14173 raft_consensus.cc:3060] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.760488 14100 consensus_queue.cc:260] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.761929 14100 raft_consensus.cc:3060] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.776978 14100 raft_consensus.cc:2468] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 2.
W20260620 13:59:32.777627 14317 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260620 13:59:32.779352 13991 leader_election.cc:304] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:32.780481 14339 raft_consensus.cc:2804] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:32.780769 14173 raft_consensus.cc:2468] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f33b223a2a51440683343b1044c26647 in term 2.
I20260620 13:59:32.780969 14339 raft_consensus.cc:697] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [term 2 LEADER]: Becoming Leader. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:32.781944 14339 consensus_queue.cc:237] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.777045 14379 consensus_queue.cc:1048] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260620 13:59:32.789695 14299 raft_consensus.cc:993] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e: : Instructing follower ddd2d9da052f4f21838c60a4f143fdba to start an election
I20260620 13:59:32.790141 14299 raft_consensus.cc:1081] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Signalling peer ddd2d9da052f4f21838c60a4f143fdba to start an election
I20260620 13:59:32.792687 14343 raft_consensus.cc:993] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e: : Instructing follower ddd2d9da052f4f21838c60a4f143fdba to start an election
I20260620 13:59:32.793222 14343 raft_consensus.cc:1081] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Signalling peer ddd2d9da052f4f21838c60a4f143fdba to start an election
I20260620 13:59:32.794552 14100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9a8bd236b6340ffae12764b4599066b"
dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
 from {username='slave'} at 127.0.0.1:50572
I20260620 13:59:32.795645 14100 raft_consensus.cc:493] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:32.796142 14100 raft_consensus.cc:3060] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.799620 13920 catalog_manager.cc:5696] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 reported cstate change: term changed from 1 to 2, leader changed from ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194) to f33b223a2a51440683343b1044c26647 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "f33b223a2a51440683343b1044c26647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:32.800526 14097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea63887d03ad488097661550c7efb41f"
dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
 from {username='slave'} at 127.0.0.1:50572
I20260620 13:59:32.801148 14097 raft_consensus.cc:493] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:32.801489 14097 raft_consensus.cc:3060] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.815450 14097 raft_consensus.cc:515] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.820570 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea63887d03ad488097661550c7efb41f" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:32.820768 14173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea63887d03ad488097661550c7efb41f" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:32.821349 14173 raft_consensus.cc:3055] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:32.821223 14024 raft_consensus.cc:3060] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.821974 14173 raft_consensus.cc:740] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:32.822929 14097 leader_election.cc:290] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:32.823169 14173 consensus_queue.cc:260] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.824844 14173 raft_consensus.cc:3060] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.821282 14100 raft_consensus.cc:515] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.826905 14099 raft_consensus.cc:1240] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Rejecting Update request from peer 3072dd282fc542529a7558aafe37a46e for earlier term 1. Current term is 2. Ops: []
I20260620 13:59:32.828135 14100 leader_election.cc:290] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:32.829071 14025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a8bd236b6340ffae12764b4599066b" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:32.830160 14299 consensus_queue.cc:1059] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:32.831000 14299 raft_consensus.cc:3055] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:32.831326 14299 raft_consensus.cc:740] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:32.832113 14299 consensus_queue.cc:260] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.834323 14172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a8bd236b6340ffae12764b4599066b" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:32.836723 14173 raft_consensus.cc:2468] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 2.
I20260620 13:59:32.838671 14064 leader_election.cc:304] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:32.833027 14299 raft_consensus.cc:3060] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.840039 14348 raft_consensus.cc:2804] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:32.839993 14379 consensus_queue.cc:1048] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:32.840756 14348 raft_consensus.cc:697] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Becoming Leader. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:32.841624 14348 consensus_queue.cc:237] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.842777 14024 raft_consensus.cc:2468] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 2.
I20260620 13:59:32.851485 14299 raft_consensus.cc:993] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e: : Instructing follower ddd2d9da052f4f21838c60a4f143fdba to start an election
I20260620 13:59:32.851936 14299 raft_consensus.cc:1081] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Signalling peer ddd2d9da052f4f21838c60a4f143fdba to start an election
I20260620 13:59:32.853119 14299 consensus_queue.cc:1048] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:32.854353 13923 catalog_manager.cc:5696] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba reported cstate change: term changed from 1 to 2, leader changed from 3072dd282fc542529a7558aafe37a46e (127.4.155.195) to ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194). New cstate: current_term: 2 leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:32.855485 14099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d68cc99fffb46cbb317cf1f588857d2"
dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
 from {username='slave'} at 127.0.0.1:50572
I20260620 13:59:32.856094 14099 raft_consensus.cc:493] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:32.856444 14099 raft_consensus.cc:3060] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.859091 14172 raft_consensus.cc:2468] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 2.
I20260620 13:59:32.863621 14064 leader_election.cc:304] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: f33b223a2a51440683343b1044c26647
I20260620 13:59:32.864595 14348 raft_consensus.cc:2804] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:32.865342 14348 raft_consensus.cc:697] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Becoming Leader. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:32.867719 14348 consensus_queue.cc:237] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.866060 14099 raft_consensus.cc:515] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.870868 14100 raft_consensus.cc:1240] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Rejecting Update request from peer 3072dd282fc542529a7558aafe37a46e for earlier term 1. Current term is 2. Ops: []
I20260620 13:59:32.871939 14099 leader_election.cc:290] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:32.873216 14299 consensus_queue.cc:1059] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:32.873799 14172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d68cc99fffb46cbb317cf1f588857d2" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:32.874218 14379 raft_consensus.cc:3055] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:32.874576 14379 raft_consensus.cc:740] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:32.875380 14379 consensus_queue.cc:260] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.878511 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d68cc99fffb46cbb317cf1f588857d2" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:32.880048 14023 raft_consensus.cc:3060] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.878650 13919 catalog_manager.cc:5696] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba reported cstate change: term changed from 1 to 2, leader changed from 3072dd282fc542529a7558aafe37a46e (127.4.155.195) to ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194). New cstate: current_term: 2 leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:32.880955 14379 raft_consensus.cc:3060] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:32.889747 14023 raft_consensus.cc:2468] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 2.
I20260620 13:59:32.890952 14064 leader_election.cc:304] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:32.891738 14348 raft_consensus.cc:2804] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:32.892197 14348 raft_consensus.cc:697] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Becoming Leader. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:32.892951 14348 consensus_queue.cc:237] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:32.895313 14172 raft_consensus.cc:2468] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 2.
I20260620 13:59:32.901087 13919 catalog_manager.cc:5696] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba reported cstate change: term changed from 1 to 2, leader changed from 3072dd282fc542529a7558aafe37a46e (127.4.155.195) to ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194). New cstate: current_term: 2 leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:33.149845 14172 raft_consensus.cc:1275] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Refusing update from remote peer f33b223a2a51440683343b1044c26647: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:33.151614 14339 consensus_queue.cc:1048] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:33.162811 14099 raft_consensus.cc:1275] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Refusing update from remote peer f33b223a2a51440683343b1044c26647: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:33.164847 14372 consensus_queue.cc:1048] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:33.211341 14099 raft_consensus.cc:1275] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:33.212586 14379 consensus_queue.cc:1048] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:33.220353 14023 raft_consensus.cc:1275] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:33.221949 14343 consensus_queue.cc:1048] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:33.247714 14099 raft_consensus.cc:1275] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Refusing update from remote peer f33b223a2a51440683343b1044c26647: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:33.248957 14339 consensus_queue.cc:1048] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:33.258433 14173 raft_consensus.cc:1275] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Refusing update from remote peer f33b223a2a51440683343b1044c26647: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:33.260442 14386 consensus_queue.cc:1048] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:33.260732 14023 raft_consensus.cc:1275] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:33.262514 14317 consensus_queue.cc:1048] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:33.285522 14173 raft_consensus.cc:1275] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:33.286885 14351 consensus_queue.cc:1048] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:33.313131 14173 raft_consensus.cc:1275] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:33.314908 14388 consensus_queue.cc:1048] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:33.324731 14024 raft_consensus.cc:3060] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:33.332101 14024 raft_consensus.cc:1275] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:33.333513 14388 consensus_queue.cc:1048] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:33.353431 14024 raft_consensus.cc:1275] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:33.354655 14388 consensus_queue.cc:1048] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:33.364396 14173 raft_consensus.cc:1275] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:33.366076 14351 consensus_queue.cc:1048] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:35.502390 13922 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43032:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260620 13:59:35.528034 13922 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43032:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260620 13:59:35.565339  4719 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260620 13:59:35.783515 14410 log.cc:927] Time spent T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260620 13:59:35.823359 14025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59f03a1afd8f48dc8e6e392ffc42d79a"
dest_uuid: "f33b223a2a51440683343b1044c26647"
mode: GRACEFUL
new_leader_uuid: "3072dd282fc542529a7558aafe37a46e"
 from {username='slave'} at 127.0.0.1:49334
I20260620 13:59:35.824368 14025 raft_consensus.cc:606] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 2 LEADER]: Received request to transfer leadership to TS 3072dd282fc542529a7558aafe37a46e
W20260620 13:59:35.975167 14438 log.cc:927] Time spent T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260620 13:59:35.983702 14449 tablet.cc:1724] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:35.996980 14446 tablet.cc:1724] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.050873 14453 tablet.cc:1724] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260620 13:59:36.096628 14126 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:6d68cc99fffb46cbb317cf1f588857d2)
W20260620 13:59:36.104036 14126 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:6d68cc99fffb46cbb317cf1f588857d2)
I20260620 13:59:36.138459 14466 tablet.cc:1724] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260620 13:59:36.140460 14051 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:ea63887d03ad488097661550c7efb41f)
W20260620 13:59:36.140493 14140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:39675, user_credentials={real_user=slave}} blocked reactor thread for 51444.7us
I20260620 13:59:36.147750 14458 tablet.cc:1724] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.074905 14447 tablet.cc:1724] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.068313 14456 tablet.cc:1724] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.208786 14472 tablet.cc:1724] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.208206 14471 tablet.cc:1724] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.212764 14098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d68cc99fffb46cbb317cf1f588857d2"
dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
mode: GRACEFUL
new_leader_uuid: "3072dd282fc542529a7558aafe37a46e"
 from {username='slave'} at 127.0.0.1:53266
I20260620 13:59:36.213413 14098 raft_consensus.cc:606] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Received request to transfer leadership to TS 3072dd282fc542529a7558aafe37a46e
I20260620 13:59:36.215341  4719 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260620 13:59:36.217314  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:36.228425 14472 tablet.cc:1724] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.232992 14021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4714f60c31e649ddba4445c6022d9dc3"
dest_uuid: "f33b223a2a51440683343b1044c26647"
mode: GRACEFUL
new_leader_uuid: "3072dd282fc542529a7558aafe37a46e"
 from {username='slave'} at 127.0.0.1:49334
I20260620 13:59:36.233651 14021 raft_consensus.cc:606] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 2 LEADER]: Received request to transfer leadership to TS 3072dd282fc542529a7558aafe37a46e
I20260620 13:59:36.236851 14098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73e50c85167b4a6c83892dd58be19c79"
dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
mode: GRACEFUL
new_leader_uuid: "3072dd282fc542529a7558aafe37a46e"
 from {username='slave'} at 127.0.0.1:53266
I20260620 13:59:36.237398 14098 raft_consensus.cc:606] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Received request to transfer leadership to TS 3072dd282fc542529a7558aafe37a46e
I20260620 13:59:36.239068  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260620 13:59:36.239820 14457 log.cc:927] Time spent T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260620 13:59:36.239897  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:36.265970 14339 raft_consensus.cc:993] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647: : Instructing follower 3072dd282fc542529a7558aafe37a46e to start an election
I20260620 13:59:36.265421 14453 tablet.cc:1724] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.266753 14424 raft_consensus.cc:1081] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 2 LEADER]: Signalling peer 3072dd282fc542529a7558aafe37a46e to start an election
W20260620 13:59:36.267269 14064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.193:35951, user_credentials={real_user=slave}} blocked reactor thread for 136289us
I20260620 13:59:36.270900 14458 tablet.cc:1724] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.271883 14456 tablet.cc:1724] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.276388 14471 tablet.cc:1724] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.265221 14474 tablet.cc:1724] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.287173 14468 raft_consensus.cc:993] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647: : Instructing follower 3072dd282fc542529a7558aafe37a46e to start an election
I20260620 13:59:36.288437 14424 raft_consensus.cc:1081] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 2 LEADER]: Signalling peer 3072dd282fc542529a7558aafe37a46e to start an election
I20260620 13:59:36.286953 14447 tablet.cc:1724] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.289562 14473 tablet.cc:1724] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.290647 14172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59f03a1afd8f48dc8e6e392ffc42d79a"
dest_uuid: "3072dd282fc542529a7558aafe37a46e"
 from {username='slave'} at 127.0.0.1:33232
I20260620 13:59:36.291319 14172 raft_consensus.cc:493] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:36.294356 14172 raft_consensus.cc:3060] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:36.308041 14446 tablet.cc:1724] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.311476 14167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4714f60c31e649ddba4445c6022d9dc3"
dest_uuid: "3072dd282fc542529a7558aafe37a46e"
 from {username='slave'} at 127.0.0.1:33232
I20260620 13:59:36.312161 14167 raft_consensus.cc:493] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:36.312527 14463 raft_consensus.cc:993] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba: : Instructing follower 3072dd282fc542529a7558aafe37a46e to start an election
I20260620 13:59:36.312523 14167 raft_consensus.cc:3060] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:36.313179 14391 raft_consensus.cc:1081] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Signalling peer 3072dd282fc542529a7558aafe37a46e to start an election
I20260620 13:59:36.303498 14172 raft_consensus.cc:515] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:36.327826 14169 raft_consensus.cc:1240] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Rejecting Update request from peer f33b223a2a51440683343b1044c26647 for earlier term 2. Current term is 3. Ops: []
I20260620 13:59:36.329741 14449 tablet.cc:1724] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.342674 14170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d68cc99fffb46cbb317cf1f588857d2"
dest_uuid: "3072dd282fc542529a7558aafe37a46e"
 from {username='slave'} at 127.0.0.1:33216
I20260620 13:59:36.344065 14463 raft_consensus.cc:993] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba: : Instructing follower 3072dd282fc542529a7558aafe37a46e to start an election
I20260620 13:59:36.344583 14463 raft_consensus.cc:1081] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Signalling peer 3072dd282fc542529a7558aafe37a46e to start an election
I20260620 13:59:36.347340 14170 raft_consensus.cc:493] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:36.347815 14170 raft_consensus.cc:3060] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:36.328578 14472 tablet.cc:1724] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.356776 14169 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73e50c85167b4a6c83892dd58be19c79"
dest_uuid: "3072dd282fc542529a7558aafe37a46e"
 from {username='slave'} at 127.0.0.1:33216
I20260620 13:59:36.357563 14169 raft_consensus.cc:493] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:36.357138 14475 tablet.cc:1724] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.357990 14169 raft_consensus.cc:3060] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:36.335206 14167 raft_consensus.cc:515] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:36.365643 14172 leader_election.cc:290] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:36.365470 14453 tablet.cc:1724] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.366888 14473 tablet.cc:1724] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.367499 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03a1afd8f48dc8e6e392ffc42d79a" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:36.379035 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f03a1afd8f48dc8e6e392ffc42d79a" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:36.382252 14100 raft_consensus.cc:3060] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:36.391386 14461 consensus_queue.cc:1059] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260620 13:59:36.401561 14024 raft_consensus.cc:3055] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:59:36.402050 14024 raft_consensus.cc:740] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:36.405233 14024 consensus_queue.cc:260] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:36.406877 14024 raft_consensus.cc:3060] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:36.406991 14100 raft_consensus.cc:2468] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 3.
I20260620 13:59:36.408370 14169 raft_consensus.cc:515] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:36.409399 14140 leader_election.cc:304] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:36.410490 14343 raft_consensus.cc:2804] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:59:36.411055 14343 raft_consensus.cc:697] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 3 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:36.397244 14170 raft_consensus.cc:515] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:36.391492 14471 tablet.cc:1724] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.412295 14343 consensus_queue.cc:237] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:36.413386 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e50c85167b4a6c83892dd58be19c79" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:36.336087 14458 tablet.cc:1724] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.416983 14021 raft_consensus.cc:3060] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:36.402082 14466 tablet.cc:1724] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.420614 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d68cc99fffb46cbb317cf1f588857d2" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:36.421002 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e50c85167b4a6c83892dd58be19c79" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:36.421352 14022 raft_consensus.cc:3060] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:36.421555 14100 raft_consensus.cc:3055] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:59:36.421908 14100 raft_consensus.cc:740] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:36.422789 14100 consensus_queue.cc:260] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:36.417050 14169 leader_election.cc:290] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:36.425239 14100 raft_consensus.cc:3060] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:36.434674 14100 raft_consensus.cc:2468] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 3.
I20260620 13:59:36.436235 14140 leader_election.cc:304] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:36.437274 14024 raft_consensus.cc:2468] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 3.
I20260620 13:59:36.437620 14459 raft_consensus.cc:2804] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Leader election won for term 3
W20260620 13:59:36.437901 14339 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260620 13:59:36.438155 14459 raft_consensus.cc:697] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [term 3 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:36.439280 14459 consensus_queue.cc:237] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:36.442391 14021 raft_consensus.cc:2468] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 3.
I20260620 13:59:36.448594 14022 raft_consensus.cc:2468] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 3.
I20260620 13:59:36.448938 14167 leader_election.cc:290] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:36.449146 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4714f60c31e649ddba4445c6022d9dc3" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:36.449863 14100 raft_consensus.cc:3060] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:36.450323 14138 leader_election.cc:304] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647; no voters: 
I20260620 13:59:36.450999 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4714f60c31e649ddba4445c6022d9dc3" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f33b223a2a51440683343b1044c26647"
I20260620 13:59:36.451499 14343 raft_consensus.cc:2804] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:59:36.451953 14021 raft_consensus.cc:3055] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:59:36.452271 14343 raft_consensus.cc:697] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 3 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:36.452477 14021 raft_consensus.cc:740] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f33b223a2a51440683343b1044c26647, State: Running, Role: LEADER
I20260620 13:59:36.453346 14343 consensus_queue.cc:237] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:36.453751 14021 consensus_queue.cc:260] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:36.455818 14021 raft_consensus.cc:3060] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:36.459625 14100 raft_consensus.cc:2468] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 3.
I20260620 13:59:36.460839 14140 leader_election.cc:304] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:36.461889 14459 raft_consensus.cc:2804] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:59:36.462634 14459 raft_consensus.cc:697] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 3 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:36.463997 14170 leader_election.cc:290] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:36.464823 14459 consensus_queue.cc:237] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:36.467044 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d68cc99fffb46cbb317cf1f588857d2" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:36.468751 14100 raft_consensus.cc:3055] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Stepping down as leader of term 2
I20260620 13:59:36.470570 14100 raft_consensus.cc:740] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:36.479871 14100 consensus_queue.cc:260] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:36.481859 14100 raft_consensus.cc:3060] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:36.495147 14100 raft_consensus.cc:2468] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 3.
I20260620 13:59:36.504794 14021 raft_consensus.cc:2468] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 3.
I20260620 13:59:36.509747 13923 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7: soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6] alter complete (version 1)
I20260620 13:59:36.526113 13919 catalog_manager.cc:5696] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 2 to 3, leader changed from ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194) to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 3 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:36.527796 13919 catalog_manager.cc:5696] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 2 to 3, leader changed from ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194) to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 3 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:36.529032 13919 catalog_manager.cc:5696] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 2 to 3, leader changed from f33b223a2a51440683343b1044c26647 (127.4.155.193) to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 3 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:36.530442 13919 catalog_manager.cc:5696] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 2 to 3, leader changed from f33b223a2a51440683343b1044c26647 (127.4.155.193) to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 3 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:36.531397 13919 catalog_manager.cc:5788] TS 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327) does not have the latest schema for tablet 59f03a1afd8f48dc8e6e392ffc42d79a (table soft_deleted_table [id=cb0d341cfa8848b2bc35cc8f787adcf6]). Expected version 1 got 0
I20260620 13:59:36.810847 14100 raft_consensus.cc:1275] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260620 13:59:36.812376 14459 consensus_queue.cc:1048] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:59:36.821254 14466 tablet.cc:1724] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 13:59:36.822880 14021 raft_consensus.cc:1275] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260620 13:59:36.827250 14425 consensus_queue.cc:1048] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:59:36.856670 14466 tablet.cc:1719] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e: Skipping requested alter to schema version 1, tablet already version 1
I20260620 13:59:36.862591 14472 tablet.cc:1719] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba: Skipping requested alter to schema version 1, tablet already version 1
I20260620 13:59:36.864804 14458 tablet.cc:1719] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647: Skipping requested alter to schema version 1, tablet already version 1
I20260620 13:59:36.868151 14024 raft_consensus.cc:1275] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:59:36.868643 14022 raft_consensus.cc:1275] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:59:36.869417 14343 consensus_queue.cc:1048] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:59:36.870108 14425 consensus_queue.cc:1048] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:59:36.888209 14100 raft_consensus.cc:1275] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:59:36.896198 14343 consensus_queue.cc:1048] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260620 13:59:36.899812 14024 raft_consensus.cc:1275] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260620 13:59:36.906390 14488 consensus_queue.cc:1048] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:59:36.913134 14100 raft_consensus.cc:1275] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:59:36.915002 14425 consensus_queue.cc:1048] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260620 13:59:36.932209 14100 raft_consensus.cc:1275] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260620 13:59:36.933827 14425 consensus_queue.cc:1048] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260620 13:59:37.253274  4719 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260620 13:59:37.260074  4719 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260620 13:59:37.260608  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:37.266799  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:59:37.267354  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:38.268318  4719 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260620 13:59:38.275385  4719 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260620 13:59:38.275877  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:38.283819  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:59:38.284298  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:39.285508  4719 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260620 13:59:39.290903  4719 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260620 13:59:39.291410  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:39.297772  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:59:39.298249  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:40.299438  4719 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260620 13:59:40.305660  4719 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260620 13:59:40.306077  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:40.311412  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:59:40.311968  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:41.313114  4719 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260620 13:59:41.318295  4719 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260620 13:59:41.318737  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:41.324348  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:59:41.324827  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:42.325938  4719 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260620 13:59:42.331800  4719 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260620 13:59:42.332239  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:42.336984  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:59:42.337421  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:43.338454  4719 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260620 13:59:43.344702  4719 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260620 13:59:43.345276  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:43.350889  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:59:43.351444  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:44.352620  4719 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260620 13:59:44.359565  4719 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260620 13:59:44.360198  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:44.364974  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:59:44.365411  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:45.367190  4719 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260620 13:59:45.377206  4719 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260620 13:59:45.377787  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 13:59:45.390790  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 13:59:45.391486  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 13:59:47.098147  4719 tablet_server.cc:179] TabletServer@127.4.155.193:0 shutting down...
I20260620 13:59:47.136322  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:59:47.137144  4719 tablet_replica.cc:333] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.138152  4719 raft_consensus.cc:2243] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:47.138883  4719 raft_consensus.cc:2272] T 6d68cc99fffb46cbb317cf1f588857d2 P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.141534  4719 tablet_replica.cc:333] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.142200  4719 raft_consensus.cc:2243] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:47.142776  4719 raft_consensus.cc:2272] T ea63887d03ad488097661550c7efb41f P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.145146  4719 tablet_replica.cc:333] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.145689  4719 raft_consensus.cc:2243] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:47.146174  4719 raft_consensus.cc:2272] T e9a8bd236b6340ffae12764b4599066b P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.148835  4719 tablet_replica.cc:333] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.149479  4719 raft_consensus.cc:2243] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:47.150571  4719 raft_consensus.cc:2272] T 0f4ac4bcd198440290b0bc35a20ab7d0 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.153188  4719 tablet_replica.cc:333] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.153820  4719 raft_consensus.cc:2243] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:47.154383  4719 raft_consensus.cc:2272] T 59f03a1afd8f48dc8e6e392ffc42d79a P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.156853  4719 tablet_replica.cc:333] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.157383  4719 raft_consensus.cc:2243] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:47.158281  4719 raft_consensus.cc:2272] T 4b31b6740d1843e4b84795a8f90e8597 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.160569  4719 tablet_replica.cc:333] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.161160  4719 raft_consensus.cc:2243] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:47.161640  4719 raft_consensus.cc:2272] T 3cc8f78c35054fb680acf6668bfa8f57 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.164077  4719 tablet_replica.cc:333] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.164616  4719 raft_consensus.cc:2243] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:47.165150  4719 raft_consensus.cc:2272] T a94b124bc8d6430ba3a7d70fc5d4fec2 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.167436  4719 tablet_replica.cc:333] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.167937  4719 raft_consensus.cc:2243] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:47.168457  4719 raft_consensus.cc:2272] T 77511ca3f725427699c041aeb81e6905 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.170951  4719 tablet_replica.cc:333] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.171444  4719 raft_consensus.cc:2243] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:47.172370  4719 raft_consensus.cc:2272] T 95ff38af22f04e42bf57fb40b90dff72 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.174744  4719 tablet_replica.cc:333] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.175266  4719 raft_consensus.cc:2243] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:47.175699  4719 raft_consensus.cc:2272] T aae371b2d718455abbbfafb14691c3e1 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.178054  4719 tablet_replica.cc:333] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.178557  4719 raft_consensus.cc:2243] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:47.178995  4719 raft_consensus.cc:2272] T 4714f60c31e649ddba4445c6022d9dc3 P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.181149  4719 tablet_replica.cc:333] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.181635  4719 raft_consensus.cc:2243] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:47.182539  4719 raft_consensus.cc:2272] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.184857  4719 tablet_replica.cc:333] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.185442  4719 raft_consensus.cc:2243] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:47.186379  4719 raft_consensus.cc:2272] T 07529c987ba84d0faf98639d7465d0c2 P f33b223a2a51440683343b1044c26647 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.188638  4719 tablet_replica.cc:333] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.189112  4719 raft_consensus.cc:2243] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:47.189589  4719 raft_consensus.cc:2272] T 73e50c85167b4a6c83892dd58be19c79 P f33b223a2a51440683343b1044c26647 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.191880  4719 tablet_replica.cc:333] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.192389  4719 raft_consensus.cc:2243] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:47.192858  4719 raft_consensus.cc:2272] T 80e1393235534f46bd9ee5f875cdd944 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.195168  4719 tablet_replica.cc:333] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.195694  4719 raft_consensus.cc:2243] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:47.196527  4719 raft_consensus.cc:2272] T c29e05ada4be4b84903c875dce890372 P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:47.198628  4719 tablet_replica.cc:333] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647: stopping tablet replica
I20260620 13:59:47.199148  4719 raft_consensus.cc:2243] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:47.199626  4719 raft_consensus.cc:2272] T 62846366d99d41cd88aa9d766bbf6e9b P f33b223a2a51440683343b1044c26647 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:47.373387 14064 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111) [suppressed 103 similar messages]
W20260620 13:59:47.377095 14064 consensus_peers.cc:597] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:47.389448 14046 debug-util.cc:398] Leaking SignalData structure 0x7b08000d1f00 after lost signal to thread 4722
W20260620 13:59:47.390913 14046 debug-util.cc:398] Leaking SignalData structure 0x7b08000f5be0 after lost signal to thread 13957
W20260620 13:59:47.390803 14138 consensus_peers.cc:597] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:47.393028 14046 debug-util.cc:398] Leaking SignalData structure 0x7b0800373480 after lost signal to thread 14124
W20260620 13:59:47.393973 14046 debug-util.cc:398] Leaking SignalData structure 0x7b080013eb80 after lost signal to thread 14198
W20260620 13:59:47.416430 14138 consensus_peers.cc:597] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:47.427677 14064 consensus_peers.cc:597] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:47.437316 14064 consensus_peers.cc:597] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:47.456974 14138 consensus_peers.cc:597] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:47.489012 14064 consensus_peers.cc:597] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:47.524087 14064 consensus_peers.cc:597] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:47.526062 14064 consensus_peers.cc:597] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:47.530584 14138 consensus_peers.cc:597] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:47.553553 14138 consensus_peers.cc:597] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:47.569770 14138 consensus_peers.cc:597] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:48.245893  4719 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 14046)
I20260620 13:59:48.457393 14527 raft_consensus.cc:493] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.458076 14527 raft_consensus.cc:515] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } }
I20260620 13:59:48.460709 14527 leader_election.cc:290] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327), f33b223a2a51440683343b1044c26647 (127.4.155.193:35951)
I20260620 13:59:48.461895 14167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07529c987ba84d0faf98639d7465d0c2" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
W20260620 13:59:48.465294 14064 leader_election.cc:336] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.465703 14064 leader_election.cc:304] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba; no voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647
I20260620 13:59:48.466292 14527 raft_consensus.cc:493] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.466509 14511 raft_consensus.cc:2749] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:48.467087 14527 raft_consensus.cc:515] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.469648 14527 leader_election.cc:290] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:48.470942 14167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29e05ada4be4b84903c875dce890372" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
W20260620 13:59:48.473438 14064 leader_election.cc:336] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.473832 14064 leader_election.cc:304] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba; no voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647
I20260620 13:59:48.474499 14527 raft_consensus.cc:2749] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:59:48.480304 14527 raft_consensus.cc:493] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.481097 14511 raft_consensus.cc:493] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.481807 14511 raft_consensus.cc:515] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.483901 14511 leader_election.cc:290] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:48.484598 14527 raft_consensus.cc:515] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.485492 14167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ff38af22f04e42bf57fb40b90dff72" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:48.487902 14527 leader_election.cc:290] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
W20260620 13:59:48.488663 14064 leader_election.cc:336] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.489082 14064 leader_election.cc:304] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba; no voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647
I20260620 13:59:48.489813 14527 raft_consensus.cc:2749] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:48.491678 14533 raft_consensus.cc:493] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.491695 14167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b31b6740d1843e4b84795a8f90e8597" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:48.492372 14533 raft_consensus.cc:515] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.493009 14534 raft_consensus.cc:493] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.493651 14507 raft_consensus.cc:493] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.493604 14534 raft_consensus.cc:515] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.494305 14507 raft_consensus.cc:515] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } }
I20260620 13:59:48.496137 14534 leader_election.cc:290] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:48.496563 14507 leader_election.cc:290] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), f33b223a2a51440683343b1044c26647 (127.4.155.193:35951)
I20260620 13:59:48.496755 14534 raft_consensus.cc:493] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.497234 14534 raft_consensus.cc:515] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.498242 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc6a0775dcd4ff2aeba8d1ac782fcc8" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:48.498997 14534 leader_election.cc:290] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:48.496120 14533 leader_election.cc:290] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
W20260620 13:59:48.503221 14064 leader_election.cc:336] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.503845 14064 leader_election.cc:304] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddd2d9da052f4f21838c60a4f143fdba; no voters: 3072dd282fc542529a7558aafe37a46e, f33b223a2a51440683343b1044c26647
I20260620 13:59:48.504751 14527 raft_consensus.cc:2749] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 13:59:48.505741 14138 leader_election.cc:336] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.505988 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f4ac4bcd198440290b0bc35a20ab7d0" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:48.506346 14138 leader_election.cc:304] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e; no voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647
I20260620 13:59:48.506404 14099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07529c987ba84d0faf98639d7465d0c2" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:48.507066 14533 raft_consensus.cc:2749] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 13:59:48.507176 14099 raft_consensus.cc:2468] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 1.
I20260620 13:59:48.507858 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29e05ada4be4b84903c875dce890372" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
W20260620 13:59:48.508134 14138 leader_election.cc:336] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.508436 14098 raft_consensus.cc:2468] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 2.
I20260620 13:59:48.508523 14533 raft_consensus.cc:493] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f33b223a2a51440683343b1044c26647)
W20260620 13:59:48.508699 14138 leader_election.cc:336] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
W20260620 13:59:48.509256 14138 leader_election.cc:336] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.509107 14533 raft_consensus.cc:515] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.509572 14140 leader_election.cc:304] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e; no voters: ddd2d9da052f4f21838c60a4f143fdba, f33b223a2a51440683343b1044c26647
I20260620 13:59:48.510229 14534 raft_consensus.cc:493] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.510725 14507 raft_consensus.cc:2749] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 13:59:48.511288 14140 leader_election.cc:304] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: f33b223a2a51440683343b1044c26647
I20260620 13:59:48.511639 14533 leader_election.cc:290] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:48.512097 14507 raft_consensus.cc:2804] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:48.512493 14507 raft_consensus.cc:493] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.512836 14507 raft_consensus.cc:3060] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:48.513126 14140 leader_election.cc:304] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: f33b223a2a51440683343b1044c26647
I20260620 13:59:48.514173 14533 raft_consensus.cc:2804] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260620 13:59:48.514590 14533 raft_consensus.cc:493] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Starting leader election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.515039 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ff38af22f04e42bf57fb40b90dff72" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:48.515817 14098 raft_consensus.cc:2468] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 1.
I20260620 13:59:48.510763 14534 raft_consensus.cc:515] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.515013 14533 raft_consensus.cc:3060] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:48.518548 14534 leader_election.cc:290] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:48.519838 14140 leader_election.cc:304] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:48.520764 14534 raft_consensus.cc:2804] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:48.521430 14534 raft_consensus.cc:493] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.521888 14534 raft_consensus.cc:3060] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:48.525213 14507 raft_consensus.cc:515] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } }
W20260620 13:59:48.530905 14138 leader_election.cc:336] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.528115 14533 raft_consensus.cc:515] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.525770 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b31b6740d1843e4b84795a8f90e8597" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba" is_pre_election: true
I20260620 13:59:48.532523 14098 raft_consensus.cc:2468] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 1.
I20260620 13:59:48.533746 14099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07529c987ba84d0faf98639d7465d0c2" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:48.534505 14099 raft_consensus.cc:3060] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:48.534795 14140 leader_election.cc:304] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:48.535349 14098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29e05ada4be4b84903c875dce890372" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:48.535835 14535 raft_consensus.cc:2804] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:48.535916 14098 raft_consensus.cc:3060] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:48.536339 14535 raft_consensus.cc:493] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.536751 14535 raft_consensus.cc:3060] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:48.539135 14527 raft_consensus.cc:493] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.540179 14527 raft_consensus.cc:515] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.542488 14527 leader_election.cc:290] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:48.533264 14507 leader_election.cc:290] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 election: Requested vote from peers ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675), f33b223a2a51440683343b1044c26647 (127.4.155.193:35951)
I20260620 13:59:48.546753 14533 leader_election.cc:290] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:48.547442 14099 raft_consensus.cc:2468] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 2.
I20260620 13:59:48.548312 14535 raft_consensus.cc:515] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.549562 14140 leader_election.cc:304] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:48.551256 14535 leader_election.cc:290] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
W20260620 13:59:48.551796 14138 leader_election.cc:336] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.552254 14533 raft_consensus.cc:2804] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election won for term 2
W20260620 13:59:48.554451 14064 leader_election.cc:336] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.554869 14533 raft_consensus.cc:697] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [term 2 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:48.556137 14533 consensus_queue.cc:237] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } }
I20260620 13:59:48.532186 14534 raft_consensus.cc:515] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.560912 14534 leader_election.cc:290] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675)
I20260620 13:59:48.558908 14099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b31b6740d1843e4b84795a8f90e8597" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:48.562423 14099 raft_consensus.cc:3060] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:48.564222 14167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc6a0775dcd4ff2aeba8d1ac782fcc8" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:48.564525 14100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ff38af22f04e42bf57fb40b90dff72" candidate_uuid: "3072dd282fc542529a7558aafe37a46e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddd2d9da052f4f21838c60a4f143fdba"
I20260620 13:59:48.564931 14167 raft_consensus.cc:2468] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 2.
I20260620 13:59:48.565162 14100 raft_consensus.cc:3060] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:48.561542 14098 raft_consensus.cc:2468] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 3.
W20260620 13:59:48.567493 14138 leader_election.cc:336] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.568081 14140 leader_election.cc:304] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:48.569267 14533 raft_consensus.cc:2804] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:59:48.569796 14533 raft_consensus.cc:697] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 3 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:48.570791 14533 consensus_queue.cc:237] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
W20260620 13:59:48.573179 14138 leader_election.cc:336] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.575043 13919 catalog_manager.cc:5696] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 1 to 2, leader changed from f33b223a2a51440683343b1044c26647 (127.4.155.193) to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 2 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:48.576900 14100 raft_consensus.cc:2468] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 2.
I20260620 13:59:48.579267 14064 leader_election.cc:304] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: f33b223a2a51440683343b1044c26647
W20260620 13:59:48.583565 14138 leader_election.cc:336] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.588326 14527 raft_consensus.cc:2804] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260620 13:59:48.588915 14138 leader_election.cc:336] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.588896 14527 raft_consensus.cc:493] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Starting leader election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.589744 14527 raft_consensus.cc:3060] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Advancing to term 3
I20260620 13:59:48.599442 14140 leader_election.cc:304] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: f33b223a2a51440683343b1044c26647
I20260620 13:59:48.599747 14527 raft_consensus.cc:515] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.601027 14533 raft_consensus.cc:2804] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:48.601624 14533 raft_consensus.cc:697] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 2 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:48.604018 14527 leader_election.cc:290] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 3 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:48.605226 14167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cc6a0775dcd4ff2aeba8d1ac782fcc8" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:48.605882 14167 raft_consensus.cc:3060] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Advancing to term 3
W20260620 13:59:48.608604 14064 leader_election.cc:336] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.615396 14167 raft_consensus.cc:2468] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 3.
I20260620 13:59:48.617092 14064 leader_election.cc:304] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: f33b223a2a51440683343b1044c26647
I20260620 13:59:48.618017 14527 raft_consensus.cc:2804] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Leader election won for term 3
I20260620 13:59:48.618677 14527 raft_consensus.cc:697] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 3 LEADER]: Becoming Leader. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:48.602674 14533 consensus_queue.cc:237] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.619772 14527 consensus_queue.cc:237] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.617413 14099 raft_consensus.cc:2468] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3072dd282fc542529a7558aafe37a46e in term 2.
I20260620 13:59:48.623857 14140 leader_election.cc:304] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: f33b223a2a51440683343b1044c26647
I20260620 13:59:48.625372 14534 raft_consensus.cc:2804] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:48.626142 14511 raft_consensus.cc:493] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.626521 14534 raft_consensus.cc:697] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 2 LEADER]: Becoming Leader. State: Replica: 3072dd282fc542529a7558aafe37a46e, State: Running, Role: LEADER
I20260620 13:59:48.627892 14511 raft_consensus.cc:515] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.628584 14534 consensus_queue.cc:237] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.634618 14511 leader_election.cc:290] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:48.636857 14167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f4ac4bcd198440290b0bc35a20ab7d0" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e" is_pre_election: true
I20260620 13:59:48.637537 14167 raft_consensus.cc:2468] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 1.
I20260620 13:59:48.640224 14064 leader_election.cc:304] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: 
I20260620 13:59:48.641301 14511 raft_consensus.cc:2804] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 13:59:48.641921 14511 raft_consensus.cc:493] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Starting leader election (detected failure of leader f33b223a2a51440683343b1044c26647)
I20260620 13:59:48.642405 14511 raft_consensus.cc:3060] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:59:48.645742 14064 leader_election.cc:336] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.646564 13919 catalog_manager.cc:5696] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba reported cstate change: term changed from 2 to 3, leader changed from f33b223a2a51440683343b1044c26647 (127.4.155.193) to ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194). New cstate: current_term: 3 leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:48.656958 14511 raft_consensus.cc:515] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.659529 14511 leader_election.cc:290] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Requested vote from peers f33b223a2a51440683343b1044c26647 (127.4.155.193:35951), 3072dd282fc542529a7558aafe37a46e (127.4.155.195:36327)
I20260620 13:59:48.661787 14167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f4ac4bcd198440290b0bc35a20ab7d0" candidate_uuid: "ddd2d9da052f4f21838c60a4f143fdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3072dd282fc542529a7558aafe37a46e"
I20260620 13:59:48.662416 14167 raft_consensus.cc:3060] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Advancing to term 2
W20260620 13:59:48.668036 14064 leader_election.cc:336] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111)
I20260620 13:59:48.670311 14167 raft_consensus.cc:2468] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddd2d9da052f4f21838c60a4f143fdba in term 2.
I20260620 13:59:48.671375 14064 leader_election.cc:304] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3072dd282fc542529a7558aafe37a46e, ddd2d9da052f4f21838c60a4f143fdba; no voters: f33b223a2a51440683343b1044c26647
I20260620 13:59:48.672040 14527 raft_consensus.cc:2804] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:48.672561 14527 raft_consensus.cc:697] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Becoming Leader. State: Replica: ddd2d9da052f4f21838c60a4f143fdba, State: Running, Role: LEADER
I20260620 13:59:48.673846 14527 consensus_queue.cc:237] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } }
I20260620 13:59:48.673591 13919 catalog_manager.cc:5696] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 2 to 3, leader changed from f33b223a2a51440683343b1044c26647 (127.4.155.193) to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 3 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:48.675740 13919 catalog_manager.cc:5696] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 1 to 2, leader changed from f33b223a2a51440683343b1044c26647 (127.4.155.193) to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 2 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:48.677467 13919 catalog_manager.cc:5696] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e reported cstate change: term changed from 1 to 2, leader changed from f33b223a2a51440683343b1044c26647 (127.4.155.193) to 3072dd282fc542529a7558aafe37a46e (127.4.155.195). New cstate: current_term: 2 leader_uuid: "3072dd282fc542529a7558aafe37a46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:48.687394 13923 catalog_manager.cc:5696] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba reported cstate change: term changed from 1 to 2, leader changed from f33b223a2a51440683343b1044c26647 (127.4.155.193) to ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194). New cstate: current_term: 2 leader_uuid: "ddd2d9da052f4f21838c60a4f143fdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33b223a2a51440683343b1044c26647" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 } health_report { overall_health: UNKNOWN } } }
W20260620 13:59:48.941308 14138 consensus_peers.cc:597] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:48.979879 14099 raft_consensus.cc:1275] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:48.981242 14534 consensus_queue.cc:1048] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:49.100481 14100 raft_consensus.cc:1275] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 13:59:49.101892 14534 consensus_queue.cc:1048] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260620 13:59:49.103160 14138 consensus_peers.cc:597] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:49.117059 14138 consensus_peers.cc:597] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:49.117658 14100 raft_consensus.cc:1275] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:49.118928 14533 consensus_queue.cc:1048] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260620 13:59:49.147733 14138 consensus_peers.cc:597] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:49.170148 14064 consensus_peers.cc:597] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:49.173065 14167 raft_consensus.cc:1275] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260620 13:59:49.173638 14173 raft_consensus.cc:1275] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Refusing update from remote peer ddd2d9da052f4f21838c60a4f143fdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260620 13:59:49.174384 14511 consensus_queue.cc:1048] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260620 13:59:49.174912 14527 consensus_queue.cc:1048] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3072dd282fc542529a7558aafe37a46e" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 13:59:49.194083 14100 raft_consensus.cc:1275] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Refusing update from remote peer 3072dd282fc542529a7558aafe37a46e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260620 13:59:49.195854 14534 consensus_queue.cc:1048] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd2d9da052f4f21838c60a4f143fdba" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260620 13:59:49.219357 14064 consensus_peers.cc:597] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 13:59:49.246492  4719 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 14046)
W20260620 13:59:49.550034 14064 consensus_peers.cc:597] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:49.721925 14138 consensus_peers.cc:597] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:49.819216 14138 consensus_peers.cc:597] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:49.985350 14138 consensus_peers.cc:597] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:49.998700 14064 consensus_peers.cc:597] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:50.010926 14064 consensus_peers.cc:597] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:50.029983 14138 consensus_peers.cc:597] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:50.048061 14138 consensus_peers.cc:597] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:50.051326 14138 consensus_peers.cc:597] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:50.087731 14064 consensus_peers.cc:597] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:50.111804 14064 consensus_peers.cc:597] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:50.236251 14064 consensus_peers.cc:597] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba -> Peer f33b223a2a51440683343b1044c26647 (127.4.155.193:35951): Couldn't send request to peer f33b223a2a51440683343b1044c26647. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:35951: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260620 13:59:50.247028  4719 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 14046)
I20260620 13:59:50.447424  4719 tablet_server.cc:196] TabletServer@127.4.155.193:0 shutdown complete.
I20260620 13:59:50.491844  4719 tablet_server.cc:179] TabletServer@127.4.155.194:0 shutting down...
W20260620 13:59:50.507815 14140 consensus_peers.cc:597] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e -> Peer ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675): Couldn't send request to peer ddd2d9da052f4f21838c60a4f143fdba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:50.524653  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:59:50.525576  4719 tablet_replica.cc:333] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.526625  4719 raft_consensus.cc:2243] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.527298  4719 raft_consensus.cc:2272] T 6d68cc99fffb46cbb317cf1f588857d2 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.530097  4719 tablet_replica.cc:333] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.530927  4719 raft_consensus.cc:2243] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.531870  4719 raft_consensus.cc:2272] T ea63887d03ad488097661550c7efb41f P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.534006  4719 tablet_replica.cc:333] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.534557  4719 raft_consensus.cc:2243] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.535401  4719 raft_consensus.cc:2272] T e9a8bd236b6340ffae12764b4599066b P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.537658  4719 tablet_replica.cc:333] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.538250  4719 raft_consensus.cc:2243] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.539212  4719 raft_consensus.cc:2272] T 0f4ac4bcd198440290b0bc35a20ab7d0 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.541348  4719 tablet_replica.cc:333] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.541946  4719 raft_consensus.cc:2243] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.542431  4719 raft_consensus.cc:2272] T 4b31b6740d1843e4b84795a8f90e8597 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.545184  4719 tablet_replica.cc:333] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.545814  4719 raft_consensus.cc:2243] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.546342  4719 raft_consensus.cc:2272] T 59f03a1afd8f48dc8e6e392ffc42d79a P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.548688  4719 tablet_replica.cc:333] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.549342  4719 raft_consensus.cc:2243] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.549832  4719 raft_consensus.cc:2272] T a94b124bc8d6430ba3a7d70fc5d4fec2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.552516  4719 tablet_replica.cc:333] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.553278  4719 raft_consensus.cc:2243] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.554190  4719 raft_consensus.cc:2272] T 77511ca3f725427699c041aeb81e6905 P ddd2d9da052f4f21838c60a4f143fdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.556542  4719 tablet_replica.cc:333] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.557153  4719 raft_consensus.cc:2243] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.557637  4719 raft_consensus.cc:2272] T 95ff38af22f04e42bf57fb40b90dff72 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.559957  4719 tablet_replica.cc:333] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.560587  4719 raft_consensus.cc:2243] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.561091  4719 raft_consensus.cc:2272] T aae371b2d718455abbbfafb14691c3e1 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.563508  4719 tablet_replica.cc:333] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.564152  4719 raft_consensus.cc:2243] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.564694  4719 raft_consensus.cc:2272] T 4714f60c31e649ddba4445c6022d9dc3 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.567328  4719 tablet_replica.cc:333] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.567940  4719 raft_consensus.cc:2243] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.568909  4719 raft_consensus.cc:2272] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.571210  4719 tablet_replica.cc:333] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.571781  4719 raft_consensus.cc:2243] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.572242  4719 raft_consensus.cc:2272] T 07529c987ba84d0faf98639d7465d0c2 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.574326  4719 tablet_replica.cc:333] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.574910  4719 raft_consensus.cc:2243] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.575801  4719 raft_consensus.cc:2272] T 3cc8f78c35054fb680acf6668bfa8f57 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.578508  4719 tablet_replica.cc:333] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.579041  4719 raft_consensus.cc:2243] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.579542  4719 raft_consensus.cc:2272] T 73e50c85167b4a6c83892dd58be19c79 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.581718  4719 tablet_replica.cc:333] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.582244  4719 raft_consensus.cc:2243] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.583119  4719 raft_consensus.cc:2272] T 80e1393235534f46bd9ee5f875cdd944 P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.585587  4719 tablet_replica.cc:333] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.586104  4719 raft_consensus.cc:2243] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.589237  4719 raft_consensus.cc:2272] T 62846366d99d41cd88aa9d766bbf6e9b P ddd2d9da052f4f21838c60a4f143fdba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:50.592433 14140 consensus_peers.cc:597] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e -> Peer ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675): Couldn't send request to peer ddd2d9da052f4f21838c60a4f143fdba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:50.593272  4719 tablet_replica.cc:333] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba: stopping tablet replica
I20260620 13:59:50.593954  4719 raft_consensus.cc:2243] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.594483  4719 raft_consensus.cc:2272] T c29e05ada4be4b84903c875dce890372 P ddd2d9da052f4f21838c60a4f143fdba [term 3 FOLLOWER]: Raft consensus is shut down!
W20260620 13:59:50.620369 14140 consensus_peers.cc:597] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e -> Peer ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675): Couldn't send request to peer ddd2d9da052f4f21838c60a4f143fdba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:50.641829  4719 tablet_server.cc:196] TabletServer@127.4.155.194:0 shutdown complete.
W20260620 13:59:50.648340 14140 consensus_peers.cc:597] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e -> Peer ddd2d9da052f4f21838c60a4f143fdba (127.4.155.194:39675): Couldn't send request to peer ddd2d9da052f4f21838c60a4f143fdba. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.194:39675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 13:59:50.680541  4719 tablet_server.cc:179] TabletServer@127.4.155.195:0 shutting down...
I20260620 13:59:50.715023  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 13:59:50.715806  4719 tablet_replica.cc:333] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.716670  4719 raft_consensus.cc:2243] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.717720  4719 raft_consensus.cc:2272] T 6d68cc99fffb46cbb317cf1f588857d2 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.720108  4719 tablet_replica.cc:333] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.720703  4719 raft_consensus.cc:2243] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.721235  4719 raft_consensus.cc:2272] T ea63887d03ad488097661550c7efb41f P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.723520  4719 tablet_replica.cc:333] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.724126  4719 raft_consensus.cc:2243] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.724617  4719 raft_consensus.cc:2272] T e9a8bd236b6340ffae12764b4599066b P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.726876  4719 tablet_replica.cc:333] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.727564  4719 raft_consensus.cc:2243] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.728093  4719 raft_consensus.cc:2272] T 0f4ac4bcd198440290b0bc35a20ab7d0 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.730050  4719 tablet_replica.cc:333] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.730628  4719 raft_consensus.cc:2243] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.731807  4719 raft_consensus.cc:2272] T 4b31b6740d1843e4b84795a8f90e8597 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.734098  4719 tablet_replica.cc:333] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.734711  4719 raft_consensus.cc:2243] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.735610  4719 raft_consensus.cc:2272] T 59f03a1afd8f48dc8e6e392ffc42d79a P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.737951  4719 tablet_replica.cc:333] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.738502  4719 raft_consensus.cc:2243] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.738996  4719 raft_consensus.cc:2272] T 3cc8f78c35054fb680acf6668bfa8f57 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.741258  4719 tablet_replica.cc:333] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.741865  4719 raft_consensus.cc:2243] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.742384  4719 raft_consensus.cc:2272] T 2cc6a0775dcd4ff2aeba8d1ac782fcc8 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.744508  4719 tablet_replica.cc:333] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.745069  4719 raft_consensus.cc:2243] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.745890  4719 raft_consensus.cc:2272] T 07529c987ba84d0faf98639d7465d0c2 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.748090  4719 tablet_replica.cc:333] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.748672  4719 raft_consensus.cc:2243] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.749469  4719 raft_consensus.cc:2272] T aae371b2d718455abbbfafb14691c3e1 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.751861  4719 tablet_replica.cc:333] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.752434  4719 raft_consensus.cc:2243] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.753224  4719 raft_consensus.cc:2272] T 4714f60c31e649ddba4445c6022d9dc3 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.755311  4719 tablet_replica.cc:333] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.755913  4719 raft_consensus.cc:2243] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.756398  4719 raft_consensus.cc:2272] T 80e1393235534f46bd9ee5f875cdd944 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.758543  4719 tablet_replica.cc:333] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.759052  4719 raft_consensus.cc:2243] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.759575  4719 raft_consensus.cc:2272] T 62846366d99d41cd88aa9d766bbf6e9b P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.761633  4719 tablet_replica.cc:333] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.762157  4719 raft_consensus.cc:2243] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.762992  4719 raft_consensus.cc:2272] T c29e05ada4be4b84903c875dce890372 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.765157  4719 tablet_replica.cc:333] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.765736  4719 raft_consensus.cc:2243] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 13:59:50.766278  4719 raft_consensus.cc:2272] T 77511ca3f725427699c041aeb81e6905 P 3072dd282fc542529a7558aafe37a46e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.768656  4719 tablet_replica.cc:333] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.769347  4719 raft_consensus.cc:2243] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.770298  4719 raft_consensus.cc:2272] T a94b124bc8d6430ba3a7d70fc5d4fec2 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.772517  4719 tablet_replica.cc:333] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.773033  4719 raft_consensus.cc:2243] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 2 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.774149  4719 raft_consensus.cc:2272] T 95ff38af22f04e42bf57fb40b90dff72 P 3072dd282fc542529a7558aafe37a46e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.776177  4719 tablet_replica.cc:333] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e: stopping tablet replica
I20260620 13:59:50.776678  4719 raft_consensus.cc:2243] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [term 3 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.777472  4719 raft_consensus.cc:2272] T 73e50c85167b4a6c83892dd58be19c79 P 3072dd282fc542529a7558aafe37a46e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.822402  4719 tablet_server.cc:196] TabletServer@127.4.155.195:0 shutdown complete.
I20260620 13:59:50.858371  4719 master.cc:562] Master@127.4.155.254:42757 shutting down...
I20260620 13:59:50.884085  4719 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [term 1 LEADER]: Raft consensus shutting down.
I20260620 13:59:50.884656  4719 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 13:59:50.885000  4719 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1a1cef163b904e4084cab21cc3904bb7: stopping tablet replica
I20260620 13:59:50.906530  4719 master.cc:584] Master@127.4.155.254:42757 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (24444 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260620 13:59:50.964627  4719 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.155.254:36277
I20260620 13:59:50.965777  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:59:50.972259 14560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:50.972519 14561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:50.974411 14563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:50.975664  4719 server_base.cc:1061] running on GCE node
I20260620 13:59:50.976666  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:59:50.976858  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:59:50.977012  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963990976999 us; error 0 us; skew 500 ppm
I20260620 13:59:50.977509  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:59:50.980195  4719 webserver.cc:533] Webserver started at http://127.4.155.254:41587/ using document root <none> and password file <none>
I20260620 13:59:50.980664  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:59:50.980829  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:59:50.981066  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:59:50.982196  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/master-0-root/instance:
uuid: "06c2c68112974cd9b76a47d8aae9bcec"
format_stamp: "Formatted at 2026-06-20 13:59:50 on dist-test-slave-n70f"
I20260620 13:59:50.987248  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260620 13:59:50.991068 14568 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:50.992010  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260620 13:59:50.992318  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/master-0-root
uuid: "06c2c68112974cd9b76a47d8aae9bcec"
format_stamp: "Formatted at 2026-06-20 13:59:50 on dist-test-slave-n70f"
I20260620 13:59:50.992662  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:59:51.015651  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:59:51.017161  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:59:51.060163  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.254:36277
I20260620 13:59:51.060286 14619 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.254:36277 every 8 connection(s)
I20260620 13:59:51.064229 14620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.076166 14620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec: Bootstrap starting.
I20260620 13:59:51.081923 14620 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:51.086845 14620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec: No bootstrap required, opened a new log
I20260620 13:59:51.089197 14620 raft_consensus.cc:359] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c2c68112974cd9b76a47d8aae9bcec" member_type: VOTER }
I20260620 13:59:51.089597 14620 raft_consensus.cc:385] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:51.089933 14620 raft_consensus.cc:740] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06c2c68112974cd9b76a47d8aae9bcec, State: Initialized, Role: FOLLOWER
I20260620 13:59:51.090622 14620 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c2c68112974cd9b76a47d8aae9bcec" member_type: VOTER }
I20260620 13:59:51.091596 14620 raft_consensus.cc:399] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 13:59:51.092134 14620 raft_consensus.cc:493] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 13:59:51.092470 14620 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:51.097568 14620 raft_consensus.cc:515] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c2c68112974cd9b76a47d8aae9bcec" member_type: VOTER }
I20260620 13:59:51.098146 14620 leader_election.cc:304] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 06c2c68112974cd9b76a47d8aae9bcec; no voters: 
I20260620 13:59:51.099408 14620 leader_election.cc:290] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 13:59:51.099828 14623 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:51.101289 14623 raft_consensus.cc:697] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [term 1 LEADER]: Becoming Leader. State: Replica: 06c2c68112974cd9b76a47d8aae9bcec, State: Running, Role: LEADER
I20260620 13:59:51.101967 14623 consensus_queue.cc:237] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c2c68112974cd9b76a47d8aae9bcec" member_type: VOTER }
I20260620 13:59:51.102420 14620 sys_catalog.cc:565] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [sys.catalog]: configured and running, proceeding with master startup.
I20260620 13:59:51.108342 14624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "06c2c68112974cd9b76a47d8aae9bcec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c2c68112974cd9b76a47d8aae9bcec" member_type: VOTER } }
I20260620 13:59:51.108765 14625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06c2c68112974cd9b76a47d8aae9bcec. Latest consensus state: current_term: 1 leader_uuid: "06c2c68112974cd9b76a47d8aae9bcec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06c2c68112974cd9b76a47d8aae9bcec" member_type: VOTER } }
I20260620 13:59:51.109098 14624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [sys.catalog]: This master's current role is: LEADER
I20260620 13:59:51.109308 14625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [sys.catalog]: This master's current role is: LEADER
I20260620 13:59:51.114562 14628 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260620 13:59:51.120596 14628 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260620 13:59:51.121860  4719 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 13:59:51.130103 14628 catalog_manager.cc:1382] Generated new cluster ID: 883626ec3954487e843431e741f126a6
I20260620 13:59:51.130414 14628 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260620 13:59:51.156467 14628 catalog_manager.cc:1405] Generated new certificate authority record
I20260620 13:59:51.157804 14628 catalog_manager.cc:1539] Loading token signing keys...
I20260620 13:59:51.176287 14628 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec: Generated new TSK 0
I20260620 13:59:51.176915 14628 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260620 13:59:51.189163  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:59:51.195261 14641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:51.196521 14642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:51.198872 14644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:51.198968  4719 server_base.cc:1061] running on GCE node
I20260620 13:59:51.200234  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:59:51.200413  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:59:51.200608  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963991200594 us; error 0 us; skew 500 ppm
I20260620 13:59:51.201174  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:59:51.203707  4719 webserver.cc:533] Webserver started at http://127.4.155.193:35283/ using document root <none> and password file <none>
I20260620 13:59:51.204159  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:59:51.204356  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:59:51.204568  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:59:51.205569  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/ts-0-root/instance:
uuid: "1edd468a2156418bb09fe244c3646ba8"
format_stamp: "Formatted at 2026-06-20 13:59:51 on dist-test-slave-n70f"
I20260620 13:59:51.209796  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260620 13:59:51.213409 14649 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:51.214470  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260620 13:59:51.214792  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/ts-0-root
uuid: "1edd468a2156418bb09fe244c3646ba8"
format_stamp: "Formatted at 2026-06-20 13:59:51 on dist-test-slave-n70f"
I20260620 13:59:51.215219  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:59:51.233603  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:59:51.234858  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:59:51.236397  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:59:51.238696  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:59:51.238870  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:51.239176  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:59:51.239344  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:51.280917  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.193:34203
I20260620 13:59:51.281049 14711 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.193:34203 every 8 connection(s)
I20260620 13:59:51.286047  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:59:51.293088 14716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:51.295116 14717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:51.297221 14719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:51.298733  4719 server_base.cc:1061] running on GCE node
I20260620 13:59:51.298640 14712 heartbeater.cc:344] Connected to a master server at 127.4.155.254:36277
I20260620 13:59:51.299413 14712 heartbeater.cc:461] Registering TS with master...
I20260620 13:59:51.299836  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:59:51.300118  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:59:51.300246 14712 heartbeater.cc:507] Master 127.4.155.254:36277 requested a full tablet report, sending...
I20260620 13:59:51.300295  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963991300275 us; error 0 us; skew 500 ppm
I20260620 13:59:51.301159  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:59:51.302953 14585 ts_manager.cc:194] Registered new tserver with Master: 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203)
I20260620 13:59:51.304280  4719 webserver.cc:533] Webserver started at http://127.4.155.194:33717/ using document root <none> and password file <none>
I20260620 13:59:51.304967  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:59:51.305233  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:59:51.305518  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:59:51.305682 14585 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37282
I20260620 13:59:51.307185  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/ts-1-root/instance:
uuid: "35ac0551993c42189492d4256639983d"
format_stamp: "Formatted at 2026-06-20 13:59:51 on dist-test-slave-n70f"
I20260620 13:59:51.312089  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260620 13:59:51.315766 14724 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:51.316679  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260620 13:59:51.317020  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/ts-1-root
uuid: "35ac0551993c42189492d4256639983d"
format_stamp: "Formatted at 2026-06-20 13:59:51 on dist-test-slave-n70f"
I20260620 13:59:51.317317  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:59:51.346081  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:59:51.347299  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:59:51.348809  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:59:51.351478  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:59:51.351667  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:51.351997  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:59:51.352154  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:51.393874  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.194:38131
I20260620 13:59:51.394121 14786 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.194:38131 every 8 connection(s)
I20260620 13:59:51.399483  4719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260620 13:59:51.406883 14790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 13:59:51.408021 14791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:51.411998 14787 heartbeater.cc:344] Connected to a master server at 127.4.155.254:36277
I20260620 13:59:51.412460 14787 heartbeater.cc:461] Registering TS with master...
I20260620 13:59:51.413201 14787 heartbeater.cc:507] Master 127.4.155.254:36277 requested a full tablet report, sending...
I20260620 13:59:51.415517 14585 ts_manager.cc:194] Registered new tserver with Master: 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
W20260620 13:59:51.417214 14793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 13:59:51.417601  4719 server_base.cc:1061] running on GCE node
I20260620 13:59:51.417865 14585 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37296
I20260620 13:59:51.418792  4719 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 13:59:51.419185  4719 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 13:59:51.419407  4719 hybrid_clock.cc:648] HybridClock initialized: now 1781963991419389 us; error 0 us; skew 500 ppm
I20260620 13:59:51.420060  4719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 13:59:51.422816  4719 webserver.cc:533] Webserver started at http://127.4.155.195:38105/ using document root <none> and password file <none>
I20260620 13:59:51.423487  4719 fs_manager.cc:362] Metadata directory not provided
I20260620 13:59:51.423899  4719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 13:59:51.424227  4719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 13:59:51.425428  4719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/ts-2-root/instance:
uuid: "b5509f23c3544993b8ac7d0318b5d857"
format_stamp: "Formatted at 2026-06-20 13:59:51 on dist-test-slave-n70f"
I20260620 13:59:51.430727  4719 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260620 13:59:51.434701 14798 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:51.435806  4719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260620 13:59:51.436367  4719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/ts-2-root
uuid: "b5509f23c3544993b8ac7d0318b5d857"
format_stamp: "Formatted at 2026-06-20 13:59:51 on dist-test-slave-n70f"
I20260620 13:59:51.436728  4719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskSzm5HW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1781963654985192-4719-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 13:59:51.465454  4719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260620 13:59:51.466744  4719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 13:59:51.469022  4719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260620 13:59:51.472643  4719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 13:59:51.472903  4719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:51.473196  4719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260620 13:59:51.473397  4719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 13:59:51.518069  4719 rpc_server.cc:307] RPC server started. Bound to: 127.4.155.195:42345
I20260620 13:59:51.518167 14860 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.155.195:42345 every 8 connection(s)
I20260620 13:59:51.532905 14861 heartbeater.cc:344] Connected to a master server at 127.4.155.254:36277
I20260620 13:59:51.533360 14861 heartbeater.cc:461] Registering TS with master...
I20260620 13:59:51.534086 14861 heartbeater.cc:507] Master 127.4.155.254:36277 requested a full tablet report, sending...
I20260620 13:59:51.536181 14585 ts_manager.cc:194] Registered new tserver with Master: b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:51.536540  4719 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014968824s
I20260620 13:59:51.538030 14585 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37312
I20260620 13:59:51.565008 14585 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37314:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260620 13:59:51.567759 14585 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 13:59:51.638106 14677 tablet_service.cc:1511] Processing CreateTablet for tablet 13ec7ecfb90c4c5ea2c0e1b06fcf9125 (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260620 13:59:51.640125 14677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ec7ecfb90c4c5ea2c0e1b06fcf9125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.644138 14826 tablet_service.cc:1511] Processing CreateTablet for tablet 13ec7ecfb90c4c5ea2c0e1b06fcf9125 (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260620 13:59:51.645733 14826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ec7ecfb90c4c5ea2c0e1b06fcf9125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.645409 14824 tablet_service.cc:1511] Processing CreateTablet for tablet a9437fc794164eb4b27d418baaf04c08 (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260620 13:59:51.646127 14823 tablet_service.cc:1511] Processing CreateTablet for tablet 22dada0282d74460ad79540693d4b1cf (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260620 13:59:51.647289 14824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9437fc794164eb4b27d418baaf04c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.648324 14825 tablet_service.cc:1511] Processing CreateTablet for tablet b93febc746444f00a48276a77eb3ee8b (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260620 13:59:51.650252 14822 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0c9fed06bb40d58aa45524e52f6394 (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260620 13:59:51.651363 14825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93febc746444f00a48276a77eb3ee8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.652067 14822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0c9fed06bb40d58aa45524e52f6394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.653159 14823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22dada0282d74460ad79540693d4b1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.665165 14821 tablet_service.cc:1511] Processing CreateTablet for tablet 48a8fdc706ad47ce8771b288d5dcbe9f (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260620 13:59:51.666702 14821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a8fdc706ad47ce8771b288d5dcbe9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.667595 14676 tablet_service.cc:1511] Processing CreateTablet for tablet b93febc746444f00a48276a77eb3ee8b (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260620 13:59:51.670204 14673 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0c9fed06bb40d58aa45524e52f6394 (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260620 13:59:51.671697 14673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0c9fed06bb40d58aa45524e52f6394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.672333 14820 tablet_service.cc:1511] Processing CreateTablet for tablet d21a96ea4d884462ac59a884f64bafb5 (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260620 13:59:51.673698 14820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d21a96ea4d884462ac59a884f64bafb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.676318 14752 tablet_service.cc:1511] Processing CreateTablet for tablet 13ec7ecfb90c4c5ea2c0e1b06fcf9125 (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260620 13:59:51.678262 14752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ec7ecfb90c4c5ea2c0e1b06fcf9125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.677990 14670 tablet_service.cc:1511] Processing CreateTablet for tablet 19fdfe98616741b992d9ca8f6598dbd4 (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260620 13:59:51.678634 14751 tablet_service.cc:1511] Processing CreateTablet for tablet b93febc746444f00a48276a77eb3ee8b (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260620 13:59:51.679155 14748 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0c9fed06bb40d58aa45524e52f6394 (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260620 13:59:51.680169 14751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93febc746444f00a48276a77eb3ee8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.680208 14746 tablet_service.cc:1511] Processing CreateTablet for tablet d21a96ea4d884462ac59a884f64bafb5 (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260620 13:59:51.681614 14746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d21a96ea4d884462ac59a884f64bafb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.681288 14674 tablet_service.cc:1511] Processing CreateTablet for tablet 22dada0282d74460ad79540693d4b1cf (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260620 13:59:51.683063 14675 tablet_service.cc:1511] Processing CreateTablet for tablet a9437fc794164eb4b27d418baaf04c08 (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260620 13:59:51.680212 14669 tablet_service.cc:1511] Processing CreateTablet for tablet 479a807e25a44a72985d99be6373c59a (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260620 13:59:51.676324 14671 tablet_service.cc:1511] Processing CreateTablet for tablet d21a96ea4d884462ac59a884f64bafb5 (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260620 13:59:51.685767 14749 tablet_service.cc:1511] Processing CreateTablet for tablet 22dada0282d74460ad79540693d4b1cf (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260620 13:59:51.686630 14670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19fdfe98616741b992d9ca8f6598dbd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.686470 14672 tablet_service.cc:1511] Processing CreateTablet for tablet 48a8fdc706ad47ce8771b288d5dcbe9f (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260620 13:59:51.678031 14747 tablet_service.cc:1511] Processing CreateTablet for tablet 48a8fdc706ad47ce8771b288d5dcbe9f (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260620 13:59:51.687371 14749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22dada0282d74460ad79540693d4b1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.689515 14745 tablet_service.cc:1511] Processing CreateTablet for tablet 19fdfe98616741b992d9ca8f6598dbd4 (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260620 13:59:51.690919 14745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19fdfe98616741b992d9ca8f6598dbd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.693011 14747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a8fdc706ad47ce8771b288d5dcbe9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.693921 14748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0c9fed06bb40d58aa45524e52f6394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.695447 14744 tablet_service.cc:1511] Processing CreateTablet for tablet 479a807e25a44a72985d99be6373c59a (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260620 13:59:51.696807 14744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479a807e25a44a72985d99be6373c59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.688602 14750 tablet_service.cc:1511] Processing CreateTablet for tablet a9437fc794164eb4b27d418baaf04c08 (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260620 13:59:51.700647 14750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9437fc794164eb4b27d418baaf04c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.705008 14818 tablet_service.cc:1511] Processing CreateTablet for tablet 479a807e25a44a72985d99be6373c59a (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260620 13:59:51.706491 14818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479a807e25a44a72985d99be6373c59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.670879 14819 tablet_service.cc:1511] Processing CreateTablet for tablet 19fdfe98616741b992d9ca8f6598dbd4 (DEFAULT_TABLE table=test-workload [id=dd5292c0b809429e85e88cefe6a261ba]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260620 13:59:51.708424 14819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19fdfe98616741b992d9ca8f6598dbd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.711851 14676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93febc746444f00a48276a77eb3ee8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.736011 14672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a8fdc706ad47ce8771b288d5dcbe9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.736843 14671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d21a96ea4d884462ac59a884f64bafb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.743633 14675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9437fc794164eb4b27d418baaf04c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.746021 14674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22dada0282d74460ad79540693d4b1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.762712 14875 tablet_bootstrap.cc:492] T 1e0c9fed06bb40d58aa45524e52f6394 P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:51.817988 14669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479a807e25a44a72985d99be6373c59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:51.837435 14875 tablet_bootstrap.cc:654] T 1e0c9fed06bb40d58aa45524e52f6394 P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:51.866019 14877 tablet_bootstrap.cc:492] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:51.875206 14876 tablet_bootstrap.cc:492] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:51.879338 14877 tablet_bootstrap.cc:654] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:51.881362 14875 tablet_bootstrap.cc:492] T 1e0c9fed06bb40d58aa45524e52f6394 P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:51.881847 14875 ts_tablet_manager.cc:1403] T 1e0c9fed06bb40d58aa45524e52f6394 P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.119s	user 0.008s	sys 0.004s
I20260620 13:59:51.882683 14876 tablet_bootstrap.cc:654] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:51.884418 14875 raft_consensus.cc:359] T 1e0c9fed06bb40d58aa45524e52f6394 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:51.885035 14875 raft_consensus.cc:385] T 1e0c9fed06bb40d58aa45524e52f6394 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:51.885188 14877 tablet_bootstrap.cc:492] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:51.885354 14875 raft_consensus.cc:740] T 1e0c9fed06bb40d58aa45524e52f6394 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:51.885878 14877 ts_tablet_manager.cc:1403] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.004s
I20260620 13:59:51.886476 14875 consensus_queue.cc:260] T 1e0c9fed06bb40d58aa45524e52f6394 P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:51.888561 14876 tablet_bootstrap.cc:492] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:51.889009 14861 heartbeater.cc:499] Master 127.4.155.254:36277 was elected leader, sending a full tablet report...
I20260620 13:59:51.889084 14876 ts_tablet_manager.cc:1403] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.015s	user 0.001s	sys 0.011s
I20260620 13:59:51.890410 14875 ts_tablet_manager.cc:1434] T 1e0c9fed06bb40d58aa45524e52f6394 P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260620 13:59:51.888939 14877 raft_consensus.cc:359] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:51.891178 14877 raft_consensus.cc:385] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:51.891500 14877 raft_consensus.cc:740] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:51.910898 14875 tablet_bootstrap.cc:492] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:51.910598 14877 consensus_queue.cc:260] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:51.913762 14787 heartbeater.cc:499] Master 127.4.155.254:36277 was elected leader, sending a full tablet report...
I20260620 13:59:51.914268 14877 ts_tablet_manager.cc:1434] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.020s
I20260620 13:59:51.915530 14877 tablet_bootstrap.cc:492] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:51.918545 14875 tablet_bootstrap.cc:654] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:51.922748 14877 tablet_bootstrap.cc:654] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:51.923472 14876 raft_consensus.cc:359] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:51.924598 14876 raft_consensus.cc:385] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:51.924975 14876 raft_consensus.cc:740] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:51.925945 14876 consensus_queue.cc:260] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:51.931900 14875 tablet_bootstrap.cc:492] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:51.932577 14875 ts_tablet_manager.cc:1403] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260620 13:59:51.932678 14876 ts_tablet_manager.cc:1434] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.004s
I20260620 13:59:51.933008 14712 heartbeater.cc:499] Master 127.4.155.254:36277 was elected leader, sending a full tablet report...
I20260620 13:59:51.934448 14876 tablet_bootstrap.cc:492] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:51.936174 14875 raft_consensus.cc:359] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } }
I20260620 13:59:51.937071 14875 raft_consensus.cc:385] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:51.937439 14875 raft_consensus.cc:740] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:51.938594 14875 consensus_queue.cc:260] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } }
I20260620 13:59:51.941293 14875 ts_tablet_manager.cc:1434] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260620 13:59:51.941650 14876 tablet_bootstrap.cc:654] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:51.942428 14875 tablet_bootstrap.cc:492] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:51.951738 14875 tablet_bootstrap.cc:654] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:51.965745 14875 tablet_bootstrap.cc:492] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:51.966282 14875 ts_tablet_manager.cc:1403] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260620 13:59:51.967263 14877 tablet_bootstrap.cc:492] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:51.967962 14876 tablet_bootstrap.cc:492] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:51.968478 14877 ts_tablet_manager.cc:1403] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.024s
I20260620 13:59:51.968573 14876 ts_tablet_manager.cc:1403] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.034s	user 0.025s	sys 0.008s
I20260620 13:59:51.969272 14875 raft_consensus.cc:359] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:51.970062 14875 raft_consensus.cc:385] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:51.970371 14875 raft_consensus.cc:740] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:51.971167 14875 consensus_queue.cc:260] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:51.971783 14877 raft_consensus.cc:359] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } }
I20260620 13:59:51.972615 14877 raft_consensus.cc:385] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:51.972090 14876 raft_consensus.cc:359] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:51.973014 14877 raft_consensus.cc:740] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:51.973429 14876 raft_consensus.cc:385] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:51.973647 14875 ts_tablet_manager.cc:1434] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260620 13:59:51.973814 14876 raft_consensus.cc:740] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:51.973927 14877 consensus_queue.cc:260] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } }
I20260620 13:59:51.974888 14875 tablet_bootstrap.cc:492] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:51.975075 14876 consensus_queue.cc:260] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:51.976836 14877 ts_tablet_manager.cc:1434] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260620 13:59:51.977811 14876 ts_tablet_manager.cc:1434] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260620 13:59:51.979025 14876 tablet_bootstrap.cc:492] T 1e0c9fed06bb40d58aa45524e52f6394 P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:51.977901 14877 tablet_bootstrap.cc:492] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:51.982118 14875 tablet_bootstrap.cc:654] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:51.986081 14876 tablet_bootstrap.cc:654] T 1e0c9fed06bb40d58aa45524e52f6394 P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:51.987181 14877 tablet_bootstrap.cc:654] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.009300 14882 raft_consensus.cc:493] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.010133 14882 raft_consensus.cc:515] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.015678 14882 leader_election.cc:290] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.031646 14876 tablet_bootstrap.cc:492] T 1e0c9fed06bb40d58aa45524e52f6394 P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:52.032456 14876 ts_tablet_manager.cc:1403] T 1e0c9fed06bb40d58aa45524e52f6394 P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.034s
I20260620 13:59:52.037734 14877 tablet_bootstrap.cc:492] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:52.038549 14877 ts_tablet_manager.cc:1403] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.033s
I20260620 13:59:52.040867 14876 raft_consensus.cc:359] T 1e0c9fed06bb40d58aa45524e52f6394 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.042037 14876 raft_consensus.cc:385] T 1e0c9fed06bb40d58aa45524e52f6394 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.042394 14876 raft_consensus.cc:740] T 1e0c9fed06bb40d58aa45524e52f6394 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.043339 14876 consensus_queue.cc:260] T 1e0c9fed06bb40d58aa45524e52f6394 P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.046022 14876 ts_tablet_manager.cc:1434] T 1e0c9fed06bb40d58aa45524e52f6394 P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260620 13:59:52.047072 14876 tablet_bootstrap.cc:492] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:52.047828 14875 tablet_bootstrap.cc:492] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:52.048425 14875 ts_tablet_manager.cc:1403] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.035s
I20260620 13:59:52.051421 14875 raft_consensus.cc:359] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.052145 14875 raft_consensus.cc:385] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.052444 14875 raft_consensus.cc:740] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.054400 14876 tablet_bootstrap.cc:654] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.054757 14875 consensus_queue.cc:260] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.058910 14875 ts_tablet_manager.cc:1434] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260620 13:59:52.060523 14875 tablet_bootstrap.cc:492] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:52.067188 14875 tablet_bootstrap.cc:654] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.067292 14877 raft_consensus.cc:359] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.068218 14877 raft_consensus.cc:385] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.068534 14877 raft_consensus.cc:740] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.068826 14836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fdfe98616741b992d9ca8f6598dbd4" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:52.069743 14877 consensus_queue.cc:260] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.070730 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fdfe98616741b992d9ca8f6598dbd4" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:52.071450 14687 raft_consensus.cc:2468] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:52.072166 14877 ts_tablet_manager.cc:1434] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.002s
I20260620 13:59:52.072746 14875 tablet_bootstrap.cc:492] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:52.072937 14728 leader_election.cc:304] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d; no voters: 
I20260620 13:59:52.073293 14877 tablet_bootstrap.cc:492] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:52.073314 14875 ts_tablet_manager.cc:1403] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260620 13:59:52.074031 14882 raft_consensus.cc:2804] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:52.074410 14882 raft_consensus.cc:493] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:52.074766 14882 raft_consensus.cc:3060] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.076779 14875 raft_consensus.cc:359] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.077605 14875 raft_consensus.cc:385] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.077891 14875 raft_consensus.cc:740] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.079015 14876 tablet_bootstrap.cc:492] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:52.078688 14875 consensus_queue.cc:260] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
W20260620 13:59:52.074417 14725 leader_election.cc:343] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:52.081442 14875 ts_tablet_manager.cc:1434] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260620 13:59:52.082463 14875 tablet_bootstrap.cc:492] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:52.086627 14877 tablet_bootstrap.cc:654] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.089447 14875 tablet_bootstrap.cc:654] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.079594 14876 ts_tablet_manager.cc:1403] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.012s
I20260620 13:59:52.098131 14882 raft_consensus.cc:515] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.101521 14877 tablet_bootstrap.cc:492] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:52.102118 14877 ts_tablet_manager.cc:1403] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.006s
I20260620 13:59:52.102149 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fdfe98616741b992d9ca8f6598dbd4" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:52.102938 14687 raft_consensus.cc:3060] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.103011 14836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fdfe98616741b992d9ca8f6598dbd4" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:52.105747 14877 raft_consensus.cc:359] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.106519 14877 raft_consensus.cc:385] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.106813 14877 raft_consensus.cc:740] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.098462 14876 raft_consensus.cc:359] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.107807 14876 raft_consensus.cc:385] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260620 13:59:52.107556 14725 leader_election.cc:343] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:52.108089 14881 raft_consensus.cc:493] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.108573 14881 raft_consensus.cc:515] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.109694 14876 raft_consensus.cc:740] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.110725 14882 leader_election.cc:290] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.110584 14876 consensus_queue.cc:260] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.111315 14875 tablet_bootstrap.cc:492] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:52.111922 14875 ts_tablet_manager.cc:1403] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.011s
I20260620 13:59:52.107599 14877 consensus_queue.cc:260] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.114003 14877 ts_tablet_manager.cc:1434] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260620 13:59:52.115368 14877 tablet_bootstrap.cc:492] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d: Bootstrap starting.
W20260620 13:59:52.116083 14633 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:59:52.117337 14875 raft_consensus.cc:359] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.118139 14875 raft_consensus.cc:385] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.118431 14875 raft_consensus.cc:740] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.119277 14875 consensus_queue.cc:260] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.121920 14881 leader_election.cc:290] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 13:59:52.122380 14876 ts_tablet_manager.cc:1434] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260620 13:59:52.124089 14877 tablet_bootstrap.cc:654] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.129011 14875 ts_tablet_manager.cc:1434] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.004s
I20260620 13:59:52.130549 14875 tablet_bootstrap.cc:492] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:52.132642 14876 tablet_bootstrap.cc:492] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:52.140198 14876 tablet_bootstrap.cc:654] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.140530 14899 raft_consensus.cc:493] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.141119 14899 raft_consensus.cc:515] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.142386 14877 tablet_bootstrap.cc:492] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:52.143042 14877 ts_tablet_manager.cc:1403] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.008s
I20260620 13:59:52.143445 14899 leader_election.cc:290] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 13:59:52.147063 14877 raft_consensus.cc:359] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.148402 14882 raft_consensus.cc:493] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.149365 14882 raft_consensus.cc:515] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.151307 14877 raft_consensus.cc:385] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.151705 14875 tablet_bootstrap.cc:654] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.151824 14877 raft_consensus.cc:740] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.152987 14877 consensus_queue.cc:260] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.153924 14686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a8fdc706ad47ce8771b288d5dcbe9f" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:52.156419 14882 leader_election.cc:290] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
W20260620 13:59:52.158035 14728 leader_election.cc:343] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:52.163340 14877 ts_tablet_manager.cc:1434] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.008s
I20260620 13:59:52.165019 14877 tablet_bootstrap.cc:492] T 479a807e25a44a72985d99be6373c59a P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:52.167991 14875 tablet_bootstrap.cc:492] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:52.168577 14875 ts_tablet_manager.cc:1403] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.016s
I20260620 13:59:52.173419 14687 raft_consensus.cc:2468] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:52.174297 14877 tablet_bootstrap.cc:654] T 479a807e25a44a72985d99be6373c59a P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.175361 14728 leader_election.cc:304] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d; no voters: b5509f23c3544993b8ac7d0318b5d857
I20260620 13:59:52.173859 14875 raft_consensus.cc:359] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.177035 14902 raft_consensus.cc:2804] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:52.177593 14875 raft_consensus.cc:385] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.177819 14902 raft_consensus.cc:697] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Leader. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:52.178011 14875 raft_consensus.cc:740] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.179163 14875 consensus_queue.cc:260] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.179224 14902 consensus_queue.cc:237] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.181470 14875 ts_tablet_manager.cc:1434] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260620 13:59:52.182497 14875 tablet_bootstrap.cc:492] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:52.189297 14882 raft_consensus.cc:493] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.190090 14882 raft_consensus.cc:515] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.191558 14875 tablet_bootstrap.cc:654] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.193907 14686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0c9fed06bb40d58aa45524e52f6394" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:52.194857 14686 raft_consensus.cc:2468] T 1e0c9fed06bb40d58aa45524e52f6394 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:52.197846 14906 raft_consensus.cc:493] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.197608 14728 leader_election.cc:304] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d; no voters: 
I20260620 13:59:52.199754 14882 leader_election.cc:290] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.200531 14882 raft_consensus.cc:2804] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:52.200996 14882 raft_consensus.cc:493] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:52.201542 14882 raft_consensus.cc:3060] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.203557 14906 raft_consensus.cc:515] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.217361 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9437fc794164eb4b27d418baaf04c08" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:52.218309 14687 raft_consensus.cc:2468] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:52.220115 14836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a8fdc706ad47ce8771b288d5dcbe9f" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:52.220280 14728 leader_election.cc:304] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d; no voters: 
I20260620 13:59:52.221055 14836 raft_consensus.cc:2468] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:52.221555 14907 raft_consensus.cc:2804] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:52.222034 14907 raft_consensus.cc:493] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:52.222517 14899 raft_consensus.cc:493] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.222513 14907 raft_consensus.cc:3060] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.223431 14899 raft_consensus.cc:515] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } }
I20260620 13:59:52.223794 14836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0c9fed06bb40d58aa45524e52f6394" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:52.224686 14836 raft_consensus.cc:2468] T 1e0c9fed06bb40d58aa45524e52f6394 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:52.225649 14899 leader_election.cc:290] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 13:59:52.226119 14725 leader_election.cc:304] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 1edd468a2156418bb09fe244c3646ba8
I20260620 13:59:52.232777 14907 raft_consensus.cc:515] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.238559 14907 leader_election.cc:290] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.238176 14583 catalog_manager.cc:5696] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ac0551993c42189492d4256639983d (127.4.155.194). New cstate: current_term: 1 leader_uuid: "35ac0551993c42189492d4256639983d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:52.240201 14907 raft_consensus.cc:2804] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:52.241487 14907 raft_consensus.cc:493] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:52.241873 14907 raft_consensus.cc:3060] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.222611 14906 leader_election.cc:290] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.245862 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9437fc794164eb4b27d418baaf04c08" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:52.246562 14687 raft_consensus.cc:3060] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.247880 14836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9437fc794164eb4b27d418baaf04c08" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:52.249122 14836 raft_consensus.cc:2468] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:52.251950 14836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9437fc794164eb4b27d418baaf04c08" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:52.252780 14836 raft_consensus.cc:3060] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.262248 14907 raft_consensus.cc:515] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.264878 14907 leader_election.cc:290] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.265208 14875 tablet_bootstrap.cc:492] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:52.265676 14875 ts_tablet_manager.cc:1403] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.024s
I20260620 13:59:52.266185 14686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a8fdc706ad47ce8771b288d5dcbe9f" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:52.267598 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a8fdc706ad47ce8771b288d5dcbe9f" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:52.268270 14835 raft_consensus.cc:3060] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.262456 14882 raft_consensus.cc:515] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.268421 14875 raft_consensus.cc:359] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.269169 14875 raft_consensus.cc:385] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.269434 14875 raft_consensus.cc:740] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.264933 14877 tablet_bootstrap.cc:492] T 479a807e25a44a72985d99be6373c59a P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:52.270359 14877 ts_tablet_manager.cc:1403] T 479a807e25a44a72985d99be6373c59a P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.037s
I20260620 13:59:52.270635 14882 leader_election.cc:290] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
W20260620 13:59:52.272039 14728 leader_election.cc:343] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:52.272799 14876 tablet_bootstrap.cc:492] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:52.273289 14876 ts_tablet_manager.cc:1403] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.141s	user 0.048s	sys 0.052s
I20260620 13:59:52.273442 14877 raft_consensus.cc:359] T 479a807e25a44a72985d99be6373c59a P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.276803 14834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0c9fed06bb40d58aa45524e52f6394" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:52.277545 14834 raft_consensus.cc:3060] T 1e0c9fed06bb40d58aa45524e52f6394 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.274215 14877 raft_consensus.cc:385] T 479a807e25a44a72985d99be6373c59a P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.278882 14877 raft_consensus.cc:740] T 479a807e25a44a72985d99be6373c59a P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.279175 14876 raft_consensus.cc:359] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } }
I20260620 13:59:52.280961 14876 raft_consensus.cc:385] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.280225 14686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0c9fed06bb40d58aa45524e52f6394" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:52.281813 14876 raft_consensus.cc:740] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.282087 14686 raft_consensus.cc:3060] T 1e0c9fed06bb40d58aa45524e52f6394 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.282694 14876 consensus_queue.cc:260] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } }
I20260620 13:59:52.285362 14876 ts_tablet_manager.cc:1434] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260620 13:59:52.286517 14876 tablet_bootstrap.cc:492] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:52.289849 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a8fdc706ad47ce8771b288d5dcbe9f" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d" is_pre_election: true
I20260620 13:59:52.287518 14836 raft_consensus.cc:2468] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:52.291543 14761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93febc746444f00a48276a77eb3ee8b" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d" is_pre_election: true
I20260620 13:59:52.291689 14760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ec7ecfb90c4c5ea2c0e1b06fcf9125" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d" is_pre_election: true
I20260620 13:59:52.292222 14725 leader_election.cc:304] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 
W20260620 13:59:52.293298 14799 leader_election.cc:343] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ac0551993c42189492d4256639983d (127.4.155.194:38131): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:52.294018 14907 raft_consensus.cc:2804] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:52.294579 14907 raft_consensus.cc:697] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Leader. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:52.295320 14876 tablet_bootstrap.cc:654] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.295445 14907 consensus_queue.cc:237] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.281131 14882 raft_consensus.cc:493] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.300621 14882 raft_consensus.cc:515] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } }
I20260620 13:59:52.280841 14877 consensus_queue.cc:260] T 479a807e25a44a72985d99be6373c59a P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.279590 14875 consensus_queue.cc:260] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.304908 14877 ts_tablet_manager.cc:1434] T 479a807e25a44a72985d99be6373c59a P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.002s
I20260620 13:59:52.304826 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ec7ecfb90c4c5ea2c0e1b06fcf9125" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:52.305353 14875 ts_tablet_manager.cc:1434] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260620 13:59:52.305601 14685 raft_consensus.cc:2468] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:52.306070 14877 tablet_bootstrap.cc:492] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:52.306628 14875 tablet_bootstrap.cc:492] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:52.307006 14728 leader_election.cc:304] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d; no voters: 
I20260620 13:59:52.307291 14760 raft_consensus.cc:2468] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 0.
I20260620 13:59:52.307979 14906 raft_consensus.cc:2804] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:52.308495 14906 raft_consensus.cc:493] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:52.308843 14906 raft_consensus.cc:3060] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.311697 14799 leader_election.cc:304] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:52.312892 14881 raft_consensus.cc:2804] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:52.313269 14881 raft_consensus.cc:493] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:52.313637 14881 raft_consensus.cc:3060] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.317414 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93febc746444f00a48276a77eb3ee8b" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:52.318821 14885 raft_consensus.cc:493] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.319494 14885 raft_consensus.cc:515] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
W20260620 13:59:52.319893 14802 leader_election.cc:343] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:52.320403 14802 leader_election.cc:304] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5509f23c3544993b8ac7d0318b5d857; no voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d
I20260620 13:59:52.321640 14899 raft_consensus.cc:2749] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:52.322221 14885 leader_election.cc:290] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ac0551993c42189492d4256639983d (127.4.155.194:38131), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.319002 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ec7ecfb90c4c5ea2c0e1b06fcf9125" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:52.323060 14683 raft_consensus.cc:2468] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 0.
I20260620 13:59:52.323261 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a8fdc706ad47ce8771b288d5dcbe9f" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
W20260620 13:59:52.325138 14802 leader_election.cc:343] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:52.326171 14882 leader_election.cc:290] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.329638 14836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ec7ecfb90c4c5ea2c0e1b06fcf9125" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:52.333911 14906 raft_consensus.cc:515] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } }
I20260620 13:59:52.334528 14835 raft_consensus.cc:2468] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:52.337142 14881 raft_consensus.cc:515] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } }
I20260620 13:59:52.338553 14877 tablet_bootstrap.cc:654] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.338771 14836 raft_consensus.cc:2393] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ac0551993c42189492d4256639983d in current term 1: Already voted for candidate b5509f23c3544993b8ac7d0318b5d857 in this term.
I20260620 13:59:52.280429 14687 raft_consensus.cc:2468] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:52.290825 14762 raft_consensus.cc:2393] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5509f23c3544993b8ac7d0318b5d857 in current term 1: Already voted for candidate 35ac0551993c42189492d4256639983d in this term.
I20260620 13:59:52.320518 14875 tablet_bootstrap.cc:654] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.342407 14799 leader_election.cc:304] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5509f23c3544993b8ac7d0318b5d857; no voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d
I20260620 13:59:52.343748 14899 raft_consensus.cc:2749] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:52.290491 14686 raft_consensus.cc:2468] T 1e0c9fed06bb40d58aa45524e52f6394 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:52.345346 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ec7ecfb90c4c5ea2c0e1b06fcf9125" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:52.345611 14834 raft_consensus.cc:2468] T 1e0c9fed06bb40d58aa45524e52f6394 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:52.346081 14685 raft_consensus.cc:3060] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.346774 14725 leader_election.cc:304] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:52.348002 14882 raft_consensus.cc:2804] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:52.348536 14882 raft_consensus.cc:697] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Leader. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:52.349455 14882 consensus_queue.cc:237] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.354843 14725 leader_election.cc:304] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 1edd468a2156418bb09fe244c3646ba8
I20260620 13:59:52.356580 14902 raft_consensus.cc:2804] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:52.358644 14875 tablet_bootstrap.cc:492] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:52.358505 14836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ec7ecfb90c4c5ea2c0e1b06fcf9125" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:52.360298 14902 raft_consensus.cc:697] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Leader. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:52.360808 14836 raft_consensus.cc:2393] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ac0551993c42189492d4256639983d in current term 1: Already voted for candidate b5509f23c3544993b8ac7d0318b5d857 in this term.
I20260620 13:59:52.361279 14902 consensus_queue.cc:237] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.362414 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ec7ecfb90c4c5ea2c0e1b06fcf9125" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 13:59:52.363229 14762 raft_consensus.cc:2393] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b5509f23c3544993b8ac7d0318b5d857 in current term 1: Already voted for candidate 35ac0551993c42189492d4256639983d in this term.
I20260620 13:59:52.363927 14875 ts_tablet_manager.cc:1403] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.003s
I20260620 13:59:52.364580 14906 leader_election.cc:290] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.365469 14881 leader_election.cc:290] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 13:59:52.368119 14875 raft_consensus.cc:359] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.354941 14685 raft_consensus.cc:2468] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 1.
I20260620 13:59:52.373961 14875 raft_consensus.cc:385] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.374362 14875 raft_consensus.cc:740] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.375190 14802 leader_election.cc:304] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857; no voters: 35ac0551993c42189492d4256639983d
I20260620 13:59:52.375976 14876 tablet_bootstrap.cc:492] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:52.376493 14876 ts_tablet_manager.cc:1403] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.090s	user 0.049s	sys 0.036s
I20260620 13:59:52.376689 14881 raft_consensus.cc:2804] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:52.377275 14881 raft_consensus.cc:697] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Becoming Leader. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Running, Role: LEADER
I20260620 13:59:52.375176 14875 consensus_queue.cc:260] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.378436 14881 consensus_queue.cc:237] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } }
I20260620 13:59:52.378960 14876 raft_consensus.cc:359] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.379789 14876 raft_consensus.cc:385] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.380234 14876 raft_consensus.cc:740] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.381208 14876 consensus_queue.cc:260] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.383870 14876 ts_tablet_manager.cc:1434] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260620 13:59:52.385253 14876 tablet_bootstrap.cc:492] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:52.385288 14875 ts_tablet_manager.cc:1434] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260620 13:59:52.390829 14877 tablet_bootstrap.cc:492] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:52.391489 14877 ts_tablet_manager.cc:1403] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.004s
I20260620 13:59:52.394532 14876 tablet_bootstrap.cc:654] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.403188 14877 raft_consensus.cc:359] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.407330 14877 raft_consensus.cc:385] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.407673 14877 raft_consensus.cc:740] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.410017 14877 consensus_queue.cc:260] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.413319 14877 ts_tablet_manager.cc:1434] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260620 13:59:52.412443 14582 catalog_manager.cc:5696] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ac0551993c42189492d4256639983d (127.4.155.194). New cstate: current_term: 1 leader_uuid: "35ac0551993c42189492d4256639983d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:52.414496 14877 tablet_bootstrap.cc:492] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:52.417680 14902 raft_consensus.cc:493] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.418226 14902 raft_consensus.cc:515] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.419196 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ec7ecfb90c4c5ea2c0e1b06fcf9125" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:52.414592 14582 catalog_manager.cc:5696] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ac0551993c42189492d4256639983d (127.4.155.194). New cstate: current_term: 1 leader_uuid: "35ac0551993c42189492d4256639983d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:52.419994 14685 raft_consensus.cc:2393] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35ac0551993c42189492d4256639983d in current term 1: Already voted for candidate b5509f23c3544993b8ac7d0318b5d857 in this term.
I20260620 13:59:52.420436 14902 leader_election.cc:290] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.421663 14728 leader_election.cc:304] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ac0551993c42189492d4256639983d; no voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857
I20260620 13:59:52.423399 14902 raft_consensus.cc:2749] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260620 13:59:52.420646 14582 catalog_manager.cc:5696] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ac0551993c42189492d4256639983d (127.4.155.194). New cstate: current_term: 1 leader_uuid: "35ac0551993c42189492d4256639983d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:52.424000 14834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dada0282d74460ad79540693d4b1cf" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:52.424692 14834 raft_consensus.cc:2468] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:52.425276 14876 tablet_bootstrap.cc:492] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:52.425855 14876 ts_tablet_manager.cc:1403] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.041s	user 0.025s	sys 0.010s
I20260620 13:59:52.425836 14725 leader_election.cc:304] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:52.427382 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dada0282d74460ad79540693d4b1cf" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:52.426885 14902 raft_consensus.cc:2804] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:52.428578 14902 raft_consensus.cc:493] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:52.428928 14902 raft_consensus.cc:3060] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.429512 14876 raft_consensus.cc:359] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.430346 14876 raft_consensus.cc:385] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.430716 14876 raft_consensus.cc:740] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.431556 14876 consensus_queue.cc:260] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
W20260620 13:59:52.431979 14728 leader_election.cc:343] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:52.434621 14876 ts_tablet_manager.cc:1434] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260620 13:59:52.435482 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21a96ea4d884462ac59a884f64bafb5" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d" is_pre_election: true
I20260620 13:59:52.435753 14876 tablet_bootstrap.cc:492] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:52.437058 14834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21a96ea4d884462ac59a884f64bafb5" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:52.431531 14877 tablet_bootstrap.cc:654] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.437107 14902 raft_consensus.cc:515] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.437891 14834 raft_consensus.cc:2468] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 0.
I20260620 13:59:52.439653 14650 leader_election.cc:304] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:52.440759 14885 raft_consensus.cc:2804] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:52.441152 14885 raft_consensus.cc:493] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:52.441552 14885 raft_consensus.cc:3060] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:59:52.442348 14650 leader_election.cc:343] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ac0551993c42189492d4256639983d (127.4.155.194:38131): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:52.444025 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dada0282d74460ad79540693d4b1cf" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:52.444188 14583 catalog_manager.cc:5696] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "b5509f23c3544993b8ac7d0318b5d857" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } }
W20260620 13:59:52.445245 14728 leader_election.cc:343] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:52.446877 14876 tablet_bootstrap.cc:654] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.452416 14885 raft_consensus.cc:515] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.445258 14834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dada0282d74460ad79540693d4b1cf" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:52.456020 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21a96ea4d884462ac59a884f64bafb5" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 13:59:52.456249 14834 raft_consensus.cc:3060] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
W20260620 13:59:52.457850 14650 leader_election.cc:343] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35ac0551993c42189492d4256639983d (127.4.155.194:38131): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:52.458561 14876 tablet_bootstrap.cc:492] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:52.459066 14876 ts_tablet_manager.cc:1403] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.005s
I20260620 13:59:52.459336 14902 leader_election.cc:290] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.461133 14877 tablet_bootstrap.cc:492] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:52.462005 14877 ts_tablet_manager.cc:1403] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.009s
I20260620 13:59:52.461777 14876 raft_consensus.cc:359] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.462538 14876 raft_consensus.cc:385] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.462821 14876 raft_consensus.cc:740] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.463537 14876 consensus_queue.cc:260] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.465255 14834 raft_consensus.cc:2468] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:52.465981 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21a96ea4d884462ac59a884f64bafb5" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:52.466851 14885 leader_election.cc:290] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 election: Requested vote from peers 35ac0551993c42189492d4256639983d (127.4.155.194:38131), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.466687 14725 leader_election.cc:304] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 1edd468a2156418bb09fe244c3646ba8
I20260620 13:59:52.466712 14835 raft_consensus.cc:3060] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.469074 14877 raft_consensus.cc:359] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.469574 14876 ts_tablet_manager.cc:1434] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260620 13:59:52.469949 14877 raft_consensus.cc:385] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.470357 14877 raft_consensus.cc:740] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.470713 14876 tablet_bootstrap.cc:492] T 479a807e25a44a72985d99be6373c59a P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:52.471182 14877 consensus_queue.cc:260] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.472397 14907 raft_consensus.cc:2804] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:52.472896 14907 raft_consensus.cc:697] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Leader. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:52.473410 14881 raft_consensus.cc:493] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.473706 14907 consensus_queue.cc:237] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.473989 14881 raft_consensus.cc:515] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.476231 14881 leader_election.cc:290] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 13:59:52.476580 14876 tablet_bootstrap.cc:654] T 479a807e25a44a72985d99be6373c59a P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.477140 14835 raft_consensus.cc:2468] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 1.
I20260620 13:59:52.478387 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479a807e25a44a72985d99be6373c59a" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:52.480130 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479a807e25a44a72985d99be6373c59a" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d" is_pre_election: true
W20260620 13:59:52.480406 14802 leader_election.cc:343] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:52.480772 14762 raft_consensus.cc:2468] T 479a807e25a44a72985d99be6373c59a P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 0.
I20260620 13:59:52.473407 14877 ts_tablet_manager.cc:1434] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260620 13:59:52.481904 14877 tablet_bootstrap.cc:492] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:52.481729 14650 leader_election.cc:304] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857; no voters: 35ac0551993c42189492d4256639983d
I20260620 13:59:52.483485 14799 leader_election.cc:304] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 1edd468a2156418bb09fe244c3646ba8
I20260620 13:59:52.484869 14881 raft_consensus.cc:2804] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:52.485302 14881 raft_consensus.cc:493] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:52.485962 14881 raft_consensus.cc:3060] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.490468 14877 tablet_bootstrap.cc:654] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:52.494004 14585 catalog_manager.cc:5696] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ac0551993c42189492d4256639983d (127.4.155.194). New cstate: current_term: 1 leader_uuid: "35ac0551993c42189492d4256639983d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:52.497219 14876 tablet_bootstrap.cc:492] T 479a807e25a44a72985d99be6373c59a P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:52.497956 14876 ts_tablet_manager.cc:1403] T 479a807e25a44a72985d99be6373c59a P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.004s
I20260620 13:59:52.486205 14885 raft_consensus.cc:2804] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:52.501523 14881 raft_consensus.cc:515] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.501425 14876 raft_consensus.cc:359] T 479a807e25a44a72985d99be6373c59a P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.502655 14876 raft_consensus.cc:385] T 479a807e25a44a72985d99be6373c59a P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.503026 14876 raft_consensus.cc:740] T 479a807e25a44a72985d99be6373c59a P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.504062 14885 raft_consensus.cc:697] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 1 LEADER]: Becoming Leader. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Running, Role: LEADER
I20260620 13:59:52.504106 14876 consensus_queue.cc:260] T 479a807e25a44a72985d99be6373c59a P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.505122 14885 consensus_queue.cc:237] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.507182 14876 ts_tablet_manager.cc:1434] T 479a807e25a44a72985d99be6373c59a P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260620 13:59:52.510872 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479a807e25a44a72985d99be6373c59a" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:52.511636 14685 raft_consensus.cc:3060] T 479a807e25a44a72985d99be6373c59a P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.517343 14881 leader_election.cc:290] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 13:59:52.518263 14877 tablet_bootstrap.cc:492] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:52.518781 14877 ts_tablet_manager.cc:1403] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.037s	user 0.025s	sys 0.009s
I20260620 13:59:52.518810 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479a807e25a44a72985d99be6373c59a" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 13:59:52.519580 14762 raft_consensus.cc:3060] T 479a807e25a44a72985d99be6373c59a P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.521724 14877 raft_consensus.cc:359] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.522457 14877 raft_consensus.cc:385] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:52.522679 14877 raft_consensus.cc:740] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:52.522953 14685 raft_consensus.cc:2468] T 479a807e25a44a72985d99be6373c59a P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 1.
I20260620 13:59:52.521149 14585 catalog_manager.cc:5696] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "1edd468a2156418bb09fe244c3646ba8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:52.523326 14877 consensus_queue.cc:260] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.524278 14802 leader_election.cc:304] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:52.525651 14877 ts_tablet_manager.cc:1434] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260620 13:59:52.528838 14762 raft_consensus.cc:2468] T 479a807e25a44a72985d99be6373c59a P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 1.
I20260620 13:59:52.529950 14881 raft_consensus.cc:2804] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:52.531298 14881 raft_consensus.cc:697] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Becoming Leader. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Running, Role: LEADER
I20260620 13:59:52.532261 14881 consensus_queue.cc:237] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.542626 14582 catalog_manager.cc:5696] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "b5509f23c3544993b8ac7d0318b5d857" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:52.548617 14885 raft_consensus.cc:493] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.549206 14885 raft_consensus.cc:515] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.551211 14885 leader_election.cc:290] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ac0551993c42189492d4256639983d (127.4.155.194:38131), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.552511 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a8fdc706ad47ce8771b288d5dcbe9f" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:52.552390 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a8fdc706ad47ce8771b288d5dcbe9f" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d" is_pre_election: true
I20260620 13:59:52.553313 14835 raft_consensus.cc:2393] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1edd468a2156418bb09fe244c3646ba8 in current term 1: Already voted for candidate 35ac0551993c42189492d4256639983d in this term.
I20260620 13:59:52.554270 14650 leader_election.cc:304] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8; no voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857
I20260620 13:59:52.554937 14885 raft_consensus.cc:3060] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.559893 14885 raft_consensus.cc:2749] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:52.667555 14881 raft_consensus.cc:493] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.668280 14881 raft_consensus.cc:515] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.670181 14881 leader_election.cc:290] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 13:59:52.671314 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fdfe98616741b992d9ca8f6598dbd4" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:52.671363 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fdfe98616741b992d9ca8f6598dbd4" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d" is_pre_election: true
I20260620 13:59:52.672217 14685 raft_consensus.cc:2393] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5509f23c3544993b8ac7d0318b5d857 in current term 1: Already voted for candidate 35ac0551993c42189492d4256639983d in this term.
I20260620 13:59:52.673295 14802 leader_election.cc:304] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5509f23c3544993b8ac7d0318b5d857; no voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d
I20260620 13:59:52.674048 14881 raft_consensus.cc:3060] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.679502 14881 raft_consensus.cc:2749] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:52.741015 14907 raft_consensus.cc:493] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.741644 14907 raft_consensus.cc:515] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.743621 14907 leader_election.cc:290] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.744577 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21a96ea4d884462ac59a884f64bafb5" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:52.744609 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21a96ea4d884462ac59a884f64bafb5" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:52.745476 14835 raft_consensus.cc:2393] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35ac0551993c42189492d4256639983d in current term 1: Already voted for candidate 1edd468a2156418bb09fe244c3646ba8 in this term.
I20260620 13:59:52.746524 14725 leader_election.cc:304] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35ac0551993c42189492d4256639983d; no voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857
I20260620 13:59:52.747493 14907 raft_consensus.cc:3060] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.752864 14907 raft_consensus.cc:2749] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:52.769826 14907 consensus_queue.cc:1048] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:52.779714 14882 consensus_queue.cc:1048] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:52.798921 14907 consensus_queue.cc:1048] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:52.800316 14907 raft_consensus.cc:493] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.800766 14907 raft_consensus.cc:515] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.802917 14907 leader_election.cc:290] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.804147 14834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93febc746444f00a48276a77eb3ee8b" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:52.804361 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93febc746444f00a48276a77eb3ee8b" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:52.805049 14685 raft_consensus.cc:2468] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:52.805054 14834 raft_consensus.cc:2468] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:52.806138 14728 leader_election.cc:304] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d; no voters: 
I20260620 13:59:52.807346 14907 raft_consensus.cc:2804] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:52.807721 14907 raft_consensus.cc:493] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:52.808056 14907 raft_consensus.cc:3060] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.816498 14907 raft_consensus.cc:515] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.816979 14906 consensus_queue.cc:1048] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:52.818429 14906 consensus_queue.cc:1048] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:52.818815 14907 leader_election.cc:290] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.820554 14834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93febc746444f00a48276a77eb3ee8b" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:52.821164 14834 raft_consensus.cc:3060] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.821377 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93febc746444f00a48276a77eb3ee8b" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:52.822093 14685 raft_consensus.cc:3060] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.828368 14917 consensus_queue.cc:1048] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:52.829068 14885 raft_consensus.cc:493] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:52.829620 14885 raft_consensus.cc:515] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.831619 14885 leader_election.cc:290] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ac0551993c42189492d4256639983d (127.4.155.194:38131), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:52.832176 14834 raft_consensus.cc:2468] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:52.834308 14725 leader_election.cc:304] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:52.835662 14917 raft_consensus.cc:2804] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:52.835520 14834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dada0282d74460ad79540693d4b1cf" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:52.836697 14834 raft_consensus.cc:2393] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1edd468a2156418bb09fe244c3646ba8 in current term 1: Already voted for candidate 35ac0551993c42189492d4256639983d in this term.
I20260620 13:59:52.837342 14917 raft_consensus.cc:697] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Leader. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:52.838289 14917 consensus_queue.cc:237] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:52.840164 14685 raft_consensus.cc:2468] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:52.844759 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dada0282d74460ad79540693d4b1cf" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d" is_pre_election: true
I20260620 13:59:52.848132 14650 leader_election.cc:304] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8; no voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857
I20260620 13:59:52.849020 14885 raft_consensus.cc:3060] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:52.846699 14902 consensus_queue.cc:1048] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260620 13:59:52.857880 14885 raft_consensus.cc:2749] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:52.859213 14582 catalog_manager.cc:5696] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ac0551993c42189492d4256639983d (127.4.155.194). New cstate: current_term: 1 leader_uuid: "35ac0551993c42189492d4256639983d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:52.878587 14907 consensus_queue.cc:1048] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:52.889611 14907 consensus_queue.cc:1048] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:52.903425 14882 consensus_queue.cc:1048] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:52.911033 14881 consensus_queue.cc:1048] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:52.929800 14881 consensus_queue.cc:1048] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:52.938428 14835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13ec7ecfb90c4c5ea2c0e1b06fcf9125"
dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
mode: GRACEFUL
new_leader_uuid: "1edd468a2156418bb09fe244c3646ba8"
 from {username='slave'} at 127.0.0.1:35732
I20260620 13:59:52.939872 14835 raft_consensus.cc:606] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Received request to transfer leadership to TS 1edd468a2156418bb09fe244c3646ba8
I20260620 13:59:52.955513 14762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b93febc746444f00a48276a77eb3ee8b"
dest_uuid: "35ac0551993c42189492d4256639983d"
mode: GRACEFUL
new_leader_uuid: "1edd468a2156418bb09fe244c3646ba8"
 from {username='slave'} at 127.0.0.1:35146
I20260620 13:59:52.956179 14762 raft_consensus.cc:606] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Received request to transfer leadership to TS 1edd468a2156418bb09fe244c3646ba8
I20260620 13:59:52.962105 14762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9437fc794164eb4b27d418baaf04c08"
dest_uuid: "35ac0551993c42189492d4256639983d"
mode: GRACEFUL
new_leader_uuid: "1edd468a2156418bb09fe244c3646ba8"
 from {username='slave'} at 127.0.0.1:35146
I20260620 13:59:52.962613 14762 raft_consensus.cc:606] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Received request to transfer leadership to TS 1edd468a2156418bb09fe244c3646ba8
I20260620 13:59:52.969007 14762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22dada0282d74460ad79540693d4b1cf"
dest_uuid: "35ac0551993c42189492d4256639983d"
mode: GRACEFUL
new_leader_uuid: "1edd468a2156418bb09fe244c3646ba8"
 from {username='slave'} at 127.0.0.1:35146
I20260620 13:59:52.969485 14762 raft_consensus.cc:606] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Received request to transfer leadership to TS 1edd468a2156418bb09fe244c3646ba8
I20260620 13:59:52.990583 14687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d21a96ea4d884462ac59a884f64bafb5"
dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
mode: GRACEFUL
new_leader_uuid: "35ac0551993c42189492d4256639983d"
 from {username='slave'} at 127.0.0.1:46014
I20260620 13:59:52.991093 14687 raft_consensus.cc:606] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 1 LEADER]: Received request to transfer leadership to TS 35ac0551993c42189492d4256639983d
I20260620 13:59:53.000267 14881 consensus_queue.cc:1048] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:53.002449 14881 consensus_queue.cc:1048] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:53.003140 14885 consensus_queue.cc:1048] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:53.036636 14885 consensus_queue.cc:1048] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:53.057891 14954 raft_consensus.cc:993] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8: : Instructing follower 35ac0551993c42189492d4256639983d to start an election
I20260620 13:59:53.058393 14925 raft_consensus.cc:1081] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 1 LEADER]: Signalling peer 35ac0551993c42189492d4256639983d to start an election
I20260620 13:59:53.060341 14762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d21a96ea4d884462ac59a884f64bafb5"
dest_uuid: "35ac0551993c42189492d4256639983d"
 from {username='slave'} at 127.0.0.1:35140
I20260620 13:59:53.060974 14762 raft_consensus.cc:493] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:53.061292 14762 raft_consensus.cc:3060] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:53.066848 14762 raft_consensus.cc:515] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:53.068704 14762 leader_election.cc:290] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 2 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:53.069813 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21a96ea4d884462ac59a884f64bafb5" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:53.069907 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21a96ea4d884462ac59a884f64bafb5" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:53.070609 14687 raft_consensus.cc:3055] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:53.070730 14835 raft_consensus.cc:3060] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:53.070997 14687 raft_consensus.cc:740] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Running, Role: LEADER
I20260620 13:59:53.072157 14687 consensus_queue.cc:260] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:53.073279 14687 raft_consensus.cc:3060] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:53.077862 14835 raft_consensus.cc:2468] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 2.
I20260620 13:59:53.078810 14687 raft_consensus.cc:2468] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 2.
I20260620 13:59:53.079272 14725 leader_election.cc:304] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:53.080119 14882 raft_consensus.cc:2804] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:53.080552 14882 raft_consensus.cc:697] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 2 LEADER]: Becoming Leader. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:53.081250 14882 consensus_queue.cc:237] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:53.087671 14585 catalog_manager.cc:5696] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d reported cstate change: term changed from 1 to 2, leader changed from 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193) to 35ac0551993c42189492d4256639983d (127.4.155.194). New cstate: current_term: 2 leader_uuid: "35ac0551993c42189492d4256639983d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:53.222319 14882 consensus_queue.cc:1048] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:53.229318 14906 raft_consensus.cc:993] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d: : Instructing follower 1edd468a2156418bb09fe244c3646ba8 to start an election
I20260620 13:59:53.229839 14902 raft_consensus.cc:1081] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Signalling peer 1edd468a2156418bb09fe244c3646ba8 to start an election
I20260620 13:59:53.234323 14685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b93febc746444f00a48276a77eb3ee8b"
dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
 from {username='slave'} at 127.0.0.1:52176
I20260620 13:59:53.234745 14882 consensus_queue.cc:1048] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:53.234982 14685 raft_consensus.cc:493] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:53.235566 14685 raft_consensus.cc:3060] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:53.243785 14685 raft_consensus.cc:515] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:53.245790 14685 leader_election.cc:290] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 2 election: Requested vote from peers 35ac0551993c42189492d4256639983d (127.4.155.194:38131), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:53.246641 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93febc746444f00a48276a77eb3ee8b" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 13:59:53.246912 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93febc746444f00a48276a77eb3ee8b" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:53.247277 14762 raft_consensus.cc:3055] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:53.247664 14835 raft_consensus.cc:3060] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:53.247666 14762 raft_consensus.cc:740] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:53.248689 14762 consensus_queue.cc:260] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:53.249951 14762 raft_consensus.cc:3060] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:53.253865 14835 raft_consensus.cc:2468] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 2.
I20260620 13:59:53.255050 14650 leader_election.cc:304] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:53.255285 14762 raft_consensus.cc:2468] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 2.
I20260620 13:59:53.255934 14925 raft_consensus.cc:2804] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:53.256438 14925 raft_consensus.cc:697] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Becoming Leader. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Running, Role: LEADER
I20260620 13:59:53.257150 14925 consensus_queue.cc:237] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:53.265594 14583 catalog_manager.cc:5696] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 reported cstate change: term changed from 1 to 2, leader changed from 35ac0551993c42189492d4256639983d (127.4.155.194) to 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "1edd468a2156418bb09fe244c3646ba8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:53.267256 14917 raft_consensus.cc:993] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d: : Instructing follower 1edd468a2156418bb09fe244c3646ba8 to start an election
I20260620 13:59:53.267791 14882 raft_consensus.cc:1081] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Signalling peer 1edd468a2156418bb09fe244c3646ba8 to start an election
I20260620 13:59:53.269418 14685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9437fc794164eb4b27d418baaf04c08"
dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
 from {username='slave'} at 127.0.0.1:52176
I20260620 13:59:53.270012 14685 raft_consensus.cc:493] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:53.270378 14685 raft_consensus.cc:3060] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:53.277738 14685 raft_consensus.cc:515] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:53.279506 14685 leader_election.cc:290] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 2 election: Requested vote from peers 35ac0551993c42189492d4256639983d (127.4.155.194:38131), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:53.280462 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9437fc794164eb4b27d418baaf04c08" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 13:59:53.280573 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9437fc794164eb4b27d418baaf04c08" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:53.281256 14762 raft_consensus.cc:3055] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:53.281288 14835 raft_consensus.cc:3060] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:53.281883 14762 raft_consensus.cc:740] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:53.282869 14762 consensus_queue.cc:260] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:53.284353 14762 raft_consensus.cc:3060] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:53.289685 14835 raft_consensus.cc:2468] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 2.
I20260620 13:59:53.291213 14650 leader_election.cc:304] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:53.292173 14925 raft_consensus.cc:2804] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:53.292328 14762 raft_consensus.cc:2468] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 2.
I20260620 13:59:53.292811 14925 raft_consensus.cc:697] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Becoming Leader. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Running, Role: LEADER
I20260620 13:59:53.294019 14925 consensus_queue.cc:237] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:53.303059 14583 catalog_manager.cc:5696] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 reported cstate change: term changed from 1 to 2, leader changed from 35ac0551993c42189492d4256639983d (127.4.155.194) to 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "1edd468a2156418bb09fe244c3646ba8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:53.341209 14917 raft_consensus.cc:993] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d: : Instructing follower 1edd468a2156418bb09fe244c3646ba8 to start an election
I20260620 13:59:53.341760 14882 raft_consensus.cc:1081] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Signalling peer 1edd468a2156418bb09fe244c3646ba8 to start an election
I20260620 13:59:53.343425 14687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22dada0282d74460ad79540693d4b1cf"
dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
 from {username='slave'} at 127.0.0.1:52176
I20260620 13:59:53.343979 14687 raft_consensus.cc:493] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:53.344306 14687 raft_consensus.cc:3060] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:53.350354 14687 raft_consensus.cc:515] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:53.352231 14687 leader_election.cc:290] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 2 election: Requested vote from peers 35ac0551993c42189492d4256639983d (127.4.155.194:38131), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:53.352946 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dada0282d74460ad79540693d4b1cf" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 13:59:53.353237 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dada0282d74460ad79540693d4b1cf" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:53.353636 14762 raft_consensus.cc:3055] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:53.353802 14835 raft_consensus.cc:3060] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:53.354003 14762 raft_consensus.cc:740] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:53.354909 14762 consensus_queue.cc:260] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:53.356180 14762 raft_consensus.cc:3060] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:53.361271 14835 raft_consensus.cc:2468] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 2.
I20260620 13:59:53.362552 14650 leader_election.cc:304] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:53.363034 14762 raft_consensus.cc:2468] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 2.
I20260620 13:59:53.363276 14925 raft_consensus.cc:2804] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:53.363906 14925 raft_consensus.cc:697] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Becoming Leader. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Running, Role: LEADER
I20260620 13:59:53.364746 14925 consensus_queue.cc:237] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:53.370992 14583 catalog_manager.cc:5696] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 reported cstate change: term changed from 1 to 2, leader changed from 35ac0551993c42189492d4256639983d (127.4.155.194) to 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "1edd468a2156418bb09fe244c3646ba8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:53.459458 14881 raft_consensus.cc:993] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857: : Instructing follower 1edd468a2156418bb09fe244c3646ba8 to start an election
I20260620 13:59:53.459955 14955 raft_consensus.cc:1081] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Signalling peer 1edd468a2156418bb09fe244c3646ba8 to start an election
I20260620 13:59:53.461537 14687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13ec7ecfb90c4c5ea2c0e1b06fcf9125"
dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
 from {username='slave'} at 127.0.0.1:52180
I20260620 13:59:53.462069 14687 raft_consensus.cc:493] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:53.462368 14687 raft_consensus.cc:3060] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:53.467574 14687 raft_consensus.cc:515] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } }
I20260620 13:59:53.469172 14687 leader_election.cc:290] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 2 election: Requested vote from peers b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 13:59:53.470324 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ec7ecfb90c4c5ea2c0e1b06fcf9125" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 13:59:53.470544 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ec7ecfb90c4c5ea2c0e1b06fcf9125" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:53.470965 14762 raft_consensus.cc:3060] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:53.471262 14835 raft_consensus.cc:3055] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:53.471590 14835 raft_consensus.cc:740] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Running, Role: LEADER
I20260620 13:59:53.472355 14835 consensus_queue.cc:260] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } }
I20260620 13:59:53.473464 14835 raft_consensus.cc:3060] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:53.476722 14762 raft_consensus.cc:2468] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 2.
I20260620 13:59:53.477902 14650 leader_election.cc:304] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d; no voters: 
I20260620 13:59:53.478665 14925 raft_consensus.cc:2804] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:53.478768 14835 raft_consensus.cc:2468] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 2.
I20260620 13:59:53.479192 14925 raft_consensus.cc:697] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Becoming Leader. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Running, Role: LEADER
I20260620 13:59:53.480062 14925 consensus_queue.cc:237] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } }
I20260620 13:59:53.484753 14835 raft_consensus.cc:1275] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Refusing update from remote peer 35ac0551993c42189492d4256639983d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:53.486249 14882 consensus_queue.cc:1048] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:53.486671 14583 catalog_manager.cc:5696] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 reported cstate change: term changed from 1 to 2, leader changed from b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195) to 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "1edd468a2156418bb09fe244c3646ba8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:53.496587 14687 raft_consensus.cc:1275] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Refusing update from remote peer 35ac0551993c42189492d4256639983d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:53.498510 14882 consensus_queue.cc:1048] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:53.698277 14762 raft_consensus.cc:1275] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Refusing update from remote peer 1edd468a2156418bb09fe244c3646ba8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:53.699791 14925 consensus_queue.cc:1048] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:53.709183 14835 raft_consensus.cc:1275] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Refusing update from remote peer 1edd468a2156418bb09fe244c3646ba8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:53.710739 14925 consensus_queue.cc:1048] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:53.721221 14835 raft_consensus.cc:1275] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Refusing update from remote peer 1edd468a2156418bb09fe244c3646ba8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:53.722716 14925 consensus_queue.cc:1048] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:53.731405 14762 raft_consensus.cc:1275] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Refusing update from remote peer 1edd468a2156418bb09fe244c3646ba8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:53.733040 14954 consensus_queue.cc:1048] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:53.851343 14835 raft_consensus.cc:1275] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Refusing update from remote peer 1edd468a2156418bb09fe244c3646ba8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:53.852739 14954 consensus_queue.cc:1048] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:53.861128 14762 raft_consensus.cc:1275] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Refusing update from remote peer 1edd468a2156418bb09fe244c3646ba8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:53.862759 14925 consensus_queue.cc:1048] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:53.909819 14835 raft_consensus.cc:1275] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Refusing update from remote peer 1edd468a2156418bb09fe244c3646ba8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:53.911258 14960 consensus_queue.cc:1048] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:53.919747 14762 raft_consensus.cc:1275] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Refusing update from remote peer 1edd468a2156418bb09fe244c3646ba8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:53.922034 14960 consensus_queue.cc:1048] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:56.033322 14583 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38634:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260620 13:59:56.036482 14583 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 13:59:56.095294 14669 tablet_service.cc:1511] Processing CreateTablet for tablet 79e05f8ee16f47d097b7571f52b81d26 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260620 13:59:56.097505 14669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e05f8ee16f47d097b7571f52b81d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.098690 14746 tablet_service.cc:1511] Processing CreateTablet for tablet 79e05f8ee16f47d097b7571f52b81d26 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260620 13:59:56.098997 14820 tablet_service.cc:1511] Processing CreateTablet for tablet 79e05f8ee16f47d097b7571f52b81d26 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260620 13:59:56.100517 14746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e05f8ee16f47d097b7571f52b81d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.100746 14820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e05f8ee16f47d097b7571f52b81d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.102864 14670 tablet_service.cc:1511] Processing CreateTablet for tablet 20d2aa7c401646b3b4edcd2c049748d3 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260620 13:59:56.104499 14670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20d2aa7c401646b3b4edcd2c049748d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.106407 14818 tablet_service.cc:1511] Processing CreateTablet for tablet 20d2aa7c401646b3b4edcd2c049748d3 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260620 13:59:56.107983 14818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20d2aa7c401646b3b4edcd2c049748d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.108281 14674 tablet_service.cc:1511] Processing CreateTablet for tablet 2dd1040ccae84f09960928fef9e79e46 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260620 13:59:56.111660 14674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dd1040ccae84f09960928fef9e79e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.113210 14824 tablet_service.cc:1511] Processing CreateTablet for tablet 2dd1040ccae84f09960928fef9e79e46 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260620 13:59:56.114683 14824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dd1040ccae84f09960928fef9e79e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.114292 14751 tablet_service.cc:1511] Processing CreateTablet for tablet 20d2aa7c401646b3b4edcd2c049748d3 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260620 13:59:56.115842 14751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20d2aa7c401646b3b4edcd2c049748d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.115978 14672 tablet_service.cc:1511] Processing CreateTablet for tablet b3d816c18e414febb24f363590c99d3e (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260620 13:59:56.117395 14672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d816c18e414febb24f363590c99d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.120522 14750 tablet_service.cc:1511] Processing CreateTablet for tablet 2dd1040ccae84f09960928fef9e79e46 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260620 13:59:56.120776 14822 tablet_service.cc:1511] Processing CreateTablet for tablet b3d816c18e414febb24f363590c99d3e (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260620 13:59:56.122184 14750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dd1040ccae84f09960928fef9e79e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.122258 14822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d816c18e414febb24f363590c99d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.125340 14744 tablet_service.cc:1511] Processing CreateTablet for tablet b3d816c18e414febb24f363590c99d3e (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260620 13:59:56.126942 14744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d816c18e414febb24f363590c99d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.134792 14676 tablet_service.cc:1511] Processing CreateTablet for tablet 43d4186b0b204c299ba878e1aa591b9c (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260620 13:59:56.136615 14676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43d4186b0b204c299ba878e1aa591b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.140815 14749 tablet_service.cc:1511] Processing CreateTablet for tablet 43d4186b0b204c299ba878e1aa591b9c (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260620 13:59:56.141083 14819 tablet_service.cc:1511] Processing CreateTablet for tablet 43d4186b0b204c299ba878e1aa591b9c (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260620 13:59:56.142364 14749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43d4186b0b204c299ba878e1aa591b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.142539 14819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43d4186b0b204c299ba878e1aa591b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.143590 14675 tablet_service.cc:1511] Processing CreateTablet for tablet 330b5c5ae7a44148916c4ceddde84d89 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260620 13:59:56.145025 14675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 330b5c5ae7a44148916c4ceddde84d89. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 13:59:56.164242 14633 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:59:56.170718 14748 tablet_service.cc:1511] Processing CreateTablet for tablet 330b5c5ae7a44148916c4ceddde84d89 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260620 13:59:56.172423 14748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 330b5c5ae7a44148916c4ceddde84d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.176970 14823 tablet_service.cc:1511] Processing CreateTablet for tablet 330b5c5ae7a44148916c4ceddde84d89 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260620 13:59:56.178493 14823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 330b5c5ae7a44148916c4ceddde84d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.190312 14677 tablet_service.cc:1511] Processing CreateTablet for tablet 0bc830adeb9d47bb8104b4ccd3265adb (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260620 13:59:56.191816 14677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bc830adeb9d47bb8104b4ccd3265adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.210484 14745 tablet_service.cc:1511] Processing CreateTablet for tablet 0bc830adeb9d47bb8104b4ccd3265adb (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260620 13:59:56.212489 14745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bc830adeb9d47bb8104b4ccd3265adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.229622 14674 tablet_service.cc:1511] Processing CreateTablet for tablet c135204f3010418cb7e1305edacb52f8 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260620 13:59:56.231070 14674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c135204f3010418cb7e1305edacb52f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.231678 14820 tablet_service.cc:1511] Processing CreateTablet for tablet 0bc830adeb9d47bb8104b4ccd3265adb (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260620 13:59:56.241782 14820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bc830adeb9d47bb8104b4ccd3265adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.241664 14676 tablet_service.cc:1511] Processing CreateTablet for tablet e57405c1b02549cc80d7c3e6c5d2c440 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260620 13:59:56.237459 14824 tablet_service.cc:1511] Processing CreateTablet for tablet c135204f3010418cb7e1305edacb52f8 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260620 13:59:56.243641 14824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c135204f3010418cb7e1305edacb52f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.235270 14747 tablet_service.cc:1511] Processing CreateTablet for tablet c135204f3010418cb7e1305edacb52f8 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260620 13:59:56.245810 14747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c135204f3010418cb7e1305edacb52f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.249008 14973 tablet_bootstrap.cc:492] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:56.252269 14974 tablet_bootstrap.cc:492] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:56.264469 14975 tablet_bootstrap.cc:492] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:56.263311 14676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57405c1b02549cc80d7c3e6c5d2c440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.277653 14975 tablet_bootstrap.cc:654] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.278059 14974 tablet_bootstrap.cc:654] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.290671 14973 tablet_bootstrap.cc:654] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.292476 14820 tablet_service.cc:1511] Processing CreateTablet for tablet e57405c1b02549cc80d7c3e6c5d2c440 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260620 13:59:56.293852 14820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57405c1b02549cc80d7c3e6c5d2c440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.299886 14748 tablet_service.cc:1511] Processing CreateTablet for tablet e57405c1b02549cc80d7c3e6c5d2c440 (DEFAULT_TABLE table=soft_deleted_table [id=ee7cf797075048d1968b078f64836225]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260620 13:59:56.300598 14973 tablet_bootstrap.cc:492] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:56.304289 14973 ts_tablet_manager.cc:1403] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.004s
I20260620 13:59:56.314085 14748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57405c1b02549cc80d7c3e6c5d2c440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 13:59:56.308925 14973 raft_consensus.cc:359] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.319614 14973 raft_consensus.cc:385] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.323638 14973 raft_consensus.cc:740] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.324671 14973 consensus_queue.cc:260] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.323236 14974 tablet_bootstrap.cc:492] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:56.330504 14974 ts_tablet_manager.cc:1403] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.079s	user 0.015s	sys 0.013s
I20260620 13:59:56.329393 14973 ts_tablet_manager.cc:1434] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.004s
W20260620 13:59:56.330979 14862 tablet.cc:2406] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 13:59:56.332104 14973 tablet_bootstrap.cc:492] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:56.338299 14974 raft_consensus.cc:359] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.339285 14974 raft_consensus.cc:385] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.339668 14973 tablet_bootstrap.cc:654] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.339660 14974 raft_consensus.cc:740] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.340956 14974 consensus_queue.cc:260] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.344059 14975 tablet_bootstrap.cc:492] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:56.344683 14975 ts_tablet_manager.cc:1403] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.081s	user 0.023s	sys 0.021s
I20260620 13:59:56.345798 14973 tablet_bootstrap.cc:492] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:56.346385 14973 ts_tablet_manager.cc:1403] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.008s
I20260620 13:59:56.346422 14974 ts_tablet_manager.cc:1434] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260620 13:59:56.347671 14974 tablet_bootstrap.cc:492] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:56.347973 14975 raft_consensus.cc:359] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.348820 14975 raft_consensus.cc:385] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.349157 14975 raft_consensus.cc:740] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.349617 14973 raft_consensus.cc:359] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.350426 14973 raft_consensus.cc:385] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.349941 14975 consensus_queue.cc:260] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.350781 14973 raft_consensus.cc:740] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.351861 14973 consensus_queue.cc:260] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.354501 14973 ts_tablet_manager.cc:1434] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260620 13:59:56.354585 14975 ts_tablet_manager.cc:1434] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260620 13:59:56.355597 14973 tablet_bootstrap.cc:492] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:56.355896 14975 tablet_bootstrap.cc:492] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:56.363196 14973 tablet_bootstrap.cc:654] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.363749 14975 tablet_bootstrap.cc:654] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.358700 14974 tablet_bootstrap.cc:654] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.384152 14975 tablet_bootstrap.cc:492] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:56.384824 14975 ts_tablet_manager.cc:1403] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.017s
I20260620 13:59:56.385103 14974 tablet_bootstrap.cc:492] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:56.385705 14974 ts_tablet_manager.cc:1403] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.011s
I20260620 13:59:56.385914 14973 tablet_bootstrap.cc:492] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:56.388092 14975 raft_consensus.cc:359] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.388924 14975 raft_consensus.cc:385] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.389353 14975 raft_consensus.cc:740] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.389070 14974 raft_consensus.cc:359] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.390252 14974 raft_consensus.cc:385] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.390326 14902 raft_consensus.cc:493] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:56.390763 14974 raft_consensus.cc:740] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.390928 14902 raft_consensus.cc:515] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.391848 14973 ts_tablet_manager.cc:1403] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.009s
I20260620 13:59:56.390686 14975 consensus_queue.cc:260] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.392153 14974 consensus_queue.cc:260] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.393347 14962 raft_consensus.cc:493] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:56.393868 14962 raft_consensus.cc:515] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.396152 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d816c18e414febb24f363590c99d3e" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:56.397239 14835 raft_consensus.cc:2468] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:56.397368 14962 leader_election.cc:290] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ac0551993c42189492d4256639983d (127.4.155.194:38131), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:56.399700 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d816c18e414febb24f363590c99d3e" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:56.402576 14760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dd1040ccae84f09960928fef9e79e46" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d" is_pre_election: true
I20260620 13:59:56.405323 14725 leader_election.cc:304] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:56.406227 14973 raft_consensus.cc:359] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.407191 14973 raft_consensus.cc:385] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.407682 14973 raft_consensus.cc:740] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.408499 14902 leader_election.cc:290] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:56.408032 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dd1040ccae84f09960928fef9e79e46" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
W20260620 13:59:56.407692 14728 leader_election.cc:343] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Illegal state: must be running to vote when last-logged opid is not known
W20260620 13:59:56.407173 14650 leader_election.cc:343] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ac0551993c42189492d4256639983d (127.4.155.194:38131): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:56.402773 14974 ts_tablet_manager.cc:1434] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.006s
I20260620 13:59:56.408577 14973 consensus_queue.cc:260] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.411093 14835 raft_consensus.cc:2468] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 0.
I20260620 13:59:56.412850 14974 tablet_bootstrap.cc:492] T 2dd1040ccae84f09960928fef9e79e46 P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:56.415746 14973 ts_tablet_manager.cc:1434] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260620 13:59:56.416944 14973 tablet_bootstrap.cc:492] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:56.424005 14974 tablet_bootstrap.cc:654] T 2dd1040ccae84f09960928fef9e79e46 P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.425411 14975 ts_tablet_manager.cc:1434] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.040s	user 0.020s	sys 0.009s
I20260620 13:59:56.428162 14975 tablet_bootstrap.cc:492] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:56.408213 14984 raft_consensus.cc:2804] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:56.433028 14984 raft_consensus.cc:493] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:56.433542 14984 raft_consensus.cc:3060] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.434092 14650 leader_election.cc:304] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857; no voters: 35ac0551993c42189492d4256639983d
I20260620 13:59:56.435063 14973 tablet_bootstrap.cc:654] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.435678 14983 raft_consensus.cc:2804] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:56.435837 14975 tablet_bootstrap.cc:654] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.449992 14983 raft_consensus.cc:493] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:56.450228 14984 raft_consensus.cc:515] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.451337 14983 raft_consensus.cc:3060] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.460790 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d816c18e414febb24f363590c99d3e" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
W20260620 13:59:56.463202 14728 leader_election.cc:343] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:56.475194 14974 tablet_bootstrap.cc:492] T 2dd1040ccae84f09960928fef9e79e46 P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:56.474992 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d816c18e414febb24f363590c99d3e" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:56.475939 14974 ts_tablet_manager.cc:1403] T 2dd1040ccae84f09960928fef9e79e46 P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.033s
I20260620 13:59:56.475940 14835 raft_consensus.cc:3060] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.477725 14975 tablet_bootstrap.cc:492] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:56.478273 14975 ts_tablet_manager.cc:1403] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.007s
I20260620 13:59:56.479671 14984 leader_election.cc:290] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:56.479760 14974 raft_consensus.cc:359] T 2dd1040ccae84f09960928fef9e79e46 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.480919 14974 raft_consensus.cc:385] T 2dd1040ccae84f09960928fef9e79e46 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.481283 14974 raft_consensus.cc:740] T 2dd1040ccae84f09960928fef9e79e46 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.481392 14975 raft_consensus.cc:359] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.482165 14975 raft_consensus.cc:385] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.482478 14975 raft_consensus.cc:740] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.482355 14974 consensus_queue.cc:260] T 2dd1040ccae84f09960928fef9e79e46 P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.483089 14973 tablet_bootstrap.cc:492] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:56.483763 14975 consensus_queue.cc:260] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.485639 14974 ts_tablet_manager.cc:1434] T 2dd1040ccae84f09960928fef9e79e46 P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260620 13:59:56.486079 14835 raft_consensus.cc:2468] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:56.486754 14974 tablet_bootstrap.cc:492] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:56.487691 14725 leader_election.cc:304] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 1edd468a2156418bb09fe244c3646ba8
I20260620 13:59:56.489333 14984 raft_consensus.cc:2804] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:56.489714 14973 ts_tablet_manager.cc:1403] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.073s	user 0.040s	sys 0.009s
I20260620 13:59:56.490020 14984 raft_consensus.cc:697] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Leader. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:56.491294 14984 consensus_queue.cc:237] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.494377 14974 tablet_bootstrap.cc:654] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.483280 14983 raft_consensus.cc:515] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.493850 14973 raft_consensus.cc:359] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.509248 14973 raft_consensus.cc:385] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.509595 14973 raft_consensus.cc:740] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.510433 14973 consensus_queue.cc:260] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.513123 14973 ts_tablet_manager.cc:1434] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.023s	user 0.016s	sys 0.000s
I20260620 13:59:56.506656 14902 raft_consensus.cc:493] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:56.513671 14902 raft_consensus.cc:515] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.514210 14973 tablet_bootstrap.cc:492] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:56.514612 14974 tablet_bootstrap.cc:492] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:56.515166 14974 ts_tablet_manager.cc:1403] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.007s
I20260620 13:59:56.517149 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e05f8ee16f47d097b7571f52b81d26" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:56.517756 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e05f8ee16f47d097b7571f52b81d26" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:56.517949 14835 raft_consensus.cc:2468] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:56.518437 14687 raft_consensus.cc:2468] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:56.519918 14728 leader_election.cc:304] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d; no voters: 
I20260620 13:59:56.520124 14974 raft_consensus.cc:359] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.520907 14974 raft_consensus.cc:385] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.521016 14984 raft_consensus.cc:2804] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:56.521224 14974 raft_consensus.cc:740] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.521517 14984 raft_consensus.cc:493] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:56.521942 14984 raft_consensus.cc:3060] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.522110 14974 consensus_queue.cc:260] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.508038 14975 ts_tablet_manager.cc:1434] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260620 13:59:56.523953 14902 leader_election.cc:290] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:56.524086 14983 leader_election.cc:290] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 election: Requested vote from peers 35ac0551993c42189492d4256639983d (127.4.155.194:38131), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:56.532790 14973 tablet_bootstrap.cc:654] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.527372 14585 catalog_manager.cc:5696] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ac0551993c42189492d4256639983d (127.4.155.194). New cstate: current_term: 1 leader_uuid: "35ac0551993c42189492d4256639983d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:56.535820 14760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dd1040ccae84f09960928fef9e79e46" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 13:59:56.538430 14760 raft_consensus.cc:3060] T 2dd1040ccae84f09960928fef9e79e46 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.543859 14975 tablet_bootstrap.cc:492] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:56.545794 14836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dd1040ccae84f09960928fef9e79e46" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:56.546466 14836 raft_consensus.cc:3060] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.546667 14760 raft_consensus.cc:2468] T 2dd1040ccae84f09960928fef9e79e46 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 1.
I20260620 13:59:56.548398 14650 leader_election.cc:304] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d; no voters: 
I20260620 13:59:56.550247 14983 raft_consensus.cc:2804] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:56.550808 14983 raft_consensus.cc:697] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [term 1 LEADER]: Becoming Leader. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Running, Role: LEADER
I20260620 13:59:56.553277 14983 consensus_queue.cc:237] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.556128 14984 raft_consensus.cc:515] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.556833 14836 raft_consensus.cc:2468] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 1.
I20260620 13:59:56.558741 14984 leader_election.cc:290] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:56.559468 14975 tablet_bootstrap.cc:654] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.560714 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e05f8ee16f47d097b7571f52b81d26" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:56.561375 14835 raft_consensus.cc:3060] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.567556 14955 raft_consensus.cc:493] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:56.568090 14955 raft_consensus.cc:515] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.571331 14955 leader_election.cc:290] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 13:59:56.575652 14760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d4186b0b204c299ba878e1aa591b9c" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d" is_pre_election: true
I20260620 13:59:56.576725 14975 tablet_bootstrap.cc:492] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:56.576967 14974 ts_tablet_manager.cc:1434] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.061s	user 0.011s	sys 0.006s
W20260620 13:59:56.577135 14799 leader_election.cc:343] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ac0551993c42189492d4256639983d (127.4.155.194:38131): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:56.579494 14975 ts_tablet_manager.cc:1403] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.005s
I20260620 13:59:56.578961 14583 catalog_manager.cc:5696] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193). New cstate: current_term: 1 leader_uuid: "1edd468a2156418bb09fe244c3646ba8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:56.580041 14974 tablet_bootstrap.cc:492] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:56.582559 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e05f8ee16f47d097b7571f52b81d26" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:56.583307 14685 raft_consensus.cc:3060] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.582904 14975 raft_consensus.cc:359] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.583832 14975 raft_consensus.cc:385] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.588840 14974 tablet_bootstrap.cc:654] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.589345 14975 raft_consensus.cc:740] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.578222 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d4186b0b204c299ba878e1aa591b9c" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:56.590880 14975 consensus_queue.cc:260] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.591516 14687 raft_consensus.cc:2468] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 0.
I20260620 13:59:56.593596 14802 leader_election.cc:304] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857; no voters: 35ac0551993c42189492d4256639983d
I20260620 13:59:56.593984 14975 ts_tablet_manager.cc:1434] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260620 13:59:56.595366 14955 raft_consensus.cc:2804] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:56.598433 14955 raft_consensus.cc:493] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:56.598863 14955 raft_consensus.cc:3060] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.595542 14975 tablet_bootstrap.cc:492] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:56.602262 14685 raft_consensus.cc:2468] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:56.602489 14974 tablet_bootstrap.cc:492] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:56.603354 14974 ts_tablet_manager.cc:1403] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.005s
I20260620 13:59:56.604457 14835 raft_consensus.cc:2468] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:56.605648 14725 leader_election.cc:304] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:56.607044 14974 raft_consensus.cc:359] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.608237 14974 raft_consensus.cc:385] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.608665 14974 raft_consensus.cc:740] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.609863 14975 tablet_bootstrap.cc:654] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.609687 14974 consensus_queue.cc:260] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.612202 14984 raft_consensus.cc:2804] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:56.612869 14984 raft_consensus.cc:697] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Leader. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:56.613957 14984 consensus_queue.cc:237] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.621953 14974 ts_tablet_manager.cc:1434] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.000s
I20260620 13:59:56.623320 14974 tablet_bootstrap.cc:492] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:56.627207 14975 tablet_bootstrap.cc:492] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:56.628461 14955 raft_consensus.cc:515] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.629776 14973 tablet_bootstrap.cc:492] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:56.630332 14973 ts_tablet_manager.cc:1403] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.116s	user 0.026s	sys 0.015s
I20260620 13:59:56.631464 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d4186b0b204c299ba878e1aa591b9c" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:56.631932 14974 tablet_bootstrap.cc:654] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.632217 14685 raft_consensus.cc:3060] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.633888 14973 raft_consensus.cc:359] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.635002 14973 raft_consensus.cc:385] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.635443 14973 raft_consensus.cc:740] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.637856 14585 catalog_manager.cc:5696] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ac0551993c42189492d4256639983d (127.4.155.194). New cstate: current_term: 1 leader_uuid: "35ac0551993c42189492d4256639983d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:56.645097 14760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d4186b0b204c299ba878e1aa591b9c" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 13:59:56.645797 14760 raft_consensus.cc:3060] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.646852 14975 ts_tablet_manager.cc:1403] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.002s
I20260620 13:59:56.653832 14760 raft_consensus.cc:2468] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 1.
I20260620 13:59:56.655378 14799 leader_election.cc:304] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:56.636704 14973 consensus_queue.cc:260] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.659366 15000 raft_consensus.cc:2804] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:56.663451 14955 leader_election.cc:290] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 13:59:56.664486 14973 ts_tablet_manager.cc:1434] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.034s	user 0.013s	sys 0.001s
I20260620 13:59:56.640821 14685 raft_consensus.cc:2468] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 1.
I20260620 13:59:56.666396 14973 tablet_bootstrap.cc:492] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:56.654794 14975 raft_consensus.cc:359] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.668226 14975 raft_consensus.cc:385] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.668872 14975 raft_consensus.cc:740] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.669958 14975 consensus_queue.cc:260] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.672904 15000 raft_consensus.cc:697] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Becoming Leader. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Running, Role: LEADER
I20260620 13:59:56.672899 14975 ts_tablet_manager.cc:1434] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.002s
I20260620 13:59:56.673945 14974 tablet_bootstrap.cc:492] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:56.674248 14975 tablet_bootstrap.cc:492] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:56.673918 15000 consensus_queue.cc:237] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.674575 14974 ts_tablet_manager.cc:1403] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.052s	user 0.030s	sys 0.017s
I20260620 13:59:56.677872 14974 raft_consensus.cc:359] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.678695 14974 raft_consensus.cc:385] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.679019 14974 raft_consensus.cc:740] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.679853 14974 consensus_queue.cc:260] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.680593 14973 tablet_bootstrap.cc:654] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.682797 14974 ts_tablet_manager.cc:1434] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260620 13:59:56.692351 14974 tablet_bootstrap.cc:492] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:56.693104 14975 tablet_bootstrap.cc:654] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.699469 14974 tablet_bootstrap.cc:654] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.699661 14582 catalog_manager.cc:5696] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "b5509f23c3544993b8ac7d0318b5d857" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:56.708021 14973 tablet_bootstrap.cc:492] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:56.708021 14975 tablet_bootstrap.cc:492] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:56.708690 14975 ts_tablet_manager.cc:1403] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.003s
I20260620 13:59:56.708690 14973 ts_tablet_manager.cc:1403] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.012s
I20260620 13:59:56.709651 14974 tablet_bootstrap.cc:492] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:56.710369 14974 ts_tablet_manager.cc:1403] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.019s	user 0.002s	sys 0.013s
I20260620 13:59:56.712054 14973 raft_consensus.cc:359] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.712754 14973 raft_consensus.cc:385] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.713081 14973 raft_consensus.cc:740] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.713457 14974 raft_consensus.cc:359] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.714217 14974 raft_consensus.cc:385] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.714471 14974 raft_consensus.cc:740] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.714918 14975 raft_consensus.cc:359] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.715299 14974 consensus_queue.cc:260] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.715758 14975 raft_consensus.cc:385] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.716167 14975 raft_consensus.cc:740] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.716276 14973 consensus_queue.cc:260] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.717340 14975 consensus_queue.cc:260] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.718120 14974 ts_tablet_manager.cc:1434] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260620 13:59:56.719311 14973 ts_tablet_manager.cc:1434] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260620 13:59:56.719405 14974 tablet_bootstrap.cc:492] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:56.720510 14973 tablet_bootstrap.cc:492] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:56.727370 14983 raft_consensus.cc:493] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:56.728065 14983 raft_consensus.cc:515] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.728447 14973 tablet_bootstrap.cc:654] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.730553 14975 ts_tablet_manager.cc:1434] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260620 13:59:56.731371 14760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c135204f3010418cb7e1305edacb52f8" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d" is_pre_election: true
I20260620 13:59:56.731707 14975 tablet_bootstrap.cc:492] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
W20260620 13:59:56.733106 14650 leader_election.cc:343] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35ac0551993c42189492d4256639983d (127.4.155.194:38131): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:56.728612 14974 tablet_bootstrap.cc:654] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.737905 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c135204f3010418cb7e1305edacb52f8" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:56.739439 14975 tablet_bootstrap.cc:654] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
W20260620 13:59:56.741235 14650 leader_election.cc:343] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:56.741758 14650 leader_election.cc:304] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8; no voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857
I20260620 13:59:56.743732 14984 raft_consensus.cc:493] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:56.743985 14962 raft_consensus.cc:2749] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:56.734222 14983 leader_election.cc:290] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ac0551993c42189492d4256639983d (127.4.155.194:38131), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:56.746423 14983 raft_consensus.cc:493] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:56.744354 14984 raft_consensus.cc:515] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.747270 14983 raft_consensus.cc:515] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.750196 14983 leader_election.cc:290] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35ac0551993c42189492d4256639983d (127.4.155.194:38131), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:56.741850 14973 tablet_bootstrap.cc:492] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:56.752010 14974 tablet_bootstrap.cc:492] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:56.753690 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d816c18e414febb24f363590c99d3e" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:56.754104 14973 ts_tablet_manager.cc:1403] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.004s
I20260620 13:59:56.754159 14974 ts_tablet_manager.cc:1403] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.010s
I20260620 13:59:56.754498 14835 raft_consensus.cc:2393] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1edd468a2156418bb09fe244c3646ba8 in current term 1: Already voted for candidate 35ac0551993c42189492d4256639983d in this term.
I20260620 13:59:56.757263 14974 raft_consensus.cc:359] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.758069 14974 raft_consensus.cc:385] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.758352 14974 raft_consensus.cc:740] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.759156 14974 consensus_queue.cc:260] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.761801 14974 ts_tablet_manager.cc:1434] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260620 13:59:56.751025 14836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d2aa7c401646b3b4edcd2c049748d3" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:56.752424 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d2aa7c401646b3b4edcd2c049748d3" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:56.762836 14974 tablet_bootstrap.cc:492] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d: Bootstrap starting.
I20260620 13:59:56.764616 14973 raft_consensus.cc:359] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.766593 14973 raft_consensus.cc:385] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.766928 14973 raft_consensus.cc:740] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.767716 14973 consensus_queue.cc:260] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.768816 14836 raft_consensus.cc:2468] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:56.770659 14973 ts_tablet_manager.cc:1434] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260620 13:59:56.751919 14760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d816c18e414febb24f363590c99d3e" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d" is_pre_election: true
I20260620 13:59:56.771719 14974 tablet_bootstrap.cc:654] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.771809 14973 tablet_bootstrap.cc:492] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:56.765776 14975 tablet_bootstrap.cc:492] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:56.776105 14975 ts_tablet_manager.cc:1403] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.011s
I20260620 13:59:56.776571 14984 leader_election.cc:290] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:56.775938 14725 leader_election.cc:304] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:56.777661 14685 raft_consensus.cc:2468] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:56.778512 14984 raft_consensus.cc:2804] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:56.778915 14984 raft_consensus.cc:493] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:56.779244 14973 tablet_bootstrap.cc:654] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.779321 14984 raft_consensus.cc:3060] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.780356 14975 raft_consensus.cc:359] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.781381 14975 raft_consensus.cc:385] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.781749 14975 raft_consensus.cc:740] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.782829 14650 leader_election.cc:304] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8; no voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857
I20260620 13:59:56.784255 14983 raft_consensus.cc:3060] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.782889 14975 consensus_queue.cc:260] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.796732 14983 raft_consensus.cc:2749] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 13:59:56.802441 14975 ts_tablet_manager.cc:1434] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.001s
I20260620 13:59:56.806348 14975 tablet_bootstrap.cc:492] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:56.813751 14984 raft_consensus.cc:515] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.818307 14973 tablet_bootstrap.cc:492] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:56.818881 14973 ts_tablet_manager.cc:1403] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.025s
I20260620 13:59:56.819573 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d2aa7c401646b3b4edcd2c049748d3" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:56.820199 14685 raft_consensus.cc:3060] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.821650 14973 raft_consensus.cc:359] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.822386 14973 raft_consensus.cc:385] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.822652 14973 raft_consensus.cc:740] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.823378 14973 consensus_queue.cc:260] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.826268 14973 ts_tablet_manager.cc:1434] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260620 13:59:56.827425 14973 tablet_bootstrap.cc:492] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857: Bootstrap starting.
I20260620 13:59:56.828429 14685 raft_consensus.cc:2468] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:56.829833 14728 leader_election.cc:304] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d; no voters: 
I20260620 13:59:56.829980 15000 raft_consensus.cc:493] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:56.830601 15000 raft_consensus.cc:515] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.833050 15000 leader_election.cc:290] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 13:59:56.830951 14993 raft_consensus.cc:2804] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:56.833657 14836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d2aa7c401646b3b4edcd2c049748d3" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:56.834250 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "330b5c5ae7a44148916c4ceddde84d89" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:56.834388 14836 raft_consensus.cc:3060] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.833813 14993 raft_consensus.cc:697] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Leader. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:56.834932 14687 raft_consensus.cc:2468] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 0.
I20260620 13:59:56.835659 14993 consensus_queue.cc:237] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.836686 14802 leader_election.cc:304] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:56.834499 14760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "330b5c5ae7a44148916c4ceddde84d89" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d" is_pre_election: true
I20260620 13:59:56.838007 15000 raft_consensus.cc:2804] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:56.838346 14760 raft_consensus.cc:2468] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 0.
I20260620 13:59:56.838533 15000 raft_consensus.cc:493] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:56.839197 15000 raft_consensus.cc:3060] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.843375 14984 leader_election.cc:290] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:56.844753 14836 raft_consensus.cc:2468] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:56.851401 14974 tablet_bootstrap.cc:492] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d: No bootstrap required, opened a new log
I20260620 13:59:56.852027 14974 ts_tablet_manager.cc:1403] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d: Time spent bootstrapping tablet: real 0.089s	user 0.024s	sys 0.050s
I20260620 13:59:56.852267 14973 tablet_bootstrap.cc:654] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.854210 14975 tablet_bootstrap.cc:654] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:56.855087 14974 raft_consensus.cc:359] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.855939 14974 raft_consensus.cc:385] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.856252 14974 raft_consensus.cc:740] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.857509 14974 consensus_queue.cc:260] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.860157 14974 ts_tablet_manager.cc:1434] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260620 13:59:56.863644 14973 tablet_bootstrap.cc:492] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857: No bootstrap required, opened a new log
I20260620 13:59:56.864248 14973 ts_tablet_manager.cc:1403] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.000s
I20260620 13:59:56.865128 14975 tablet_bootstrap.cc:492] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:56.865801 14975 ts_tablet_manager.cc:1403] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.003s
I20260620 13:59:56.869223 14975 raft_consensus.cc:359] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.870013 14975 raft_consensus.cc:385] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.870292 14975 raft_consensus.cc:740] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.871013 14975 consensus_queue.cc:260] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.873656 14975 ts_tablet_manager.cc:1434] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260620 13:59:56.869094 14973 raft_consensus.cc:359] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.874099 14973 raft_consensus.cc:385] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:56.874414 14973 raft_consensus.cc:740] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Initialized, Role: FOLLOWER
I20260620 13:59:56.873299 15000 raft_consensus.cc:515] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.874758 14975 tablet_bootstrap.cc:492] T e57405c1b02549cc80d7c3e6c5d2c440 P 1edd468a2156418bb09fe244c3646ba8: Bootstrap starting.
I20260620 13:59:56.875226 14973 consensus_queue.cc:260] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.877579 14973 ts_tablet_manager.cc:1434] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260620 13:59:56.878031 15000 leader_election.cc:290] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 13:59:56.878253 14760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "330b5c5ae7a44148916c4ceddde84d89" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 13:59:56.879263 14760 raft_consensus.cc:3060] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.880198 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "330b5c5ae7a44148916c4ceddde84d89" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:56.881542 14687 raft_consensus.cc:3060] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.877991 14582 catalog_manager.cc:5696] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ac0551993c42189492d4256639983d (127.4.155.194). New cstate: current_term: 1 leader_uuid: "35ac0551993c42189492d4256639983d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:56.891312 14993 raft_consensus.cc:493] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:56.891970 14993 raft_consensus.cc:515] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.894258 14984 raft_consensus.cc:493] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:56.894884 14984 raft_consensus.cc:515] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.898772 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc830adeb9d47bb8104b4ccd3265adb" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:56.900672 14686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c135204f3010418cb7e1305edacb52f8" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
I20260620 13:59:56.970394 14685 raft_consensus.cc:2468] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:56.971043 14686 raft_consensus.cc:2468] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:56.898998 14984 leader_election.cc:290] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:56.973311 14728 leader_election.cc:304] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d; no voters: 
I20260620 13:59:56.938395 15001 raft_consensus.cc:493] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 13:59:56.978816 14993 leader_election.cc:290] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:56.914657 14990 consensus_queue.cc:1048] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.068s
I20260620 13:59:56.983063 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c135204f3010418cb7e1305edacb52f8" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:56.983903 14835 raft_consensus.cc:2468] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:56.976480 14687 raft_consensus.cc:2468] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 1.
I20260620 13:59:56.983076 14728 leader_election.cc:304] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d; no voters: 
I20260620 13:59:56.988219 14990 raft_consensus.cc:2804] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:56.988570 14802 leader_election.cc:304] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:56.989557 15000 raft_consensus.cc:2804] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:56.989123 15001 raft_consensus.cc:515] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.990203 15000 raft_consensus.cc:697] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Becoming Leader. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Running, Role: LEADER
I20260620 13:59:56.991166 15000 consensus_queue.cc:237] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:56.988605 14990 raft_consensus.cc:493] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:56.992470 14990 raft_consensus.cc:3060] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:56.994794 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57405c1b02549cc80d7c3e6c5d2c440" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8" is_pre_election: true
W20260620 13:59:56.996392 14802 leader_election.cc:343] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Illegal state: must be running to vote when last-logged opid is not known
I20260620 13:59:56.996465 14760 raft_consensus.cc:2468] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 1.
I20260620 13:59:56.980615 14984 raft_consensus.cc:2804] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:56.999064 14984 raft_consensus.cc:493] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:56.999485 14984 raft_consensus.cc:3060] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:57.005105 15001 leader_election.cc:290] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 13:59:57.008987 14760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57405c1b02549cc80d7c3e6c5d2c440" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d" is_pre_election: true
I20260620 13:59:57.010092 14760 raft_consensus.cc:2468] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 0.
I20260620 13:59:57.003324 14990 raft_consensus.cc:515] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.012462 14799 leader_election.cc:304] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 1edd468a2156418bb09fe244c3646ba8
I20260620 13:59:57.020820 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc830adeb9d47bb8104b4ccd3265adb" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:57.021572 14687 raft_consensus.cc:3060] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:57.022053 15000 raft_consensus.cc:2804] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 13:59:57.021960 14984 raft_consensus.cc:515] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.022869 15000 raft_consensus.cc:493] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 13:59:57.027563 15000 raft_consensus.cc:3060] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:57.034181 14975 tablet_bootstrap.cc:654] T e57405c1b02549cc80d7c3e6c5d2c440 P 1edd468a2156418bb09fe244c3646ba8: Neither blocks nor log segments found. Creating new log.
I20260620 13:59:57.037271 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c135204f3010418cb7e1305edacb52f8" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:57.038337 14685 raft_consensus.cc:3060] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:57.041065 14836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc830adeb9d47bb8104b4ccd3265adb" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857" is_pre_election: true
I20260620 13:59:57.041813 14836 raft_consensus.cc:2468] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 0.
I20260620 13:59:57.045804 14687 raft_consensus.cc:2468] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:57.047912 14990 leader_election.cc:290] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:57.048298 14728 leader_election.cc:304] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d; no voters: 
I20260620 13:59:57.048560 14582 catalog_manager.cc:5696] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "b5509f23c3544993b8ac7d0318b5d857" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:57.049578 14984 leader_election.cc:290] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:57.052024 15017 raft_consensus.cc:2804] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:57.053843 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bc830adeb9d47bb8104b4ccd3265adb" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:57.055413 14835 raft_consensus.cc:3060] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:57.056128 14975 tablet_bootstrap.cc:492] T e57405c1b02549cc80d7c3e6c5d2c440 P 1edd468a2156418bb09fe244c3646ba8: No bootstrap required, opened a new log
I20260620 13:59:57.056661 14975 ts_tablet_manager.cc:1403] T e57405c1b02549cc80d7c3e6c5d2c440 P 1edd468a2156418bb09fe244c3646ba8: Time spent bootstrapping tablet: real 0.182s	user 0.011s	sys 0.003s
I20260620 13:59:57.056155 14685 raft_consensus.cc:2468] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:57.059645 14728 leader_election.cc:304] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d; no voters: 
I20260620 13:59:57.060623 14902 raft_consensus.cc:2804] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:57.060485 14975 raft_consensus.cc:359] T e57405c1b02549cc80d7c3e6c5d2c440 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.054674 14834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c135204f3010418cb7e1305edacb52f8" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:57.062000 14975 raft_consensus.cc:385] T e57405c1b02549cc80d7c3e6c5d2c440 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 13:59:57.062206 14834 raft_consensus.cc:3060] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:57.062377 14975 raft_consensus.cc:740] T e57405c1b02549cc80d7c3e6c5d2c440 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Initialized, Role: FOLLOWER
I20260620 13:59:57.063524 14975 consensus_queue.cc:260] T e57405c1b02549cc80d7c3e6c5d2c440 P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.065016 15009 consensus_queue.cc:1048] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:57.061546 14902 raft_consensus.cc:697] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Leader. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:57.068167 14902 consensus_queue.cc:237] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.071580 14975 ts_tablet_manager.cc:1434] T e57405c1b02549cc80d7c3e6c5d2c440 P 1edd468a2156418bb09fe244c3646ba8: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260620 13:59:57.077149 15000 raft_consensus.cc:515] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.054306 15017 raft_consensus.cc:697] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Leader. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:57.078804 15017 consensus_queue.cc:237] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.080546 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57405c1b02549cc80d7c3e6c5d2c440" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:57.081338 14685 raft_consensus.cc:3060] T e57405c1b02549cc80d7c3e6c5d2c440 P 1edd468a2156418bb09fe244c3646ba8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:57.083398 14835 raft_consensus.cc:2468] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:57.086884 14990 consensus_queue.cc:1048] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:57.090399 14760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57405c1b02549cc80d7c3e6c5d2c440" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 13:59:57.094313 14760 raft_consensus.cc:3060] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d [term 0 FOLLOWER]: Advancing to term 1
I20260620 13:59:57.091892 15000 leader_election.cc:290] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 13:59:57.092599 14902 consensus_queue.cc:1048] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:57.124073 14902 consensus_queue.cc:1048] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:57.093242 14834 raft_consensus.cc:2468] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 1.
I20260620 13:59:57.132109 14760 raft_consensus.cc:2468] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 1.
I20260620 13:59:57.144752 14799 leader_election.cc:304] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:57.145598 15000 raft_consensus.cc:2804] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 13:59:57.146004 15001 consensus_queue.cc:1048] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:57.146132 15000 raft_consensus.cc:697] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Becoming Leader. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Running, Role: LEADER
I20260620 13:59:57.147419 15000 consensus_queue.cc:237] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.149667 14585 catalog_manager.cc:5696] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ac0551993c42189492d4256639983d (127.4.155.194). New cstate: current_term: 1 leader_uuid: "35ac0551993c42189492d4256639983d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:57.163533 14999 consensus_queue.cc:1048] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:57.132673 14685 raft_consensus.cc:2468] T e57405c1b02549cc80d7c3e6c5d2c440 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 1.
I20260620 13:59:57.187523 15009 consensus_queue.cc:1048] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:57.191444 14583 catalog_manager.cc:5696] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195). New cstate: current_term: 1 leader_uuid: "b5509f23c3544993b8ac7d0318b5d857" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: HEALTHY } } }
I20260620 13:59:57.222369 14585 catalog_manager.cc:5696] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d reported cstate change: term changed from 0 to 1, leader changed from <none> to 35ac0551993c42189492d4256639983d (127.4.155.194). New cstate: current_term: 1 leader_uuid: "35ac0551993c42189492d4256639983d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
W20260620 13:59:57.226011 14633 auto_rebalancer.cc:259] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260620 13:59:57.230558 14990 consensus_queue.cc:1048] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:57.257655 15027 consensus_queue.cc:1048] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:57.262355 14761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79e05f8ee16f47d097b7571f52b81d26"
dest_uuid: "35ac0551993c42189492d4256639983d"
mode: GRACEFUL
new_leader_uuid: "1edd468a2156418bb09fe244c3646ba8"
 from {username='slave'} at 127.0.0.1:35146
I20260620 13:59:57.263219 14761 raft_consensus.cc:606] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Received request to transfer leadership to TS 1edd468a2156418bb09fe244c3646ba8
I20260620 13:59:57.271724 14761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20d2aa7c401646b3b4edcd2c049748d3"
dest_uuid: "35ac0551993c42189492d4256639983d"
mode: GRACEFUL
new_leader_uuid: "1edd468a2156418bb09fe244c3646ba8"
 from {username='slave'} at 127.0.0.1:35146
I20260620 13:59:57.272413 14761 raft_consensus.cc:606] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Received request to transfer leadership to TS 1edd468a2156418bb09fe244c3646ba8
I20260620 13:59:57.275583 14990 raft_consensus.cc:993] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d: : Instructing follower 1edd468a2156418bb09fe244c3646ba8 to start an election
I20260620 13:59:57.276430 15027 raft_consensus.cc:1081] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Signalling peer 1edd468a2156418bb09fe244c3646ba8 to start an election
I20260620 13:59:57.278949 14685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20d2aa7c401646b3b4edcd2c049748d3"
dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
 from {username='slave'} at 127.0.0.1:52176
I20260620 13:59:57.279619 14685 raft_consensus.cc:493] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:57.279940 14685 raft_consensus.cc:3060] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:57.284029 14761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3d816c18e414febb24f363590c99d3e"
dest_uuid: "35ac0551993c42189492d4256639983d"
mode: GRACEFUL
new_leader_uuid: "1edd468a2156418bb09fe244c3646ba8"
 from {username='slave'} at 127.0.0.1:35146
I20260620 13:59:57.285032 14761 raft_consensus.cc:606] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Received request to transfer leadership to TS 1edd468a2156418bb09fe244c3646ba8
I20260620 13:59:57.288051 14685 raft_consensus.cc:515] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.290308 14685 leader_election.cc:290] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 2 election: Requested vote from peers 35ac0551993c42189492d4256639983d (127.4.155.194:38131), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:57.290921 14761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d2aa7c401646b3b4edcd2c049748d3" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 13:59:57.291468 14833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d2aa7c401646b3b4edcd2c049748d3" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:57.291688 14761 raft_consensus.cc:3055] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:57.292060 14833 raft_consensus.cc:3060] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:57.292083 14835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43d4186b0b204c299ba878e1aa591b9c"
dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
mode: GRACEFUL
new_leader_uuid: "35ac0551993c42189492d4256639983d"
 from {username='slave'} at 127.0.0.1:35732
I20260620 13:59:57.292718 14835 raft_consensus.cc:606] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Received request to transfer leadership to TS 35ac0551993c42189492d4256639983d
I20260620 13:59:57.292061 14761 raft_consensus.cc:740] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:57.294021 14761 consensus_queue.cc:260] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.295184 14761 raft_consensus.cc:3060] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:57.300056 14835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "330b5c5ae7a44148916c4ceddde84d89"
dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
mode: GRACEFUL
new_leader_uuid: "35ac0551993c42189492d4256639983d"
 from {username='slave'} at 127.0.0.1:35732
I20260620 13:59:57.300213 14833 raft_consensus.cc:2468] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 2.
I20260620 13:59:57.300791 14835 raft_consensus.cc:606] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Received request to transfer leadership to TS 35ac0551993c42189492d4256639983d
I20260620 13:59:57.301232 14761 raft_consensus.cc:2468] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 2.
I20260620 13:59:57.301589 14650 leader_election.cc:304] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:57.303223 14962 raft_consensus.cc:2804] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:57.303769 14962 raft_consensus.cc:697] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Becoming Leader. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Running, Role: LEADER
I20260620 13:59:57.304633 14962 consensus_queue.cc:237] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.312654 14583 catalog_manager.cc:5696] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 reported cstate change: term changed from 1 to 2, leader changed from 35ac0551993c42189492d4256639983d (127.4.155.194) to 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "1edd468a2156418bb09fe244c3646ba8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:57.442071 15000 consensus_queue.cc:1048] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:57.454106 14999 consensus_queue.cc:1048] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:57.464866 15001 raft_consensus.cc:993] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857: : Instructing follower 35ac0551993c42189492d4256639983d to start an election
I20260620 13:59:57.465396 14999 raft_consensus.cc:1081] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Signalling peer 35ac0551993c42189492d4256639983d to start an election
I20260620 13:59:57.467152 14761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "330b5c5ae7a44148916c4ceddde84d89"
dest_uuid: "35ac0551993c42189492d4256639983d"
 from {username='slave'} at 127.0.0.1:55146
I20260620 13:59:57.467772 14761 raft_consensus.cc:493] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:57.468168 14761 raft_consensus.cc:3060] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:57.473381 14761 raft_consensus.cc:515] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.475435 14761 leader_election.cc:290] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 2 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:57.476159 14685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "330b5c5ae7a44148916c4ceddde84d89" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:57.476630 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "330b5c5ae7a44148916c4ceddde84d89" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:57.477038 14685 raft_consensus.cc:3060] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:57.477326 14835 raft_consensus.cc:3055] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:57.477802 14835 raft_consensus.cc:740] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Running, Role: LEADER
I20260620 13:59:57.478588 14835 consensus_queue.cc:260] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.479821 14835 raft_consensus.cc:3060] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:57.485009 14685 raft_consensus.cc:2468] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 2.
I20260620 13:59:57.486459 14728 leader_election.cc:304] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, 35ac0551993c42189492d4256639983d; no voters: 
I20260620 13:59:57.486728 14835 raft_consensus.cc:2468] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 2.
I20260620 13:59:57.487345 15027 raft_consensus.cc:2804] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:57.487978 15027 raft_consensus.cc:697] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [term 2 LEADER]: Becoming Leader. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:57.488740 15027 consensus_queue.cc:237] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.496306 14584 catalog_manager.cc:5696] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d reported cstate change: term changed from 1 to 2, leader changed from b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195) to 35ac0551993c42189492d4256639983d (127.4.155.194). New cstate: current_term: 2 leader_uuid: "35ac0551993c42189492d4256639983d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:57.497126 15027 consensus_queue.cc:1048] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:57.508177 15027 consensus_queue.cc:1048] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:57.555861 14990 raft_consensus.cc:993] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d: : Instructing follower 1edd468a2156418bb09fe244c3646ba8 to start an election
I20260620 13:59:57.556334 14990 raft_consensus.cc:1081] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Signalling peer 1edd468a2156418bb09fe244c3646ba8 to start an election
I20260620 13:59:57.557870 14685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3d816c18e414febb24f363590c99d3e"
dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
 from {username='slave'} at 127.0.0.1:52176
I20260620 13:59:57.558395 14685 raft_consensus.cc:493] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:57.558645 14685 raft_consensus.cc:3060] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:57.563709 14685 raft_consensus.cc:515] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.565232 14685 leader_election.cc:290] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 2 election: Requested vote from peers 35ac0551993c42189492d4256639983d (127.4.155.194:38131), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:57.566293 14761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d816c18e414febb24f363590c99d3e" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 13:59:57.566713 14833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d816c18e414febb24f363590c99d3e" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:57.567040 14761 raft_consensus.cc:3055] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:57.567488 14761 raft_consensus.cc:740] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:57.567554 14833 raft_consensus.cc:3060] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:57.568373 14761 consensus_queue.cc:260] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.569350 14761 raft_consensus.cc:3060] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:57.573649 14833 raft_consensus.cc:2468] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 2.
I20260620 13:59:57.575490 14761 raft_consensus.cc:2468] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 2.
I20260620 13:59:57.574914 14650 leader_election.cc:304] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:57.576647 14962 raft_consensus.cc:2804] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:57.577124 14962 raft_consensus.cc:697] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Becoming Leader. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Running, Role: LEADER
I20260620 13:59:57.577989 14962 consensus_queue.cc:237] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.587600 14583 catalog_manager.cc:5696] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 reported cstate change: term changed from 1 to 2, leader changed from 35ac0551993c42189492d4256639983d (127.4.155.194) to 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "1edd468a2156418bb09fe244c3646ba8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:57.590216 15027 consensus_queue.cc:1048] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:57.603186 14902 consensus_queue.cc:1048] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 13:59:57.656586 15001 consensus_queue.cc:1048] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:57.669988 15001 consensus_queue.cc:1048] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 13:59:57.698632 14902 raft_consensus.cc:993] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d: : Instructing follower 1edd468a2156418bb09fe244c3646ba8 to start an election
I20260620 13:59:57.699048 14902 raft_consensus.cc:1081] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Signalling peer 1edd468a2156418bb09fe244c3646ba8 to start an election
I20260620 13:59:57.700446 14686 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79e05f8ee16f47d097b7571f52b81d26"
dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
 from {username='slave'} at 127.0.0.1:52176
I20260620 13:59:57.700872 14686 raft_consensus.cc:493] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:57.701186 14686 raft_consensus.cc:3060] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:57.706852 14686 raft_consensus.cc:515] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.708447 14686 leader_election.cc:290] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 2 election: Requested vote from peers 35ac0551993c42189492d4256639983d (127.4.155.194:38131), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:57.709601 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e05f8ee16f47d097b7571f52b81d26" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:57.709594 14761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e05f8ee16f47d097b7571f52b81d26" candidate_uuid: "1edd468a2156418bb09fe244c3646ba8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 13:59:57.710202 14835 raft_consensus.cc:3060] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:57.710309 14761 raft_consensus.cc:3055] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:57.710724 14761 raft_consensus.cc:740] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:57.711486 14761 consensus_queue.cc:260] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.712428 14761 raft_consensus.cc:3060] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:57.715157 14835 raft_consensus.cc:2468] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 2.
I20260620 13:59:57.716456 14650 leader_election.cc:304] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:57.717264 14962 raft_consensus.cc:2804] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:57.717737 14962 raft_consensus.cc:697] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Becoming Leader. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Running, Role: LEADER
I20260620 13:59:57.718513 14761 raft_consensus.cc:2468] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edd468a2156418bb09fe244c3646ba8 in term 2.
I20260620 13:59:57.718698 14962 consensus_queue.cc:237] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.725531 14583 catalog_manager.cc:5696] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 reported cstate change: term changed from 1 to 2, leader changed from 35ac0551993c42189492d4256639983d (127.4.155.194) to 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193). New cstate: current_term: 2 leader_uuid: "1edd468a2156418bb09fe244c3646ba8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:57.797679 14761 raft_consensus.cc:1275] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Refusing update from remote peer 1edd468a2156418bb09fe244c3646ba8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:57.799311 14962 consensus_queue.cc:1048] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:57.807653 14835 raft_consensus.cc:1275] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Refusing update from remote peer 1edd468a2156418bb09fe244c3646ba8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:57.809441 15009 consensus_queue.cc:1048] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:57.818426 15000 raft_consensus.cc:993] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857: : Instructing follower 35ac0551993c42189492d4256639983d to start an election
I20260620 13:59:57.818972 15001 raft_consensus.cc:1081] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Signalling peer 35ac0551993c42189492d4256639983d to start an election
I20260620 13:59:57.820883 14761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43d4186b0b204c299ba878e1aa591b9c"
dest_uuid: "35ac0551993c42189492d4256639983d"
 from {username='slave'} at 127.0.0.1:55146
I20260620 13:59:57.821390 14761 raft_consensus.cc:493] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 13:59:57.821720 14761 raft_consensus.cc:3060] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:57.828060 14761 raft_consensus.cc:515] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.829823 14761 leader_election.cc:290] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 2 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195:42345)
I20260620 13:59:57.830791 14686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d4186b0b204c299ba878e1aa591b9c" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 13:59:57.830862 14835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d4186b0b204c299ba878e1aa591b9c" candidate_uuid: "35ac0551993c42189492d4256639983d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
I20260620 13:59:57.831714 14835 raft_consensus.cc:3055] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 13:59:57.831650 14686 raft_consensus.cc:3060] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:57.832048 14835 raft_consensus.cc:740] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Running, Role: LEADER
I20260620 13:59:57.832707 14835 consensus_queue.cc:260] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.833869 14835 raft_consensus.cc:3060] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Advancing to term 2
I20260620 13:59:57.838302 14686 raft_consensus.cc:2468] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 2.
I20260620 13:59:57.838513 14835 raft_consensus.cc:2468] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35ac0551993c42189492d4256639983d in term 2.
I20260620 13:59:57.840312 14725 leader_election.cc:304] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 13:59:57.841300 14902 raft_consensus.cc:2804] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Leader election won for term 2
I20260620 13:59:57.841779 14902 raft_consensus.cc:697] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [term 2 LEADER]: Becoming Leader. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 13:59:57.842545 14902 consensus_queue.cc:237] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 13:59:57.851398 14584 catalog_manager.cc:5696] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d reported cstate change: term changed from 1 to 2, leader changed from b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195) to 35ac0551993c42189492d4256639983d (127.4.155.194). New cstate: current_term: 2 leader_uuid: "35ac0551993c42189492d4256639983d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260620 13:59:58.010179 14762 raft_consensus.cc:1275] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Refusing update from remote peer 1edd468a2156418bb09fe244c3646ba8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:58.011499 14962 consensus_queue.cc:1048] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:58.020385 14835 raft_consensus.cc:1275] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Refusing update from remote peer 1edd468a2156418bb09fe244c3646ba8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:58.022264 14983 consensus_queue.cc:1048] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:58.045097 14835 raft_consensus.cc:1275] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Refusing update from remote peer 35ac0551993c42189492d4256639983d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:58.046294 14902 consensus_queue.cc:1048] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:58.053841 14686 raft_consensus.cc:1275] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Refusing update from remote peer 35ac0551993c42189492d4256639983d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:58.055665 14990 consensus_queue.cc:1048] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:58.116845 14835 raft_consensus.cc:1275] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Refusing update from remote peer 1edd468a2156418bb09fe244c3646ba8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:58.118211 14983 consensus_queue.cc:1048] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 13:59:58.127684 14762 raft_consensus.cc:1275] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Refusing update from remote peer 1edd468a2156418bb09fe244c3646ba8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:58.129495 14983 consensus_queue.cc:1048] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:58.383850 14835 raft_consensus.cc:1275] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Refusing update from remote peer 35ac0551993c42189492d4256639983d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:58.385422 14990 consensus_queue.cc:1048] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260620 13:59:58.394697 14686 raft_consensus.cc:1275] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Refusing update from remote peer 35ac0551993c42189492d4256639983d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260620 13:59:58.397332 15028 consensus_queue.cc:1048] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260620 14:00:00.317786 14583 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38634:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260620 14:00:00.340481 14583 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38634:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260620 14:00:00.402829  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260620 14:00:00.458938 15063 log.cc:927] Time spent T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260620 14:00:00.718818 15108 tablet.cc:1724] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.728991 15111 tablet.cc:1724] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.711740 15103 tablet.cc:1724] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.732982 14687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9437fc794164eb4b27d418baaf04c08"
dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
mode: GRACEFUL
new_leader_uuid: "b5509f23c3544993b8ac7d0318b5d857"
 from {username='slave'} at 127.0.0.1:46024
W20260620 14:00:00.749630 15102 log.cc:927] Time spent T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260620 14:00:00.754782 15115 tablet.cc:1724] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.749948 15112 tablet.cc:1724] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.748881 14687 raft_consensus.cc:606] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Received request to transfer leadership to TS b5509f23c3544993b8ac7d0318b5d857
I20260620 14:00:00.743932 15107 tablet.cc:1724] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.764843 15114 tablet.cc:1724] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260620 14:00:00.766203 15097 log.cc:927] Time spent T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857: Append to log took a long time: real 0.117s	user 0.002s	sys 0.000s
W20260620 14:00:00.767976 15100 log.cc:927] Time spent T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.006s
I20260620 14:00:00.773854 15113 tablet.cc:1724] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260620 14:00:00.781198 14799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.155.194:38131, user_credentials={real_user=slave}} blocked reactor thread for 65717.5us
I20260620 14:00:00.827621 15117 tablet.cc:1724] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.841842 15088 raft_consensus.cc:993] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8: : Instructing follower b5509f23c3544993b8ac7d0318b5d857 to start an election
I20260620 14:00:00.842543 15088 raft_consensus.cc:1081] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Signalling peer b5509f23c3544993b8ac7d0318b5d857 to start an election
I20260620 14:00:00.844591 14830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9437fc794164eb4b27d418baaf04c08"
dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
 from {username='slave'} at 127.0.0.1:35716
I20260620 14:00:00.845216 14830 raft_consensus.cc:493] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 14:00:00.845570 14830 raft_consensus.cc:3060] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Advancing to term 3
I20260620 14:00:00.833949 15122 tablet.cc:1724] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.870046 14830 raft_consensus.cc:515] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 14:00:00.874019 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9437fc794164eb4b27d418baaf04c08" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 14:00:00.874713 14683 raft_consensus.cc:3055] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Stepping down as leader of term 2
I20260620 14:00:00.874795 14830 leader_election.cc:290] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 3 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 14:00:00.874713 14759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9437fc794164eb4b27d418baaf04c08" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 14:00:00.875886 14759 raft_consensus.cc:3060] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Advancing to term 3
I20260620 14:00:00.879150 14683 raft_consensus.cc:740] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1edd468a2156418bb09fe244c3646ba8, State: Running, Role: LEADER
I20260620 14:00:00.880450 14683 consensus_queue.cc:260] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 14:00:00.881896 14683 raft_consensus.cc:3060] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Advancing to term 3
W20260620 14:00:00.882587 15119 log.cc:927] Time spent T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260620 14:00:00.884646 14759 raft_consensus.cc:2468] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 3.
I20260620 14:00:00.886186 14799 leader_election.cc:304] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35ac0551993c42189492d4256639983d, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 14:00:00.887214 15105 raft_consensus.cc:2804] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 14:00:00.887692 15105 raft_consensus.cc:697] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 3 LEADER]: Becoming Leader. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Running, Role: LEADER
I20260620 14:00:00.889182 15105 consensus_queue.cc:237] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 14:00:00.891553 15112 tablet.cc:1724] T e57405c1b02549cc80d7c3e6c5d2c440 P 1edd468a2156418bb09fe244c3646ba8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.892835 15121 tablet.cc:1724] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260620 14:00:00.881067 15116 log.cc:927] Time spent T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260620 14:00:00.897329 15108 tablet.cc:1724] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.902598 14683 raft_consensus.cc:2468] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 3.
I20260620 14:00:00.894100 15103 tablet.cc:1724] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.917132 15112 tablet.cc:1724] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.932714 14583 catalog_manager.cc:5696] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 reported cstate change: term changed from 2 to 3, leader changed from 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193) to b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "b5509f23c3544993b8ac7d0318b5d857" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: HEALTHY } } }
I20260620 14:00:00.922101 15117 tablet.cc:1724] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.946465 15114 tablet.cc:1724] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.950479 15103 tablet.cc:1724] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.953333 14759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d21a96ea4d884462ac59a884f64bafb5"
dest_uuid: "35ac0551993c42189492d4256639983d"
mode: GRACEFUL
new_leader_uuid: "b5509f23c3544993b8ac7d0318b5d857"
 from {username='slave'} at 127.0.0.1:35160
I20260620 14:00:00.953994 14759 raft_consensus.cc:606] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 2 LEADER]: Received request to transfer leadership to TS b5509f23c3544993b8ac7d0318b5d857
I20260620 14:00:00.955899  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260620 14:00:00.956634  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 14:00:00.948839 15125 tablet.cc:1724] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.978484 15111 tablet.cc:1724] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.984110 15107 tablet.cc:1724] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.984931 15115 tablet.cc:1724] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.987061 15103 tablet.cc:1724] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:00.992437 15113 tablet.cc:1724] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:01.012940 15108 tablet.cc:1724] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:01.022114 15113 tablet.cc:1724] T 2dd1040ccae84f09960928fef9e79e46 P 35ac0551993c42189492d4256639983d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:01.038308 15117 tablet.cc:1724] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260620 14:00:01.051119 14582 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec: soft_deleted_table [id=ee7cf797075048d1968b078f64836225] alter complete (version 1)
I20260620 14:00:01.169517 15087 raft_consensus.cc:993] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d: : Instructing follower b5509f23c3544993b8ac7d0318b5d857 to start an election
I20260620 14:00:01.170140 15082 raft_consensus.cc:1081] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 2 LEADER]: Signalling peer b5509f23c3544993b8ac7d0318b5d857 to start an election
I20260620 14:00:01.172205 14831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d21a96ea4d884462ac59a884f64bafb5"
dest_uuid: "b5509f23c3544993b8ac7d0318b5d857"
 from {username='slave'} at 127.0.0.1:43278
I20260620 14:00:01.172780 14831 raft_consensus.cc:493] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 14:00:01.173081 14831 raft_consensus.cc:3060] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Advancing to term 3
I20260620 14:00:01.178403 14831 raft_consensus.cc:515] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 14:00:01.180320 14831 leader_election.cc:290] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 3 election: Requested vote from peers 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203), 35ac0551993c42189492d4256639983d (127.4.155.194:38131)
I20260620 14:00:01.181131 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21a96ea4d884462ac59a884f64bafb5" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1edd468a2156418bb09fe244c3646ba8"
I20260620 14:00:01.181588 14759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21a96ea4d884462ac59a884f64bafb5" candidate_uuid: "b5509f23c3544993b8ac7d0318b5d857" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35ac0551993c42189492d4256639983d"
I20260620 14:00:01.181807 14683 raft_consensus.cc:3060] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Advancing to term 3
I20260620 14:00:01.182197 14759 raft_consensus.cc:3055] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 2 LEADER]: Stepping down as leader of term 2
I20260620 14:00:01.182525 14759 raft_consensus.cc:740] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35ac0551993c42189492d4256639983d, State: Running, Role: LEADER
I20260620 14:00:01.183401 14759 consensus_queue.cc:260] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 14:00:01.184756 14759 raft_consensus.cc:3060] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Advancing to term 3
I20260620 14:00:01.190062 14683 raft_consensus.cc:2468] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 3.
I20260620 14:00:01.191195 14802 leader_election.cc:304] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edd468a2156418bb09fe244c3646ba8, b5509f23c3544993b8ac7d0318b5d857; no voters: 
I20260620 14:00:01.191191 14759 raft_consensus.cc:2468] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5509f23c3544993b8ac7d0318b5d857 in term 3.
I20260620 14:00:01.192126 15124 raft_consensus.cc:2804] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 14:00:01.192694 15124 raft_consensus.cc:697] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 3 LEADER]: Becoming Leader. State: Replica: b5509f23c3544993b8ac7d0318b5d857, State: Running, Role: LEADER
I20260620 14:00:01.194053 15124 consensus_queue.cc:237] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } }
I20260620 14:00:01.202827 14582 catalog_manager.cc:5696] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 reported cstate change: term changed from 2 to 3, leader changed from 35ac0551993c42189492d4256639983d (127.4.155.194) to b5509f23c3544993b8ac7d0318b5d857 (127.4.155.195). New cstate: current_term: 3 leader_uuid: "b5509f23c3544993b8ac7d0318b5d857" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5509f23c3544993b8ac7d0318b5d857" member_type: VOTER last_known_addr { host: "127.4.155.195" port: 42345 } health_report { overall_health: HEALTHY } } }
I20260620 14:00:01.279768 14759 raft_consensus.cc:1275] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 3 FOLLOWER]: Refusing update from remote peer b5509f23c3544993b8ac7d0318b5d857: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 14:00:01.280972 15124 consensus_queue.cc:1048] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 14:00:01.292098 14683 raft_consensus.cc:1275] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 3 FOLLOWER]: Refusing update from remote peer b5509f23c3544993b8ac7d0318b5d857: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 14:00:01.294142 15124 consensus_queue.cc:1048] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 14:00:01.600838 14759 raft_consensus.cc:1275] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 3 FOLLOWER]: Refusing update from remote peer b5509f23c3544993b8ac7d0318b5d857: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 14:00:01.602219 15124 consensus_queue.cc:1048] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35ac0551993c42189492d4256639983d" member_type: VOTER last_known_addr { host: "127.4.155.194" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 14:00:01.615301 14683 raft_consensus.cc:1275] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 3 FOLLOWER]: Refusing update from remote peer b5509f23c3544993b8ac7d0318b5d857: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260620 14:00:01.617156 15138 consensus_queue.cc:1048] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd468a2156418bb09fe244c3646ba8" member_type: VOTER last_known_addr { host: "127.4.155.193" port: 34203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260620 14:00:01.957978  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 14:00:01.965481  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 14:00:01.965945  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 14:00:02.966967  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 14:00:02.972500  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 14:00:02.973032  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 14:00:03.974277  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 14:00:03.981491  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 14:00:03.982015  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 14:00:04.983314  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 14:00:04.989326  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 14:00:04.989987  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 14:00:05.991532  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 14:00:06.003789  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 14:00:06.004245  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 14:00:07.005517  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 14:00:07.011566  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 14:00:07.012066  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 14:00:08.013191  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 14:00:08.019300  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 14:00:08.019886  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 14:00:09.021070  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 14:00:09.029906  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 14:00:09.030723  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 14:00:10.031880  4719 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260620 14:00:10.038759  4719 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260620 14:00:10.039417  4719 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260620 14:00:11.112437  4719 tablet_server.cc:179] TabletServer@127.4.155.193:0 shutting down...
I20260620 14:00:11.162071  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 14:00:11.163129  4719 tablet_replica.cc:333] T e57405c1b02549cc80d7c3e6c5d2c440 P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.164541  4719 raft_consensus.cc:2243] T e57405c1b02549cc80d7c3e6c5d2c440 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.165390  4719 raft_consensus.cc:2272] T e57405c1b02549cc80d7c3e6c5d2c440 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.168246  4719 tablet_replica.cc:333] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.168901  4719 raft_consensus.cc:2243] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.169441  4719 raft_consensus.cc:2272] T 330b5c5ae7a44148916c4ceddde84d89 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.171885  4719 tablet_replica.cc:333] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.172446  4719 raft_consensus.cc:2243] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.173527  4719 raft_consensus.cc:2272] T 20d2aa7c401646b3b4edcd2c049748d3 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.176460  4719 tablet_replica.cc:333] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.177250  4719 raft_consensus.cc:2243] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.178865  4719 raft_consensus.cc:2272] T 2dd1040ccae84f09960928fef9e79e46 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.182410  4719 tablet_replica.cc:333] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.183207  4719 raft_consensus.cc:2243] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.184156  4719 raft_consensus.cc:2272] T b3d816c18e414febb24f363590c99d3e P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.186633  4719 tablet_replica.cc:333] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.187330  4719 raft_consensus.cc:2243] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.187882  4719 raft_consensus.cc:2272] T 43d4186b0b204c299ba878e1aa591b9c P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.190459  4719 tablet_replica.cc:333] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.191010  4719 raft_consensus.cc:2243] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.191862  4719 raft_consensus.cc:2272] T 0bc830adeb9d47bb8104b4ccd3265adb P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.195372  4719 tablet_replica.cc:333] T 479a807e25a44a72985d99be6373c59a P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.196146  4719 raft_consensus.cc:2243] T 479a807e25a44a72985d99be6373c59a P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260620 14:00:11.196739 14728 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 124 similar messages]
I20260620 14:00:11.196759  4719 raft_consensus.cc:2272] T 479a807e25a44a72985d99be6373c59a P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 14:00:11.200233 14728 consensus_peers.cc:597] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d -> Peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Couldn't send request to peer 1edd468a2156418bb09fe244c3646ba8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 14:00:11.200348  4719 tablet_replica.cc:333] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.201275  4719 raft_consensus.cc:2243] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.202131  4719 raft_consensus.cc:2272] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.204705  4719 tablet_replica.cc:333] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.205439  4719 raft_consensus.cc:2243] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.205943  4719 raft_consensus.cc:2272] T 19fdfe98616741b992d9ca8f6598dbd4 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.208397  4719 tablet_replica.cc:333] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.209072  4719 raft_consensus.cc:2243] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.209581  4719 raft_consensus.cc:2272] T a9437fc794164eb4b27d418baaf04c08 P 1edd468a2156418bb09fe244c3646ba8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.212208  4719 tablet_replica.cc:333] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.212776  4719 raft_consensus.cc:2243] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.213650  4719 raft_consensus.cc:2272] T 79e05f8ee16f47d097b7571f52b81d26 P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.216534  4719 tablet_replica.cc:333] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.217177  4719 raft_consensus.cc:2243] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.218148  4719 raft_consensus.cc:2272] T 22dada0282d74460ad79540693d4b1cf P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.220849  4719 tablet_replica.cc:333] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.221402  4719 raft_consensus.cc:2243] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.221956  4719 raft_consensus.cc:2272] T c135204f3010418cb7e1305edacb52f8 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.224135  4719 tablet_replica.cc:333] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.224658  4719 raft_consensus.cc:2243] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [term 2 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.225554  4719 raft_consensus.cc:2272] T b93febc746444f00a48276a77eb3ee8b P 1edd468a2156418bb09fe244c3646ba8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.227854  4719 tablet_replica.cc:333] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.228401  4719 raft_consensus.cc:2243] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.228894  4719 raft_consensus.cc:2272] T 48a8fdc706ad47ce8771b288d5dcbe9f P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.231561  4719 tablet_replica.cc:333] T 1e0c9fed06bb40d58aa45524e52f6394 P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.232131  4719 raft_consensus.cc:2243] T 1e0c9fed06bb40d58aa45524e52f6394 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.232583  4719 raft_consensus.cc:2272] T 1e0c9fed06bb40d58aa45524e52f6394 P 1edd468a2156418bb09fe244c3646ba8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.234980  4719 tablet_replica.cc:333] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8: stopping tablet replica
I20260620 14:00:11.235508  4719 raft_consensus.cc:2243] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.236020  4719 raft_consensus.cc:2272] T d21a96ea4d884462ac59a884f64bafb5 P 1edd468a2156418bb09fe244c3646ba8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.284950  4719 tablet_server.cc:196] TabletServer@127.4.155.193:0 shutdown complete.
W20260620 14:00:11.294221 14728 consensus_peers.cc:597] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d -> Peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Couldn't send request to peer 1edd468a2156418bb09fe244c3646ba8. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:34203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 14:00:11.294890 14728 consensus_peers.cc:597] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d -> Peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Couldn't send request to peer 1edd468a2156418bb09fe244c3646ba8. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:34203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 14:00:11.320765 14728 consensus_peers.cc:597] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d -> Peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Couldn't send request to peer 1edd468a2156418bb09fe244c3646ba8. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:34203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 14:00:11.332018  4719 tablet_server.cc:179] TabletServer@127.4.155.194:0 shutting down...
W20260620 14:00:11.344322 14799 consensus_peers.cc:597] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 -> Peer 35ac0551993c42189492d4256639983d (127.4.155.194:38131): Couldn't send request to peer 35ac0551993c42189492d4256639983d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 14:00:11.353222 14802 consensus_peers.cc:597] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 -> Peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Couldn't send request to peer 1edd468a2156418bb09fe244c3646ba8. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:34203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 14:00:11.374313  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 14:00:11.376699  4719 tablet_replica.cc:333] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.377767  4719 raft_consensus.cc:2243] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.378458  4719 raft_consensus.cc:2272] T e57405c1b02549cc80d7c3e6c5d2c440 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.382265  4719 tablet_replica.cc:333] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.383076  4719 raft_consensus.cc:2243] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.383673  4719 raft_consensus.cc:2272] T 20d2aa7c401646b3b4edcd2c049748d3 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.386058  4719 tablet_replica.cc:333] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.386610  4719 raft_consensus.cc:2243] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [term 2 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.387563  4719 raft_consensus.cc:2272] T 330b5c5ae7a44148916c4ceddde84d89 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.390064  4719 tablet_replica.cc:333] T 2dd1040ccae84f09960928fef9e79e46 P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.390775  4719 raft_consensus.cc:2243] T 2dd1040ccae84f09960928fef9e79e46 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.391570  4719 raft_consensus.cc:2272] T 2dd1040ccae84f09960928fef9e79e46 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.395970  4719 tablet_replica.cc:333] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d: stopping tablet replica
W20260620 14:00:11.396914 14802 consensus_peers.cc:597] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 -> Peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Couldn't send request to peer 1edd468a2156418bb09fe244c3646ba8. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:34203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 14:00:11.397156  4719 raft_consensus.cc:2243] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [term 2 LEADER]: Raft consensus shutting down.
W20260620 14:00:11.397514 14799 consensus_peers.cc:597] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 -> Peer 35ac0551993c42189492d4256639983d (127.4.155.194:38131): Couldn't send request to peer 35ac0551993c42189492d4256639983d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 14:00:11.398763  4719 raft_consensus.cc:2272] T 43d4186b0b204c299ba878e1aa591b9c P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.401268  4719 tablet_replica.cc:333] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.401938  4719 raft_consensus.cc:2243] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.402907  4719 raft_consensus.cc:2272] T b3d816c18e414febb24f363590c99d3e P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.406409  4719 tablet_replica.cc:333] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.407022  4719 raft_consensus.cc:2243] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.407554  4719 raft_consensus.cc:2272] T d21a96ea4d884462ac59a884f64bafb5 P 35ac0551993c42189492d4256639983d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.410661  4719 tablet_replica.cc:333] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.411350  4719 raft_consensus.cc:2243] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.412616  4719 raft_consensus.cc:2272] T 0bc830adeb9d47bb8104b4ccd3265adb P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.416476  4719 tablet_replica.cc:333] T 479a807e25a44a72985d99be6373c59a P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.417254  4719 raft_consensus.cc:2243] T 479a807e25a44a72985d99be6373c59a P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.417968  4719 raft_consensus.cc:2272] T 479a807e25a44a72985d99be6373c59a P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.420970  4719 tablet_replica.cc:333] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.421530  4719 raft_consensus.cc:2243] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.422032  4719 raft_consensus.cc:2272] T 22dada0282d74460ad79540693d4b1cf P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.424396  4719 tablet_replica.cc:333] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.424958  4719 raft_consensus.cc:2243] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.425496  4719 raft_consensus.cc:2272] T 79e05f8ee16f47d097b7571f52b81d26 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.427682  4719 tablet_replica.cc:333] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.428238  4719 raft_consensus.cc:2243] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.429416  4719 raft_consensus.cc:2272] T c135204f3010418cb7e1305edacb52f8 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.431552  4719 tablet_replica.cc:333] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.432097  4719 raft_consensus.cc:2243] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.432612  4719 raft_consensus.cc:2272] T b93febc746444f00a48276a77eb3ee8b P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.434732  4719 tablet_replica.cc:333] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.435274  4719 raft_consensus.cc:2243] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.436427  4719 raft_consensus.cc:2272] T 48a8fdc706ad47ce8771b288d5dcbe9f P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.441861  4719 tablet_replica.cc:333] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d: stopping tablet replica
W20260620 14:00:11.442193 14799 consensus_peers.cc:597] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 -> Peer 35ac0551993c42189492d4256639983d (127.4.155.194:38131): Couldn't send request to peer 35ac0551993c42189492d4256639983d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260620 14:00:11.442770  4719 raft_consensus.cc:2243] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Raft consensus shutting down.
W20260620 14:00:11.443439 14728 consensus_peers.cc:597] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d -> Peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Couldn't send request to peer 1edd468a2156418bb09fe244c3646ba8. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:34203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 14:00:11.443868  4719 raft_consensus.cc:2272] T 1e0c9fed06bb40d58aa45524e52f6394 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.446095  4719 tablet_replica.cc:333] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.446661  4719 raft_consensus.cc:2243] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.447619  4719 raft_consensus.cc:2272] T 19fdfe98616741b992d9ca8f6598dbd4 P 35ac0551993c42189492d4256639983d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.450209  4719 tablet_replica.cc:333] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.450850  4719 raft_consensus.cc:2243] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.451972  4719 raft_consensus.cc:2272] T a9437fc794164eb4b27d418baaf04c08 P 35ac0551993c42189492d4256639983d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.454872  4719 tablet_replica.cc:333] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d: stopping tablet replica
I20260620 14:00:11.455575  4719 raft_consensus.cc:2243] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.456148  4719 raft_consensus.cc:2272] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P 35ac0551993c42189492d4256639983d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260620 14:00:11.456265 14799 consensus_peers.cc:597] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 -> Peer 35ac0551993c42189492d4256639983d (127.4.155.194:38131): Couldn't send request to peer 35ac0551993c42189492d4256639983d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260620 14:00:11.500113 14802 consensus_peers.cc:597] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 -> Peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Couldn't send request to peer 1edd468a2156418bb09fe244c3646ba8. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:34203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 14:00:11.505281  4719 tablet_server.cc:196] TabletServer@127.4.155.194:0 shutdown complete.
W20260620 14:00:11.536644 14802 consensus_peers.cc:597] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 -> Peer 1edd468a2156418bb09fe244c3646ba8 (127.4.155.193:34203): Couldn't send request to peer 1edd468a2156418bb09fe244c3646ba8. Status: Network error: Client connection negotiation failed: client connection to 127.4.155.193:34203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 14:00:11.554378  4719 tablet_server.cc:179] TabletServer@127.4.155.195:0 shutting down...
I20260620 14:00:11.594470  4719 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260620 14:00:11.596194  4719 tablet_replica.cc:333] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.597186  4719 raft_consensus.cc:2243] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.598454  4719 raft_consensus.cc:2272] T e57405c1b02549cc80d7c3e6c5d2c440 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.600893  4719 tablet_replica.cc:333] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.601527  4719 raft_consensus.cc:2243] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.602058  4719 raft_consensus.cc:2272] T 20d2aa7c401646b3b4edcd2c049748d3 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.604512  4719 tablet_replica.cc:333] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.605118  4719 raft_consensus.cc:2243] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.605701  4719 raft_consensus.cc:2272] T 330b5c5ae7a44148916c4ceddde84d89 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.607913  4719 tablet_replica.cc:333] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.608454  4719 raft_consensus.cc:2243] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.608958  4719 raft_consensus.cc:2272] T 2dd1040ccae84f09960928fef9e79e46 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.611039  4719 tablet_replica.cc:333] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.611917  4719 raft_consensus.cc:2243] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.612825  4719 raft_consensus.cc:2272] T 43d4186b0b204c299ba878e1aa591b9c P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.616756  4719 tablet_replica.cc:333] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.618196  4719 raft_consensus.cc:2243] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.619393  4719 raft_consensus.cc:2272] T b3d816c18e414febb24f363590c99d3e P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.622239  4719 tablet_replica.cc:333] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.623528  4719 raft_consensus.cc:2243] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 3 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.624467  4719 raft_consensus.cc:2272] T d21a96ea4d884462ac59a884f64bafb5 P b5509f23c3544993b8ac7d0318b5d857 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.626811  4719 tablet_replica.cc:333] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.627547  4719 raft_consensus.cc:2243] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.628599  4719 raft_consensus.cc:2272] T 0bc830adeb9d47bb8104b4ccd3265adb P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.630972  4719 tablet_replica.cc:333] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.631599  4719 raft_consensus.cc:2243] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.632838  4719 raft_consensus.cc:2272] T 479a807e25a44a72985d99be6373c59a P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.635140  4719 tablet_replica.cc:333] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.635739  4719 raft_consensus.cc:2243] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 3 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.636628  4719 raft_consensus.cc:2272] T a9437fc794164eb4b27d418baaf04c08 P b5509f23c3544993b8ac7d0318b5d857 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.639984  4719 tablet_replica.cc:333] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.640722  4719 raft_consensus.cc:2243] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.641270  4719 raft_consensus.cc:2272] T 19fdfe98616741b992d9ca8f6598dbd4 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.644454  4719 tablet_replica.cc:333] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.645246  4719 raft_consensus.cc:2243] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.645814  4719 raft_consensus.cc:2272] T 22dada0282d74460ad79540693d4b1cf P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.648524  4719 tablet_replica.cc:333] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.649178  4719 raft_consensus.cc:2243] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.649847  4719 raft_consensus.cc:2272] T 79e05f8ee16f47d097b7571f52b81d26 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.652531  4719 tablet_replica.cc:333] T 1e0c9fed06bb40d58aa45524e52f6394 P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.653190  4719 raft_consensus.cc:2243] T 1e0c9fed06bb40d58aa45524e52f6394 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.653710  4719 raft_consensus.cc:2272] T 1e0c9fed06bb40d58aa45524e52f6394 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.656270  4719 tablet_replica.cc:333] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.657131  4719 raft_consensus.cc:2243] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.657858  4719 raft_consensus.cc:2272] T c135204f3010418cb7e1305edacb52f8 P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.660815  4719 tablet_replica.cc:333] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.661819  4719 raft_consensus.cc:2243] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.662472  4719 raft_consensus.cc:2272] T b93febc746444f00a48276a77eb3ee8b P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.664819  4719 tablet_replica.cc:333] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.665366  4719 raft_consensus.cc:2243] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.665889  4719 raft_consensus.cc:2272] T 48a8fdc706ad47ce8771b288d5dcbe9f P b5509f23c3544993b8ac7d0318b5d857 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.668061  4719 tablet_replica.cc:333] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857: stopping tablet replica
I20260620 14:00:11.668577  4719 raft_consensus.cc:2243] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260620 14:00:11.669044  4719 raft_consensus.cc:2272] T 13ec7ecfb90c4c5ea2c0e1b06fcf9125 P b5509f23c3544993b8ac7d0318b5d857 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.712791  4719 tablet_server.cc:196] TabletServer@127.4.155.195:0 shutdown complete.
I20260620 14:00:11.764030  4719 master.cc:562] Master@127.4.155.254:36277 shutting down...
I20260620 14:00:11.806946  4719 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:00:11.807626  4719 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:00:11.808339  4719 tablet_replica.cc:333] T 00000000000000000000000000000000 P 06c2c68112974cd9b76a47d8aae9bcec: stopping tablet replica
I20260620 14:00:11.836127  4719 master.cc:584] Master@127.4.155.254:36277 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20936 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (45381 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (356739 ms total)
[  PASSED  ] 6 tests.
[  SKIPPED ] 1 test, listed below:
[  SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260620 14:00:11.905865  4719 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2439 messages since previous log ~35 seconds ago
I20260620 14:00:11.906139  4719 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2439 messages since previous log ~35 seconds ago
I20260620 14:00:11.906329  4719 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2438 messages since previous log ~35 seconds ago
I20260620 14:00:11.906534  4719 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 44 messages since previous log ~71 seconds ago
I20260620 14:00:11.906731  4719 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 44 messages since previous log ~71 seconds ago
I20260620 14:00:11.906950  4719 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~144 seconds ago
I20260620 14:00:11.907253  4719 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 12 messages since previous log ~0 seconds ago
I20260620 14:00:11.907704  4719 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~15 seconds ago